Sep 11 11:49:42.089883 ip-10-0-138-111 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 11 11:49:42.089898 ip-10-0-138-111 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 11 11:49:42.089909 ip-10-0-138-111 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 11 11:49:42.090127 ip-10-0-138-111 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 11 11:49:52.199581 ip-10-0-138-111 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 11 11:49:52.199596 ip-10-0-138-111 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 3218bf16ddcf4581a542b726db664b30 --
Sep 11 11:51:26.209976 ip-10-0-138-111 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 11:51:26.639443 ip-10-0-138-111 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 11:51:26.639443 ip-10-0-138-111 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 11:51:26.639443 ip-10-0-138-111 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 11:51:26.640056 ip-10-0-138-111 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 11:51:26.640056 ip-10-0-138-111 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 11:51:26.640537 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.640445    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 11:51:26.644511 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644496    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 11:51:26.644511 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644511    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 11:51:26.644573 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644514    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 11:51:26.644573 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644518    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 11:51:26.644573 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644521    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 11:51:26.644573 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644524    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 11:51:26.644573 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644528    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 11:51:26.644573 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644530    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 11:51:26.644573 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644533    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 11:51:26.644573 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644536    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 11:51:26.644573 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644543    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 11:51:26.644573 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644545    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 11:51:26.644573 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644548    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 11:51:26.644573 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644551    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 11:51:26.644573 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644554    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 11:51:26.644573 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644556    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 11:51:26.644573 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644559    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 11:51:26.644573 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644562    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 11:51:26.644573 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644564    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 11:51:26.644573 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644567    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 11:51:26.644573 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644569    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 11:51:26.644573 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644572    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 11:51:26.645063 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644575    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 11:51:26.645063 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644578    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 11:51:26.645063 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644581    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 11:51:26.645063 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644586    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 11:51:26.645063 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644589    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 11:51:26.645063 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644592    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 11:51:26.645063 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644596    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 11:51:26.645063 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644600    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 11:51:26.645063 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644603    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 11:51:26.645063 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644605    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 11:51:26.645063 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644608    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 11:51:26.645063 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644611    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 11:51:26.645063 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644613    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 11:51:26.645063 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644616    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 11:51:26.645063 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644619    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 11:51:26.645063 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644622    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 11:51:26.645063 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644625    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 11:51:26.645063 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644628    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 11:51:26.645063 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644630    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 11:51:26.645063 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644633    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 11:51:26.645544 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644635    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 11:51:26.645544 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644639    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 11:51:26.645544 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644643    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 11:51:26.645544 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644646    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 11:51:26.645544 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644649    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 11:51:26.645544 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644653    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 11:51:26.645544 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644656    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 11:51:26.645544 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644659    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 11:51:26.645544 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644662    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 11:51:26.645544 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644665    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 11:51:26.645544 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644668    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 11:51:26.645544 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644671    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 11:51:26.645544 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644673    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 11:51:26.645544 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644678    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 11:51:26.645544 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644692    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 11:51:26.645544 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644696    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 11:51:26.645544 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644699    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 11:51:26.645544 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644702    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 11:51:26.645544 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644705    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 11:51:26.646028 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644707    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 11:51:26.646028 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644710    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 11:51:26.646028 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644713    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 11:51:26.646028 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644715    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 11:51:26.646028 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644718    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 11:51:26.646028 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644720    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 11:51:26.646028 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644723    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 11:51:26.646028 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644726    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 11:51:26.646028 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644728    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 11:51:26.646028 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644731    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 11:51:26.646028 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644733    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 11:51:26.646028 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644736    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 11:51:26.646028 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644738    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 11:51:26.646028 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644741    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 11:51:26.646028 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644745    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 11:51:26.646028 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644747    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 11:51:26.646028 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644750    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 11:51:26.646028 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644753    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 11:51:26.646028 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644756    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 11:51:26.646028 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644758    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 11:51:26.646509 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644761    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 11:51:26.646509 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644764    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 11:51:26.646509 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644766    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 11:51:26.646509 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644769    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 11:51:26.646509 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644771    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 11:51:26.646509 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644774    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 11:51:26.646509 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644777    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 11:51:26.646509 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644779    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 11:51:26.646509 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644782    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 11:51:26.646509 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644784    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 11:51:26.646509 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644787    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 11:51:26.646509 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644791    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 11:51:26.646509 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644795    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 11:51:26.646509 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644798    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 11:51:26.646509 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644800    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 11:51:26.646509 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644803    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 11:51:26.646509 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644806    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 11:51:26.646509 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.644808    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 11:51:26.646509 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645495    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 11:51:26.646509 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645502    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 11:51:26.647005 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645505    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 11:51:26.647005 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645508    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 11:51:26.647005 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645511    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 11:51:26.647005 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645514    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 11:51:26.647005 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645516    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 11:51:26.647005 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645519    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 11:51:26.647005 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645522    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 11:51:26.647005 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645526    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 11:51:26.647005 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645529    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 11:51:26.647005 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645531    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 11:51:26.647005 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645534    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 11:51:26.647005 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645538    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 11:51:26.647005 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645541    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 11:51:26.647005 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645544    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 11:51:26.647005 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645548    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 11:51:26.647005 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645550    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 11:51:26.647005 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645553    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 11:51:26.647005 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645556    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 11:51:26.647005 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645560    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 11:51:26.647474 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645563    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 11:51:26.647474 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645567    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 11:51:26.647474 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645571    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 11:51:26.647474 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645573    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 11:51:26.647474 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645576    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 11:51:26.647474 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645579    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 11:51:26.647474 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645582    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 11:51:26.647474 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645585    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 11:51:26.647474 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645587    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 11:51:26.647474 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645590    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 11:51:26.647474 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645593    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 11:51:26.647474 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645596    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 11:51:26.647474 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645599    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 11:51:26.647474 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645601    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 11:51:26.647474 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645605    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 11:51:26.647474 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645609    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 11:51:26.647474 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645611    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 11:51:26.647474 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645614    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 11:51:26.647474 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645616    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 11:51:26.647963 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645619    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 11:51:26.647963 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645621    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 11:51:26.647963 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645625    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 11:51:26.647963 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645627    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 11:51:26.647963 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645630    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 11:51:26.647963 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645633    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 11:51:26.647963 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645636    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 11:51:26.647963 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645638    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 11:51:26.647963 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645641    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 11:51:26.647963 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645644    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 11:51:26.647963 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645646    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 11:51:26.647963 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645649    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 11:51:26.647963 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645652    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 11:51:26.647963 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645654    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 11:51:26.647963 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645657    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 11:51:26.647963 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645659    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 11:51:26.647963 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645662    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 11:51:26.647963 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645664    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 11:51:26.647963 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645667    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 11:51:26.647963 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645669    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 11:51:26.648445 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645672    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 11:51:26.648445 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645674    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 11:51:26.648445 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645677    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 11:51:26.648445 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645694    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 11:51:26.648445 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645697    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 11:51:26.648445 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645700    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 11:51:26.648445 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645702    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 11:51:26.648445 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645706    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 11:51:26.648445 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645708    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 11:51:26.648445 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645711    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 11:51:26.648445 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645713    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 11:51:26.648445 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645716    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 11:51:26.648445 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645719    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 11:51:26.648445 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645721    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 11:51:26.648445 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645724    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 11:51:26.648445 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645737    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 11:51:26.648445 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645740    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 11:51:26.648445 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645743    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 11:51:26.648445 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645746    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 11:51:26.648445 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645748    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 11:51:26.648976 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645751    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 11:51:26.648976 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645754    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 11:51:26.648976 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645756    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 11:51:26.648976 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645759    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 11:51:26.648976 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645762    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 11:51:26.648976 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645765    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 11:51:26.648976 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645767    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 11:51:26.648976 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645770    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 11:51:26.648976 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645772    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 11:51:26.648976 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645775    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 11:51:26.648976 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645778    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 11:51:26.648976 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645780    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 11:51:26.648976 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645783    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 11:51:26.648976 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645785    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 11:51:26.648976 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645788    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 11:51:26.648976 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645791    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 11:51:26.648976 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645793    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 11:51:26.648976 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645796    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 11:51:26.648976 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.645798    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 11:51:26.648976 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646160    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 11:51:26.649466 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646166    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 11:51:26.649466 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646168    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 11:51:26.649466 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646171    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 11:51:26.649466 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646176    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 11:51:26.649466 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646180    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 11:51:26.649466 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646183    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 11:51:26.649466 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646186    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 11:51:26.649466 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646190    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 11:51:26.649466 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646192    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 11:51:26.649466 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646195    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 11:51:26.649466 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646198    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 11:51:26.649466 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646201    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 11:51:26.649466 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646203    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 11:51:26.649466 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646206    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 11:51:26.649466 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646208    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 11:51:26.649466 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646211    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 11:51:26.649466 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646214    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 11:51:26.649466 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646216    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 11:51:26.649466 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646218    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 11:51:26.649946 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646221    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 11:51:26.649946 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646223    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 11:51:26.649946 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646226    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 11:51:26.649946 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646231    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 11:51:26.649946 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646233    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 11:51:26.649946 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646236    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 11:51:26.649946 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646239    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 11:51:26.649946 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646241    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 11:51:26.649946 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646244    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 11:51:26.649946 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646246    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 11:51:26.649946 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646249    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 11:51:26.649946 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646251    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 11:51:26.649946 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646254    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 11:51:26.649946 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646257    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 11:51:26.649946 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646259    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 11:51:26.649946 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646262    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 11:51:26.649946 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646264    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 11:51:26.649946 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646269    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 11:51:26.649946 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646271    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 11:51:26.649946 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646274    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 11:51:26.650453 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646276    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 11:51:26.650453 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646279    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 11:51:26.650453 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646283    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 11:51:26.650453 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646285    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 11:51:26.650453 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646288    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 11:51:26.650453 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646290    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 11:51:26.650453 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646293    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 11:51:26.650453 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646295    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 11:51:26.650453 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646298    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 11:51:26.650453 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646301    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 11:51:26.650453 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646304    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 11:51:26.650453 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646306    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 11:51:26.650453 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646309    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 11:51:26.650453 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646311    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 11:51:26.650453 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646314    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 11:51:26.650453 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646317    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 11:51:26.650453 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646320    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 11:51:26.650453 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646322    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 11:51:26.650453 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646325    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 11:51:26.650453 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646328    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 11:51:26.650956 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646330    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 11:51:26.650956 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646333    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 11:51:26.650956 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646335    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 11:51:26.650956 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646338    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 11:51:26.650956 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646341    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 11:51:26.650956 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646343    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 11:51:26.650956 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646346    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 11:51:26.650956 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646348    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 11:51:26.650956 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646351    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 11:51:26.650956 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646354    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 11:51:26.650956 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646359    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 11:51:26.650956 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646362    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 11:51:26.650956 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646365    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 11:51:26.650956 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646368    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 11:51:26.650956 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646372    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 11:51:26.650956 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646375    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 11:51:26.650956 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646378    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 11:51:26.650956 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646380    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 11:51:26.650956 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646383    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 11:51:26.650956 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646386    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 11:51:26.651444 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646389    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 11:51:26.651444 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646392    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 11:51:26.651444 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646396    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 11:51:26.651444 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646399    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 11:51:26.651444 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646401    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 11:51:26.651444 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646404    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 11:51:26.651444 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646407    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 11:51:26.651444 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646410    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 11:51:26.651444 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646413    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 11:51:26.651444 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646416    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 11:51:26.651444 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646418    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 11:51:26.651444 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646421    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 11:51:26.651444 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646423    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 11:51:26.651444 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646426    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 11:51:26.651444 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646428    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 11:51:26.651444 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646431    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 11:51:26.651444 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646433    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 11:51:26.651444 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646436    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 11:51:26.651444 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.646438    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 11:51:26.651444 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646524    2565 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 11:51:26.651979 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646573    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 11:51:26.651979 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646583    2565 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 11:51:26.651979 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646587    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 11:51:26.651979 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646592    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 11:51:26.651979 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646595    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 11:51:26.651979 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646599    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 11:51:26.651979 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646603    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 11:51:26.651979 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646607    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 11:51:26.651979 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646610    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 11:51:26.651979 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646614    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 11:51:26.651979 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646618    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 11:51:26.651979 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646621    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 11:51:26.651979 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646624    2565 flags.go:64] FLAG: --cgroup-root=""
Sep 11 11:51:26.651979 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646627    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 11:51:26.651979 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646630    2565 flags.go:64] FLAG: --client-ca-file=""
Sep 11 11:51:26.651979 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646633    2565 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 11:51:26.651979 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646636    2565 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 11:51:26.651979 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646640    2565 flags.go:64] FLAG: --cluster-domain=""
Sep 11 11:51:26.651979 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646643    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 11:51:26.651979 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646647    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 11:51:26.651979 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646650    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 11:51:26.651979 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646653    2565 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 11:51:26.651979 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646657    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 11:51:26.651979 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646660    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 11:51:26.652579 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646663    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 11:51:26.652579 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646667    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 11:51:26.652579 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646670    2565 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 11:51:26.652579 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646673    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 11:51:26.652579 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646676    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 11:51:26.652579 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646690    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 11:51:26.652579 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646694    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 11:51:26.652579 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646698    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 11:51:26.652579 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646701    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 11:51:26.652579 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646705    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 11:51:26.652579 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646709    2565 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 11:51:26.652579 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646712    2565 flags.go:64] FLAG: --enable-server="true"
Sep 11 11:51:26.652579 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646715    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 11:51:26.652579 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646720    2565 flags.go:64] FLAG: --event-burst="100"
Sep 11 11:51:26.652579 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646723    2565 flags.go:64] FLAG: --event-qps="50"
Sep 11 11:51:26.652579 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646725    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 11:51:26.652579 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646730    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 11:51:26.652579 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646733    2565 flags.go:64] FLAG: --eviction-hard=""
Sep 11 11:51:26.652579 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646737    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 11:51:26.652579 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646740    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 11:51:26.652579 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646743    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 11:51:26.652579 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646746    2565 flags.go:64] FLAG: --eviction-soft=""
Sep 11 11:51:26.652579 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646749    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 11:51:26.652579 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646752    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 11:51:26.652579 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646755    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 11:51:26.653208 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646758    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 11:51:26.653208 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646761    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 11:51:26.653208 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646764    2565 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 11:51:26.653208 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646767    2565 flags.go:64] FLAG: --feature-gates=""
Sep 11 11:51:26.653208 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646771    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 11:51:26.653208 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646774    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 11:51:26.653208 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646777    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 11:51:26.653208 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646780    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 11:51:26.653208 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646783    2565 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 11:51:26.653208 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646787    2565 flags.go:64] FLAG: --help="false"
Sep 11 11:51:26.653208 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646790    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-138-111.ec2.internal"
Sep 11 11:51:26.653208 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646793    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 11:51:26.653208 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646795    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 11:51:26.653208 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646798    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 11:51:26.653208 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646802    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 11:51:26.653208 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646805    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 11:51:26.653208 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646809    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 11:51:26.653208 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646812    2565 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 11:51:26.653208 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646815    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 11:51:26.653208 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646818    2565 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 11:51:26.653208 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646821    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 11:51:26.653208 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646824    2565 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 11:51:26.653208 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646827    2565 flags.go:64] FLAG: --kube-reserved=""
Sep 11 11:51:26.653208 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646830    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 11:51:26.653810 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646834    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 11:51:26.653810 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646837    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 11:51:26.653810 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646840    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 11:51:26.653810 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646843    2565 flags.go:64] FLAG: --lock-file=""
Sep 11 11:51:26.653810 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646846    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 11:51:26.653810 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646849    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 11:51:26.653810 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646851    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 11:51:26.653810 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646857    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 11:51:26.653810 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646860    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 11:51:26.653810 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646863    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 11:51:26.653810 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646866    2565 flags.go:64] FLAG: --logging-format="text"
Sep 11 11:51:26.653810 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646869    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 11:51:26.653810 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646873    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 11:51:26.653810 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646876    2565 flags.go:64] FLAG: --manifest-url=""
Sep 11 11:51:26.653810 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646879    2565 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 11:51:26.653810 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646883    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 11:51:26.653810 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646886    2565 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 11:51:26.653810 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646889    2565 flags.go:64] FLAG: --max-pods="110"
Sep 11 11:51:26.653810 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646893    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 11:51:26.653810 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646898    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 11:51:26.653810 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646902    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 11:51:26.653810 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646907    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 11:51:26.653810 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646925    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 11:51:26.653810 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646928    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 11:51:26.653810 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646933    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 11:51:26.654502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646941    2565 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 11:51:26.654502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646944    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 11:51:26.654502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646948    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 11:51:26.654502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646951    2565 flags.go:64] FLAG: --pod-cidr=""
Sep 11 11:51:26.654502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646953    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 11:51:26.654502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646959    2565 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 11:51:26.654502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646962    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 11:51:26.654502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646965    2565 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 11:51:26.654502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646969    2565 flags.go:64] FLAG: --port="10250"
Sep 11 11:51:26.654502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646972    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 11:51:26.654502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646975    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cee8ccb199e16442"
Sep 11 11:51:26.654502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646978    2565 flags.go:64] FLAG: --qos-reserved=""
Sep 11 11:51:26.654502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646981    2565 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 11:51:26.654502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646984    2565 flags.go:64] FLAG: --register-node="true"
Sep 11 11:51:26.654502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646987    2565 flags.go:64] FLAG: --register-with-taints=""
Sep 11 11:51:26.654502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646991    2565 flags.go:64] FLAG: --registry-burst="10"
Sep 11 11:51:26.654502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646994    2565 flags.go:64] FLAG: --registry-qps="5"
Sep 11 11:51:26.654502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.646997    2565 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 11:51:26.654502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647000    2565 flags.go:64] FLAG: --reserved-memory=""
Sep 11 11:51:26.654502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647004    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 11:51:26.654502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647007    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 11:51:26.654502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647010    2565 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 11:51:26.654502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647013    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 11:51:26.654502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647017    2565 flags.go:64] FLAG: --runonce="false"
Sep 11 11:51:26.654502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647020    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 11:51:26.655596 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647023    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 11:51:26.655596 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647026    2565 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 11:51:26.655596 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647029    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 11:51:26.655596 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647032    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 11:51:26.655596 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647035    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 11:51:26.655596 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647038    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 11:51:26.655596 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647042    2565 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 11:51:26.655596 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647046    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 11:51:26.655596 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647049    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 11:51:26.655596 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647052    2565 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 11:51:26.655596 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647054    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 11:51:26.655596 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647058    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 11:51:26.655596 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647061    2565 flags.go:64] FLAG: --system-cgroups=""
Sep 11 11:51:26.655596 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647065    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 11:51:26.655596 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647070    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 11:51:26.655596 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647073    2565 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 11:51:26.655596 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647076    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 11:51:26.655596 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647080    2565 flags.go:64] FLAG: --tls-min-version=""
Sep 11 11:51:26.655596 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647083    2565 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 11:51:26.655596 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647086    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 11:51:26.655596 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647089    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 11:51:26.655596 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647092    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 11:51:26.655596 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647095    2565 flags.go:64] FLAG: --v="2"
Sep 11 11:51:26.655596 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647099    2565 flags.go:64] FLAG: --version="false"
Sep 11 11:51:26.655596 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647104    2565 flags.go:64] FLAG: --vmodule=""
Sep 11 11:51:26.656806 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647108    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 11:51:26.656806 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.647111    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 11:51:26.656806 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647232    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 11:51:26.656806 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647235    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 11:51:26.656806 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647238    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 11:51:26.656806 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647241    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 11:51:26.656806 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647246    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 11:51:26.656806 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647249    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 11:51:26.656806 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647252    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 11:51:26.656806 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647255    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 11:51:26.656806 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647258    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 11:51:26.656806 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647261    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 11:51:26.656806 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647264    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 11:51:26.656806 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647267    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 11:51:26.656806 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647273    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 11:51:26.656806 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647275    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 11:51:26.656806 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647278    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 11:51:26.656806 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647281    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 11:51:26.656806 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647284    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 11:51:26.657274 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647286    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 11:51:26.657274 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647289    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 11:51:26.657274 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647291    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 11:51:26.657274 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647294    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 11:51:26.657274 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647297    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 11:51:26.657274 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647300    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 11:51:26.657274 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647302    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 11:51:26.657274 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647305    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 11:51:26.657274 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647308    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 11:51:26.657274 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647311    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 11:51:26.657274 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647313    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 11:51:26.657274 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647316    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 11:51:26.657274 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647322    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 11:51:26.657274 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647325    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 11:51:26.657274 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647327    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 11:51:26.657274 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647330    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 11:51:26.657274 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647334    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 11:51:26.657274 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647337    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 11:51:26.657274 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647341    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 11:51:26.657930 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647343    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 11:51:26.657930 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647346    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 11:51:26.657930 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647348    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 11:51:26.657930 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647351    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 11:51:26.657930 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647354    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 11:51:26.657930 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647357    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 11:51:26.657930 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647359    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 11:51:26.657930 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647362    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 11:51:26.657930 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647366    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 11:51:26.657930 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647369    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 11:51:26.657930 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647371    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 11:51:26.657930 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647374    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 11:51:26.657930 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647377    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 11:51:26.657930 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647379    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 11:51:26.657930 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647382    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 11:51:26.657930 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647384    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 11:51:26.657930 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647387    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 11:51:26.657930 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647390    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 11:51:26.657930 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647393    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 11:51:26.657930 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647396    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 11:51:26.658827 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647398    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 11:51:26.658827 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647401    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 11:51:26.658827 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647404    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 11:51:26.658827 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647406    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 11:51:26.658827 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647409    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 11:51:26.658827 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647413    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 11:51:26.658827 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647415    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 11:51:26.658827 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647418    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 11:51:26.658827 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647421    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 11:51:26.658827 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647423    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 11:51:26.658827 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647426    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 11:51:26.658827 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647429    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 11:51:26.658827 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647432    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 11:51:26.658827 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647434    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 11:51:26.658827 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647437    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 11:51:26.658827 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647439    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 11:51:26.658827 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647442    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 11:51:26.658827 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647444    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 11:51:26.658827 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647447    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 11:51:26.658827 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647450    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 11:51:26.659439 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647453    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 11:51:26.659439 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647456    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 11:51:26.659439 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647459    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 11:51:26.659439 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647462    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 11:51:26.659439 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647464    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 11:51:26.659439 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647467    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 11:51:26.659439 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647469    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 11:51:26.659439 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647472    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 11:51:26.659439 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647475    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 11:51:26.659439 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647477    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 11:51:26.659439 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647480    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 11:51:26.659439 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647483    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 11:51:26.659439 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647486    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 11:51:26.659439 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647489    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 11:51:26.659439 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647491    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 11:51:26.659439 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647494    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 11:51:26.659439 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647497    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 11:51:26.659439 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647500    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 11:51:26.659439 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647503    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 11:51:26.659439 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647507    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 11:51:26.660235 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647510    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 11:51:26.660235 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647514    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 11:51:26.660235 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.647516    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 11:51:26.660235 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.648186    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 11:51:26.660235 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.656628    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 11:51:26.660235 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.656647    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 11:51:26.660235 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.657562    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 11:51:26.660235 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.657578    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 11:51:26.660235 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657674    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 11:51:26.660235 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657700    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 11:51:26.660235 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657705    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 11:51:26.660235 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657710    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 11:51:26.660235 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657714    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 11:51:26.660235 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657719    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 11:51:26.660235 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657722    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 11:51:26.660904 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657727    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 11:51:26.660904 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657732    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 11:51:26.660904 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657736    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 11:51:26.660904 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657740    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 11:51:26.660904 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657744    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 11:51:26.660904 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657749    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 11:51:26.660904 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657754    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 11:51:26.660904 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657758    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 11:51:26.660904 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657762    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 11:51:26.660904 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657766    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 11:51:26.660904 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657771    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 11:51:26.660904 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657776    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 11:51:26.660904 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657780    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 11:51:26.660904 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657787    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 11:51:26.660904 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657793    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 11:51:26.660904 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657797    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 11:51:26.660904 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657802    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 11:51:26.660904 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657806    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 11:51:26.660904 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657810    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 11:51:26.660904 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657815    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 11:51:26.661562 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657822    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 11:51:26.661562 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657829    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 11:51:26.661562 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657836    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 11:51:26.661562 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657842    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 11:51:26.661562 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657846    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 11:51:26.661562 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657850    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 11:51:26.661562 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657855    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 11:51:26.661562 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657859    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 11:51:26.661562 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657864    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 11:51:26.661562 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657868    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 11:51:26.661562 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657872    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 11:51:26.661562 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657876    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 11:51:26.661562 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657880    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 11:51:26.661562 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657884    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 11:51:26.661562 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657889    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 11:51:26.661562 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657893    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 11:51:26.661562 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657897    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 11:51:26.661562 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657902    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 11:51:26.661562 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657906    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 11:51:26.661562 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657910    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 11:51:26.662187 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657914    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 11:51:26.662187 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657918    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 11:51:26.662187 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657922    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 11:51:26.662187 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657926    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 11:51:26.662187 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657931    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 11:51:26.662187 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657934    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 11:51:26.662187 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657938    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 11:51:26.662187 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657942    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 11:51:26.662187 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657946    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 11:51:26.662187 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657950    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 11:51:26.662187 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657954    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 11:51:26.662187 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657958    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 11:51:26.662187 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657962    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 11:51:26.662187 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657969    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 11:51:26.662187 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657976    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 11:51:26.662187 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657982    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 11:51:26.662187 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657987    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 11:51:26.662187 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657991    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 11:51:26.662187 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.657996    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 11:51:26.662187 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658000    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 11:51:26.662725 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658004    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 11:51:26.662725 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658008    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 11:51:26.662725 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658013    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 11:51:26.662725 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658017    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 11:51:26.662725 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658021    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 11:51:26.662725 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658025    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 11:51:26.662725 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658029    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 11:51:26.662725 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658033    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 11:51:26.662725 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658037    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 11:51:26.662725 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658041    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 11:51:26.662725 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658046    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 11:51:26.662725 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658050    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 11:51:26.662725 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658054    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 11:51:26.662725 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658059    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 11:51:26.662725 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658063    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 11:51:26.662725 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658067    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 11:51:26.662725 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658071    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 11:51:26.662725 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658075    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 11:51:26.662725 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658079    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 11:51:26.663207 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658083    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 11:51:26.663207 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658087    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 11:51:26.663207 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658091    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 11:51:26.663207 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658095    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 11:51:26.663207 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658099    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 11:51:26.663207 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658104    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 11:51:26.663207 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658108    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 11:51:26.663207 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658113    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 11:51:26.663207 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658118    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 11:51:26.663207 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658127    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 11:51:26.663207 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658131    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 11:51:26.663207 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658135    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 11:51:26.663207 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658140    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 11:51:26.663207 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.658148    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 11:51:26.663207 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658358    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 11:51:26.663610 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658367    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 11:51:26.663610 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658372    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 11:51:26.663610 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658376    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 11:51:26.663610 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658380    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 11:51:26.663610 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658384    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 11:51:26.663610 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658388    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 11:51:26.663610 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658393    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 11:51:26.663610 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658397    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 11:51:26.663610 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658401    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 11:51:26.663610 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658405    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 11:51:26.663610 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658410    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 11:51:26.663610 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658415    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 11:51:26.663610 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658419    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 11:51:26.663610 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658424    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 11:51:26.663610 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658430    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 11:51:26.663610 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658437    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 11:51:26.663610 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658442    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 11:51:26.663610 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658446    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 11:51:26.663610 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658453    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 11:51:26.664140 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658458    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 11:51:26.664140 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658463    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 11:51:26.664140 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658468    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 11:51:26.664140 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658472    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 11:51:26.664140 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658477    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 11:51:26.664140 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658482    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 11:51:26.664140 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658486    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 11:51:26.664140 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658490    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 11:51:26.664140 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658495    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 11:51:26.664140 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658499    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 11:51:26.664140 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658504    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 11:51:26.664140 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658507    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 11:51:26.664140 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658514    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 11:51:26.664140 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658519    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 11:51:26.664140 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658523    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 11:51:26.664140 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658527    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 11:51:26.664140 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658531    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 11:51:26.664140 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658536    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 11:51:26.664140 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658540    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 11:51:26.664140 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658543    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 11:51:26.664639 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658548    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 11:51:26.664639 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658552    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 11:51:26.664639 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658557    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 11:51:26.664639 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658561    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 11:51:26.664639 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658565    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 11:51:26.664639 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658569    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 11:51:26.664639 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658573    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 11:51:26.664639 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658577    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 11:51:26.664639 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658581    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 11:51:26.664639 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658585    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 11:51:26.664639 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658590    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 11:51:26.664639 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658594    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 11:51:26.664639 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658598    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 11:51:26.664639 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658602    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 11:51:26.664639 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658607    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 11:51:26.664639 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658611    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 11:51:26.664639 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658615    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 11:51:26.664639 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658619    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 11:51:26.664639 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658623    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 11:51:26.664639 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658627    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 11:51:26.665170 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658631    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 11:51:26.665170 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658636    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 11:51:26.665170 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658640    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 11:51:26.665170 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658645    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 11:51:26.665170 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658648    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 11:51:26.665170 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658652    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 11:51:26.665170 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658657    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 11:51:26.665170 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658661    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 11:51:26.665170 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658665    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 11:51:26.665170 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658669    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 11:51:26.665170 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658673    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 11:51:26.665170 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658677    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 11:51:26.665170 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658698    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 11:51:26.665170 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658702    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 11:51:26.665170 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658706    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 11:51:26.665170 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658711    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 11:51:26.665170 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658715    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 11:51:26.665170 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658719    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 11:51:26.665170 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658724    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 11:51:26.665170 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658729    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 11:51:26.665661 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658733    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 11:51:26.665661 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658737    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 11:51:26.665661 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658741    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 11:51:26.665661 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658745    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 11:51:26.665661 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658749    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 11:51:26.665661 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658753    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 11:51:26.665661 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658757    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 11:51:26.665661 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658761    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 11:51:26.665661 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658766    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 11:51:26.665661 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658770    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 11:51:26.665661 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658774    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 11:51:26.665661 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658779    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 11:51:26.665661 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658783    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 11:51:26.665661 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658787    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 11:51:26.665661 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658792    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 11:51:26.665661 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658796    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 11:51:26.665661 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658800    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 11:51:26.665661 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658804    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 11:51:26.665661 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:26.658808    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 11:51:26.666457 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.658816    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 11:51:26.666457 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.658972    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 11:51:26.666457 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.662023    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 11:51:26.666457 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.663167    2565 server.go:1019] "Starting client certificate rotation"
Sep 11 11:51:26.666457 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.663270    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 11:51:26.666457 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.663308    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 11:51:26.666457 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.666326    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 11:51:26.673775 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.673708    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 11:51:26.680739 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.680721    2565 log.go:25] "Validated CRI v1 runtime API"
Sep 11 11:51:26.684005 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.683990    2565 log.go:25] "Validated CRI v1 image API"
Sep 11 11:51:26.684806 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.684792    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 11:51:26.688256 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.688229    2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 da1eea7f-b333-40fe-a7a6-554d721a536d:/dev/nvme0n1p4 fde0d66c-9889-4115-acd6-8b1d721c38ab:/dev/nvme0n1p3]
Sep 11 11:51:26.688345 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.688254    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 11:51:26.693745 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.693623    2565 manager.go:216] Machine: {Timestamp:2026-09-11 11:51:26.692207276 +0000 UTC m=+0.374606764 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3198200 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ede4a9fe9ad69d5de7e46e2ad0723 SystemUUID:ec2ede4a-9fe9-ad69-d5de-7e46e2ad0723 BootID:3218bf16-ddcf-4581-a542-b726db664b30 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:44:1c:33:43:bf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:44:1c:33:43:bf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:21:31:a3:32:81 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 11:51:26.693745 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.693737    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 11:51:26.693862 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.693813    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 11:51:26.697350 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.697326    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 11:51:26.697509 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.697352    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-111.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 11:51:26.697712 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.697693    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 11:51:26.698941 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.698931    2565 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 11:51:26.698984 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.698944    2565 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 11:51:26.698984 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.698952    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 11:51:26.699767 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.699755    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 11:51:26.701084 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.701074    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 11:51:26.705692 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.705674    2565 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 11:51:26.705805 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.705796    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 11:51:26.705836 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.705829    2565 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 11:51:26.705874 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.705839    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 11:51:26.705874 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.705852    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 11:51:26.705874 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.705862    2565 kubelet.go:398] "Adding apiserver pod source"
Sep 11 11:51:26.705874 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.705871    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 11:51:26.706235 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.706223    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 11:51:26.706276 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.706247    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 11:51:26.708543 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.708524    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 11:51:26.711437 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.711424    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 11:51:26.711483 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.711454    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 11:51:26.713527 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.713512    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 11:51:26.713527 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.713528    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 11:51:26.713639 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.713534    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 11:51:26.713639 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.713539    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 11:51:26.713639 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.713548    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 11:51:26.713639 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.713554    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 11:51:26.713639 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.713567    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 11:51:26.713639 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.713572    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 11:51:26.713639 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.713578    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 11:51:26.713639 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.713583    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 11:51:26.713639 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.713591    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 11:51:26.713639 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.713596    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 11:51:26.714510 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.714501    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 11:51:26.714510 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.714511    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 11:51:26.718137 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.718124    2565 server.go:1268] "Started kubelet"
Sep 11 11:51:26.718230 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.718202    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 11:51:26.718341 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.718286    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 11:51:26.718378 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.718367    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 11:51:26.724474 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.724454    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 11:51:26.724980 ip-10-0-138-111 systemd[1]: Started Kubernetes Kubelet.
Sep 11 11:51:26.727754 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.727649    2565 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 11:51:26.728640 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:26.727669    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 11:51:26.731308 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.731289    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 11:51:26.731964 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.731941    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 11:51:26.732064 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.731981    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-111.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 11:51:26.732064 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:26.732021    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-111.ec2.internal\" not found"
Sep 11 11:51:26.732535 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:26.732509    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 11:51:26.732630 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:26.731456    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-111.ec2.internal.18d441f84fb83a3c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-111.ec2.internal,UID:ip-10-0-138-111.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-111.ec2.internal,},FirstTimestamp:2026-09-11 11:51:26.71809798 +0000 UTC m=+0.400497469,LastTimestamp:2026-09-11 11:51:26.71809798 +0000 UTC m=+0.400497469,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-111.ec2.internal,}"
Sep 11 11:51:26.732746 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.732725    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 11:51:26.732746 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.732747    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 11:51:26.732893 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.732758    2565 factory.go:55] Registering systemd factory
Sep 11 11:51:26.732893 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.732772    2565 factory.go:223] Registration of the systemd container factory successfully
Sep 11 11:51:26.732893 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.732729    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 11:51:26.732893 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.732862    2565 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 11:51:26.732893 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.732869    2565 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 11:51:26.733097 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.732947    2565 factory.go:153] Registering CRI-O factory
Sep 11 11:51:26.733097 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.732960    2565 factory.go:223] Registration of the crio container factory successfully
Sep 11 11:51:26.733097 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:26.732955    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-111.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 11:51:26.733097 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.733009    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 11:51:26.733097 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.733028    2565 factory.go:103] Registering Raw factory
Sep 11 11:51:26.733097 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.733043    2565 manager.go:1196] Started watching for new ooms in manager
Sep 11 11:51:26.733403 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.733391    2565 manager.go:349] Starting recovery of all containers
Sep 11 11:51:26.734999 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:26.734977    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 11:51:26.735226 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:26.735204    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-111.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 11:51:26.742992 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.742851    2565 manager.go:354] Recovery completed
Sep 11 11:51:26.747248 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.747236    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 11:51:26.749301 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.749285    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-111.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 11:51:26.749381 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.749314    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-111.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 11:51:26.749381 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.749328    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-111.ec2.internal" event="NodeHasSufficientPID"
Sep 11 11:51:26.750297 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.750275    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 11:51:26.750297 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.750296    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 11:51:26.750418 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.750313    2565 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 11:51:26.750811 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.750780    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 11:51:26.751005 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:26.750917    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-111.ec2.internal.18d441f8519456e0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-111.ec2.internal,UID:ip-10-0-138-111.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-111.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-111.ec2.internal,},FirstTimestamp:2026-09-11 11:51:26.749300448 +0000 UTC m=+0.431699936,LastTimestamp:2026-09-11 11:51:26.749300448 +0000 UTC m=+0.431699936,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-111.ec2.internal,}"
Sep 11 11:51:26.751813 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.751792    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-111.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 11:51:26.751923 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.751824    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-111.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 11:51:26.751923 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.751846    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-111.ec2.internal" event="NodeHasSufficientPID"
Sep 11 11:51:26.753402 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.753383    2565 policy_none.go:49] "None policy: Start"
Sep 11 11:51:26.753485 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.753408    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 11:51:26.753485 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.753423    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 11:51:26.755444 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.755432    2565 policy_none.go:47] "Start"
Sep 11 11:51:26.759768 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:26.759671    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-111.ec2.internal.18d441f85194ace8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-111.ec2.internal,UID:ip-10-0-138-111.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-111.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-111.ec2.internal,},FirstTimestamp:2026-09-11 11:51:26.749322472 +0000 UTC m=+0.431721960,LastTimestamp:2026-09-11 11:51:26.749322472 +0000 UTC m=+0.431721960,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-111.ec2.internal,}"
Sep 11 11:51:26.761940 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.761919    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bqncs"
Sep 11 11:51:26.762652 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:26.762596    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-111.ec2.internal.18d441f85194d175  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-111.ec2.internal,UID:ip-10-0-138-111.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-111.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-111.ec2.internal,},FirstTimestamp:2026-09-11 11:51:26.749331829 +0000 UTC m=+0.431731319,LastTimestamp:2026-09-11 11:51:26.749331829 +0000 UTC m=+0.431731319,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-111.ec2.internal,}"
Sep 11 11:51:26.767538 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.767522    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bqncs"
Sep 11 11:51:26.768733 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:26.768612    2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-111.ec2.internal.18d441f8519456e0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-111.ec2.internal.18d441f8519456e0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-111.ec2.internal,UID:ip-10-0-138-111.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-111.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-111.ec2.internal,},FirstTimestamp:2026-09-11 11:51:26.749300448 +0000 UTC m=+0.431699936,LastTimestamp:2026-09-11 11:51:26.751811567 +0000 UTC m=+0.434211060,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-111.ec2.internal,}"
Sep 11 11:51:26.788370 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.788347    2565 manager.go:337] "Starting Device Plugin manager"
Sep 11 11:51:26.807717 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:26.788390    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 11:51:26.807717 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.788404    2565 server.go:87] "Starting device plugin registration server"
Sep 11 11:51:26.807717 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.788716    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 11:51:26.807717 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.788727    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 11:51:26.807717 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.788823    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 11:51:26.807717 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.788944    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 11:51:26.807717 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.788953    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 11:51:26.807717 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:26.789348    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 11:51:26.807717 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:26.789398    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-111.ec2.internal\" not found"
Sep 11 11:51:26.834102 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.834078    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 11:51:26.835294 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.835277    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 11:51:26.835352 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.835331    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 11:51:26.835400 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.835355    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 11:51:26.835445 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:26.835399    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 11:51:26.837922 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.837902    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 11:51:26.889878 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.889795    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 11:51:26.890662 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.890647    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-111.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 11:51:26.890745 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.890675    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-111.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 11:51:26.890745 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.890698    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-111.ec2.internal" event="NodeHasSufficientPID"
Sep 11 11:51:26.890745 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.890727    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-111.ec2.internal"
Sep 11 11:51:26.899205 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.899191    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-111.ec2.internal"
Sep 11 11:51:26.899260 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:26.899212    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-111.ec2.internal\": node \"ip-10-0-138-111.ec2.internal\" not found"
Sep 11 11:51:26.921658 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:26.921637    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-111.ec2.internal\" not found"
Sep 11 11:51:26.935966 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.935942    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-111.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-111.ec2.internal"]
Sep 11 11:51:26.936048 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.936012    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 11:51:26.936829 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.936810    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-111.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 11:51:26.936918 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.936838    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-111.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 11:51:26.936918 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.936848    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-111.ec2.internal" event="NodeHasSufficientPID"
Sep 11 11:51:26.939188 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.939176    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 11:51:26.939318 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.939304    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-111.ec2.internal"
Sep 11 11:51:26.939376 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.939339    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 11:51:26.939878 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.939864    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-111.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 11:51:26.939959 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.939888    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-111.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 11:51:26.939959 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.939900    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-111.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 11:51:26.939959 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.939919    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-111.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 11:51:26.939959 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.939903    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-111.ec2.internal" event="NodeHasSufficientPID"
Sep 11 11:51:26.940139 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.939934    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-111.ec2.internal" event="NodeHasSufficientPID"
Sep 11 11:51:26.942207 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.942192    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-111.ec2.internal"
Sep 11 11:51:26.942280 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.942222    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 11:51:26.942922 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.942905    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-111.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 11:51:26.943005 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.942927    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-111.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 11:51:26.943005 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:26.942937    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-111.ec2.internal" event="NodeHasSufficientPID"
Sep 11 11:51:26.958250 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:26.958232    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-111.ec2.internal\" not found" node="ip-10-0-138-111.ec2.internal"
Sep 11 11:51:26.961583 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:26.961568    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-111.ec2.internal\" not found" node="ip-10-0-138-111.ec2.internal"
Sep 11 11:51:27.021950 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:27.021928    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-111.ec2.internal\" not found"
Sep 11 11:51:27.034205 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:27.034188    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c78744bb1b8d7ee618cc9c33e60a9eea-config\") pod \"kube-apiserver-proxy-ip-10-0-138-111.ec2.internal\" (UID: \"c78744bb1b8d7ee618cc9c33e60a9eea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-111.ec2.internal"
Sep 11 11:51:27.034266 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:27.034210    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/651d7bae19c1e9349170a4babadaa923-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-111.ec2.internal\" (UID: \"651d7bae19c1e9349170a4babadaa923\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-111.ec2.internal"
Sep 11 11:51:27.034266 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:27.034230    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/651d7bae19c1e9349170a4babadaa923-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-111.ec2.internal\" (UID: \"651d7bae19c1e9349170a4babadaa923\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-111.ec2.internal"
Sep 11 11:51:27.122389 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:27.122356    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-111.ec2.internal\" not found"
Sep 11 11:51:27.134730 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:27.134712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/651d7bae19c1e9349170a4babadaa923-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-111.ec2.internal\" (UID: \"651d7bae19c1e9349170a4babadaa923\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-111.ec2.internal"
Sep 11 11:51:27.134786 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:27.134742    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/651d7bae19c1e9349170a4babadaa923-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-111.ec2.internal\" (UID: \"651d7bae19c1e9349170a4babadaa923\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-111.ec2.internal"
Sep 11 11:51:27.134786 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:27.134750    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/651d7bae19c1e9349170a4babadaa923-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-111.ec2.internal\" (UID: \"651d7bae19c1e9349170a4babadaa923\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-111.ec2.internal"
Sep 11 11:51:27.134786 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:27.134766    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c78744bb1b8d7ee618cc9c33e60a9eea-config\") pod \"kube-apiserver-proxy-ip-10-0-138-111.ec2.internal\" (UID: \"c78744bb1b8d7ee618cc9c33e60a9eea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-111.ec2.internal"
Sep 11 11:51:27.134893 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:27.134793    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/651d7bae19c1e9349170a4babadaa923-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-111.ec2.internal\" (UID: \"651d7bae19c1e9349170a4babadaa923\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-111.ec2.internal"
Sep 11 11:51:27.134893 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:27.134802    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c78744bb1b8d7ee618cc9c33e60a9eea-config\") pod \"kube-apiserver-proxy-ip-10-0-138-111.ec2.internal\" (UID: \"c78744bb1b8d7ee618cc9c33e60a9eea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-111.ec2.internal"
Sep 11 11:51:27.223196 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:27.223122    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-111.ec2.internal\" not found"
Sep 11 11:51:27.260650 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:27.260613    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-111.ec2.internal"
Sep 11 11:51:27.263923 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:27.263907    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-111.ec2.internal"
Sep 11 11:51:27.323678 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:27.323650    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-111.ec2.internal\" not found"
Sep 11 11:51:27.426238 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:27.426201    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-111.ec2.internal\" not found"
Sep 11 11:51:27.526798 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:27.526725    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-111.ec2.internal\" not found"
Sep 11 11:51:27.627574 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:27.627535    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-111.ec2.internal\" not found"
Sep 11 11:51:27.663692 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:27.663655    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 11:51:27.664105 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:27.663817    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 11:51:27.729011 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:27.728980    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-111.ec2.internal\" not found"
Sep 11 11:51:27.774143 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:27.774101    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 11:46:27 +0000 UTC" deadline="2028-02-25 16:28:06.063584628 +0000 UTC"
Sep 11 11:51:27.774143 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:27.774138    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12772h36m38.289451187s"
Sep 11 11:51:27.829581 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:27.829519    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-111.ec2.internal\" not found"
Sep 11 11:51:27.843015 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:27.842995    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 11:51:27.843904 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:27.843887    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-111.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 11:51:27.843987 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:27.843918    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-111.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 11:51:27.843987 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:27.843929    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-111.ec2.internal" event="NodeHasSufficientPID"
Sep 11 11:51:27.929744 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:27.929704    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-111.ec2.internal\" not found"
Sep 11 11:51:27.972089 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:27.972048    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc78744bb1b8d7ee618cc9c33e60a9eea.slice/crio-a0ecda758f7f714cab7799d214d86c2aef63c6933a8e64bf0a393c23a2134725 WatchSource:0}: Error finding container a0ecda758f7f714cab7799d214d86c2aef63c6933a8e64bf0a393c23a2134725: Status 404 returned error can't find the container with id a0ecda758f7f714cab7799d214d86c2aef63c6933a8e64bf0a393c23a2134725
Sep 11 11:51:27.972604 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:27.972583    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod651d7bae19c1e9349170a4babadaa923.slice/crio-3872bfb7001acde72190f442d277f0f71a7f498e71f1f68118b1f6dd9569f833 WatchSource:0}: Error finding container 3872bfb7001acde72190f442d277f0f71a7f498e71f1f68118b1f6dd9569f833: Status 404 returned error can't find the container with id 3872bfb7001acde72190f442d277f0f71a7f498e71f1f68118b1f6dd9569f833
Sep 11 11:51:27.977774 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:27.977753    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 11:51:28.028193 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.028165    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 11:51:28.030206 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:28.030188    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-111.ec2.internal\" not found"
Sep 11 11:51:28.136874 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:28.136856    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-111.ec2.internal\" not found"
Sep 11 11:51:28.205996 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.205972    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 11:51:28.212778 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.212752    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 11:51:28.232477 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.232446    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-111.ec2.internal"
Sep 11 11:51:28.245666 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.245646    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 11:51:28.246821 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.246807    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-111.ec2.internal"
Sep 11 11:51:28.255404 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.255391    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 11:51:28.708403 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.708372    2565 apiserver.go:52] "Watching apiserver"
Sep 11 11:51:28.717414 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.717387    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 11:51:28.718552 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.718526    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-wzvlx","kube-system/global-pull-secret-syncer-zdjj7","kube-system/konnectivity-agent-lzbk8","kube-system/kube-apiserver-proxy-ip-10-0-138-111.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55","openshift-cluster-node-tuning-operator/tuned-pztl2","openshift-dns/node-resolver-kp8l6","openshift-image-registry/node-ca-bc6h9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-111.ec2.internal","openshift-multus/multus-additional-cni-plugins-9pk4q","openshift-multus/multus-zc9s9","openshift-multus/network-metrics-daemon-jcs8z","openshift-network-diagnostics/network-check-target-tbtxm","openshift-network-operator/iptables-alerter-8svbc"]
Sep 11 11:51:28.721316 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.721295    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9pk4q"
Sep 11 11:51:28.723558 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.723537    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.724645 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.724537    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 11:51:28.724645 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.724591    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 11:51:28.724890 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.724848    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 11:51:28.724958 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.724907    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 11:51:28.725019 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.724975    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qnth2\""
Sep 11 11:51:28.725073 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.725016    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 11:51:28.726635 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.726341    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lzbk8"
Sep 11 11:51:28.726635 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.726386    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-p4pzz\""
Sep 11 11:51:28.726635 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.726426    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 11:51:28.728533 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.728514    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:51:28.728645 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:28.728627    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcs8z" podUID="5b7c905b-ecae-4cbe-a5c2-3962ec391672"
Sep 11 11:51:28.729120 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.729095    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v4ls5\""
Sep 11 11:51:28.729265 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.729247    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 11:51:28.729374 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.729352    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 11:51:28.730876 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.730852    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kp8l6"
Sep 11 11:51:28.733102 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.733082    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 11:51:28.733204 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.733170    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 11:51:28.733345 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.733327    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.733501 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.733484    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vmf5j\""
Sep 11 11:51:28.733918 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.733901    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 11:51:28.735962 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.735931    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.736120 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.736095    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 11:51:28.736216 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.736127    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-557wt\""
Sep 11 11:51:28.737146 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.737100    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 11:51:28.738953 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.738804    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 11:51:28.741699 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.740183    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:51:28.741699 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:28.740272    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tbtxm" podUID="3ccf784d-5d83-482f-b3cf-00f1a976f4be"
Sep 11 11:51:28.741699 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.740581    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 11:51:28.741699 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.740598    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 11:51:28.741699 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.740978    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 11:51:28.741699 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.741179    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 11:51:28.741699 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.741314    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 11:51:28.741699 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.741651    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c6kvj\""
Sep 11 11:51:28.743991 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.743942    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:28.744103 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:28.744041    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjj7" podUID="307113f7-a015-4c41-a620-b5c2b90b3828"
Sep 11 11:51:28.745594 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.745561    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cqn7\" (UniqueName: \"kubernetes.io/projected/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-kube-api-access-9cqn7\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.745683 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.745598    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/947d0f48-7790-4364-acbe-15b44a71f937-agent-certs\") pod \"konnectivity-agent-lzbk8\" (UID: \"947d0f48-7790-4364-acbe-15b44a71f937\") " pod="kube-system/konnectivity-agent-lzbk8"
Sep 11 11:51:28.745683 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.745618    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs\") pod \"network-metrics-daemon-jcs8z\" (UID: \"5b7c905b-ecae-4cbe-a5c2-3962ec391672\") " pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:51:28.745683 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.745643    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-etc-sysconfig\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.745683 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.745669    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c353d851-ad50-4533-ba4a-af3d820e25d1-cni-binary-copy\") pod \"multus-additional-cni-plugins-9pk4q\" (UID: \"c353d851-ad50-4533-ba4a-af3d820e25d1\") " pod="openshift-multus/multus-additional-cni-plugins-9pk4q"
Sep 11 11:51:28.745935 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.745694    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-cnibin\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.745935 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.745734    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-host-var-lib-cni-multus\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.745935 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.745766    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-hostroot\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.745935 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.745832    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-etc-sysctl-conf\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.745935 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.745866    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-etc-systemd\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.745935 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.745891    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn89p\" (UniqueName: \"kubernetes.io/projected/bfebd292-13d0-45a0-bd2c-836e0f4aed14-kube-api-access-hn89p\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.745935 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.745926    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-multus-socket-dir-parent\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.746304 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.745966    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-host-run-netns\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.746304 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746049    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-host-run-multus-certs\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.746304 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746126    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dc741275-985d-42ea-b85c-11c3b6af7009-hosts-file\") pod \"node-resolver-kp8l6\" (UID: \"dc741275-985d-42ea-b85c-11c3b6af7009\") " pod="openshift-dns/node-resolver-kp8l6"
Sep 11 11:51:28.746304 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746153    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-var-lib-kubelet\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.746304 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746176    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-host\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.746304 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746199    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c353d851-ad50-4533-ba4a-af3d820e25d1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9pk4q\" (UID: \"c353d851-ad50-4533-ba4a-af3d820e25d1\") " pod="openshift-multus/multus-additional-cni-plugins-9pk4q"
Sep 11 11:51:28.746304 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746222    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz4z8\" (UniqueName: \"kubernetes.io/projected/c353d851-ad50-4533-ba4a-af3d820e25d1-kube-api-access-lz4z8\") pod \"multus-additional-cni-plugins-9pk4q\" (UID: \"c353d851-ad50-4533-ba4a-af3d820e25d1\") " pod="openshift-multus/multus-additional-cni-plugins-9pk4q"
Sep 11 11:51:28.746304 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746290    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-system-cni-dir\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.746877 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746312    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-cni-binary-copy\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.746877 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746336    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-host-run-k8s-cni-cncf-io\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.746877 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746358    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc741275-985d-42ea-b85c-11c3b6af7009-tmp-dir\") pod \"node-resolver-kp8l6\" (UID: \"dc741275-985d-42ea-b85c-11c3b6af7009\") " pod="openshift-dns/node-resolver-kp8l6"
Sep 11 11:51:28.746877 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746394    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-etc-modprobe-d\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.746877 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746415    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-etc-sysctl-d\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.746877 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746437    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bfebd292-13d0-45a0-bd2c-836e0f4aed14-etc-tuned\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.746877 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746464    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-etc-kubernetes\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.746877 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746488    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/947d0f48-7790-4364-acbe-15b44a71f937-konnectivity-ca\") pod \"konnectivity-agent-lzbk8\" (UID: \"947d0f48-7790-4364-acbe-15b44a71f937\") " pod="kube-system/konnectivity-agent-lzbk8"
Sep 11 11:51:28.746877 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746530    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c353d851-ad50-4533-ba4a-af3d820e25d1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9pk4q\" (UID: \"c353d851-ad50-4533-ba4a-af3d820e25d1\") " pod="openshift-multus/multus-additional-cni-plugins-9pk4q"
Sep 11 11:51:28.746877 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746561    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-host-var-lib-kubelet\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.746877 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746586    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-multus-daemon-config\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.746877 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746612    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9xxx\" (UniqueName: \"kubernetes.io/projected/5b7c905b-ecae-4cbe-a5c2-3962ec391672-kube-api-access-b9xxx\") pod \"network-metrics-daemon-jcs8z\" (UID: \"5b7c905b-ecae-4cbe-a5c2-3962ec391672\") " pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:51:28.746877 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746636    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-etc-kubernetes\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.746877 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746659    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfebd292-13d0-45a0-bd2c-836e0f4aed14-tmp\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.746877 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746697    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c353d851-ad50-4533-ba4a-af3d820e25d1-cnibin\") pod \"multus-additional-cni-plugins-9pk4q\" (UID: \"c353d851-ad50-4533-ba4a-af3d820e25d1\") " pod="openshift-multus/multus-additional-cni-plugins-9pk4q"
Sep 11 11:51:28.746877 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746718    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 11:51:28.746877 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746720    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-host-var-lib-cni-bin\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.747727 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746807    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hbrd\" (UniqueName: \"kubernetes.io/projected/dc741275-985d-42ea-b85c-11c3b6af7009-kube-api-access-7hbrd\") pod \"node-resolver-kp8l6\" (UID: \"dc741275-985d-42ea-b85c-11c3b6af7009\") " pod="openshift-dns/node-resolver-kp8l6"
Sep 11 11:51:28.747727 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746839    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-run\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.747727 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746874    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55"
Sep 11 11:51:28.747727 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746888    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-sys\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.747727 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746918    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-lib-modules\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.747727 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746943    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c353d851-ad50-4533-ba4a-af3d820e25d1-system-cni-dir\") pod \"multus-additional-cni-plugins-9pk4q\" (UID: \"c353d851-ad50-4533-ba4a-af3d820e25d1\") " pod="openshift-multus/multus-additional-cni-plugins-9pk4q"
Sep 11 11:51:28.747727 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.746982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c353d851-ad50-4533-ba4a-af3d820e25d1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9pk4q\" (UID: \"c353d851-ad50-4533-ba4a-af3d820e25d1\") " pod="openshift-multus/multus-additional-cni-plugins-9pk4q"
Sep 11 11:51:28.747727 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.747013    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-multus-cni-dir\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.747727 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.747041    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-multus-conf-dir\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.749489 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.749171    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bc6h9"
Sep 11 11:51:28.749617 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.749599    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 11:51:28.749927 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.749901    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 11:51:28.750257 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.750236    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-prp2g\""
Sep 11 11:51:28.751789 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.751574    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 11:51:28.751892 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.751797    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8svbc"
Sep 11 11:51:28.752396 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.752205    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 11:51:28.752396 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.752280    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4568k\""
Sep 11 11:51:28.752396 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.752299    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 11:51:28.752934 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.752912    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 11:51:28.754552 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.754532    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 11:51:28.754806 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.754786    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 11:51:28.754947 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.754929    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 11:51:28.755178 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.755159    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lgppv\""
Sep 11 11:51:28.769523 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.769500    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6n5tt"
Sep 11 11:51:28.777478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.777456    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6n5tt"
Sep 11 11:51:28.834012 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.833986    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 11:51:28.844688 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.844650    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-111.ec2.internal" event={"ID":"c78744bb1b8d7ee618cc9c33e60a9eea","Type":"ContainerStarted","Data":"a0ecda758f7f714cab7799d214d86c2aef63c6933a8e64bf0a393c23a2134725"}
Sep 11 11:51:28.845749 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.845720    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-111.ec2.internal" event={"ID":"651d7bae19c1e9349170a4babadaa923","Type":"ContainerStarted","Data":"3872bfb7001acde72190f442d277f0f71a7f498e71f1f68118b1f6dd9569f833"}
Sep 11 11:51:28.847975 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.847948    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b2c794da-4296-49a0-a9af-491db5c72a12-serviceca\") pod \"node-ca-bc6h9\" (UID: \"b2c794da-4296-49a0-a9af-491db5c72a12\") " pod="openshift-image-registry/node-ca-bc6h9"
Sep 11 11:51:28.848077 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.847978    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-log-socket\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.848077 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.848001    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c353d851-ad50-4533-ba4a-af3d820e25d1-system-cni-dir\") pod \"multus-additional-cni-plugins-9pk4q\" (UID: \"c353d851-ad50-4533-ba4a-af3d820e25d1\") " pod="openshift-multus/multus-additional-cni-plugins-9pk4q"
Sep 11 11:51:28.848077 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.848018    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c353d851-ad50-4533-ba4a-af3d820e25d1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9pk4q\" (UID: \"c353d851-ad50-4533-ba4a-af3d820e25d1\") " pod="openshift-multus/multus-additional-cni-plugins-9pk4q"
Sep 11 11:51:28.848077 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.848062    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-multus-cni-dir\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.848280 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.848096    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cqn7\" (UniqueName: \"kubernetes.io/projected/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-kube-api-access-9cqn7\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.848280 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.848125    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs\") pod \"network-metrics-daemon-jcs8z\" (UID: \"5b7c905b-ecae-4cbe-a5c2-3962ec391672\") " pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:51:28.848533 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.848396    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-multus-cni-dir\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.848533 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.848499    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c353d851-ad50-4533-ba4a-af3d820e25d1-system-cni-dir\") pod \"multus-additional-cni-plugins-9pk4q\" (UID: \"c353d851-ad50-4533-ba4a-af3d820e25d1\") " pod="openshift-multus/multus-additional-cni-plugins-9pk4q"
Sep 11 11:51:28.848533 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:28.848506    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:51:28.848721 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:28.848616    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs podName:5b7c905b-ecae-4cbe-a5c2-3962ec391672 nodeName:}" failed. No retries permitted until 2026-09-11 11:51:29.348590956 +0000 UTC m=+3.030990456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs") pod "network-metrics-daemon-jcs8z" (UID: "5b7c905b-ecae-4cbe-a5c2-3962ec391672") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:51:28.848721 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.848659    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-etc-sysconfig\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.848848 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.848733    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/56521050-777d-4be5-8838-b87c6a819706-sys-fs\") pod \"aws-ebs-csi-driver-node-2dt55\" (UID: \"56521050-777d-4be5-8838-b87c6a819706\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55"
Sep 11 11:51:28.848848 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.848771    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-run-systemd\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.848848 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.848807    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c353d851-ad50-4533-ba4a-af3d820e25d1-cni-binary-copy\") pod \"multus-additional-cni-plugins-9pk4q\" (UID: \"c353d851-ad50-4533-ba4a-af3d820e25d1\") " pod="openshift-multus/multus-additional-cni-plugins-9pk4q"
Sep 11 11:51:28.848848 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.848830    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-etc-sysconfig\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.849037 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.848844    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-host-var-lib-cni-multus\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.849037 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.848893    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-host-var-lib-cni-multus\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.849037 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.848946    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-hostroot\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.849188 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.849049    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c353d851-ad50-4533-ba4a-af3d820e25d1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9pk4q\" (UID: \"c353d851-ad50-4533-ba4a-af3d820e25d1\") " pod="openshift-multus/multus-additional-cni-plugins-9pk4q"
Sep 11 11:51:28.849188 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.849181    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-hostroot\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.849286 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.849214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn89p\" (UniqueName: \"kubernetes.io/projected/bfebd292-13d0-45a0-bd2c-836e0f4aed14-kube-api-access-hn89p\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.849286 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.849245    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/56521050-777d-4be5-8838-b87c6a819706-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2dt55\" (UID: \"56521050-777d-4be5-8838-b87c6a819706\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55"
Sep 11 11:51:28.849286 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.849278    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-host-cni-bin\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.849429 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.849308    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-env-overrides\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.849429 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.849334    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-ovn-node-metrics-cert\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.849429 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.849370    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-multus-socket-dir-parent\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.849569 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.849440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-var-lib-kubelet\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.849569 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.849452    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c353d851-ad50-4533-ba4a-af3d820e25d1-cni-binary-copy\") pod \"multus-additional-cni-plugins-9pk4q\" (UID: \"c353d851-ad50-4533-ba4a-af3d820e25d1\") " pod="openshift-multus/multus-additional-cni-plugins-9pk4q"
Sep 11 11:51:28.849569 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.849475    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9927\" (UniqueName: \"kubernetes.io/projected/56564e4d-52ec-47e2-912d-edfcd55412c2-kube-api-access-z9927\") pod \"iptables-alerter-8svbc\" (UID: \"56564e4d-52ec-47e2-912d-edfcd55412c2\") " pod="openshift-network-operator/iptables-alerter-8svbc"
Sep 11 11:51:28.849569 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.849508    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz4z8\" (UniqueName: \"kubernetes.io/projected/c353d851-ad50-4533-ba4a-af3d820e25d1-kube-api-access-lz4z8\") pod \"multus-additional-cni-plugins-9pk4q\" (UID: \"c353d851-ad50-4533-ba4a-af3d820e25d1\") " pod="openshift-multus/multus-additional-cni-plugins-9pk4q"
Sep 11 11:51:28.849569 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.849535    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-host-run-k8s-cni-cncf-io\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.849825 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.849581    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tctgg\" (UniqueName: \"kubernetes.io/projected/3ccf784d-5d83-482f-b3cf-00f1a976f4be-kube-api-access-tctgg\") pod \"network-check-target-tbtxm\" (UID: \"3ccf784d-5d83-482f-b3cf-00f1a976f4be\") " pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:51:28.849825 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.849655    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-host-run-k8s-cni-cncf-io\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.849825 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.849759    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-multus-socket-dir-parent\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.849974 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.849837    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-var-lib-kubelet\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.851522 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.850119    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k86xf\" (UniqueName: \"kubernetes.io/projected/b2c794da-4296-49a0-a9af-491db5c72a12-kube-api-access-k86xf\") pod \"node-ca-bc6h9\" (UID: \"b2c794da-4296-49a0-a9af-491db5c72a12\") " pod="openshift-image-registry/node-ca-bc6h9"
Sep 11 11:51:28.851522 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.850176    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-ovnkube-script-lib\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.851522 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.850204    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/56564e4d-52ec-47e2-912d-edfcd55412c2-iptables-alerter-script\") pod \"iptables-alerter-8svbc\" (UID: \"56564e4d-52ec-47e2-912d-edfcd55412c2\") " pod="openshift-network-operator/iptables-alerter-8svbc"
Sep 11 11:51:28.851522 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.850257    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc741275-985d-42ea-b85c-11c3b6af7009-tmp-dir\") pod \"node-resolver-kp8l6\" (UID: \"dc741275-985d-42ea-b85c-11c3b6af7009\") " pod="openshift-dns/node-resolver-kp8l6"
Sep 11 11:51:28.851522 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.850290    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-etc-sysctl-d\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.851522 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.850315    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bfebd292-13d0-45a0-bd2c-836e0f4aed14-etc-tuned\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.851522 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.850347    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/56521050-777d-4be5-8838-b87c6a819706-device-dir\") pod \"aws-ebs-csi-driver-node-2dt55\" (UID: \"56521050-777d-4be5-8838-b87c6a819706\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55"
Sep 11 11:51:28.851522 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.850437    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56564e4d-52ec-47e2-912d-edfcd55412c2-host-slash\") pod \"iptables-alerter-8svbc\" (UID: \"56564e4d-52ec-47e2-912d-edfcd55412c2\") " pod="openshift-network-operator/iptables-alerter-8svbc"
Sep 11 11:51:28.851522 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.850469    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.851522 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.850651    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-etc-sysctl-d\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.851522 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.850697    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65q5q\" (UniqueName: \"kubernetes.io/projected/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-kube-api-access-65q5q\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.851522 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.850790    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c353d851-ad50-4533-ba4a-af3d820e25d1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9pk4q\" (UID: \"c353d851-ad50-4533-ba4a-af3d820e25d1\") " pod="openshift-multus/multus-additional-cni-plugins-9pk4q"
Sep 11 11:51:28.851522 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.850825    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-host-var-lib-kubelet\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.851522 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.850864    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-multus-daemon-config\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.851522 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.850895    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9xxx\" (UniqueName: \"kubernetes.io/projected/5b7c905b-ecae-4cbe-a5c2-3962ec391672-kube-api-access-b9xxx\") pod \"network-metrics-daemon-jcs8z\" (UID: \"5b7c905b-ecae-4cbe-a5c2-3962ec391672\") " pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:51:28.851522 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.850988    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-etc-kubernetes\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.852478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.851023    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-host-slash\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.852478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.851054    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-var-lib-openvswitch\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.852478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.851078    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-run-openvswitch\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.852478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.851114    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c353d851-ad50-4533-ba4a-af3d820e25d1-cnibin\") pod \"multus-additional-cni-plugins-9pk4q\" (UID: \"c353d851-ad50-4533-ba4a-af3d820e25d1\") " pod="openshift-multus/multus-additional-cni-plugins-9pk4q"
Sep 11 11:51:28.852478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.851143    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-sys\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.852478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.851173    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-lib-modules\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.852478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.851195    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2c794da-4296-49a0-a9af-491db5c72a12-host\") pod \"node-ca-bc6h9\" (UID: \"b2c794da-4296-49a0-a9af-491db5c72a12\") " pod="openshift-image-registry/node-ca-bc6h9"
Sep 11 11:51:28.852478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.851276    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 11:51:28.852478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.851293    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-host-kubelet\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.852478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.851317    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-run-ovn\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.852478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.851347    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-multus-conf-dir\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.852478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.851378    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/947d0f48-7790-4364-acbe-15b44a71f937-agent-certs\") pod \"konnectivity-agent-lzbk8\" (UID: \"947d0f48-7790-4364-acbe-15b44a71f937\") " pod="kube-system/konnectivity-agent-lzbk8"
Sep 11 11:51:28.852478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.851409    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-node-log\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.852478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.851432    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-host-cni-netd\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.852478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.851670    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-host-var-lib-kubelet\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.852478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.851770    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-sys\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.852478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.851788    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c353d851-ad50-4533-ba4a-af3d820e25d1-cnibin\") pod \"multus-additional-cni-plugins-9pk4q\" (UID: \"c353d851-ad50-4533-ba4a-af3d820e25d1\") " pod="openshift-multus/multus-additional-cni-plugins-9pk4q"
Sep 11 11:51:28.852478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.851855    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-multus-conf-dir\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.853140 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.851885    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc741275-985d-42ea-b85c-11c3b6af7009-tmp-dir\") pod \"node-resolver-kp8l6\" (UID: \"dc741275-985d-42ea-b85c-11c3b6af7009\") " pod="openshift-dns/node-resolver-kp8l6"
Sep 11 11:51:28.853140 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.851937    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-lib-modules\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.853140 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.852032    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/307113f7-a015-4c41-a620-b5c2b90b3828-kubelet-config\") pod \"global-pull-secret-syncer-zdjj7\" (UID: \"307113f7-a015-4c41-a620-b5c2b90b3828\") " pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:28.853140 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.852094    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-cnibin\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.853140 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.852147    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-cnibin\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.853140 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.852159    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-etc-sysctl-conf\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.853140 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.852174    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-etc-kubernetes\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.853140 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.852315    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-etc-sysctl-conf\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.853140 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.852394    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-multus-daemon-config\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.853140 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.852435    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-etc-systemd\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.853140 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.852493    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/56521050-777d-4be5-8838-b87c6a819706-socket-dir\") pod \"aws-ebs-csi-driver-node-2dt55\" (UID: \"56521050-777d-4be5-8838-b87c6a819706\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55"
Sep 11 11:51:28.853140 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.852514    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-etc-systemd\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.853140 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.852533    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-host-run-ovn-kubernetes\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.853140 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.852638    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-ovnkube-config\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.853140 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.852678    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-host-run-netns\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.853140 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.852704    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c353d851-ad50-4533-ba4a-af3d820e25d1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9pk4q\" (UID: \"c353d851-ad50-4533-ba4a-af3d820e25d1\") " pod="openshift-multus/multus-additional-cni-plugins-9pk4q"
Sep 11 11:51:28.853140 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.852709    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-host-run-multus-certs\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.853859 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.852766    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dc741275-985d-42ea-b85c-11c3b6af7009-hosts-file\") pod \"node-resolver-kp8l6\" (UID: \"dc741275-985d-42ea-b85c-11c3b6af7009\") " pod="openshift-dns/node-resolver-kp8l6"
Sep 11 11:51:28.853859 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.852784    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-host-run-multus-certs\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.853859 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.852800    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-host\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.853859 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.852862    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-host\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.853859 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.852867    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dc741275-985d-42ea-b85c-11c3b6af7009-hosts-file\") pod \"node-resolver-kp8l6\" (UID: \"dc741275-985d-42ea-b85c-11c3b6af7009\") " pod="openshift-dns/node-resolver-kp8l6"
Sep 11 11:51:28.853859 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.852975    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp2tj\" (UniqueName: \"kubernetes.io/projected/56521050-777d-4be5-8838-b87c6a819706-kube-api-access-sp2tj\") pod \"aws-ebs-csi-driver-node-2dt55\" (UID: \"56521050-777d-4be5-8838-b87c6a819706\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55"
Sep 11 11:51:28.853859 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.853364    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/307113f7-a015-4c41-a620-b5c2b90b3828-dbus\") pod \"global-pull-secret-syncer-zdjj7\" (UID: \"307113f7-a015-4c41-a620-b5c2b90b3828\") " pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:28.853859 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.853365    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-host-run-netns\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.853859 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.853384    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/307113f7-a015-4c41-a620-b5c2b90b3828-original-pull-secret\") pod \"global-pull-secret-syncer-zdjj7\" (UID: \"307113f7-a015-4c41-a620-b5c2b90b3828\") " pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:28.853859 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.853439    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c353d851-ad50-4533-ba4a-af3d820e25d1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9pk4q\" (UID: \"c353d851-ad50-4533-ba4a-af3d820e25d1\") " pod="openshift-multus/multus-additional-cni-plugins-9pk4q"
Sep 11 11:51:28.853859 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.853455    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-system-cni-dir\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.853859 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.853470    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-cni-binary-copy\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.853859 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.853549    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-system-cni-dir\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.853859 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.853555    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-etc-modprobe-d\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.853859 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.853605    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/56521050-777d-4be5-8838-b87c6a819706-etc-selinux\") pod \"aws-ebs-csi-driver-node-2dt55\" (UID: \"56521050-777d-4be5-8838-b87c6a819706\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55"
Sep 11 11:51:28.853859 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.853631    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-systemd-units\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.853859 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.853631    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c353d851-ad50-4533-ba4a-af3d820e25d1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9pk4q\" (UID: \"c353d851-ad50-4533-ba4a-af3d820e25d1\") " pod="openshift-multus/multus-additional-cni-plugins-9pk4q"
Sep 11 11:51:28.854504 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.853670    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-etc-kubernetes\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.854504 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.853717    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/947d0f48-7790-4364-acbe-15b44a71f937-konnectivity-ca\") pod \"konnectivity-agent-lzbk8\" (UID: \"947d0f48-7790-4364-acbe-15b44a71f937\") " pod="kube-system/konnectivity-agent-lzbk8"
Sep 11 11:51:28.854504 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.853722    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-etc-kubernetes\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.854504 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.853725    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-etc-modprobe-d\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.854504 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.853748    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/56521050-777d-4be5-8838-b87c6a819706-registration-dir\") pod \"aws-ebs-csi-driver-node-2dt55\" (UID: \"56521050-777d-4be5-8838-b87c6a819706\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55"
Sep 11 11:51:28.854504 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.853774    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-etc-openvswitch\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.854504 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.853803    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfebd292-13d0-45a0-bd2c-836e0f4aed14-tmp\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.854504 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.853828    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-host-run-netns\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.854504 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.853875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-host-var-lib-cni-bin\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.854504 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.853907    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hbrd\" (UniqueName: \"kubernetes.io/projected/dc741275-985d-42ea-b85c-11c3b6af7009-kube-api-access-7hbrd\") pod \"node-resolver-kp8l6\" (UID: \"dc741275-985d-42ea-b85c-11c3b6af7009\") " pod="openshift-dns/node-resolver-kp8l6"
Sep 11 11:51:28.854504 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.853920    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-cni-binary-copy\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.854504 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.853940    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-run\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.854504 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.853954    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-host-var-lib-cni-bin\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.854504 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.854028    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bfebd292-13d0-45a0-bd2c-836e0f4aed14-run\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.854504 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.854296    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/947d0f48-7790-4364-acbe-15b44a71f937-konnectivity-ca\") pod \"konnectivity-agent-lzbk8\" (UID: \"947d0f48-7790-4364-acbe-15b44a71f937\") " pod="kube-system/konnectivity-agent-lzbk8"
Sep 11 11:51:28.855147 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.855125    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bfebd292-13d0-45a0-bd2c-836e0f4aed14-etc-tuned\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.855393 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.855374    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/947d0f48-7790-4364-acbe-15b44a71f937-agent-certs\") pod \"konnectivity-agent-lzbk8\" (UID: \"947d0f48-7790-4364-acbe-15b44a71f937\") " pod="kube-system/konnectivity-agent-lzbk8"
Sep 11 11:51:28.856125 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.856106    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfebd292-13d0-45a0-bd2c-836e0f4aed14-tmp\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.861114 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.861091    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cqn7\" (UniqueName: \"kubernetes.io/projected/2af1845b-bb2b-4fc9-96f1-c8805e1d1d56-kube-api-access-9cqn7\") pod \"multus-zc9s9\" (UID: \"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56\") " pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:28.861828 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.861490    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz4z8\" (UniqueName: \"kubernetes.io/projected/c353d851-ad50-4533-ba4a-af3d820e25d1-kube-api-access-lz4z8\") pod \"multus-additional-cni-plugins-9pk4q\" (UID: \"c353d851-ad50-4533-ba4a-af3d820e25d1\") " pod="openshift-multus/multus-additional-cni-plugins-9pk4q"
Sep 11 11:51:28.861828 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.861672    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn89p\" (UniqueName: \"kubernetes.io/projected/bfebd292-13d0-45a0-bd2c-836e0f4aed14-kube-api-access-hn89p\") pod \"tuned-pztl2\" (UID: \"bfebd292-13d0-45a0-bd2c-836e0f4aed14\") " pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:28.862028 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.862009    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9xxx\" (UniqueName: \"kubernetes.io/projected/5b7c905b-ecae-4cbe-a5c2-3962ec391672-kube-api-access-b9xxx\") pod \"network-metrics-daemon-jcs8z\" (UID: \"5b7c905b-ecae-4cbe-a5c2-3962ec391672\") " pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:51:28.865586 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.865560    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hbrd\" (UniqueName: \"kubernetes.io/projected/dc741275-985d-42ea-b85c-11c3b6af7009-kube-api-access-7hbrd\") pod \"node-resolver-kp8l6\" (UID: \"dc741275-985d-42ea-b85c-11c3b6af7009\") " pod="openshift-dns/node-resolver-kp8l6"
Sep 11 11:51:28.883823 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.883726    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 11:51:28.955000 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.954966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/56521050-777d-4be5-8838-b87c6a819706-sys-fs\") pod \"aws-ebs-csi-driver-node-2dt55\" (UID: \"56521050-777d-4be5-8838-b87c6a819706\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55"
Sep 11 11:51:28.955172 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955012    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-run-systemd\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.955172 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955045    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/56521050-777d-4be5-8838-b87c6a819706-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2dt55\" (UID: \"56521050-777d-4be5-8838-b87c6a819706\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55"
Sep 11 11:51:28.955172 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955071    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-host-cni-bin\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.955172 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955096    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-env-overrides\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.955172 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955132    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-ovn-node-metrics-cert\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.955172 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955168    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9927\" (UniqueName: \"kubernetes.io/projected/56564e4d-52ec-47e2-912d-edfcd55412c2-kube-api-access-z9927\") pod \"iptables-alerter-8svbc\" (UID: \"56564e4d-52ec-47e2-912d-edfcd55412c2\") " pod="openshift-network-operator/iptables-alerter-8svbc"
Sep 11 11:51:28.955478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955197    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tctgg\" (UniqueName: \"kubernetes.io/projected/3ccf784d-5d83-482f-b3cf-00f1a976f4be-kube-api-access-tctgg\") pod \"network-check-target-tbtxm\" (UID: \"3ccf784d-5d83-482f-b3cf-00f1a976f4be\") " pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:51:28.955478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955222    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k86xf\" (UniqueName: \"kubernetes.io/projected/b2c794da-4296-49a0-a9af-491db5c72a12-kube-api-access-k86xf\") pod \"node-ca-bc6h9\" (UID: \"b2c794da-4296-49a0-a9af-491db5c72a12\") " pod="openshift-image-registry/node-ca-bc6h9"
Sep 11 11:51:28.955478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955248    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-ovnkube-script-lib\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.955478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955281    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/56564e4d-52ec-47e2-912d-edfcd55412c2-iptables-alerter-script\") pod \"iptables-alerter-8svbc\" (UID: \"56564e4d-52ec-47e2-912d-edfcd55412c2\") " pod="openshift-network-operator/iptables-alerter-8svbc"
Sep 11 11:51:28.955478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955312    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/56521050-777d-4be5-8838-b87c6a819706-device-dir\") pod \"aws-ebs-csi-driver-node-2dt55\" (UID: \"56521050-777d-4be5-8838-b87c6a819706\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55"
Sep 11 11:51:28.955478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955337    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56564e4d-52ec-47e2-912d-edfcd55412c2-host-slash\") pod \"iptables-alerter-8svbc\" (UID: \"56564e4d-52ec-47e2-912d-edfcd55412c2\") " pod="openshift-network-operator/iptables-alerter-8svbc"
Sep 11 11:51:28.955478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955375    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.955478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955422    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65q5q\" (UniqueName: \"kubernetes.io/projected/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-kube-api-access-65q5q\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.955478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955453    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-host-slash\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.955952 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955497    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-var-lib-openvswitch\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.955952 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955523    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-run-openvswitch\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.955952 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955551    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2c794da-4296-49a0-a9af-491db5c72a12-host\") pod \"node-ca-bc6h9\" (UID: \"b2c794da-4296-49a0-a9af-491db5c72a12\") " pod="openshift-image-registry/node-ca-bc6h9"
Sep 11 11:51:28.955952 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955581    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-host-kubelet\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.955952 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955605    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-run-ovn\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.955952 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955631    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-node-log\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.955952 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955656    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-host-cni-netd\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.955952 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955683    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/307113f7-a015-4c41-a620-b5c2b90b3828-kubelet-config\") pod \"global-pull-secret-syncer-zdjj7\" (UID: \"307113f7-a015-4c41-a620-b5c2b90b3828\") " pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:28.955952 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955714    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/56521050-777d-4be5-8838-b87c6a819706-socket-dir\") pod \"aws-ebs-csi-driver-node-2dt55\" (UID: \"56521050-777d-4be5-8838-b87c6a819706\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55"
Sep 11 11:51:28.955952 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955739    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-host-run-ovn-kubernetes\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.955952 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955783    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-ovnkube-config\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.955952 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955822    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp2tj\" (UniqueName: \"kubernetes.io/projected/56521050-777d-4be5-8838-b87c6a819706-kube-api-access-sp2tj\") pod \"aws-ebs-csi-driver-node-2dt55\" (UID: \"56521050-777d-4be5-8838-b87c6a819706\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55"
Sep 11 11:51:28.955952 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955850    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/307113f7-a015-4c41-a620-b5c2b90b3828-dbus\") pod \"global-pull-secret-syncer-zdjj7\" (UID: \"307113f7-a015-4c41-a620-b5c2b90b3828\") " pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:28.955952 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/307113f7-a015-4c41-a620-b5c2b90b3828-original-pull-secret\") pod \"global-pull-secret-syncer-zdjj7\" (UID: \"307113f7-a015-4c41-a620-b5c2b90b3828\") " pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:28.955952 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955928    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/56521050-777d-4be5-8838-b87c6a819706-etc-selinux\") pod \"aws-ebs-csi-driver-node-2dt55\" (UID: \"56521050-777d-4be5-8838-b87c6a819706\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55"
Sep 11 11:51:28.955952 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955953    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-systemd-units\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.956789 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.955983    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/56521050-777d-4be5-8838-b87c6a819706-registration-dir\") pod \"aws-ebs-csi-driver-node-2dt55\" (UID: \"56521050-777d-4be5-8838-b87c6a819706\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55"
Sep 11 11:51:28.956789 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.956013    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-etc-openvswitch\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.956789 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.956048    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-host-run-netns\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.956789 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.956080    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b2c794da-4296-49a0-a9af-491db5c72a12-serviceca\") pod \"node-ca-bc6h9\" (UID: \"b2c794da-4296-49a0-a9af-491db5c72a12\") " pod="openshift-image-registry/node-ca-bc6h9"
Sep 11 11:51:28.956789 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.956106    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-log-socket\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.956789 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.956231    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-log-socket\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.956789 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.956310    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/56521050-777d-4be5-8838-b87c6a819706-sys-fs\") pod \"aws-ebs-csi-driver-node-2dt55\" (UID: \"56521050-777d-4be5-8838-b87c6a819706\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55"
Sep 11 11:51:28.956789 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.956354    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-run-systemd\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.956789 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.956408    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/56521050-777d-4be5-8838-b87c6a819706-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2dt55\" (UID: \"56521050-777d-4be5-8838-b87c6a819706\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55"
Sep 11 11:51:28.956789 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.956449    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-host-cni-bin\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.957304 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.956974    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-env-overrides\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.957421 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.957400    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-run-ovn\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.957761 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.957741    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-node-log\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.957863 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.957802    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-host-cni-netd\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.957932 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.957862    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/307113f7-a015-4c41-a620-b5c2b90b3828-kubelet-config\") pod \"global-pull-secret-syncer-zdjj7\" (UID: \"307113f7-a015-4c41-a620-b5c2b90b3828\") " pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:28.957992 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.957981    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/56521050-777d-4be5-8838-b87c6a819706-socket-dir\") pod \"aws-ebs-csi-driver-node-2dt55\" (UID: \"56521050-777d-4be5-8838-b87c6a819706\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55"
Sep 11 11:51:28.958060 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.958034    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-host-run-ovn-kubernetes\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.958625 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.958567    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-ovnkube-script-lib\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.958625 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.958586    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-ovnkube-config\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.958806 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.958684    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/56521050-777d-4be5-8838-b87c6a819706-device-dir\") pod \"aws-ebs-csi-driver-node-2dt55\" (UID: \"56521050-777d-4be5-8838-b87c6a819706\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55"
Sep 11 11:51:28.958806 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.958736    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56564e4d-52ec-47e2-912d-edfcd55412c2-host-slash\") pod \"iptables-alerter-8svbc\" (UID: \"56564e4d-52ec-47e2-912d-edfcd55412c2\") " pod="openshift-network-operator/iptables-alerter-8svbc"
Sep 11 11:51:28.958933 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.958803    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.958933 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.958893    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/307113f7-a015-4c41-a620-b5c2b90b3828-dbus\") pod \"global-pull-secret-syncer-zdjj7\" (UID: \"307113f7-a015-4c41-a620-b5c2b90b3828\") " pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:28.959051 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:28.958990    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 11:51:28.959051 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:28.959048    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/307113f7-a015-4c41-a620-b5c2b90b3828-original-pull-secret podName:307113f7-a015-4c41-a620-b5c2b90b3828 nodeName:}" failed. No retries permitted until 2026-09-11 11:51:29.459028016 +0000 UTC m=+3.141427501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/307113f7-a015-4c41-a620-b5c2b90b3828-original-pull-secret") pod "global-pull-secret-syncer-zdjj7" (UID: "307113f7-a015-4c41-a620-b5c2b90b3828") : object "kube-system"/"original-pull-secret" not registered
Sep 11 11:51:28.959175 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.959050    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-host-slash\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.959175 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.959101    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-var-lib-openvswitch\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.959175 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.959147    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-run-openvswitch\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.959349 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.959190    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2c794da-4296-49a0-a9af-491db5c72a12-host\") pod \"node-ca-bc6h9\" (UID: \"b2c794da-4296-49a0-a9af-491db5c72a12\") " pod="openshift-image-registry/node-ca-bc6h9"
Sep 11 11:51:28.959349 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.959234    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-host-kubelet\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.959349 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.959277    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-host-run-netns\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.959349 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.959305    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/56521050-777d-4be5-8838-b87c6a819706-etc-selinux\") pod \"aws-ebs-csi-driver-node-2dt55\" (UID: \"56521050-777d-4be5-8838-b87c6a819706\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55"
Sep 11 11:51:28.959349 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.959324    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-systemd-units\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.959614 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.959389    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/56521050-777d-4be5-8838-b87c6a819706-registration-dir\") pod \"aws-ebs-csi-driver-node-2dt55\" (UID: \"56521050-777d-4be5-8838-b87c6a819706\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55"
Sep 11 11:51:28.959614 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.959441    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-etc-openvswitch\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.960055 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.959789    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b2c794da-4296-49a0-a9af-491db5c72a12-serviceca\") pod \"node-ca-bc6h9\" (UID: \"b2c794da-4296-49a0-a9af-491db5c72a12\") " pod="openshift-image-registry/node-ca-bc6h9"
Sep 11 11:51:28.960055 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.959991    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/56564e4d-52ec-47e2-912d-edfcd55412c2-iptables-alerter-script\") pod \"iptables-alerter-8svbc\" (UID: \"56564e4d-52ec-47e2-912d-edfcd55412c2\") " pod="openshift-network-operator/iptables-alerter-8svbc"
Sep 11 11:51:28.960055 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.960047    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-ovn-node-metrics-cert\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:28.965144 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:28.965003    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 11:51:28.965144 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:28.965031    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 11:51:28.965144 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:28.965045    2565 projected.go:196] Error preparing data for projected volume kube-api-access-tctgg for pod openshift-network-diagnostics/network-check-target-tbtxm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:51:28.965373 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:28.965174    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ccf784d-5d83-482f-b3cf-00f1a976f4be-kube-api-access-tctgg podName:3ccf784d-5d83-482f-b3cf-00f1a976f4be nodeName:}" failed. No retries permitted until 2026-09-11 11:51:29.46508672 +0000 UTC m=+3.147486213 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tctgg" (UniqueName: "kubernetes.io/projected/3ccf784d-5d83-482f-b3cf-00f1a976f4be-kube-api-access-tctgg") pod "network-check-target-tbtxm" (UID: "3ccf784d-5d83-482f-b3cf-00f1a976f4be") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:51:28.968626 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.968443    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9927\" (UniqueName: \"kubernetes.io/projected/56564e4d-52ec-47e2-912d-edfcd55412c2-kube-api-access-z9927\") pod \"iptables-alerter-8svbc\" (UID: \"56564e4d-52ec-47e2-912d-edfcd55412c2\") " pod="openshift-network-operator/iptables-alerter-8svbc"
Sep 11 11:51:28.969396 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.969016    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k86xf\" (UniqueName: \"kubernetes.io/projected/b2c794da-4296-49a0-a9af-491db5c72a12-kube-api-access-k86xf\") pod \"node-ca-bc6h9\" (UID: \"b2c794da-4296-49a0-a9af-491db5c72a12\") " pod="openshift-image-registry/node-ca-bc6h9"
Sep 11 11:51:28.971399 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.971374    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp2tj\" (UniqueName: \"kubernetes.io/projected/56521050-777d-4be5-8838-b87c6a819706-kube-api-access-sp2tj\") pod \"aws-ebs-csi-driver-node-2dt55\" (UID: \"56521050-777d-4be5-8838-b87c6a819706\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55"
Sep 11 11:51:28.974148 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:28.974118    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65q5q\" (UniqueName: \"kubernetes.io/projected/2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b-kube-api-access-65q5q\") pod \"ovnkube-node-wzvlx\" (UID: \"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b\") " pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:29.032908 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:29.032872    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9pk4q"
Sep 11 11:51:29.043392 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:29.043358    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zc9s9"
Sep 11 11:51:29.051527 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:29.051501    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lzbk8"
Sep 11 11:51:29.057826 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:29.057797    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kp8l6"
Sep 11 11:51:29.065890 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:29.065865    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pztl2"
Sep 11 11:51:29.072856 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:29.072835    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:29.080831 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:29.080797    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55"
Sep 11 11:51:29.087832 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:29.087810    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bc6h9"
Sep 11 11:51:29.094720 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:29.094697    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8svbc"
Sep 11 11:51:29.359926 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:29.359842    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs\") pod \"network-metrics-daemon-jcs8z\" (UID: \"5b7c905b-ecae-4cbe-a5c2-3962ec391672\") " pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:51:29.360096 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:29.359973    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:51:29.360096 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:29.360043    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs podName:5b7c905b-ecae-4cbe-a5c2-3962ec391672 nodeName:}" failed. No retries permitted until 2026-09-11 11:51:30.36002355 +0000 UTC m=+4.042423033 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs") pod "network-metrics-daemon-jcs8z" (UID: "5b7c905b-ecae-4cbe-a5c2-3962ec391672") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:51:29.396295 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:29.396118    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d6b2252_3e4b_4fe6_b8f0_c90c3481f50b.slice/crio-e30c3e5af6cac5d0e4ec639bae4953abb1dca962a74ada7b8575e5c3d3f7c699 WatchSource:0}: Error finding container e30c3e5af6cac5d0e4ec639bae4953abb1dca962a74ada7b8575e5c3d3f7c699: Status 404 returned error can't find the container with id e30c3e5af6cac5d0e4ec639bae4953abb1dca962a74ada7b8575e5c3d3f7c699
Sep 11 11:51:29.397309 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:29.397227    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc741275_985d_42ea_b85c_11c3b6af7009.slice/crio-9dd2bf3bc7daada11ced04a5b37f634db59da6636c7888a01e1338126ed523fa WatchSource:0}: Error finding container 9dd2bf3bc7daada11ced04a5b37f634db59da6636c7888a01e1338126ed523fa: Status 404 returned error can't find the container with id 9dd2bf3bc7daada11ced04a5b37f634db59da6636c7888a01e1338126ed523fa
Sep 11 11:51:29.398310 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:29.398273    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af1845b_bb2b_4fc9_96f1_c8805e1d1d56.slice/crio-5a7ca2c77555383baa2abfecad32519563c449312265f0e45d180e6353c284a6 WatchSource:0}: Error finding container 5a7ca2c77555383baa2abfecad32519563c449312265f0e45d180e6353c284a6: Status 404 returned error can't find the container with id 5a7ca2c77555383baa2abfecad32519563c449312265f0e45d180e6353c284a6
Sep 11 11:51:29.403298 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:29.403265    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56564e4d_52ec_47e2_912d_edfcd55412c2.slice/crio-dfd979b86c41ca7b3b8ebe3f05911ec8f7cb40059fc7f78c7b988a6fb8e17c8d WatchSource:0}: Error finding container dfd979b86c41ca7b3b8ebe3f05911ec8f7cb40059fc7f78c7b988a6fb8e17c8d: Status 404 returned error can't find the container with id dfd979b86c41ca7b3b8ebe3f05911ec8f7cb40059fc7f78c7b988a6fb8e17c8d
Sep 11 11:51:29.404216 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:29.404190    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc353d851_ad50_4533_ba4a_af3d820e25d1.slice/crio-4029dc7ac9417225a59c7e9dbdab45b098de6121e85df220b31a1f3c59bb32ec WatchSource:0}: Error finding container 4029dc7ac9417225a59c7e9dbdab45b098de6121e85df220b31a1f3c59bb32ec: Status 404 returned error can't find the container with id 4029dc7ac9417225a59c7e9dbdab45b098de6121e85df220b31a1f3c59bb32ec
Sep 11 11:51:29.405290 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:29.405259    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56521050_777d_4be5_8838_b87c6a819706.slice/crio-3d3c0a72b3464551908a6d0096ecbb291a0e4e618c56dc3d0741510a17ced955 WatchSource:0}: Error finding container 3d3c0a72b3464551908a6d0096ecbb291a0e4e618c56dc3d0741510a17ced955: Status 404 returned error can't find the container with id 3d3c0a72b3464551908a6d0096ecbb291a0e4e618c56dc3d0741510a17ced955
Sep 11 11:51:29.428278 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:29.428252    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfebd292_13d0_45a0_bd2c_836e0f4aed14.slice/crio-917ee9c602cc7a3226f135f56c7d64700fbfca6edd2aa99f3a2f18056eb9e5ed WatchSource:0}: Error finding container 917ee9c602cc7a3226f135f56c7d64700fbfca6edd2aa99f3a2f18056eb9e5ed: Status 404 returned error can't find the container with id 917ee9c602cc7a3226f135f56c7d64700fbfca6edd2aa99f3a2f18056eb9e5ed
Sep 11 11:51:29.429910 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:29.429861    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod947d0f48_7790_4364_acbe_15b44a71f937.slice/crio-e89bd96a1d275f793e69c57e7c3308a8dcfaf6652541faaf576b68aba2fb794e WatchSource:0}: Error finding container e89bd96a1d275f793e69c57e7c3308a8dcfaf6652541faaf576b68aba2fb794e: Status 404 returned error can't find the container with id e89bd96a1d275f793e69c57e7c3308a8dcfaf6652541faaf576b68aba2fb794e
Sep 11 11:51:29.430565 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:51:29.430445    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2c794da_4296_49a0_a9af_491db5c72a12.slice/crio-1494f1cb8d5d79e7d4af1e2d0bc0e3ee456dbf5cef361a35deeadb3375fc6a4e WatchSource:0}: Error finding container 1494f1cb8d5d79e7d4af1e2d0bc0e3ee456dbf5cef361a35deeadb3375fc6a4e: Status 404 returned error can't find the container with id 1494f1cb8d5d79e7d4af1e2d0bc0e3ee456dbf5cef361a35deeadb3375fc6a4e
Sep 11 11:51:29.461000 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:29.460966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/307113f7-a015-4c41-a620-b5c2b90b3828-original-pull-secret\") pod \"global-pull-secret-syncer-zdjj7\" (UID: \"307113f7-a015-4c41-a620-b5c2b90b3828\") " pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:29.461120 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:29.461090    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 11:51:29.461195 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:29.461152    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/307113f7-a015-4c41-a620-b5c2b90b3828-original-pull-secret podName:307113f7-a015-4c41-a620-b5c2b90b3828 nodeName:}" failed. No retries permitted until 2026-09-11 11:51:30.46113274 +0000 UTC m=+4.143532221 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/307113f7-a015-4c41-a620-b5c2b90b3828-original-pull-secret") pod "global-pull-secret-syncer-zdjj7" (UID: "307113f7-a015-4c41-a620-b5c2b90b3828") : object "kube-system"/"original-pull-secret" not registered
Sep 11 11:51:29.561315 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:29.561283    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tctgg\" (UniqueName: \"kubernetes.io/projected/3ccf784d-5d83-482f-b3cf-00f1a976f4be-kube-api-access-tctgg\") pod \"network-check-target-tbtxm\" (UID: \"3ccf784d-5d83-482f-b3cf-00f1a976f4be\") " pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:51:29.561492 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:29.561458    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 11:51:29.561492 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:29.561478    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 11:51:29.561492 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:29.561489    2565 projected.go:196] Error preparing data for projected volume kube-api-access-tctgg for pod openshift-network-diagnostics/network-check-target-tbtxm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:51:29.561630 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:29.561559    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ccf784d-5d83-482f-b3cf-00f1a976f4be-kube-api-access-tctgg podName:3ccf784d-5d83-482f-b3cf-00f1a976f4be nodeName:}" failed. No retries permitted until 2026-09-11 11:51:30.56153867 +0000 UTC m=+4.243938148 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tctgg" (UniqueName: "kubernetes.io/projected/3ccf784d-5d83-482f-b3cf-00f1a976f4be-kube-api-access-tctgg") pod "network-check-target-tbtxm" (UID: "3ccf784d-5d83-482f-b3cf-00f1a976f4be") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:51:29.780939 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:29.780900    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 11:46:29 +0000 UTC" deadline="2028-06-07 15:13:08.152407196 +0000 UTC"
Sep 11 11:51:29.780939 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:29.780933    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15243h21m38.371477735s"
Sep 11 11:51:29.850536 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:29.849710    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bc6h9" event={"ID":"b2c794da-4296-49a0-a9af-491db5c72a12","Type":"ContainerStarted","Data":"1494f1cb8d5d79e7d4af1e2d0bc0e3ee456dbf5cef361a35deeadb3375fc6a4e"}
Sep 11 11:51:29.853745 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:29.853708    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8svbc" event={"ID":"56564e4d-52ec-47e2-912d-edfcd55412c2","Type":"ContainerStarted","Data":"dfd979b86c41ca7b3b8ebe3f05911ec8f7cb40059fc7f78c7b988a6fb8e17c8d"}
Sep 11 11:51:29.855301 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:29.855208    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx" event={"ID":"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b","Type":"ContainerStarted","Data":"e30c3e5af6cac5d0e4ec639bae4953abb1dca962a74ada7b8575e5c3d3f7c699"}
Sep 11 11:51:29.856673 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:29.856649    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pztl2" event={"ID":"bfebd292-13d0-45a0-bd2c-836e0f4aed14","Type":"ContainerStarted","Data":"917ee9c602cc7a3226f135f56c7d64700fbfca6edd2aa99f3a2f18056eb9e5ed"}
Sep 11 11:51:29.858043 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:29.857987    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9pk4q" event={"ID":"c353d851-ad50-4533-ba4a-af3d820e25d1","Type":"ContainerStarted","Data":"4029dc7ac9417225a59c7e9dbdab45b098de6121e85df220b31a1f3c59bb32ec"}
Sep 11 11:51:29.859327 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:29.859307    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55" event={"ID":"56521050-777d-4be5-8838-b87c6a819706","Type":"ContainerStarted","Data":"3d3c0a72b3464551908a6d0096ecbb291a0e4e618c56dc3d0741510a17ced955"}
Sep 11 11:51:29.860769 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:29.860743    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kp8l6" event={"ID":"dc741275-985d-42ea-b85c-11c3b6af7009","Type":"ContainerStarted","Data":"9dd2bf3bc7daada11ced04a5b37f634db59da6636c7888a01e1338126ed523fa"}
Sep 11 11:51:29.862073 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:29.862048    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zc9s9" event={"ID":"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56","Type":"ContainerStarted","Data":"5a7ca2c77555383baa2abfecad32519563c449312265f0e45d180e6353c284a6"}
Sep 11 11:51:29.863369 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:29.863346    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lzbk8" event={"ID":"947d0f48-7790-4364-acbe-15b44a71f937","Type":"ContainerStarted","Data":"e89bd96a1d275f793e69c57e7c3308a8dcfaf6652541faaf576b68aba2fb794e"}
Sep 11 11:51:30.369234 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:30.369202    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs\") pod \"network-metrics-daemon-jcs8z\" (UID: \"5b7c905b-ecae-4cbe-a5c2-3962ec391672\") " pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:51:30.369371 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:30.369325    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:51:30.369434 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:30.369388    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs podName:5b7c905b-ecae-4cbe-a5c2-3962ec391672 nodeName:}" failed. No retries permitted until 2026-09-11 11:51:32.369370874 +0000 UTC m=+6.051770367 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs") pod "network-metrics-daemon-jcs8z" (UID: "5b7c905b-ecae-4cbe-a5c2-3962ec391672") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:51:30.470751 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:30.470694    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/307113f7-a015-4c41-a620-b5c2b90b3828-original-pull-secret\") pod \"global-pull-secret-syncer-zdjj7\" (UID: \"307113f7-a015-4c41-a620-b5c2b90b3828\") " pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:30.470954 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:30.470890    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 11:51:30.471023 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:30.470963    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/307113f7-a015-4c41-a620-b5c2b90b3828-original-pull-secret podName:307113f7-a015-4c41-a620-b5c2b90b3828 nodeName:}" failed. No retries permitted until 2026-09-11 11:51:32.470944392 +0000 UTC m=+6.153343884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/307113f7-a015-4c41-a620-b5c2b90b3828-original-pull-secret") pod "global-pull-secret-syncer-zdjj7" (UID: "307113f7-a015-4c41-a620-b5c2b90b3828") : object "kube-system"/"original-pull-secret" not registered
Sep 11 11:51:30.571861 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:30.571762    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tctgg\" (UniqueName: \"kubernetes.io/projected/3ccf784d-5d83-482f-b3cf-00f1a976f4be-kube-api-access-tctgg\") pod \"network-check-target-tbtxm\" (UID: \"3ccf784d-5d83-482f-b3cf-00f1a976f4be\") " pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:51:30.572027 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:30.571980    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 11:51:30.572027 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:30.572000    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 11:51:30.572027 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:30.572015    2565 projected.go:196] Error preparing data for projected volume kube-api-access-tctgg for pod openshift-network-diagnostics/network-check-target-tbtxm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:51:30.572192 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:30.572074    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ccf784d-5d83-482f-b3cf-00f1a976f4be-kube-api-access-tctgg podName:3ccf784d-5d83-482f-b3cf-00f1a976f4be nodeName:}" failed. No retries permitted until 2026-09-11 11:51:32.572056316 +0000 UTC m=+6.254455798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tctgg" (UniqueName: "kubernetes.io/projected/3ccf784d-5d83-482f-b3cf-00f1a976f4be-kube-api-access-tctgg") pod "network-check-target-tbtxm" (UID: "3ccf784d-5d83-482f-b3cf-00f1a976f4be") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:51:30.781383 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:30.781284    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 11:46:29 +0000 UTC" deadline="2028-05-29 09:57:58.272556302 +0000 UTC"
Sep 11 11:51:30.781383 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:30.781351    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15022h6m27.491210546s"
Sep 11 11:51:30.837767 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:30.836427    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:51:30.837767 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:30.836585    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcs8z" podUID="5b7c905b-ecae-4cbe-a5c2-3962ec391672"
Sep 11 11:51:30.837767 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:30.836887    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:30.837767 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:30.836990    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjj7" podUID="307113f7-a015-4c41-a620-b5c2b90b3828"
Sep 11 11:51:30.837767 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:30.837070    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:51:30.837767 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:30.837151    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tbtxm" podUID="3ccf784d-5d83-482f-b3cf-00f1a976f4be"
Sep 11 11:51:30.876366 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:30.876330    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-111.ec2.internal" event={"ID":"c78744bb1b8d7ee618cc9c33e60a9eea","Type":"ContainerStarted","Data":"2a3614b65357375dd0b232f48b4429b2ecc812aa7936ea4730b6d6ca78777668"}
Sep 11 11:51:30.881276 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:30.881243    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-111.ec2.internal" event={"ID":"651d7bae19c1e9349170a4babadaa923","Type":"ContainerStarted","Data":"c7e35936a0354e558320bbd8d7b80981b38b9d8d754e633f22966ad7441c25c2"}
Sep 11 11:51:30.908197 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:30.908113    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-111.ec2.internal" podStartSLOduration=1.908092218 podStartE2EDuration="1.908092218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 11:51:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:51:30.892864492 +0000 UTC m=+4.575263996" watchObservedRunningTime="2026-09-11 11:51:30.908092218 +0000 UTC m=+4.590491711"
Sep 11 11:51:32.385957 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:32.385911    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs\") pod \"network-metrics-daemon-jcs8z\" (UID: \"5b7c905b-ecae-4cbe-a5c2-3962ec391672\") " pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:51:32.386452 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:32.386132    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:51:32.386452 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:32.386204    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs podName:5b7c905b-ecae-4cbe-a5c2-3962ec391672 nodeName:}" failed. No retries permitted until 2026-09-11 11:51:36.386185662 +0000 UTC m=+10.068585145 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs") pod "network-metrics-daemon-jcs8z" (UID: "5b7c905b-ecae-4cbe-a5c2-3962ec391672") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:51:32.486615 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:32.486574    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/307113f7-a015-4c41-a620-b5c2b90b3828-original-pull-secret\") pod \"global-pull-secret-syncer-zdjj7\" (UID: \"307113f7-a015-4c41-a620-b5c2b90b3828\") " pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:32.486828 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:32.486804    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 11:51:32.486912 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:32.486885    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/307113f7-a015-4c41-a620-b5c2b90b3828-original-pull-secret podName:307113f7-a015-4c41-a620-b5c2b90b3828 nodeName:}" failed. No retries permitted until 2026-09-11 11:51:36.48686308 +0000 UTC m=+10.169262565 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/307113f7-a015-4c41-a620-b5c2b90b3828-original-pull-secret") pod "global-pull-secret-syncer-zdjj7" (UID: "307113f7-a015-4c41-a620-b5c2b90b3828") : object "kube-system"/"original-pull-secret" not registered
Sep 11 11:51:32.588104 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:32.588014    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tctgg\" (UniqueName: \"kubernetes.io/projected/3ccf784d-5d83-482f-b3cf-00f1a976f4be-kube-api-access-tctgg\") pod \"network-check-target-tbtxm\" (UID: \"3ccf784d-5d83-482f-b3cf-00f1a976f4be\") " pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:51:32.588272 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:32.588184    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 11:51:32.588272 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:32.588205    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 11:51:32.588272 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:32.588219    2565 projected.go:196] Error preparing data for projected volume kube-api-access-tctgg for pod openshift-network-diagnostics/network-check-target-tbtxm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:51:32.588432 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:32.588277    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ccf784d-5d83-482f-b3cf-00f1a976f4be-kube-api-access-tctgg podName:3ccf784d-5d83-482f-b3cf-00f1a976f4be nodeName:}" failed. No retries permitted until 2026-09-11 11:51:36.588258467 +0000 UTC m=+10.270657950 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tctgg" (UniqueName: "kubernetes.io/projected/3ccf784d-5d83-482f-b3cf-00f1a976f4be-kube-api-access-tctgg") pod "network-check-target-tbtxm" (UID: "3ccf784d-5d83-482f-b3cf-00f1a976f4be") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:51:32.836910 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:32.836849    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:32.837096 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:32.836995    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjj7" podUID="307113f7-a015-4c41-a620-b5c2b90b3828"
Sep 11 11:51:32.837447 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:32.837421    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:51:32.837553 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:32.837534    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcs8z" podUID="5b7c905b-ecae-4cbe-a5c2-3962ec391672"
Sep 11 11:51:32.837719 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:32.837669    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:51:32.837848 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:32.837806    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tbtxm" podUID="3ccf784d-5d83-482f-b3cf-00f1a976f4be"
Sep 11 11:51:32.888986 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:32.888956    2565 generic.go:356] "Generic (PLEG): container finished" podID="651d7bae19c1e9349170a4babadaa923" containerID="c7e35936a0354e558320bbd8d7b80981b38b9d8d754e633f22966ad7441c25c2" exitCode=0
Sep 11 11:51:32.889166 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:32.889003    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-111.ec2.internal" event={"ID":"651d7bae19c1e9349170a4babadaa923","Type":"ContainerDied","Data":"c7e35936a0354e558320bbd8d7b80981b38b9d8d754e633f22966ad7441c25c2"}
Sep 11 11:51:34.837899 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:34.837862    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:51:34.838413 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:34.838001    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tbtxm" podUID="3ccf784d-5d83-482f-b3cf-00f1a976f4be"
Sep 11 11:51:34.838413 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:34.838393    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:34.838579 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:34.838500    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjj7" podUID="307113f7-a015-4c41-a620-b5c2b90b3828"
Sep 11 11:51:34.838579 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:34.838563    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:51:34.838682 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:34.838649    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcs8z" podUID="5b7c905b-ecae-4cbe-a5c2-3962ec391672"
Sep 11 11:51:36.422313 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:36.422084    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs\") pod \"network-metrics-daemon-jcs8z\" (UID: \"5b7c905b-ecae-4cbe-a5c2-3962ec391672\") " pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:51:36.422313 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:36.422311    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:51:36.423024 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:36.422384    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs podName:5b7c905b-ecae-4cbe-a5c2-3962ec391672 nodeName:}" failed. No retries permitted until 2026-09-11 11:51:44.422365344 +0000 UTC m=+18.104764822 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs") pod "network-metrics-daemon-jcs8z" (UID: "5b7c905b-ecae-4cbe-a5c2-3962ec391672") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:51:36.522675 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:36.522632    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/307113f7-a015-4c41-a620-b5c2b90b3828-original-pull-secret\") pod \"global-pull-secret-syncer-zdjj7\" (UID: \"307113f7-a015-4c41-a620-b5c2b90b3828\") " pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:36.522924 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:36.522877    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 11:51:36.522998 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:36.522958    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/307113f7-a015-4c41-a620-b5c2b90b3828-original-pull-secret podName:307113f7-a015-4c41-a620-b5c2b90b3828 nodeName:}" failed. No retries permitted until 2026-09-11 11:51:44.522936156 +0000 UTC m=+18.205335634 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/307113f7-a015-4c41-a620-b5c2b90b3828-original-pull-secret") pod "global-pull-secret-syncer-zdjj7" (UID: "307113f7-a015-4c41-a620-b5c2b90b3828") : object "kube-system"/"original-pull-secret" not registered
Sep 11 11:51:36.623505 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:36.623460    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tctgg\" (UniqueName: \"kubernetes.io/projected/3ccf784d-5d83-482f-b3cf-00f1a976f4be-kube-api-access-tctgg\") pod \"network-check-target-tbtxm\" (UID: \"3ccf784d-5d83-482f-b3cf-00f1a976f4be\") " pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:51:36.623789 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:36.623633    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 11:51:36.623789 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:36.623652    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 11:51:36.623789 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:36.623665    2565 projected.go:196] Error preparing data for projected volume kube-api-access-tctgg for pod openshift-network-diagnostics/network-check-target-tbtxm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:51:36.623789 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:36.623748    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ccf784d-5d83-482f-b3cf-00f1a976f4be-kube-api-access-tctgg podName:3ccf784d-5d83-482f-b3cf-00f1a976f4be nodeName:}" failed. No retries permitted until 2026-09-11 11:51:44.623713757 +0000 UTC m=+18.306113235 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tctgg" (UniqueName: "kubernetes.io/projected/3ccf784d-5d83-482f-b3cf-00f1a976f4be-kube-api-access-tctgg") pod "network-check-target-tbtxm" (UID: "3ccf784d-5d83-482f-b3cf-00f1a976f4be") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:51:36.836505 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:36.836422    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:36.836505 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:36.836460    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:51:36.836732 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:36.836425    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:51:36.836732 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:36.836565    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjj7" podUID="307113f7-a015-4c41-a620-b5c2b90b3828"
Sep 11 11:51:36.837927 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:36.837896    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tbtxm" podUID="3ccf784d-5d83-482f-b3cf-00f1a976f4be"
Sep 11 11:51:36.838052 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:36.838018    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcs8z" podUID="5b7c905b-ecae-4cbe-a5c2-3962ec391672"
Sep 11 11:51:38.836761 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:38.836647    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:38.837278 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:38.836803    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjj7" podUID="307113f7-a015-4c41-a620-b5c2b90b3828"
Sep 11 11:51:38.837278 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:38.836952    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:51:38.837278 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:38.837027    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:51:38.837278 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:38.837138    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tbtxm" podUID="3ccf784d-5d83-482f-b3cf-00f1a976f4be"
Sep 11 11:51:38.837278 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:38.837200    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcs8z" podUID="5b7c905b-ecae-4cbe-a5c2-3962ec391672"
Sep 11 11:51:40.835827 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:40.835793    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:51:40.835827 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:40.835829    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:40.836332 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:40.835791    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:51:40.836332 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:40.835918    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tbtxm" podUID="3ccf784d-5d83-482f-b3cf-00f1a976f4be"
Sep 11 11:51:40.836332 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:40.836014    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjj7" podUID="307113f7-a015-4c41-a620-b5c2b90b3828"
Sep 11 11:51:40.836332 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:40.836131    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcs8z" podUID="5b7c905b-ecae-4cbe-a5c2-3962ec391672"
Sep 11 11:51:42.839171 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:42.839142    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:42.839626 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:42.839142    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:51:42.839626 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:42.839261    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjj7" podUID="307113f7-a015-4c41-a620-b5c2b90b3828"
Sep 11 11:51:42.839626 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:42.839142    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:51:42.839626 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:42.839379    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcs8z" podUID="5b7c905b-ecae-4cbe-a5c2-3962ec391672"
Sep 11 11:51:42.839626 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:42.839406    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tbtxm" podUID="3ccf784d-5d83-482f-b3cf-00f1a976f4be"
Sep 11 11:51:44.483483 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:44.483450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs\") pod \"network-metrics-daemon-jcs8z\" (UID: \"5b7c905b-ecae-4cbe-a5c2-3962ec391672\") " pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:51:44.483982 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:44.483608    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:51:44.483982 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:44.483679    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs podName:5b7c905b-ecae-4cbe-a5c2-3962ec391672 nodeName:}" failed. No retries permitted until 2026-09-11 11:52:00.483660698 +0000 UTC m=+34.166060180 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs") pod "network-metrics-daemon-jcs8z" (UID: "5b7c905b-ecae-4cbe-a5c2-3962ec391672") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:51:44.584302 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:44.584270    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/307113f7-a015-4c41-a620-b5c2b90b3828-original-pull-secret\") pod \"global-pull-secret-syncer-zdjj7\" (UID: \"307113f7-a015-4c41-a620-b5c2b90b3828\") " pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:44.584496 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:44.584437    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 11:51:44.584559 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:44.584510    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/307113f7-a015-4c41-a620-b5c2b90b3828-original-pull-secret podName:307113f7-a015-4c41-a620-b5c2b90b3828 nodeName:}" failed. No retries permitted until 2026-09-11 11:52:00.584489659 +0000 UTC m=+34.266889156 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/307113f7-a015-4c41-a620-b5c2b90b3828-original-pull-secret") pod "global-pull-secret-syncer-zdjj7" (UID: "307113f7-a015-4c41-a620-b5c2b90b3828") : object "kube-system"/"original-pull-secret" not registered
Sep 11 11:51:44.685328 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:44.685294    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tctgg\" (UniqueName: \"kubernetes.io/projected/3ccf784d-5d83-482f-b3cf-00f1a976f4be-kube-api-access-tctgg\") pod \"network-check-target-tbtxm\" (UID: \"3ccf784d-5d83-482f-b3cf-00f1a976f4be\") " pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:51:44.685485 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:44.685458    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 11:51:44.685564 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:44.685488    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 11:51:44.685564 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:44.685503    2565 projected.go:196] Error preparing data for projected volume kube-api-access-tctgg for pod openshift-network-diagnostics/network-check-target-tbtxm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:51:44.685564 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:44.685563    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ccf784d-5d83-482f-b3cf-00f1a976f4be-kube-api-access-tctgg podName:3ccf784d-5d83-482f-b3cf-00f1a976f4be nodeName:}" failed. No retries permitted until 2026-09-11 11:52:00.68554484 +0000 UTC m=+34.367944330 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tctgg" (UniqueName: "kubernetes.io/projected/3ccf784d-5d83-482f-b3cf-00f1a976f4be-kube-api-access-tctgg") pod "network-check-target-tbtxm" (UID: "3ccf784d-5d83-482f-b3cf-00f1a976f4be") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:51:44.836537 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:44.836460    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:51:44.836537 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:44.836495    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:51:44.836537 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:44.836460    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:44.836825 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:44.836599    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tbtxm" podUID="3ccf784d-5d83-482f-b3cf-00f1a976f4be"
Sep 11 11:51:44.836825 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:44.836676    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcs8z" podUID="5b7c905b-ecae-4cbe-a5c2-3962ec391672"
Sep 11 11:51:44.836825 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:44.836774    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjj7" podUID="307113f7-a015-4c41-a620-b5c2b90b3828"
Sep 11 11:51:46.837018 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:46.836985    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:46.837444 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:46.837127    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjj7" podUID="307113f7-a015-4c41-a620-b5c2b90b3828"
Sep 11 11:51:46.837444 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:46.837201    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:51:46.837444 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:46.837285    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tbtxm" podUID="3ccf784d-5d83-482f-b3cf-00f1a976f4be"
Sep 11 11:51:46.837444 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:46.837313    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:51:46.837444 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:46.837383    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcs8z" podUID="5b7c905b-ecae-4cbe-a5c2-3962ec391672"
Sep 11 11:51:47.920784 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:47.920452    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-111.ec2.internal" event={"ID":"651d7bae19c1e9349170a4babadaa923","Type":"ContainerStarted","Data":"af3808be12daed323a94bbec82ffcc5127219d37824b25e31bd221dd90d3c4c4"}
Sep 11 11:51:47.921901 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:47.921881    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lzbk8" event={"ID":"947d0f48-7790-4364-acbe-15b44a71f937","Type":"ContainerStarted","Data":"faacc098ffadf25c8839917f0bdd8faae81f815a6728829af33da84af5bc26d4"}
Sep 11 11:51:47.923188 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:47.923168    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bc6h9" event={"ID":"b2c794da-4296-49a0-a9af-491db5c72a12","Type":"ContainerStarted","Data":"b6a7ffca1fed1b3d4812bd7b45c43299b43f5986fff5615530ae6f2a00a69d19"}
Sep 11 11:51:47.925113 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:47.925094    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wzvlx_2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b/ovn-acl-logging/0.log"
Sep 11 11:51:47.925424 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:47.925405    2565 generic.go:356] "Generic (PLEG): container finished" podID="2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b" containerID="24bc3ca319b4bb7fbeb6baa5f92df712be131052b77abb84a60ba698be189fdd" exitCode=1
Sep 11 11:51:47.925486 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:47.925461    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx" event={"ID":"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b","Type":"ContainerStarted","Data":"457357ecfaaaaf296d185eaf0c0036d7ac92727e05acd0649da136a40901e9e7"}
Sep 11 11:51:47.925590 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:47.925516    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx" event={"ID":"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b","Type":"ContainerDied","Data":"24bc3ca319b4bb7fbeb6baa5f92df712be131052b77abb84a60ba698be189fdd"}
Sep 11 11:51:47.925590 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:47.925563    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx" event={"ID":"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b","Type":"ContainerStarted","Data":"e6f18f1f7bc61c2bb94f3b90cb28ec0bb8d27308531a897e17dc07868dba0b04"}
Sep 11 11:51:47.926776 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:47.926750    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pztl2" event={"ID":"bfebd292-13d0-45a0-bd2c-836e0f4aed14","Type":"ContainerStarted","Data":"13ec5f6437a2c9ecb19415c8b386f442f6eef353adc8b0dbf7542a344569d870"}
Sep 11 11:51:47.928153 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:47.928133    2565 generic.go:356] "Generic (PLEG): container finished" podID="c353d851-ad50-4533-ba4a-af3d820e25d1" containerID="2006ddee4f2be5be6a022d7d98e9597c568348915bd49206901d59c7ca6b5aa5" exitCode=0
Sep 11 11:51:47.928213 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:47.928158    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9pk4q" event={"ID":"c353d851-ad50-4533-ba4a-af3d820e25d1","Type":"ContainerDied","Data":"2006ddee4f2be5be6a022d7d98e9597c568348915bd49206901d59c7ca6b5aa5"}
Sep 11 11:51:47.932549 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:47.932527    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55" event={"ID":"56521050-777d-4be5-8838-b87c6a819706","Type":"ContainerStarted","Data":"8d6f8fba9872874d4cc87b585c9815aef81d7798e17a1fe10d720303c3511fe0"}
Sep 11 11:51:47.933915 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:47.933893    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kp8l6" event={"ID":"dc741275-985d-42ea-b85c-11c3b6af7009","Type":"ContainerStarted","Data":"3d3518570fcddb7f4f9a4a2ab0f16ce2082e8f399b7d09ab9e438804478ac685"}
Sep 11 11:51:47.934599 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:47.934566    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-111.ec2.internal" podStartSLOduration=18.934555136 podStartE2EDuration="18.934555136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 11:51:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:51:47.93413896 +0000 UTC m=+21.616538460" watchObservedRunningTime="2026-09-11 11:51:47.934555136 +0000 UTC m=+21.616954634"
Sep 11 11:51:47.946918 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:47.946855    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lzbk8" podStartSLOduration=6.565183681 podStartE2EDuration="20.946843518s" totalImagesPullingTime="14.381659837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:51:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:51:47.946402556 +0000 UTC m=+21.628802053" watchObservedRunningTime="2026-09-11 11:51:47.946843518 +0000 UTC m=+21.629243015"
Sep 11 11:51:47.961626 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:47.961590    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pztl2" podStartSLOduration=2.9150162059999998 podStartE2EDuration="20.961577981s" totalImagesPullingTime="18.046561775s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 11:51:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:51:47.96121012 +0000 UTC m=+21.643609617" watchObservedRunningTime="2026-09-11 11:51:47.961577981 +0000 UTC m=+21.643977479"
Sep 11 11:51:47.974083 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:47.974047    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bc6h9" podStartSLOduration=1.966507016 podStartE2EDuration="19.974034262s" totalImagesPullingTime="18.007527246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 11:51:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:51:47.973647383 +0000 UTC m=+21.656046883" watchObservedRunningTime="2026-09-11 11:51:47.974034262 +0000 UTC m=+21.656433786"
Sep 11 11:51:48.018763 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:48.018724    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kp8l6" podStartSLOduration=2.945274809 podStartE2EDuration="21.018708967s" totalImagesPullingTime="18.073434158s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 11:51:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:51:48.018508026 +0000 UTC m=+21.700907524" watchObservedRunningTime="2026-09-11 11:51:48.018708967 +0000 UTC m=+21.701108464"
Sep 11 11:51:48.836478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:48.836419    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:51:48.836703 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:48.836426    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:51:48.836703 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:48.836541    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tbtxm" podUID="3ccf784d-5d83-482f-b3cf-00f1a976f4be"
Sep 11 11:51:48.836703 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:48.836651    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcs8z" podUID="5b7c905b-ecae-4cbe-a5c2-3962ec391672"
Sep 11 11:51:48.836703 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:48.836436    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:48.836924 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:48.836760    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjj7" podUID="307113f7-a015-4c41-a620-b5c2b90b3828"
Sep 11 11:51:48.939337 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:48.938778    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zc9s9" event={"ID":"2af1845b-bb2b-4fc9-96f1-c8805e1d1d56","Type":"ContainerStarted","Data":"efc927f81c3a52173a380f62d0ee921b7c6605d304bb977fa4187c5ac562c4db"}
Sep 11 11:51:48.940832 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:48.940804    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8svbc" event={"ID":"56564e4d-52ec-47e2-912d-edfcd55412c2","Type":"ContainerStarted","Data":"898f6430036220827da4b43baaef0ae4cf99a51801dee8472c5a0e848607f8dc"}
Sep 11 11:51:48.944542 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:48.944518    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wzvlx_2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b/ovn-acl-logging/0.log"
Sep 11 11:51:48.945039 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:48.945009    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx" event={"ID":"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b","Type":"ContainerStarted","Data":"14c62c27dbe4fdd43f5831031ccc9ff6a4b0c74542e5f14bb4896e046fe4400d"}
Sep 11 11:51:48.945168 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:48.945090    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx" event={"ID":"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b","Type":"ContainerStarted","Data":"904d8db9cc1791a723b5f3c31462f4a4df36e0c1439bfa0bf86788a56ec7492e"}
Sep 11 11:51:48.945168 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:48.945144    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx" event={"ID":"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b","Type":"ContainerStarted","Data":"e53b317a00237f712f0dcac21f5130296c44f85fe4ab8108ee353d22a19497a7"}
Sep 11 11:51:48.954414 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:48.954364    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zc9s9" podStartSLOduration=3.303400865 podStartE2EDuration="21.954346253s" totalImagesPullingTime="18.650945388s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 11:51:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:51:48.95429022 +0000 UTC m=+22.636689718" watchObservedRunningTime="2026-09-11 11:51:48.954346253 +0000 UTC m=+22.636745753"
Sep 11 11:51:49.272653 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:49.272621    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 11:51:49.802158 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:49.802051    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T11:51:49.272645543Z","UUID":"ce7b6096-4c0c-4269-bf4d-81b0f32793a1","Handler":null,"Name":"","Endpoint":""}
Sep 11 11:51:49.803920 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:49.803897    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 11:51:49.804056 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:49.803934    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 11:51:49.950200 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:49.949986    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55" event={"ID":"56521050-777d-4be5-8838-b87c6a819706","Type":"ContainerStarted","Data":"4fa45357804e315aa2b2e106231e30378eff835d5096f7ebd575c226100278ac"}
Sep 11 11:51:50.839741 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:50.839641    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:51:50.839741 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:50.839670    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:51:50.839741 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:50.839695    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:50.839993 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:50.839797    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcs8z" podUID="5b7c905b-ecae-4cbe-a5c2-3962ec391672"
Sep 11 11:51:50.839993 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:50.839852    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tbtxm" podUID="3ccf784d-5d83-482f-b3cf-00f1a976f4be"
Sep 11 11:51:50.839993 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:50.839908    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjj7" podUID="307113f7-a015-4c41-a620-b5c2b90b3828"
Sep 11 11:51:50.955989 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:50.955965    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wzvlx_2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b/ovn-acl-logging/0.log"
Sep 11 11:51:50.956457 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:50.956410    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx" event={"ID":"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b","Type":"ContainerStarted","Data":"b718f302e5bfba52da8b99d5a2494cee4ade7a55bb9fb3e97161a86aa966cbfa"}
Sep 11 11:51:51.780015 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:51.779980    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lzbk8"
Sep 11 11:51:51.780633 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:51.780602    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lzbk8"
Sep 11 11:51:51.794226 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:51.794185    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8svbc" podStartSLOduration=5.754544916 podStartE2EDuration="23.794167474s" totalImagesPullingTime="18.039622558s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 11:51:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:51:48.967558036 +0000 UTC m=+22.649957536" watchObservedRunningTime="2026-09-11 11:51:51.794167474 +0000 UTC m=+25.476566972"
Sep 11 11:51:51.959025 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:51.958998    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lzbk8"
Sep 11 11:51:51.959518 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:51.959501    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lzbk8"
Sep 11 11:51:52.836428 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:52.836206    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:51:52.836598 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:52.836202    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:52.836598 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:52.836465    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcs8z" podUID="5b7c905b-ecae-4cbe-a5c2-3962ec391672"
Sep 11 11:51:52.836598 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:52.836252    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:51:52.836598 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:52.836554    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjj7" podUID="307113f7-a015-4c41-a620-b5c2b90b3828"
Sep 11 11:51:52.836835 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:52.836610    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tbtxm" podUID="3ccf784d-5d83-482f-b3cf-00f1a976f4be"
Sep 11 11:51:52.964176 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:52.964150    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wzvlx_2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b/ovn-acl-logging/0.log"
Sep 11 11:51:52.964553 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:52.964520    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx" event={"ID":"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b","Type":"ContainerStarted","Data":"b997a307b706d81f6a49897070d51d7c3b1419b00957f4fe289db0da53f25172"}
Sep 11 11:51:52.964774 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:52.964745    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:52.964860 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:52.964815    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:52.964912 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:52.964865    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:52.964982 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:52.964968    2565 scope.go:117] "RemoveContainer" containerID="24bc3ca319b4bb7fbeb6baa5f92df712be131052b77abb84a60ba698be189fdd"
Sep 11 11:51:52.966961 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:52.966940    2565 generic.go:356] "Generic (PLEG): container finished" podID="c353d851-ad50-4533-ba4a-af3d820e25d1" containerID="ba480756f5b1ec656370b5dc90970ef81ea388bac8bea13f3cfad54bb99cccc9" exitCode=0
Sep 11 11:51:52.967320 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:52.967010    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9pk4q" event={"ID":"c353d851-ad50-4533-ba4a-af3d820e25d1","Type":"ContainerDied","Data":"ba480756f5b1ec656370b5dc90970ef81ea388bac8bea13f3cfad54bb99cccc9"}
Sep 11 11:51:52.970014 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:52.969993    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55" event={"ID":"56521050-777d-4be5-8838-b87c6a819706","Type":"ContainerStarted","Data":"b60d01fea5b0e282d5772bc4188e7684ff1fd5dc32906926401506ca35fa5dbf"}
Sep 11 11:51:52.982604 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:52.982582    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:52.982767 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:52.982754    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:51:53.051822 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:53.051764    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2dt55" podStartSLOduration=2.412475045 podStartE2EDuration="25.051750264s" totalImagesPullingTime="22.639275219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 11:51:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:51:53.051698562 +0000 UTC m=+26.734098050" watchObservedRunningTime="2026-09-11 11:51:53.051750264 +0000 UTC m=+26.734149762"
Sep 11 11:51:53.975823 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:53.975791    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wzvlx_2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b/ovn-acl-logging/0.log"
Sep 11 11:51:53.976505 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:53.976141    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx" event={"ID":"2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b","Type":"ContainerStarted","Data":"03e040aa1bb8219f9e3583a91665cc839400fe9320cba690a198ad6e7fff8cfa"}
Sep 11 11:51:54.002482 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:54.002434    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx" podStartSLOduration=8.879694656 podStartE2EDuration="27.002418429s" totalImagesPullingTime="18.122723773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 11:51:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:51:54.002359738 +0000 UTC m=+27.684759238" watchObservedRunningTime="2026-09-11 11:51:54.002418429 +0000 UTC m=+27.684817931"
Sep 11 11:51:54.442332 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:54.442304    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zdjj7"]
Sep 11 11:51:54.442496 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:54.442478    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:54.442625 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:54.442598    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjj7" podUID="307113f7-a015-4c41-a620-b5c2b90b3828"
Sep 11 11:51:54.445536 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:54.445514    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jcs8z"]
Sep 11 11:51:54.445633 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:54.445621    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:51:54.445757 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:54.445735    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcs8z" podUID="5b7c905b-ecae-4cbe-a5c2-3962ec391672"
Sep 11 11:51:54.446391 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:54.446368    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tbtxm"]
Sep 11 11:51:54.446466 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:54.446450    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:51:54.446538 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:54.446515    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tbtxm" podUID="3ccf784d-5d83-482f-b3cf-00f1a976f4be"
Sep 11 11:51:54.980367 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:54.980334    2565 generic.go:356] "Generic (PLEG): container finished" podID="c353d851-ad50-4533-ba4a-af3d820e25d1" containerID="f276f692bb75d9ddd34351e9f6b86ff6a5aa0b507cc5d594413f3d594caccd7b" exitCode=0
Sep 11 11:51:54.980824 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:54.980423    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9pk4q" event={"ID":"c353d851-ad50-4533-ba4a-af3d820e25d1","Type":"ContainerDied","Data":"f276f692bb75d9ddd34351e9f6b86ff6a5aa0b507cc5d594413f3d594caccd7b"}
Sep 11 11:51:55.835985 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:55.835962    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:55.836100 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:55.836082    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjj7" podUID="307113f7-a015-4c41-a620-b5c2b90b3828"
Sep 11 11:51:55.984453 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:55.984378    2565 generic.go:356] "Generic (PLEG): container finished" podID="c353d851-ad50-4533-ba4a-af3d820e25d1" containerID="0102b3509287464813796d9632e347f56ffba320571d1b8a0572c40aa8b5ed3c" exitCode=0
Sep 11 11:51:55.984453 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:55.984431    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9pk4q" event={"ID":"c353d851-ad50-4533-ba4a-af3d820e25d1","Type":"ContainerDied","Data":"0102b3509287464813796d9632e347f56ffba320571d1b8a0572c40aa8b5ed3c"}
Sep 11 11:51:56.837317 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:56.837090    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:51:56.837457 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:56.837142    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:51:56.837457 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:56.837413    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tbtxm" podUID="3ccf784d-5d83-482f-b3cf-00f1a976f4be"
Sep 11 11:51:56.837557 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:56.837463    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcs8z" podUID="5b7c905b-ecae-4cbe-a5c2-3962ec391672"
Sep 11 11:51:57.836331 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:57.836297    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:57.836756 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:57.836436    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjj7" podUID="307113f7-a015-4c41-a620-b5c2b90b3828"
Sep 11 11:51:58.836128 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:58.836074    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:51:58.836339 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:58.836204    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tbtxm" podUID="3ccf784d-5d83-482f-b3cf-00f1a976f4be"
Sep 11 11:51:58.836339 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:58.836243    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:51:58.836339 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:58.836326    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jcs8z" podUID="5b7c905b-ecae-4cbe-a5c2-3962ec391672"
Sep 11 11:51:59.835858 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:51:59.835825    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:51:59.836089 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:51:59.835947    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdjj7" podUID="307113f7-a015-4c41-a620-b5c2b90b3828"
Sep 11 11:52:00.505008 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.504979    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs\") pod \"network-metrics-daemon-jcs8z\" (UID: \"5b7c905b-ecae-4cbe-a5c2-3962ec391672\") " pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:52:00.505319 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:00.505170    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:52:00.505319 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:00.505254    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs podName:5b7c905b-ecae-4cbe-a5c2-3962ec391672 nodeName:}" failed. No retries permitted until 2026-09-11 11:52:32.505232774 +0000 UTC m=+66.187632273 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs") pod "network-metrics-daemon-jcs8z" (UID: "5b7c905b-ecae-4cbe-a5c2-3962ec391672") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 11:52:00.606139 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.606106    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/307113f7-a015-4c41-a620-b5c2b90b3828-original-pull-secret\") pod \"global-pull-secret-syncer-zdjj7\" (UID: \"307113f7-a015-4c41-a620-b5c2b90b3828\") " pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:52:00.606256 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:00.606211    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 11:52:00.606302 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:00.606263    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/307113f7-a015-4c41-a620-b5c2b90b3828-original-pull-secret podName:307113f7-a015-4c41-a620-b5c2b90b3828 nodeName:}" failed. No retries permitted until 2026-09-11 11:52:32.606248525 +0000 UTC m=+66.288648000 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/307113f7-a015-4c41-a620-b5c2b90b3828-original-pull-secret") pod "global-pull-secret-syncer-zdjj7" (UID: "307113f7-a015-4c41-a620-b5c2b90b3828") : object "kube-system"/"original-pull-secret" not registered
Sep 11 11:52:00.628310 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.628261    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-111.ec2.internal" event="NodeReady"
Sep 11 11:52:00.628407 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.628381    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 11:52:00.659574 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.659537    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d999f4bdd-vmwn8"]
Sep 11 11:52:00.665477 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.665460    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:00.667658 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.667634    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 11:52:00.668065 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.668044    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 11:52:00.668155 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.668093    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 11:52:00.668155 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.668146    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6j76c\""
Sep 11 11:52:00.673334 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.673283    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5csdj"]
Sep 11 11:52:00.673609 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.673591    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 11:52:00.680339 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.680318    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d999f4bdd-vmwn8"]
Sep 11 11:52:00.680435 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.680353    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-96hq7"]
Sep 11 11:52:00.680435 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.680424    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5csdj"
Sep 11 11:52:00.682732 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.682713    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 11:52:00.682829 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.682817    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 11:52:00.682960 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.682943    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mvnq6\""
Sep 11 11:52:00.688673 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.688654    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5csdj"]
Sep 11 11:52:00.688794 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.688708    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-96hq7"]
Sep 11 11:52:00.688794 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.688779    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-96hq7"
Sep 11 11:52:00.691368 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.691349    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5ncdh\""
Sep 11 11:52:00.691468 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.691397    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 11:52:00.691468 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.691410    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 11:52:00.691468 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.691419    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 11:52:00.706519 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.706486    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tctgg\" (UniqueName: \"kubernetes.io/projected/3ccf784d-5d83-482f-b3cf-00f1a976f4be-kube-api-access-tctgg\") pod \"network-check-target-tbtxm\" (UID: \"3ccf784d-5d83-482f-b3cf-00f1a976f4be\") " pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:52:00.706639 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:00.706623    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 11:52:00.706718 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:00.706644    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 11:52:00.706718 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:00.706654    2565 projected.go:196] Error preparing data for projected volume kube-api-access-tctgg for pod openshift-network-diagnostics/network-check-target-tbtxm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:52:00.706718 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:00.706711    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ccf784d-5d83-482f-b3cf-00f1a976f4be-kube-api-access-tctgg podName:3ccf784d-5d83-482f-b3cf-00f1a976f4be nodeName:}" failed. No retries permitted until 2026-09-11 11:52:32.706699616 +0000 UTC m=+66.389099091 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tctgg" (UniqueName: "kubernetes.io/projected/3ccf784d-5d83-482f-b3cf-00f1a976f4be-kube-api-access-tctgg") pod "network-check-target-tbtxm" (UID: "3ccf784d-5d83-482f-b3cf-00f1a976f4be") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 11:52:00.807511 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.807487    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce076ee4-4421-459e-96ee-6cab9a0c807c-ca-trust-extracted\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:00.807614 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.807535    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-certificates\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:00.807614 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.807566    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce076ee4-4421-459e-96ee-6cab9a0c807c-image-registry-private-configuration\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:00.807614 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.807590    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce076ee4-4421-459e-96ee-6cab9a0c807c-installation-pull-secrets\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:00.807614 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.807611    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce076ee4-4421-459e-96ee-6cab9a0c807c-trusted-ca\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:00.807798 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.807648    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17b83b0d-839c-4c6c-9ab6-da6827bf62f0-cert\") pod \"ingress-canary-96hq7\" (UID: \"17b83b0d-839c-4c6c-9ab6-da6827bf62f0\") " pod="openshift-ingress-canary/ingress-canary-96hq7"
Sep 11 11:52:00.807798 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.807725    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w2zd\" (UniqueName: \"kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-kube-api-access-7w2zd\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:00.807798 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.807742    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/92208eb8-4897-4a87-ab47-b3b7e57ebcec-config-volume\") pod \"dns-default-5csdj\" (UID: \"92208eb8-4897-4a87-ab47-b3b7e57ebcec\") " pod="openshift-dns/dns-default-5csdj"
Sep 11 11:52:00.807798 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.807756    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92208eb8-4897-4a87-ab47-b3b7e57ebcec-metrics-tls\") pod \"dns-default-5csdj\" (UID: \"92208eb8-4897-4a87-ab47-b3b7e57ebcec\") " pod="openshift-dns/dns-default-5csdj"
Sep 11 11:52:00.807798 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.807771    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57tsr\" (UniqueName: \"kubernetes.io/projected/92208eb8-4897-4a87-ab47-b3b7e57ebcec-kube-api-access-57tsr\") pod \"dns-default-5csdj\" (UID: \"92208eb8-4897-4a87-ab47-b3b7e57ebcec\") " pod="openshift-dns/dns-default-5csdj"
Sep 11 11:52:00.807798 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.807794    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:00.807969 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.807825    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-bound-sa-token\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:00.807969 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.807850    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92208eb8-4897-4a87-ab47-b3b7e57ebcec-tmp-dir\") pod \"dns-default-5csdj\" (UID: \"92208eb8-4897-4a87-ab47-b3b7e57ebcec\") " pod="openshift-dns/dns-default-5csdj"
Sep 11 11:52:00.807969 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.807875    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcz9m\" (UniqueName: \"kubernetes.io/projected/17b83b0d-839c-4c6c-9ab6-da6827bf62f0-kube-api-access-qcz9m\") pod \"ingress-canary-96hq7\" (UID: \"17b83b0d-839c-4c6c-9ab6-da6827bf62f0\") " pod="openshift-ingress-canary/ingress-canary-96hq7"
Sep 11 11:52:00.835895 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.835876    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:52:00.836104 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.836083    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:52:00.838697 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.838661    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 11:52:00.838697 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.838678    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f8bwk\""
Sep 11 11:52:00.838858 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.838721    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 11:52:00.838858 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.838738    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 11:52:00.838858 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.838742    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-74fqm\""
Sep 11 11:52:00.908518 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.908243    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17b83b0d-839c-4c6c-9ab6-da6827bf62f0-cert\") pod \"ingress-canary-96hq7\" (UID: \"17b83b0d-839c-4c6c-9ab6-da6827bf62f0\") " pod="openshift-ingress-canary/ingress-canary-96hq7"
Sep 11 11:52:00.908669 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.908578    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w2zd\" (UniqueName: \"kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-kube-api-access-7w2zd\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:00.908669 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.908612    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/92208eb8-4897-4a87-ab47-b3b7e57ebcec-config-volume\") pod \"dns-default-5csdj\" (UID: \"92208eb8-4897-4a87-ab47-b3b7e57ebcec\") " pod="openshift-dns/dns-default-5csdj"
Sep 11 11:52:00.908669 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.908640    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92208eb8-4897-4a87-ab47-b3b7e57ebcec-metrics-tls\") pod \"dns-default-5csdj\" (UID: \"92208eb8-4897-4a87-ab47-b3b7e57ebcec\") " pod="openshift-dns/dns-default-5csdj"
Sep 11 11:52:00.908669 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.908667    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57tsr\" (UniqueName: \"kubernetes.io/projected/92208eb8-4897-4a87-ab47-b3b7e57ebcec-kube-api-access-57tsr\") pod \"dns-default-5csdj\" (UID: \"92208eb8-4897-4a87-ab47-b3b7e57ebcec\") " pod="openshift-dns/dns-default-5csdj"
Sep 11 11:52:00.908897 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.908738    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:00.908897 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.908765    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-bound-sa-token\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:00.908897 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:00.908776    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 11:52:00.908897 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.908796    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92208eb8-4897-4a87-ab47-b3b7e57ebcec-tmp-dir\") pod \"dns-default-5csdj\" (UID: \"92208eb8-4897-4a87-ab47-b3b7e57ebcec\") " pod="openshift-dns/dns-default-5csdj"
Sep 11 11:52:00.908897 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:00.908839    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92208eb8-4897-4a87-ab47-b3b7e57ebcec-metrics-tls podName:92208eb8-4897-4a87-ab47-b3b7e57ebcec nodeName:}" failed. No retries permitted until 2026-09-11 11:52:01.408821111 +0000 UTC m=+35.091220587 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92208eb8-4897-4a87-ab47-b3b7e57ebcec-metrics-tls") pod "dns-default-5csdj" (UID: "92208eb8-4897-4a87-ab47-b3b7e57ebcec") : secret "dns-default-metrics-tls" not found
Sep 11 11:52:00.908897 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.908879    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcz9m\" (UniqueName: \"kubernetes.io/projected/17b83b0d-839c-4c6c-9ab6-da6827bf62f0-kube-api-access-qcz9m\") pod \"ingress-canary-96hq7\" (UID: \"17b83b0d-839c-4c6c-9ab6-da6827bf62f0\") " pod="openshift-ingress-canary/ingress-canary-96hq7"
Sep 11 11:52:00.909197 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.908915    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce076ee4-4421-459e-96ee-6cab9a0c807c-ca-trust-extracted\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:00.909197 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.908955    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-certificates\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:00.909197 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.908986    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce076ee4-4421-459e-96ee-6cab9a0c807c-image-registry-private-configuration\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:00.909197 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.909016    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce076ee4-4421-459e-96ee-6cab9a0c807c-installation-pull-secrets\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:00.909197 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:00.909032    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 11:52:00.909197 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:00.909052    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d999f4bdd-vmwn8: secret "image-registry-tls" not found
Sep 11 11:52:00.909197 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.909052    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce076ee4-4421-459e-96ee-6cab9a0c807c-trusted-ca\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:00.909197 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:00.909110    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls podName:ce076ee4-4421-459e-96ee-6cab9a0c807c nodeName:}" failed. No retries permitted until 2026-09-11 11:52:01.409093501 +0000 UTC m=+35.091492979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls") pod "image-registry-d999f4bdd-vmwn8" (UID: "ce076ee4-4421-459e-96ee-6cab9a0c807c") : secret "image-registry-tls" not found
Sep 11 11:52:00.909197 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.909111    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92208eb8-4897-4a87-ab47-b3b7e57ebcec-tmp-dir\") pod \"dns-default-5csdj\" (UID: \"92208eb8-4897-4a87-ab47-b3b7e57ebcec\") " pod="openshift-dns/dns-default-5csdj"
Sep 11 11:52:00.909634 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.909308    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/92208eb8-4897-4a87-ab47-b3b7e57ebcec-config-volume\") pod \"dns-default-5csdj\" (UID: \"92208eb8-4897-4a87-ab47-b3b7e57ebcec\") " pod="openshift-dns/dns-default-5csdj"
Sep 11 11:52:00.909634 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.909571    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce076ee4-4421-459e-96ee-6cab9a0c807c-ca-trust-extracted\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:00.909766 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.909653    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-certificates\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:00.910326 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.910303    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce076ee4-4421-459e-96ee-6cab9a0c807c-trusted-ca\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:00.912762 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.912739    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17b83b0d-839c-4c6c-9ab6-da6827bf62f0-cert\") pod \"ingress-canary-96hq7\" (UID: \"17b83b0d-839c-4c6c-9ab6-da6827bf62f0\") " pod="openshift-ingress-canary/ingress-canary-96hq7"
Sep 11 11:52:00.912840 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.912814    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce076ee4-4421-459e-96ee-6cab9a0c807c-image-registry-private-configuration\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:00.912886 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.912864    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce076ee4-4421-459e-96ee-6cab9a0c807c-installation-pull-secrets\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:00.917296 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.917270    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w2zd\" (UniqueName: \"kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-kube-api-access-7w2zd\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:00.917421 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.917383    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57tsr\" (UniqueName: \"kubernetes.io/projected/92208eb8-4897-4a87-ab47-b3b7e57ebcec-kube-api-access-57tsr\") pod \"dns-default-5csdj\" (UID: \"92208eb8-4897-4a87-ab47-b3b7e57ebcec\") " pod="openshift-dns/dns-default-5csdj"
Sep 11 11:52:00.917488 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.917470    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcz9m\" (UniqueName: \"kubernetes.io/projected/17b83b0d-839c-4c6c-9ab6-da6827bf62f0-kube-api-access-qcz9m\") pod \"ingress-canary-96hq7\" (UID: \"17b83b0d-839c-4c6c-9ab6-da6827bf62f0\") " pod="openshift-ingress-canary/ingress-canary-96hq7"
Sep 11 11:52:00.917660 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.917645    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-bound-sa-token\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:00.997863 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.997841    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-96hq7"
Sep 11 11:52:01.000007 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:00.999971    2565 generic.go:356] "Generic (PLEG): container finished" podID="c353d851-ad50-4533-ba4a-af3d820e25d1" containerID="384aeeb5dde537e1c58b4183cbce390b9f5279a9811da86e5507200a29bb2cb9" exitCode=0
Sep 11 11:52:01.000114 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:01.000010    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9pk4q" event={"ID":"c353d851-ad50-4533-ba4a-af3d820e25d1","Type":"ContainerDied","Data":"384aeeb5dde537e1c58b4183cbce390b9f5279a9811da86e5507200a29bb2cb9"}
Sep 11 11:52:01.316281 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:01.316250    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-96hq7"]
Sep 11 11:52:01.320666 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:52:01.320638    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17b83b0d_839c_4c6c_9ab6_da6827bf62f0.slice/crio-249c60f0cf3ec4665d105d8788d7c12a1b7f9f3ff7af606ceac213a45487c573 WatchSource:0}: Error finding container 249c60f0cf3ec4665d105d8788d7c12a1b7f9f3ff7af606ceac213a45487c573: Status 404 returned error can't find the container with id 249c60f0cf3ec4665d105d8788d7c12a1b7f9f3ff7af606ceac213a45487c573
Sep 11 11:52:01.412871 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:01.412787    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92208eb8-4897-4a87-ab47-b3b7e57ebcec-metrics-tls\") pod \"dns-default-5csdj\" (UID: \"92208eb8-4897-4a87-ab47-b3b7e57ebcec\") " pod="openshift-dns/dns-default-5csdj"
Sep 11 11:52:01.412871 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:01.412829    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:01.413043 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:01.412928    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 11:52:01.413043 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:01.412935    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 11:52:01.413043 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:01.413003    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92208eb8-4897-4a87-ab47-b3b7e57ebcec-metrics-tls podName:92208eb8-4897-4a87-ab47-b3b7e57ebcec nodeName:}" failed. No retries permitted until 2026-09-11 11:52:02.412986112 +0000 UTC m=+36.095385587 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92208eb8-4897-4a87-ab47-b3b7e57ebcec-metrics-tls") pod "dns-default-5csdj" (UID: "92208eb8-4897-4a87-ab47-b3b7e57ebcec") : secret "dns-default-metrics-tls" not found
Sep 11 11:52:01.413043 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:01.412940    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d999f4bdd-vmwn8: secret "image-registry-tls" not found
Sep 11 11:52:01.413043 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:01.413042    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls podName:ce076ee4-4421-459e-96ee-6cab9a0c807c nodeName:}" failed. No retries permitted until 2026-09-11 11:52:02.413035835 +0000 UTC m=+36.095435311 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls") pod "image-registry-d999f4bdd-vmwn8" (UID: "ce076ee4-4421-459e-96ee-6cab9a0c807c") : secret "image-registry-tls" not found
Sep 11 11:52:01.835894 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:01.835804    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:52:01.838768 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:01.838747    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 11:52:02.006719 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:02.006666    2565 generic.go:356] "Generic (PLEG): container finished" podID="c353d851-ad50-4533-ba4a-af3d820e25d1" containerID="f743bcc13a1d57aa3c3203a8655ef5497697966343cb7a7d6b51dfb3375a8dac" exitCode=0
Sep 11 11:52:02.006894 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:02.006752    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9pk4q" event={"ID":"c353d851-ad50-4533-ba4a-af3d820e25d1","Type":"ContainerDied","Data":"f743bcc13a1d57aa3c3203a8655ef5497697966343cb7a7d6b51dfb3375a8dac"}
Sep 11 11:52:02.008324 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:02.008301    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-96hq7" event={"ID":"17b83b0d-839c-4c6c-9ab6-da6827bf62f0","Type":"ContainerStarted","Data":"249c60f0cf3ec4665d105d8788d7c12a1b7f9f3ff7af606ceac213a45487c573"}
Sep 11 11:52:02.422697 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:02.422648    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92208eb8-4897-4a87-ab47-b3b7e57ebcec-metrics-tls\") pod \"dns-default-5csdj\" (UID: \"92208eb8-4897-4a87-ab47-b3b7e57ebcec\") " pod="openshift-dns/dns-default-5csdj"
Sep 11 11:52:02.422876 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:02.422715    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:02.422876 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:02.422822    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 11:52:02.422979 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:02.422875    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 11:52:02.422979 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:02.422890    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d999f4bdd-vmwn8: secret "image-registry-tls" not found
Sep 11 11:52:02.422979 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:02.422897    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92208eb8-4897-4a87-ab47-b3b7e57ebcec-metrics-tls podName:92208eb8-4897-4a87-ab47-b3b7e57ebcec nodeName:}" failed. No retries permitted until 2026-09-11 11:52:04.422877662 +0000 UTC m=+38.105277145 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92208eb8-4897-4a87-ab47-b3b7e57ebcec-metrics-tls") pod "dns-default-5csdj" (UID: "92208eb8-4897-4a87-ab47-b3b7e57ebcec") : secret "dns-default-metrics-tls" not found
Sep 11 11:52:02.422979 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:02.422938    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls podName:ce076ee4-4421-459e-96ee-6cab9a0c807c nodeName:}" failed. No retries permitted until 2026-09-11 11:52:04.422922675 +0000 UTC m=+38.105322155 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls") pod "image-registry-d999f4bdd-vmwn8" (UID: "ce076ee4-4421-459e-96ee-6cab9a0c807c") : secret "image-registry-tls" not found
Sep 11 11:52:03.014824 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:03.014792    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9pk4q" event={"ID":"c353d851-ad50-4533-ba4a-af3d820e25d1","Type":"ContainerStarted","Data":"1e49a08a346f8b7f7c1703f30a5fd7e4bea0b9e6770e9a2c4e895c21fc75d517"}
Sep 11 11:52:03.035887 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:03.035827    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9pk4q" podStartSLOduration=6.110927035 podStartE2EDuration="36.035804741s" totalImagesPullingTime="29.924877706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 11:51:27 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:52:03.033894363 +0000 UTC m=+36.716293860" watchObservedRunningTime="2026-09-11 11:52:03.035804741 +0000 UTC m=+36.718204255"
Sep 11 11:52:04.438946 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:04.438907    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92208eb8-4897-4a87-ab47-b3b7e57ebcec-metrics-tls\") pod \"dns-default-5csdj\" (UID: \"92208eb8-4897-4a87-ab47-b3b7e57ebcec\") " pod="openshift-dns/dns-default-5csdj"
Sep 11 11:52:04.439314 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:04.438956    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:04.439314 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:04.439066    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 11:52:04.439314 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:04.439125    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92208eb8-4897-4a87-ab47-b3b7e57ebcec-metrics-tls podName:92208eb8-4897-4a87-ab47-b3b7e57ebcec nodeName:}" failed. No retries permitted until 2026-09-11 11:52:08.439110484 +0000 UTC m=+42.121509963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92208eb8-4897-4a87-ab47-b3b7e57ebcec-metrics-tls") pod "dns-default-5csdj" (UID: "92208eb8-4897-4a87-ab47-b3b7e57ebcec") : secret "dns-default-metrics-tls" not found
Sep 11 11:52:04.439314 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:04.439139    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 11:52:04.439314 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:04.439159    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d999f4bdd-vmwn8: secret "image-registry-tls" not found
Sep 11 11:52:04.439314 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:04.439209    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls podName:ce076ee4-4421-459e-96ee-6cab9a0c807c nodeName:}" failed. No retries permitted until 2026-09-11 11:52:08.439195417 +0000 UTC m=+42.121594912 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls") pod "image-registry-d999f4bdd-vmwn8" (UID: "ce076ee4-4421-459e-96ee-6cab9a0c807c") : secret "image-registry-tls" not found
Sep 11 11:52:05.021404 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:05.021367    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-96hq7" event={"ID":"17b83b0d-839c-4c6c-9ab6-da6827bf62f0","Type":"ContainerStarted","Data":"00d2874a698f5d27939b4c5aaadfd192e12b3c4bab24bed6d06f9ae51cf75fa6"}
Sep 11 11:52:05.036028 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:05.035980    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-96hq7" podStartSLOduration=2.3352659559999998 podStartE2EDuration="5.035965178s" totalImagesPullingTime="2.700699222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:52:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:52:05.035513604 +0000 UTC m=+38.717913101" watchObservedRunningTime="2026-09-11 11:52:05.035965178 +0000 UTC m=+38.718364654"
Sep 11 11:52:08.467739 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:08.467678    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:08.468182 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:08.467796    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92208eb8-4897-4a87-ab47-b3b7e57ebcec-metrics-tls\") pod \"dns-default-5csdj\" (UID: \"92208eb8-4897-4a87-ab47-b3b7e57ebcec\") " pod="openshift-dns/dns-default-5csdj"
Sep 11 11:52:08.468182 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:08.467824    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 11:52:08.468182 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:08.467843    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d999f4bdd-vmwn8: secret "image-registry-tls" not found
Sep 11 11:52:08.468182 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:08.467891    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 11:52:08.468182 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:08.467897    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls podName:ce076ee4-4421-459e-96ee-6cab9a0c807c nodeName:}" failed. No retries permitted until 2026-09-11 11:52:16.467882635 +0000 UTC m=+50.150282111 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls") pod "image-registry-d999f4bdd-vmwn8" (UID: "ce076ee4-4421-459e-96ee-6cab9a0c807c") : secret "image-registry-tls" not found
Sep 11 11:52:08.468182 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:08.467958    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92208eb8-4897-4a87-ab47-b3b7e57ebcec-metrics-tls podName:92208eb8-4897-4a87-ab47-b3b7e57ebcec nodeName:}" failed. No retries permitted until 2026-09-11 11:52:16.467941778 +0000 UTC m=+50.150341256 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92208eb8-4897-4a87-ab47-b3b7e57ebcec-metrics-tls") pod "dns-default-5csdj" (UID: "92208eb8-4897-4a87-ab47-b3b7e57ebcec") : secret "dns-default-metrics-tls" not found
Sep 11 11:52:16.524932 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:16.524888    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92208eb8-4897-4a87-ab47-b3b7e57ebcec-metrics-tls\") pod \"dns-default-5csdj\" (UID: \"92208eb8-4897-4a87-ab47-b3b7e57ebcec\") " pod="openshift-dns/dns-default-5csdj"
Sep 11 11:52:16.524932 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:16.524935    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:16.525442 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:16.525033    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 11:52:16.525442 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:16.525102    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92208eb8-4897-4a87-ab47-b3b7e57ebcec-metrics-tls podName:92208eb8-4897-4a87-ab47-b3b7e57ebcec nodeName:}" failed. No retries permitted until 2026-09-11 11:52:32.525078454 +0000 UTC m=+66.207477930 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92208eb8-4897-4a87-ab47-b3b7e57ebcec-metrics-tls") pod "dns-default-5csdj" (UID: "92208eb8-4897-4a87-ab47-b3b7e57ebcec") : secret "dns-default-metrics-tls" not found
Sep 11 11:52:16.525442 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:16.525039    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 11:52:16.525442 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:16.525133    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d999f4bdd-vmwn8: secret "image-registry-tls" not found
Sep 11 11:52:16.525442 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:16.525176    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls podName:ce076ee4-4421-459e-96ee-6cab9a0c807c nodeName:}" failed. No retries permitted until 2026-09-11 11:52:32.52516423 +0000 UTC m=+66.207563705 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls") pod "image-registry-d999f4bdd-vmwn8" (UID: "ce076ee4-4421-459e-96ee-6cab9a0c807c") : secret "image-registry-tls" not found
Sep 11 11:52:24.990375 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:24.990345    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wzvlx"
Sep 11 11:52:28.843021 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.842926    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-htsk6"]
Sep 11 11:52:28.846529 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.846509    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-5pnqx"]
Sep 11 11:52:28.846634 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.846622    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-htsk6"
Sep 11 11:52:28.848573 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.848555    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-5pnqx"
Sep 11 11:52:28.849166 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.849145    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 11 11:52:28.849264 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.849163    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 11 11:52:28.849264 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.849163    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6jj69\""
Sep 11 11:52:28.850748 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.850733    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-7hbbr\""
Sep 11 11:52:28.851122 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.851081    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 11 11:52:28.851122 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.851110    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 11 11:52:28.851302 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.851168    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 11 11:52:28.851396 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.851383    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 11 11:52:28.859112 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.859093    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 11 11:52:28.859512 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.859493    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-htsk6"]
Sep 11 11:52:28.860273 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.860253    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-5pnqx"]
Sep 11 11:52:28.910370 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.910340    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj2dl\" (UniqueName: \"kubernetes.io/projected/223e97bb-f3c6-4476-bfa0-e8298a46d0cd-kube-api-access-kj2dl\") pod \"volume-data-source-validator-86695b7cc7-htsk6\" (UID: \"223e97bb-f3c6-4476-bfa0-e8298a46d0cd\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-htsk6"
Sep 11 11:52:28.910523 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.910420    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfjvp\" (UniqueName: \"kubernetes.io/projected/2233f21d-d3f8-44fc-92bf-03a86f7456ce-kube-api-access-jfjvp\") pod \"console-operator-696884fb9c-5pnqx\" (UID: \"2233f21d-d3f8-44fc-92bf-03a86f7456ce\") " pod="openshift-console-operator/console-operator-696884fb9c-5pnqx"
Sep 11 11:52:28.910523 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.910448    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2233f21d-d3f8-44fc-92bf-03a86f7456ce-serving-cert\") pod \"console-operator-696884fb9c-5pnqx\" (UID: \"2233f21d-d3f8-44fc-92bf-03a86f7456ce\") " pod="openshift-console-operator/console-operator-696884fb9c-5pnqx"
Sep 11 11:52:28.910523 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.910465    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2233f21d-d3f8-44fc-92bf-03a86f7456ce-config\") pod \"console-operator-696884fb9c-5pnqx\" (UID: \"2233f21d-d3f8-44fc-92bf-03a86f7456ce\") " pod="openshift-console-operator/console-operator-696884fb9c-5pnqx"
Sep 11 11:52:28.910523 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.910484    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2233f21d-d3f8-44fc-92bf-03a86f7456ce-trusted-ca\") pod \"console-operator-696884fb9c-5pnqx\" (UID: \"2233f21d-d3f8-44fc-92bf-03a86f7456ce\") " pod="openshift-console-operator/console-operator-696884fb9c-5pnqx"
Sep 11 11:52:28.940176 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.940146    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-lwcvz"]
Sep 11 11:52:28.942668 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.942648    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lwcvz"
Sep 11 11:52:28.945047 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.945028    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 11 11:52:28.945841 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.945821    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9rg5q\""
Sep 11 11:52:28.945841 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.945835    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 11:52:28.946940 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.946924    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 11:52:28.947035 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.946930    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 11 11:52:28.956509 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:28.956488    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-lwcvz"]
Sep 11 11:52:29.011767 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:29.011731    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4f66e97d-43ad-400a-8b2a-acc93a06e282-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-lwcvz\" (UID: \"4f66e97d-43ad-400a-8b2a-acc93a06e282\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lwcvz"
Sep 11 11:52:29.011767 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:29.011768    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfjvp\" (UniqueName: \"kubernetes.io/projected/2233f21d-d3f8-44fc-92bf-03a86f7456ce-kube-api-access-jfjvp\") pod \"console-operator-696884fb9c-5pnqx\" (UID: \"2233f21d-d3f8-44fc-92bf-03a86f7456ce\") " pod="openshift-console-operator/console-operator-696884fb9c-5pnqx"
Sep 11 11:52:29.011947 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:29.011790    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2233f21d-d3f8-44fc-92bf-03a86f7456ce-serving-cert\") pod \"console-operator-696884fb9c-5pnqx\" (UID: \"2233f21d-d3f8-44fc-92bf-03a86f7456ce\") " pod="openshift-console-operator/console-operator-696884fb9c-5pnqx"
Sep 11 11:52:29.011947 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:29.011813    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2233f21d-d3f8-44fc-92bf-03a86f7456ce-config\") pod \"console-operator-696884fb9c-5pnqx\" (UID: \"2233f21d-d3f8-44fc-92bf-03a86f7456ce\") " pod="openshift-console-operator/console-operator-696884fb9c-5pnqx"
Sep 11 11:52:29.011947 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:29.011836    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2233f21d-d3f8-44fc-92bf-03a86f7456ce-trusted-ca\") pod \"console-operator-696884fb9c-5pnqx\" (UID: \"2233f21d-d3f8-44fc-92bf-03a86f7456ce\") " pod="openshift-console-operator/console-operator-696884fb9c-5pnqx"
Sep 11 11:52:29.012064 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:29.011984    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f66e97d-43ad-400a-8b2a-acc93a06e282-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-lwcvz\" (UID: \"4f66e97d-43ad-400a-8b2a-acc93a06e282\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lwcvz"
Sep 11 11:52:29.012064 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:29.012026    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msjw2\" (UniqueName: \"kubernetes.io/projected/4f66e97d-43ad-400a-8b2a-acc93a06e282-kube-api-access-msjw2\") pod \"cluster-monitoring-operator-6cd954b897-lwcvz\" (UID: \"4f66e97d-43ad-400a-8b2a-acc93a06e282\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lwcvz"
Sep 11 11:52:29.012173 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:29.012065    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj2dl\" (UniqueName: \"kubernetes.io/projected/223e97bb-f3c6-4476-bfa0-e8298a46d0cd-kube-api-access-kj2dl\") pod \"volume-data-source-validator-86695b7cc7-htsk6\" (UID: \"223e97bb-f3c6-4476-bfa0-e8298a46d0cd\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-htsk6"
Sep 11 11:52:29.012469 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:29.012444    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2233f21d-d3f8-44fc-92bf-03a86f7456ce-config\") pod \"console-operator-696884fb9c-5pnqx\" (UID: \"2233f21d-d3f8-44fc-92bf-03a86f7456ce\") " pod="openshift-console-operator/console-operator-696884fb9c-5pnqx"
Sep 11 11:52:29.012731 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:29.012713    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2233f21d-d3f8-44fc-92bf-03a86f7456ce-trusted-ca\") pod \"console-operator-696884fb9c-5pnqx\" (UID: \"2233f21d-d3f8-44fc-92bf-03a86f7456ce\") " pod="openshift-console-operator/console-operator-696884fb9c-5pnqx"
Sep 11 11:52:29.015106 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:29.015090    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2233f21d-d3f8-44fc-92bf-03a86f7456ce-serving-cert\") pod \"console-operator-696884fb9c-5pnqx\" (UID: \"2233f21d-d3f8-44fc-92bf-03a86f7456ce\") " pod="openshift-console-operator/console-operator-696884fb9c-5pnqx"
Sep 11 11:52:29.020669 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:29.020646    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfjvp\" (UniqueName: \"kubernetes.io/projected/2233f21d-d3f8-44fc-92bf-03a86f7456ce-kube-api-access-jfjvp\") pod \"console-operator-696884fb9c-5pnqx\" (UID: \"2233f21d-d3f8-44fc-92bf-03a86f7456ce\") " pod="openshift-console-operator/console-operator-696884fb9c-5pnqx"
Sep 11 11:52:29.020821 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:29.020804    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj2dl\" (UniqueName: \"kubernetes.io/projected/223e97bb-f3c6-4476-bfa0-e8298a46d0cd-kube-api-access-kj2dl\") pod \"volume-data-source-validator-86695b7cc7-htsk6\" (UID: \"223e97bb-f3c6-4476-bfa0-e8298a46d0cd\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-htsk6"
Sep 11 11:52:29.113069 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:29.113003    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4f66e97d-43ad-400a-8b2a-acc93a06e282-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-lwcvz\" (UID: \"4f66e97d-43ad-400a-8b2a-acc93a06e282\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lwcvz"
Sep 11 11:52:29.113069 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:29.113051    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f66e97d-43ad-400a-8b2a-acc93a06e282-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-lwcvz\" (UID: \"4f66e97d-43ad-400a-8b2a-acc93a06e282\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lwcvz"
Sep 11 11:52:29.113069 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:29.113070    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msjw2\" (UniqueName: \"kubernetes.io/projected/4f66e97d-43ad-400a-8b2a-acc93a06e282-kube-api-access-msjw2\") pod \"cluster-monitoring-operator-6cd954b897-lwcvz\" (UID: \"4f66e97d-43ad-400a-8b2a-acc93a06e282\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lwcvz"
Sep 11 11:52:29.113262 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:29.113154    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 11:52:29.113262 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:29.113229    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f66e97d-43ad-400a-8b2a-acc93a06e282-cluster-monitoring-operator-tls podName:4f66e97d-43ad-400a-8b2a-acc93a06e282 nodeName:}" failed. No retries permitted until 2026-09-11 11:52:29.613213264 +0000 UTC m=+63.295612739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f66e97d-43ad-400a-8b2a-acc93a06e282-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-lwcvz" (UID: "4f66e97d-43ad-400a-8b2a-acc93a06e282") : secret "cluster-monitoring-operator-tls" not found
Sep 11 11:52:29.113603 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:29.113584    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4f66e97d-43ad-400a-8b2a-acc93a06e282-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-lwcvz\" (UID: \"4f66e97d-43ad-400a-8b2a-acc93a06e282\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lwcvz"
Sep 11 11:52:29.123968 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:29.123943    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msjw2\" (UniqueName: \"kubernetes.io/projected/4f66e97d-43ad-400a-8b2a-acc93a06e282-kube-api-access-msjw2\") pod \"cluster-monitoring-operator-6cd954b897-lwcvz\" (UID: \"4f66e97d-43ad-400a-8b2a-acc93a06e282\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lwcvz"
Sep 11 11:52:29.159903 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:29.159868    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-htsk6"
Sep 11 11:52:29.166243 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:29.166219    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-5pnqx"
Sep 11 11:52:29.440939 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:29.440906    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-htsk6"]
Sep 11 11:52:29.444400 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:29.444377    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-5pnqx"]
Sep 11 11:52:29.445143 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:52:29.445114    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod223e97bb_f3c6_4476_bfa0_e8298a46d0cd.slice/crio-ab4575648095f8b43b6ce6553a31364f45484b64db201e342e8a9c45b05c8f91 WatchSource:0}: Error finding container ab4575648095f8b43b6ce6553a31364f45484b64db201e342e8a9c45b05c8f91: Status 404 returned error can't find the container with id ab4575648095f8b43b6ce6553a31364f45484b64db201e342e8a9c45b05c8f91
Sep 11 11:52:29.446936 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:52:29.446820    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2233f21d_d3f8_44fc_92bf_03a86f7456ce.slice/crio-3f75104e1aedbb6dbd523b68958b545f32344a6c3c4f99bb6abb2f7ffb2f8a3e WatchSource:0}: Error finding container 3f75104e1aedbb6dbd523b68958b545f32344a6c3c4f99bb6abb2f7ffb2f8a3e: Status 404 returned error can't find the container with id 3f75104e1aedbb6dbd523b68958b545f32344a6c3c4f99bb6abb2f7ffb2f8a3e
Sep 11 11:52:29.616537 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:29.616504    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f66e97d-43ad-400a-8b2a-acc93a06e282-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-lwcvz\" (UID: \"4f66e97d-43ad-400a-8b2a-acc93a06e282\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lwcvz"
Sep 11 11:52:29.616671 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:29.616610    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 11:52:29.616745 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:29.616679    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f66e97d-43ad-400a-8b2a-acc93a06e282-cluster-monitoring-operator-tls podName:4f66e97d-43ad-400a-8b2a-acc93a06e282 nodeName:}" failed. No retries permitted until 2026-09-11 11:52:30.616662897 +0000 UTC m=+64.299062374 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f66e97d-43ad-400a-8b2a-acc93a06e282-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-lwcvz" (UID: "4f66e97d-43ad-400a-8b2a-acc93a06e282") : secret "cluster-monitoring-operator-tls" not found
Sep 11 11:52:30.081361 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:30.081327    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-5pnqx" event={"ID":"2233f21d-d3f8-44fc-92bf-03a86f7456ce","Type":"ContainerStarted","Data":"3f75104e1aedbb6dbd523b68958b545f32344a6c3c4f99bb6abb2f7ffb2f8a3e"}
Sep 11 11:52:30.082412 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:30.082390    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-htsk6" event={"ID":"223e97bb-f3c6-4476-bfa0-e8298a46d0cd","Type":"ContainerStarted","Data":"ab4575648095f8b43b6ce6553a31364f45484b64db201e342e8a9c45b05c8f91"}
Sep 11 11:52:30.625696 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:30.625652    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f66e97d-43ad-400a-8b2a-acc93a06e282-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-lwcvz\" (UID: \"4f66e97d-43ad-400a-8b2a-acc93a06e282\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lwcvz"
Sep 11 11:52:30.625893 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:30.625815    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 11:52:30.625893 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:30.625877    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f66e97d-43ad-400a-8b2a-acc93a06e282-cluster-monitoring-operator-tls podName:4f66e97d-43ad-400a-8b2a-acc93a06e282 nodeName:}" failed. No retries permitted until 2026-09-11 11:52:32.62585938 +0000 UTC m=+66.308258868 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f66e97d-43ad-400a-8b2a-acc93a06e282-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-lwcvz" (UID: "4f66e97d-43ad-400a-8b2a-acc93a06e282") : secret "cluster-monitoring-operator-tls" not found
Sep 11 11:52:32.089566 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:32.089530    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-htsk6" event={"ID":"223e97bb-f3c6-4476-bfa0-e8298a46d0cd","Type":"ContainerStarted","Data":"00753c0b00a30a661a7f8feed62b55ad512dbfd35783425cf27f1d3242bb12ff"}
Sep 11 11:52:32.091071 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:32.091052    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5pnqx_2233f21d-d3f8-44fc-92bf-03a86f7456ce/console-operator/0.log"
Sep 11 11:52:32.091174 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:32.091089    2565 generic.go:356] "Generic (PLEG): container finished" podID="2233f21d-d3f8-44fc-92bf-03a86f7456ce" containerID="92b24cfbec5294bef0a43bd14b9f2fd5f9af8a8e31f20ce9a900fc4c0d5d59a0" exitCode=255
Sep 11 11:52:32.091174 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:32.091119    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-5pnqx" event={"ID":"2233f21d-d3f8-44fc-92bf-03a86f7456ce","Type":"ContainerDied","Data":"92b24cfbec5294bef0a43bd14b9f2fd5f9af8a8e31f20ce9a900fc4c0d5d59a0"}
Sep 11 11:52:32.091348 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:32.091336    2565 scope.go:117] "RemoveContainer" containerID="92b24cfbec5294bef0a43bd14b9f2fd5f9af8a8e31f20ce9a900fc4c0d5d59a0"
Sep 11 11:52:32.104004 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:32.103957    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-htsk6" podStartSLOduration=2.482109028 podStartE2EDuration="4.103941597s" totalImagesPullingTime="1.621832569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:52:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:52:32.103810283 +0000 UTC m=+65.786209784" watchObservedRunningTime="2026-09-11 11:52:32.103941597 +0000 UTC m=+65.786341096"
Sep 11 11:52:32.540131 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:32.540081    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs\") pod \"network-metrics-daemon-jcs8z\" (UID: \"5b7c905b-ecae-4cbe-a5c2-3962ec391672\") " pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:52:32.540131 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:32.540138    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92208eb8-4897-4a87-ab47-b3b7e57ebcec-metrics-tls\") pod \"dns-default-5csdj\" (UID: \"92208eb8-4897-4a87-ab47-b3b7e57ebcec\") " pod="openshift-dns/dns-default-5csdj"
Sep 11 11:52:32.540386 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:32.540165    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:52:32.540386 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:32.540312    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 11:52:32.540386 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:32.540344    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 11:52:32.540386 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:32.540360    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d999f4bdd-vmwn8: secret "image-registry-tls" not found
Sep 11 11:52:32.540577 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:32.540390    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92208eb8-4897-4a87-ab47-b3b7e57ebcec-metrics-tls podName:92208eb8-4897-4a87-ab47-b3b7e57ebcec nodeName:}" failed. No retries permitted until 2026-09-11 11:53:04.540369816 +0000 UTC m=+98.222769306 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92208eb8-4897-4a87-ab47-b3b7e57ebcec-metrics-tls") pod "dns-default-5csdj" (UID: "92208eb8-4897-4a87-ab47-b3b7e57ebcec") : secret "dns-default-metrics-tls" not found
Sep 11 11:52:32.540577 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:32.540410    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls podName:ce076ee4-4421-459e-96ee-6cab9a0c807c nodeName:}" failed. No retries permitted until 2026-09-11 11:53:04.540398265 +0000 UTC m=+98.222797741 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls") pod "image-registry-d999f4bdd-vmwn8" (UID: "ce076ee4-4421-459e-96ee-6cab9a0c807c") : secret "image-registry-tls" not found
Sep 11 11:52:32.542994 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:32.542977    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 11:52:32.550415 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:32.550393    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 11:52:32.550552 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:32.550438    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs podName:5b7c905b-ecae-4cbe-a5c2-3962ec391672 nodeName:}" failed. No retries permitted until 2026-09-11 11:53:36.550426386 +0000 UTC m=+130.232825862 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs") pod "network-metrics-daemon-jcs8z" (UID: "5b7c905b-ecae-4cbe-a5c2-3962ec391672") : secret "metrics-daemon-secret" not found
Sep 11 11:52:32.641032 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:32.640996    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f66e97d-43ad-400a-8b2a-acc93a06e282-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-lwcvz\" (UID: \"4f66e97d-43ad-400a-8b2a-acc93a06e282\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lwcvz"
Sep 11 11:52:32.641134 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:32.641114    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/307113f7-a015-4c41-a620-b5c2b90b3828-original-pull-secret\") pod \"global-pull-secret-syncer-zdjj7\" (UID: \"307113f7-a015-4c41-a620-b5c2b90b3828\") " pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:52:32.641176 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:32.641135    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 11:52:32.641208 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:32.641174    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f66e97d-43ad-400a-8b2a-acc93a06e282-cluster-monitoring-operator-tls podName:4f66e97d-43ad-400a-8b2a-acc93a06e282 nodeName:}" failed. No retries permitted until 2026-09-11 11:52:36.641163829 +0000 UTC m=+70.323563304 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f66e97d-43ad-400a-8b2a-acc93a06e282-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-lwcvz" (UID: "4f66e97d-43ad-400a-8b2a-acc93a06e282") : secret "cluster-monitoring-operator-tls" not found
Sep 11 11:52:32.643496 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:32.643482    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 11:52:32.654219 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:32.654201    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/307113f7-a015-4c41-a620-b5c2b90b3828-original-pull-secret\") pod \"global-pull-secret-syncer-zdjj7\" (UID: \"307113f7-a015-4c41-a620-b5c2b90b3828\") " pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:52:32.741960 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:32.741927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tctgg\" (UniqueName: \"kubernetes.io/projected/3ccf784d-5d83-482f-b3cf-00f1a976f4be-kube-api-access-tctgg\") pod \"network-check-target-tbtxm\" (UID: \"3ccf784d-5d83-482f-b3cf-00f1a976f4be\") " pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:52:32.744365 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:32.744342    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdjj7"
Sep 11 11:52:32.744526 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:32.744509    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 11:52:32.754487 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:32.754467    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 11:52:32.765506 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:32.765483    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tctgg\" (UniqueName: \"kubernetes.io/projected/3ccf784d-5d83-482f-b3cf-00f1a976f4be-kube-api-access-tctgg\") pod \"network-check-target-tbtxm\" (UID: \"3ccf784d-5d83-482f-b3cf-00f1a976f4be\") " pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:52:32.948834 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:32.948806    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f8bwk\""
Sep 11 11:52:32.956786 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:32.956767    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:52:33.010241 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.010171    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zdjj7"]
Sep 11 11:52:33.014530 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:52:33.014494    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod307113f7_a015_4c41_a620_b5c2b90b3828.slice/crio-b72b86db982b8c3fbb3ad73291571733945fb744705af8712bce04d503eb9740 WatchSource:0}: Error finding container b72b86db982b8c3fbb3ad73291571733945fb744705af8712bce04d503eb9740: Status 404 returned error can't find the container with id b72b86db982b8c3fbb3ad73291571733945fb744705af8712bce04d503eb9740
Sep 11 11:52:33.095470 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.095407    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5pnqx_2233f21d-d3f8-44fc-92bf-03a86f7456ce/console-operator/1.log"
Sep 11 11:52:33.095838 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.095821    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5pnqx_2233f21d-d3f8-44fc-92bf-03a86f7456ce/console-operator/0.log"
Sep 11 11:52:33.095881 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.095856    2565 generic.go:356] "Generic (PLEG): container finished" podID="2233f21d-d3f8-44fc-92bf-03a86f7456ce" containerID="c9694009bbb5fe1a72ea1f3546f10b914125f260502aec582c39cba435863d27" exitCode=255
Sep 11 11:52:33.095934 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.095910    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-5pnqx" event={"ID":"2233f21d-d3f8-44fc-92bf-03a86f7456ce","Type":"ContainerDied","Data":"c9694009bbb5fe1a72ea1f3546f10b914125f260502aec582c39cba435863d27"}
Sep 11 11:52:33.096005 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.095991    2565 scope.go:117] "RemoveContainer" containerID="92b24cfbec5294bef0a43bd14b9f2fd5f9af8a8e31f20ce9a900fc4c0d5d59a0"
Sep 11 11:52:33.096174 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.096159    2565 scope.go:117] "RemoveContainer" containerID="c9694009bbb5fe1a72ea1f3546f10b914125f260502aec582c39cba435863d27"
Sep 11 11:52:33.096347 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:33.096328    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-5pnqx_openshift-console-operator(2233f21d-d3f8-44fc-92bf-03a86f7456ce)\"" pod="openshift-console-operator/console-operator-696884fb9c-5pnqx" podUID="2233f21d-d3f8-44fc-92bf-03a86f7456ce"
Sep 11 11:52:33.097297 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.097125    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zdjj7" event={"ID":"307113f7-a015-4c41-a620-b5c2b90b3828","Type":"ContainerStarted","Data":"b72b86db982b8c3fbb3ad73291571733945fb744705af8712bce04d503eb9740"}
Sep 11 11:52:33.226207 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.226178    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tbtxm"]
Sep 11 11:52:33.229022 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:52:33.228994    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ccf784d_5d83_482f_b3cf_00f1a976f4be.slice/crio-eb09ee5027577b341c1214c0d2af6cc133bfdeeefd644e5fa8b84a6721764046 WatchSource:0}: Error finding container eb09ee5027577b341c1214c0d2af6cc133bfdeeefd644e5fa8b84a6721764046: Status 404 returned error can't find the container with id eb09ee5027577b341c1214c0d2af6cc133bfdeeefd644e5fa8b84a6721764046
Sep 11 11:52:33.425136 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.425090    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8qkvp"]
Sep 11 11:52:33.429828 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.429805    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:52:33.432305 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.432280    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 11:52:33.432418 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.432327    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 11:52:33.432418 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.432336    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 11:52:33.432418 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.432361    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 11:52:33.432549 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.432439    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-685qw\""
Sep 11 11:52:33.437944 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.437922    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8qkvp"]
Sep 11 11:52:33.446892 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.446871    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3affa3aa-fa25-4aa6-9e45-2059f116ea81-crio-socket\") pod \"insights-runtime-extractor-8qkvp\" (UID: \"3affa3aa-fa25-4aa6-9e45-2059f116ea81\") " pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:52:33.446985 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.446909    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3affa3aa-fa25-4aa6-9e45-2059f116ea81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8qkvp\" (UID: \"3affa3aa-fa25-4aa6-9e45-2059f116ea81\") " pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:52:33.446985 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.446953    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3affa3aa-fa25-4aa6-9e45-2059f116ea81-data-volume\") pod \"insights-runtime-extractor-8qkvp\" (UID: \"3affa3aa-fa25-4aa6-9e45-2059f116ea81\") " pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:52:33.447126 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.446971    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3affa3aa-fa25-4aa6-9e45-2059f116ea81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8qkvp\" (UID: \"3affa3aa-fa25-4aa6-9e45-2059f116ea81\") " pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:52:33.450215 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.447294    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hvkn\" (UniqueName: \"kubernetes.io/projected/3affa3aa-fa25-4aa6-9e45-2059f116ea81-kube-api-access-5hvkn\") pod \"insights-runtime-extractor-8qkvp\" (UID: \"3affa3aa-fa25-4aa6-9e45-2059f116ea81\") " pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:52:33.548381 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.548335    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3affa3aa-fa25-4aa6-9e45-2059f116ea81-crio-socket\") pod \"insights-runtime-extractor-8qkvp\" (UID: \"3affa3aa-fa25-4aa6-9e45-2059f116ea81\") " pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:52:33.548381 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.548393    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3affa3aa-fa25-4aa6-9e45-2059f116ea81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8qkvp\" (UID: \"3affa3aa-fa25-4aa6-9e45-2059f116ea81\") " pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:52:33.548576 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.548433    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3affa3aa-fa25-4aa6-9e45-2059f116ea81-data-volume\") pod \"insights-runtime-extractor-8qkvp\" (UID: \"3affa3aa-fa25-4aa6-9e45-2059f116ea81\") " pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:52:33.548576 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.548449    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3affa3aa-fa25-4aa6-9e45-2059f116ea81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8qkvp\" (UID: \"3affa3aa-fa25-4aa6-9e45-2059f116ea81\") " pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:52:33.548576 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.548468    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hvkn\" (UniqueName: \"kubernetes.io/projected/3affa3aa-fa25-4aa6-9e45-2059f116ea81-kube-api-access-5hvkn\") pod \"insights-runtime-extractor-8qkvp\" (UID: \"3affa3aa-fa25-4aa6-9e45-2059f116ea81\") " pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:52:33.548576 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.548472    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3affa3aa-fa25-4aa6-9e45-2059f116ea81-crio-socket\") pod \"insights-runtime-extractor-8qkvp\" (UID: \"3affa3aa-fa25-4aa6-9e45-2059f116ea81\") " pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:52:33.548576 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:33.548560    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 11:52:33.548576 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:33.548575    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 11:52:33.548799 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:33.548629    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3affa3aa-fa25-4aa6-9e45-2059f116ea81-kube-rbac-proxy-cm podName:3affa3aa-fa25-4aa6-9e45-2059f116ea81 nodeName:}" failed. No retries permitted until 2026-09-11 11:52:34.048612901 +0000 UTC m=+67.731012378 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3affa3aa-fa25-4aa6-9e45-2059f116ea81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8qkvp" (UID: "3affa3aa-fa25-4aa6-9e45-2059f116ea81") : configmap "kube-rbac-proxy" not found
Sep 11 11:52:33.548799 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:33.548644    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3affa3aa-fa25-4aa6-9e45-2059f116ea81-insights-runtime-extractor-tls podName:3affa3aa-fa25-4aa6-9e45-2059f116ea81 nodeName:}" failed. No retries permitted until 2026-09-11 11:52:34.048637643 +0000 UTC m=+67.731037120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3affa3aa-fa25-4aa6-9e45-2059f116ea81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8qkvp" (UID: "3affa3aa-fa25-4aa6-9e45-2059f116ea81") : secret "insights-runtime-extractor-tls" not found
Sep 11 11:52:33.548878 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.548810    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3affa3aa-fa25-4aa6-9e45-2059f116ea81-data-volume\") pod \"insights-runtime-extractor-8qkvp\" (UID: \"3affa3aa-fa25-4aa6-9e45-2059f116ea81\") " pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:52:33.557371 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:33.557343    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hvkn\" (UniqueName: \"kubernetes.io/projected/3affa3aa-fa25-4aa6-9e45-2059f116ea81-kube-api-access-5hvkn\") pod \"insights-runtime-extractor-8qkvp\" (UID: \"3affa3aa-fa25-4aa6-9e45-2059f116ea81\") " pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:52:34.053489 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:34.053450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3affa3aa-fa25-4aa6-9e45-2059f116ea81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8qkvp\" (UID: \"3affa3aa-fa25-4aa6-9e45-2059f116ea81\") " pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:52:34.053667 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:34.053526    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 11:52:34.053667 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:34.053588    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3affa3aa-fa25-4aa6-9e45-2059f116ea81-kube-rbac-proxy-cm podName:3affa3aa-fa25-4aa6-9e45-2059f116ea81 nodeName:}" failed. No retries permitted until 2026-09-11 11:52:35.05357278 +0000 UTC m=+68.735972256 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3affa3aa-fa25-4aa6-9e45-2059f116ea81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8qkvp" (UID: "3affa3aa-fa25-4aa6-9e45-2059f116ea81") : configmap "kube-rbac-proxy" not found
Sep 11 11:52:34.053667 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:34.053605    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 11:52:34.053667 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:34.053652    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3affa3aa-fa25-4aa6-9e45-2059f116ea81-insights-runtime-extractor-tls podName:3affa3aa-fa25-4aa6-9e45-2059f116ea81 nodeName:}" failed. No retries permitted until 2026-09-11 11:52:35.053640417 +0000 UTC m=+68.736039913 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3affa3aa-fa25-4aa6-9e45-2059f116ea81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8qkvp" (UID: "3affa3aa-fa25-4aa6-9e45-2059f116ea81") : secret "insights-runtime-extractor-tls" not found
Sep 11 11:52:34.053667 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:34.053531    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3affa3aa-fa25-4aa6-9e45-2059f116ea81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8qkvp\" (UID: \"3affa3aa-fa25-4aa6-9e45-2059f116ea81\") " pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:52:34.101628 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:34.101599    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5pnqx_2233f21d-d3f8-44fc-92bf-03a86f7456ce/console-operator/1.log"
Sep 11 11:52:34.102036 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:34.101986    2565 scope.go:117] "RemoveContainer" containerID="c9694009bbb5fe1a72ea1f3546f10b914125f260502aec582c39cba435863d27"
Sep 11 11:52:34.102196 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:34.102168    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-5pnqx_openshift-console-operator(2233f21d-d3f8-44fc-92bf-03a86f7456ce)\"" pod="openshift-console-operator/console-operator-696884fb9c-5pnqx" podUID="2233f21d-d3f8-44fc-92bf-03a86f7456ce"
Sep 11 11:52:34.103124 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:34.103089    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tbtxm" event={"ID":"3ccf784d-5d83-482f-b3cf-00f1a976f4be","Type":"ContainerStarted","Data":"eb09ee5027577b341c1214c0d2af6cc133bfdeeefd644e5fa8b84a6721764046"}
Sep 11 11:52:35.061936 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:35.061900    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3affa3aa-fa25-4aa6-9e45-2059f116ea81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8qkvp\" (UID: \"3affa3aa-fa25-4aa6-9e45-2059f116ea81\") " pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:52:35.062136 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:35.061973    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3affa3aa-fa25-4aa6-9e45-2059f116ea81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8qkvp\" (UID: \"3affa3aa-fa25-4aa6-9e45-2059f116ea81\") " pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:52:35.062136 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:35.062030    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 11:52:35.062136 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:35.062093    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3affa3aa-fa25-4aa6-9e45-2059f116ea81-kube-rbac-proxy-cm podName:3affa3aa-fa25-4aa6-9e45-2059f116ea81 nodeName:}" failed. No retries permitted until 2026-09-11 11:52:37.06207472 +0000 UTC m=+70.744474217 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3affa3aa-fa25-4aa6-9e45-2059f116ea81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8qkvp" (UID: "3affa3aa-fa25-4aa6-9e45-2059f116ea81") : configmap "kube-rbac-proxy" not found
Sep 11 11:52:35.062136 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:35.062104    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 11:52:35.062136 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:35.062137    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3affa3aa-fa25-4aa6-9e45-2059f116ea81-insights-runtime-extractor-tls podName:3affa3aa-fa25-4aa6-9e45-2059f116ea81 nodeName:}" failed. No retries permitted until 2026-09-11 11:52:37.062127222 +0000 UTC m=+70.744526704 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3affa3aa-fa25-4aa6-9e45-2059f116ea81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8qkvp" (UID: "3affa3aa-fa25-4aa6-9e45-2059f116ea81") : secret "insights-runtime-extractor-tls" not found
Sep 11 11:52:35.192469 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:35.192409    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kp8l6_dc741275-985d-42ea-b85c-11c3b6af7009/dns-node-resolver/0.log"
Sep 11 11:52:36.196446 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:36.196416    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bc6h9_b2c794da-4296-49a0-a9af-491db5c72a12/node-ca/0.log"
Sep 11 11:52:36.676204 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:36.676165    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f66e97d-43ad-400a-8b2a-acc93a06e282-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-lwcvz\" (UID: \"4f66e97d-43ad-400a-8b2a-acc93a06e282\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lwcvz"
Sep 11 11:52:36.676389 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:36.676287    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 11:52:36.676389 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:36.676351    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f66e97d-43ad-400a-8b2a-acc93a06e282-cluster-monitoring-operator-tls podName:4f66e97d-43ad-400a-8b2a-acc93a06e282 nodeName:}" failed. No retries permitted until 2026-09-11 11:52:44.676334829 +0000 UTC m=+78.358734306 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f66e97d-43ad-400a-8b2a-acc93a06e282-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-lwcvz" (UID: "4f66e97d-43ad-400a-8b2a-acc93a06e282") : secret "cluster-monitoring-operator-tls" not found
Sep 11 11:52:36.992806 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:36.992668    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-96hq7_17b83b0d-839c-4c6c-9ab6-da6827bf62f0/serve-healthcheck-canary/0.log"
Sep 11 11:52:37.015123 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:37.015091    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-bjxh5"]
Sep 11 11:52:37.019335 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:37.019314    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-bjxh5"
Sep 11 11:52:37.021805 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:37.021780    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 11 11:52:37.021904 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:37.021846    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vmzx2\""
Sep 11 11:52:37.021904 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:37.021784    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 11 11:52:37.023094 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:37.023076    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 11 11:52:37.023204 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:37.023188    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 11 11:52:37.027453 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:37.027161    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-bjxh5"]
Sep 11 11:52:37.079599 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:37.079566    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcz4x\" (UniqueName: \"kubernetes.io/projected/f35ee34a-e09c-4d4d-8877-33148170cda6-kube-api-access-lcz4x\") pod \"service-ca-568869fdc5-bjxh5\" (UID: \"f35ee34a-e09c-4d4d-8877-33148170cda6\") " pod="openshift-service-ca/service-ca-568869fdc5-bjxh5"
Sep 11 11:52:37.079747 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:37.079659    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f35ee34a-e09c-4d4d-8877-33148170cda6-signing-cabundle\") pod \"service-ca-568869fdc5-bjxh5\" (UID: \"f35ee34a-e09c-4d4d-8877-33148170cda6\") " pod="openshift-service-ca/service-ca-568869fdc5-bjxh5"
Sep 11 11:52:37.079747 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:37.079716    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f35ee34a-e09c-4d4d-8877-33148170cda6-signing-key\") pod \"service-ca-568869fdc5-bjxh5\" (UID: \"f35ee34a-e09c-4d4d-8877-33148170cda6\") " pod="openshift-service-ca/service-ca-568869fdc5-bjxh5"
Sep 11 11:52:37.079844 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:37.079770    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3affa3aa-fa25-4aa6-9e45-2059f116ea81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8qkvp\" (UID: \"3affa3aa-fa25-4aa6-9e45-2059f116ea81\") " pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:52:37.079844 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:37.079822    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3affa3aa-fa25-4aa6-9e45-2059f116ea81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8qkvp\" (UID: \"3affa3aa-fa25-4aa6-9e45-2059f116ea81\") " pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:52:37.079906 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:37.079845    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 11:52:37.079906 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:37.079899    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3affa3aa-fa25-4aa6-9e45-2059f116ea81-kube-rbac-proxy-cm podName:3affa3aa-fa25-4aa6-9e45-2059f116ea81 nodeName:}" failed. No retries permitted until 2026-09-11 11:52:41.079881633 +0000 UTC m=+74.762281109 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3affa3aa-fa25-4aa6-9e45-2059f116ea81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8qkvp" (UID: "3affa3aa-fa25-4aa6-9e45-2059f116ea81") : configmap "kube-rbac-proxy" not found
Sep 11 11:52:37.080000 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:37.079929    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 11:52:37.080000 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:37.079972    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3affa3aa-fa25-4aa6-9e45-2059f116ea81-insights-runtime-extractor-tls podName:3affa3aa-fa25-4aa6-9e45-2059f116ea81 nodeName:}" failed. No retries permitted until 2026-09-11 11:52:41.079959956 +0000 UTC m=+74.762359447 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3affa3aa-fa25-4aa6-9e45-2059f116ea81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8qkvp" (UID: "3affa3aa-fa25-4aa6-9e45-2059f116ea81") : secret "insights-runtime-extractor-tls" not found
Sep 11 11:52:37.180697 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:37.180644    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f35ee34a-e09c-4d4d-8877-33148170cda6-signing-cabundle\") pod \"service-ca-568869fdc5-bjxh5\" (UID: \"f35ee34a-e09c-4d4d-8877-33148170cda6\") " pod="openshift-service-ca/service-ca-568869fdc5-bjxh5"
Sep 11 11:52:37.180853 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:37.180731    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f35ee34a-e09c-4d4d-8877-33148170cda6-signing-key\") pod \"service-ca-568869fdc5-bjxh5\" (UID: \"f35ee34a-e09c-4d4d-8877-33148170cda6\") " pod="openshift-service-ca/service-ca-568869fdc5-bjxh5"
Sep 11 11:52:37.180853 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:37.180778    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcz4x\" (UniqueName: \"kubernetes.io/projected/f35ee34a-e09c-4d4d-8877-33148170cda6-kube-api-access-lcz4x\") pod \"service-ca-568869fdc5-bjxh5\" (UID: \"f35ee34a-e09c-4d4d-8877-33148170cda6\") " pod="openshift-service-ca/service-ca-568869fdc5-bjxh5"
Sep 11 11:52:37.181960 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:37.181927    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f35ee34a-e09c-4d4d-8877-33148170cda6-signing-cabundle\") pod \"service-ca-568869fdc5-bjxh5\" (UID: \"f35ee34a-e09c-4d4d-8877-33148170cda6\") " pod="openshift-service-ca/service-ca-568869fdc5-bjxh5"
Sep 11 11:52:37.183530 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:37.183508    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f35ee34a-e09c-4d4d-8877-33148170cda6-signing-key\") pod \"service-ca-568869fdc5-bjxh5\" (UID: \"f35ee34a-e09c-4d4d-8877-33148170cda6\") " pod="openshift-service-ca/service-ca-568869fdc5-bjxh5"
Sep 11 11:52:37.189344 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:37.189319    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcz4x\" (UniqueName: \"kubernetes.io/projected/f35ee34a-e09c-4d4d-8877-33148170cda6-kube-api-access-lcz4x\") pod \"service-ca-568869fdc5-bjxh5\" (UID: \"f35ee34a-e09c-4d4d-8877-33148170cda6\") " pod="openshift-service-ca/service-ca-568869fdc5-bjxh5"
Sep 11 11:52:37.330815 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:37.330737    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-bjxh5"
Sep 11 11:52:38.116571 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:38.116540    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tbtxm" event={"ID":"3ccf784d-5d83-482f-b3cf-00f1a976f4be","Type":"ContainerStarted","Data":"be990869df0824376e70071119ef02a5035a378e4c94a0e94a53553d2042b9d0"}
Sep 11 11:52:38.116780 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:38.116762    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:52:38.133284 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:38.133143    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tbtxm" podStartSLOduration=66.338187284 podStartE2EDuration="1m11.133121154s" totalImagesPullingTime="4.79493387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:51:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:52:38.132944588 +0000 UTC m=+71.815344087" watchObservedRunningTime="2026-09-11 11:52:38.133121154 +0000 UTC m=+71.815520651"
Sep 11 11:52:38.286639 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:38.286563    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-bjxh5"]
Sep 11 11:52:38.289620 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:52:38.289581    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf35ee34a_e09c_4d4d_8877_33148170cda6.slice/crio-b8cf419618f21bca55aaa3e249a8b7f73d3dfec6814f1d9f534d297f4b1877fd WatchSource:0}: Error finding container b8cf419618f21bca55aaa3e249a8b7f73d3dfec6814f1d9f534d297f4b1877fd: Status 404 returned error can't find the container with id b8cf419618f21bca55aaa3e249a8b7f73d3dfec6814f1d9f534d297f4b1877fd
Sep 11 11:52:39.121359 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:39.121322    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-bjxh5" event={"ID":"f35ee34a-e09c-4d4d-8877-33148170cda6","Type":"ContainerStarted","Data":"b8cf419618f21bca55aaa3e249a8b7f73d3dfec6814f1d9f534d297f4b1877fd"}
Sep 11 11:52:39.123080 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:39.123043    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zdjj7" event={"ID":"307113f7-a015-4c41-a620-b5c2b90b3828","Type":"ContainerStarted","Data":"2a0328328e721630dd75e54a6d6c2cd331c8eee7e21ac0352728214821da207a"}
Sep 11 11:52:39.139033 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:39.138978    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zdjj7" podStartSLOduration=66.118111093 podStartE2EDuration="1m11.138958886s" totalImagesPullingTime="5.020847793s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 11:51:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:52:39.137606558 +0000 UTC m=+72.820006060" watchObservedRunningTime="2026-09-11 11:52:39.138958886 +0000 UTC m=+72.821358385"
Sep 11 11:52:39.167020 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:39.166987    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-5pnqx"
Sep 11 11:52:39.167152 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:39.167047    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-5pnqx"
Sep 11 11:52:39.167405 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:39.167388    2565 scope.go:117] "RemoveContainer" containerID="c9694009bbb5fe1a72ea1f3546f10b914125f260502aec582c39cba435863d27"
Sep 11 11:52:39.167590 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:39.167568    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-5pnqx_openshift-console-operator(2233f21d-d3f8-44fc-92bf-03a86f7456ce)\"" pod="openshift-console-operator/console-operator-696884fb9c-5pnqx" podUID="2233f21d-d3f8-44fc-92bf-03a86f7456ce"
Sep 11 11:52:41.111193 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:41.111145    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3affa3aa-fa25-4aa6-9e45-2059f116ea81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8qkvp\" (UID: \"3affa3aa-fa25-4aa6-9e45-2059f116ea81\") " pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:52:41.111193 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:41.111194    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3affa3aa-fa25-4aa6-9e45-2059f116ea81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8qkvp\" (UID: \"3affa3aa-fa25-4aa6-9e45-2059f116ea81\") " pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:52:41.111645 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:41.111273    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 11:52:41.111645 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:41.111356    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3affa3aa-fa25-4aa6-9e45-2059f116ea81-kube-rbac-proxy-cm podName:3affa3aa-fa25-4aa6-9e45-2059f116ea81 nodeName:}" failed. No retries permitted until 2026-09-11 11:52:49.111332965 +0000 UTC m=+82.793732455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3affa3aa-fa25-4aa6-9e45-2059f116ea81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8qkvp" (UID: "3affa3aa-fa25-4aa6-9e45-2059f116ea81") : configmap "kube-rbac-proxy" not found
Sep 11 11:52:41.111645 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:41.111285    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 11:52:41.111645 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:41.111397    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3affa3aa-fa25-4aa6-9e45-2059f116ea81-insights-runtime-extractor-tls podName:3affa3aa-fa25-4aa6-9e45-2059f116ea81 nodeName:}" failed. No retries permitted until 2026-09-11 11:52:49.11138656 +0000 UTC m=+82.793786055 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3affa3aa-fa25-4aa6-9e45-2059f116ea81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8qkvp" (UID: "3affa3aa-fa25-4aa6-9e45-2059f116ea81") : secret "insights-runtime-extractor-tls" not found
Sep 11 11:52:41.131062 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:41.131031    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-bjxh5" event={"ID":"f35ee34a-e09c-4d4d-8877-33148170cda6","Type":"ContainerStarted","Data":"58f7fdb74ff647161ffbe52d24c671026f8abdcd663aa104a8d9027bd9926d42"}
Sep 11 11:52:41.147976 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:41.147932    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-bjxh5" podStartSLOduration=2.193484354 podStartE2EDuration="4.147917574s" totalImagesPullingTime="1.95443322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:52:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:52:41.147458998 +0000 UTC m=+74.829858499" watchObservedRunningTime="2026-09-11 11:52:41.147917574 +0000 UTC m=+74.830317100"
Sep 11 11:52:44.744149 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:44.744113    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f66e97d-43ad-400a-8b2a-acc93a06e282-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-lwcvz\" (UID: \"4f66e97d-43ad-400a-8b2a-acc93a06e282\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lwcvz"
Sep 11 11:52:44.744583 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:44.744222    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 11:52:44.744583 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:44.744277    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f66e97d-43ad-400a-8b2a-acc93a06e282-cluster-monitoring-operator-tls podName:4f66e97d-43ad-400a-8b2a-acc93a06e282 nodeName:}" failed. No retries permitted until 2026-09-11 11:53:00.744262589 +0000 UTC m=+94.426662078 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4f66e97d-43ad-400a-8b2a-acc93a06e282-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-lwcvz" (UID: "4f66e97d-43ad-400a-8b2a-acc93a06e282") : secret "cluster-monitoring-operator-tls" not found
Sep 11 11:52:49.185282 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:49.185145    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3affa3aa-fa25-4aa6-9e45-2059f116ea81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8qkvp\" (UID: \"3affa3aa-fa25-4aa6-9e45-2059f116ea81\") " pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:52:49.185282 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:49.185187    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3affa3aa-fa25-4aa6-9e45-2059f116ea81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8qkvp\" (UID: \"3affa3aa-fa25-4aa6-9e45-2059f116ea81\") " pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:52:49.185820 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:49.185323    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 11:52:49.185820 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:52:49.185377    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3affa3aa-fa25-4aa6-9e45-2059f116ea81-insights-runtime-extractor-tls podName:3affa3aa-fa25-4aa6-9e45-2059f116ea81 nodeName:}" failed. No retries permitted until 2026-09-11 11:53:05.185362125 +0000 UTC m=+98.867761601 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3affa3aa-fa25-4aa6-9e45-2059f116ea81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8qkvp" (UID: "3affa3aa-fa25-4aa6-9e45-2059f116ea81") : secret "insights-runtime-extractor-tls" not found
Sep 11 11:52:49.185919 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:49.185814    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3affa3aa-fa25-4aa6-9e45-2059f116ea81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8qkvp\" (UID: \"3affa3aa-fa25-4aa6-9e45-2059f116ea81\") " pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:52:50.836490 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:50.836456    2565 scope.go:117] "RemoveContainer" containerID="c9694009bbb5fe1a72ea1f3546f10b914125f260502aec582c39cba435863d27"
Sep 11 11:52:51.165849 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:51.165819    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5pnqx_2233f21d-d3f8-44fc-92bf-03a86f7456ce/console-operator/1.log"
Sep 11 11:52:51.166005 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:51.165893    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-5pnqx" event={"ID":"2233f21d-d3f8-44fc-92bf-03a86f7456ce","Type":"ContainerStarted","Data":"8b7deb5fa9fe4fd81996dbbf371d44e8fbfc7caf03bbbb926a5d1a68d69c698e"}
Sep 11 11:52:51.166243 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:51.166218    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-5pnqx"
Sep 11 11:52:51.182750 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:51.182697    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-5pnqx" podStartSLOduration=20.783253496 podStartE2EDuration="23.182669915s" totalImagesPullingTime="2.399416419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:52:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:52:51.181590066 +0000 UTC m=+84.863989565" watchObservedRunningTime="2026-09-11 11:52:51.182669915 +0000 UTC m=+84.865069412"
Sep 11 11:52:52.166748 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:52.166679    2565 patch_prober.go:28] interesting pod/console-operator-696884fb9c-5pnqx container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.10:8443/readyz\": context deadline exceeded" start-of-body=
Sep 11 11:52:52.167231 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:52.166782    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-696884fb9c-5pnqx" podUID="2233f21d-d3f8-44fc-92bf-03a86f7456ce" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.10:8443/readyz\": context deadline exceeded"
Sep 11 11:52:52.598470 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:52.598400    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-5pnqx"
Sep 11 11:52:55.498280 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.498239    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x"]
Sep 11 11:52:55.501482 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.501458    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x"
Sep 11 11:52:55.503902 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.503881    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 11 11:52:55.504061 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.504040    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 11 11:52:55.506070 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.506050    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 11 11:52:55.506188 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.506086    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 11 11:52:55.506361 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.506343    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 11 11:52:55.506449 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.506398    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 11 11:52:55.506449 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.506419    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 11 11:52:55.511923 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.511900    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x"]
Sep 11 11:52:55.635229 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.635192    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6364a21c-23dd-42aa-9449-33c3f20458f9-hub\") pod \"cluster-proxy-proxy-agent-7c7876c779-csh8x\" (UID: \"6364a21c-23dd-42aa-9449-33c3f20458f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x"
Sep 11 11:52:55.635413 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.635249    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6364a21c-23dd-42aa-9449-33c3f20458f9-ca\") pod \"cluster-proxy-proxy-agent-7c7876c779-csh8x\" (UID: \"6364a21c-23dd-42aa-9449-33c3f20458f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x"
Sep 11 11:52:55.635413 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.635303    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6364a21c-23dd-42aa-9449-33c3f20458f9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c7876c779-csh8x\" (UID: \"6364a21c-23dd-42aa-9449-33c3f20458f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x"
Sep 11 11:52:55.635413 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.635346    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lds5x\" (UniqueName: \"kubernetes.io/projected/6364a21c-23dd-42aa-9449-33c3f20458f9-kube-api-access-lds5x\") pod \"cluster-proxy-proxy-agent-7c7876c779-csh8x\" (UID: \"6364a21c-23dd-42aa-9449-33c3f20458f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x"
Sep 11 11:52:55.635413 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.635381    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6364a21c-23dd-42aa-9449-33c3f20458f9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c7876c779-csh8x\" (UID: \"6364a21c-23dd-42aa-9449-33c3f20458f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x"
Sep 11 11:52:55.635413 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.635399    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6364a21c-23dd-42aa-9449-33c3f20458f9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7c7876c779-csh8x\" (UID: \"6364a21c-23dd-42aa-9449-33c3f20458f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x"
Sep 11 11:52:55.736822 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.736791    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6364a21c-23dd-42aa-9449-33c3f20458f9-hub\") pod \"cluster-proxy-proxy-agent-7c7876c779-csh8x\" (UID: \"6364a21c-23dd-42aa-9449-33c3f20458f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x"
Sep 11 11:52:55.737011 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.736837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6364a21c-23dd-42aa-9449-33c3f20458f9-ca\") pod \"cluster-proxy-proxy-agent-7c7876c779-csh8x\" (UID: \"6364a21c-23dd-42aa-9449-33c3f20458f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x"
Sep 11 11:52:55.737011 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.736863    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6364a21c-23dd-42aa-9449-33c3f20458f9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c7876c779-csh8x\" (UID: \"6364a21c-23dd-42aa-9449-33c3f20458f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x"
Sep 11 11:52:55.737011 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.736919    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lds5x\" (UniqueName: \"kubernetes.io/projected/6364a21c-23dd-42aa-9449-33c3f20458f9-kube-api-access-lds5x\") pod \"cluster-proxy-proxy-agent-7c7876c779-csh8x\" (UID: \"6364a21c-23dd-42aa-9449-33c3f20458f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x"
Sep 11 11:52:55.737011 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.736961    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6364a21c-23dd-42aa-9449-33c3f20458f9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c7876c779-csh8x\" (UID: \"6364a21c-23dd-42aa-9449-33c3f20458f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x"
Sep 11 11:52:55.737011 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.736987    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6364a21c-23dd-42aa-9449-33c3f20458f9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7c7876c779-csh8x\" (UID: \"6364a21c-23dd-42aa-9449-33c3f20458f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x"
Sep 11 11:52:55.737783 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.737742    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6364a21c-23dd-42aa-9449-33c3f20458f9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7c7876c779-csh8x\" (UID: \"6364a21c-23dd-42aa-9449-33c3f20458f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x"
Sep 11 11:52:55.739527 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.739503    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6364a21c-23dd-42aa-9449-33c3f20458f9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c7876c779-csh8x\" (UID: \"6364a21c-23dd-42aa-9449-33c3f20458f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x"
Sep 11 11:52:55.739626 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.739544    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6364a21c-23dd-42aa-9449-33c3f20458f9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c7876c779-csh8x\" (UID: \"6364a21c-23dd-42aa-9449-33c3f20458f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x"
Sep 11 11:52:55.739626 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.739620    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6364a21c-23dd-42aa-9449-33c3f20458f9-hub\") pod \"cluster-proxy-proxy-agent-7c7876c779-csh8x\" (UID: \"6364a21c-23dd-42aa-9449-33c3f20458f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x"
Sep 11 11:52:55.739721 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.739648    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6364a21c-23dd-42aa-9449-33c3f20458f9-ca\") pod \"cluster-proxy-proxy-agent-7c7876c779-csh8x\" (UID: \"6364a21c-23dd-42aa-9449-33c3f20458f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x"
Sep 11 11:52:55.747304 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.747277    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lds5x\" (UniqueName: \"kubernetes.io/projected/6364a21c-23dd-42aa-9449-33c3f20458f9-kube-api-access-lds5x\") pod \"cluster-proxy-proxy-agent-7c7876c779-csh8x\" (UID: \"6364a21c-23dd-42aa-9449-33c3f20458f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x"
Sep 11 11:52:55.829169 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:55.829093    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x"
Sep 11 11:52:56.104269 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:56.104201    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x"]
Sep 11 11:52:56.107916 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:52:56.107891    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6364a21c_23dd_42aa_9449_33c3f20458f9.slice/crio-53d660ecd28f6a38ab519419e39d88f7ee7206b36c3d86838c9f6a3075009305 WatchSource:0}: Error finding container 53d660ecd28f6a38ab519419e39d88f7ee7206b36c3d86838c9f6a3075009305: Status 404 returned error can't find the container with id 53d660ecd28f6a38ab519419e39d88f7ee7206b36c3d86838c9f6a3075009305
Sep 11 11:52:56.183984 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:52:56.183952    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x" event={"ID":"6364a21c-23dd-42aa-9449-33c3f20458f9","Type":"ContainerStarted","Data":"53d660ecd28f6a38ab519419e39d88f7ee7206b36c3d86838c9f6a3075009305"}
Sep 11 11:53:00.199889 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:00.199851    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x" event={"ID":"6364a21c-23dd-42aa-9449-33c3f20458f9","Type":"ContainerStarted","Data":"4015fcb477b47ac2e5d993c673fa16d06f26328c7edc7e2306df952388c9aefc"}
Sep 11 11:53:00.200439 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:00.199899    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x" event={"ID":"6364a21c-23dd-42aa-9449-33c3f20458f9","Type":"ContainerStarted","Data":"3320ae8df90bd6cc2c8cc0ffba00785b2f9c227f531606eaeea0df43a8fc0ed0"}
Sep 11 11:53:00.200439 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:00.199916    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x" event={"ID":"6364a21c-23dd-42aa-9449-33c3f20458f9","Type":"ContainerStarted","Data":"90af6ceacc9911f1dd480d15b40bc7689a7fbe7ba8acf5d1d3c190994ed4a09e"}
Sep 11 11:53:00.218362 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:00.218314    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c7876c779-csh8x" podStartSLOduration=1.715804919 podStartE2EDuration="5.218299031s" totalImagesPullingTime="3.502494112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:53:00.2161915 +0000 UTC m=+93.898590999" watchObservedRunningTime="2026-09-11 11:53:00.218299031 +0000 UTC m=+93.900698529"
Sep 11 11:53:00.777576 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:00.777541    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f66e97d-43ad-400a-8b2a-acc93a06e282-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-lwcvz\" (UID: \"4f66e97d-43ad-400a-8b2a-acc93a06e282\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lwcvz"
Sep 11 11:53:00.780219 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:00.780189    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f66e97d-43ad-400a-8b2a-acc93a06e282-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-lwcvz\" (UID: \"4f66e97d-43ad-400a-8b2a-acc93a06e282\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lwcvz"
Sep 11 11:53:01.050934 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:01.050852    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lwcvz"
Sep 11 11:53:01.317508 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:01.317303    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-lwcvz"]
Sep 11 11:53:01.320037 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:53:01.320003    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f66e97d_43ad_400a_8b2a_acc93a06e282.slice/crio-74f118b779c18f9f516c812646156161bba3588c725bd686108cfe0600da4284 WatchSource:0}: Error finding container 74f118b779c18f9f516c812646156161bba3588c725bd686108cfe0600da4284: Status 404 returned error can't find the container with id 74f118b779c18f9f516c812646156161bba3588c725bd686108cfe0600da4284
Sep 11 11:53:02.206577 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:02.206543    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lwcvz" event={"ID":"4f66e97d-43ad-400a-8b2a-acc93a06e282","Type":"ContainerStarted","Data":"74f118b779c18f9f516c812646156161bba3588c725bd686108cfe0600da4284"}
Sep 11 11:53:04.215014 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:04.214928    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lwcvz" event={"ID":"4f66e97d-43ad-400a-8b2a-acc93a06e282","Type":"ContainerStarted","Data":"bcc7187c4a5b97874204eb8126818420d1a792badd0e7a91943a2c3649f36078"}
Sep 11 11:53:04.231263 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:04.231205    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-lwcvz" podStartSLOduration=33.959644862 podStartE2EDuration="36.231188285s" totalImagesPullingTime="2.271543423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:52:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:53:04.230748612 +0000 UTC m=+97.913148111" watchObservedRunningTime="2026-09-11 11:53:04.231188285 +0000 UTC m=+97.913587827"
Sep 11 11:53:04.608393 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:04.608301    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92208eb8-4897-4a87-ab47-b3b7e57ebcec-metrics-tls\") pod \"dns-default-5csdj\" (UID: \"92208eb8-4897-4a87-ab47-b3b7e57ebcec\") " pod="openshift-dns/dns-default-5csdj"
Sep 11 11:53:04.608393 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:04.608369    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:53:04.610841 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:04.610808    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92208eb8-4897-4a87-ab47-b3b7e57ebcec-metrics-tls\") pod \"dns-default-5csdj\" (UID: \"92208eb8-4897-4a87-ab47-b3b7e57ebcec\") " pod="openshift-dns/dns-default-5csdj"
Sep 11 11:53:04.610954 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:04.610868    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls\") pod \"image-registry-d999f4bdd-vmwn8\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") " pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:53:04.877928 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:04.877844    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6j76c\""
Sep 11 11:53:04.886510 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:04.886474    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:53:04.893887 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:04.893865    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mvnq6\""
Sep 11 11:53:04.901924 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:04.901898    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5csdj"
Sep 11 11:53:05.157058 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:05.157031    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d999f4bdd-vmwn8"]
Sep 11 11:53:05.159787 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:53:05.159761    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce076ee4_4421_459e_96ee_6cab9a0c807c.slice/crio-ed3a48abd31f02c4480e04bfc2e69f12b3e265536e7545088f58e253b6ce649a WatchSource:0}: Error finding container ed3a48abd31f02c4480e04bfc2e69f12b3e265536e7545088f58e253b6ce649a: Status 404 returned error can't find the container with id ed3a48abd31f02c4480e04bfc2e69f12b3e265536e7545088f58e253b6ce649a
Sep 11 11:53:05.177941 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:05.177922    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5csdj"]
Sep 11 11:53:05.191494 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:53:05.191471    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92208eb8_4897_4a87_ab47_b3b7e57ebcec.slice/crio-029b397c80dead7d1e254cdce6fb785ed82ed15871a76cdce87c10b44c28134a WatchSource:0}: Error finding container 029b397c80dead7d1e254cdce6fb785ed82ed15871a76cdce87c10b44c28134a: Status 404 returned error can't find the container with id 029b397c80dead7d1e254cdce6fb785ed82ed15871a76cdce87c10b44c28134a
Sep 11 11:53:05.213616 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:05.213593    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3affa3aa-fa25-4aa6-9e45-2059f116ea81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8qkvp\" (UID: \"3affa3aa-fa25-4aa6-9e45-2059f116ea81\") " pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:53:05.215800 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:05.215776    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3affa3aa-fa25-4aa6-9e45-2059f116ea81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8qkvp\" (UID: \"3affa3aa-fa25-4aa6-9e45-2059f116ea81\") " pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:53:05.219397 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:05.219370    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8" event={"ID":"ce076ee4-4421-459e-96ee-6cab9a0c807c","Type":"ContainerStarted","Data":"ed3a48abd31f02c4480e04bfc2e69f12b3e265536e7545088f58e253b6ce649a"}
Sep 11 11:53:05.220517 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:05.220424    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5csdj" event={"ID":"92208eb8-4897-4a87-ab47-b3b7e57ebcec","Type":"ContainerStarted","Data":"029b397c80dead7d1e254cdce6fb785ed82ed15871a76cdce87c10b44c28134a"}
Sep 11 11:53:05.239525 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:05.239502    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8qkvp"
Sep 11 11:53:05.507906 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:05.507829    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8qkvp"]
Sep 11 11:53:05.510414 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:53:05.510386    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3affa3aa_fa25_4aa6_9e45_2059f116ea81.slice/crio-83164cfefb1c5f84b21ce50f46f729c21122fe7a9c8ac17569278e7e819cab60 WatchSource:0}: Error finding container 83164cfefb1c5f84b21ce50f46f729c21122fe7a9c8ac17569278e7e819cab60: Status 404 returned error can't find the container with id 83164cfefb1c5f84b21ce50f46f729c21122fe7a9c8ac17569278e7e819cab60
Sep 11 11:53:06.227364 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:06.227310    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8qkvp" event={"ID":"3affa3aa-fa25-4aa6-9e45-2059f116ea81","Type":"ContainerStarted","Data":"53b4b14fa4ead7a40833c4d07ea2efb7ab00593b5a6514f085020523e44f570b"}
Sep 11 11:53:06.227879 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:06.227401    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8qkvp" event={"ID":"3affa3aa-fa25-4aa6-9e45-2059f116ea81","Type":"ContainerStarted","Data":"83164cfefb1c5f84b21ce50f46f729c21122fe7a9c8ac17569278e7e819cab60"}
Sep 11 11:53:06.229370 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:06.229333    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8" event={"ID":"ce076ee4-4421-459e-96ee-6cab9a0c807c","Type":"ContainerStarted","Data":"3874a77491e5dd998ade1d2b812af86c262942219e6e19f879e1ac75bbf35f75"}
Sep 11 11:53:06.229503 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:06.229449    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:53:06.250006 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:06.249961    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8" podStartSLOduration=98.249946839 podStartE2EDuration="1m38.249946839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:51:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:53:06.248744081 +0000 UTC m=+99.931143579" watchObservedRunningTime="2026-09-11 11:53:06.249946839 +0000 UTC m=+99.932346336"
Sep 11 11:53:07.234991 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:07.234952    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5csdj" event={"ID":"92208eb8-4897-4a87-ab47-b3b7e57ebcec","Type":"ContainerStarted","Data":"4e9f57737b2aca3c3b5148b2eba56a907375b1d675edd2128df4bb4270b690a1"}
Sep 11 11:53:07.235435 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:07.235009    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5csdj" event={"ID":"92208eb8-4897-4a87-ab47-b3b7e57ebcec","Type":"ContainerStarted","Data":"0c1f7e586b8a9d3deaddef247f0272ac40dc96461207f82848683658c268a41b"}
Sep 11 11:53:07.235435 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:07.235078    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5csdj"
Sep 11 11:53:07.237013 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:07.236987    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8qkvp" event={"ID":"3affa3aa-fa25-4aa6-9e45-2059f116ea81","Type":"ContainerStarted","Data":"65c2ee36a424582413e92a299744da483fa9dd13ce7ebc8376428fb38a0be293"}
Sep 11 11:53:07.251932 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:07.251891    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5csdj" podStartSLOduration=65.581418351 podStartE2EDuration="1m7.251878977s" totalImagesPullingTime="1.670460626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:52:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:53:07.250080841 +0000 UTC m=+100.932480340" watchObservedRunningTime="2026-09-11 11:53:07.251878977 +0000 UTC m=+100.934278474"
Sep 11 11:53:09.125409 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:09.125373    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tbtxm"
Sep 11 11:53:09.247118 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:09.247084    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8qkvp" event={"ID":"3affa3aa-fa25-4aa6-9e45-2059f116ea81","Type":"ContainerStarted","Data":"a9121bddcc81e63813a03f014603ddfb4f6cfb3c473ffe5db57136235ab3d27d"}
Sep 11 11:53:09.264093 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:09.264050    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8qkvp" podStartSLOduration=33.460267041 podStartE2EDuration="36.264034202s" totalImagesPullingTime="2.803767161s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 11:52:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:53:09.262886913 +0000 UTC m=+102.945286422" watchObservedRunningTime="2026-09-11 11:53:09.264034202 +0000 UTC m=+102.946433701"
Sep 11 11:53:11.502742 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.502703    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-djqrt"]
Sep 11 11:53:11.540898 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.540872    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.543583 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.543558    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gz4mc\""
Sep 11 11:53:11.543739 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.543585    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 11:53:11.543986 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.543854    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 11:53:11.543986 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.543873    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 11:53:11.544506 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.544489    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 11:53:11.664830 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.664789    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-metrics-client-ca\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.665005 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.664858    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-node-exporter-accelerators-collector-config\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.665005 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.664884    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.665005 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.664948    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw9gb\" (UniqueName: \"kubernetes.io/projected/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-kube-api-access-fw9gb\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.665113 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.665008    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-root\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.665113 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.665033    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-node-exporter-textfile\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.665113 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.665063    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-sys\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.665113 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.665085    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-node-exporter-tls\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.665113 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.665102    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-node-exporter-wtmp\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.766091 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.766016    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-metrics-client-ca\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.766091 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.766070    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-node-exporter-accelerators-collector-config\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.766309 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.766091    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.766309 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.766119    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw9gb\" (UniqueName: \"kubernetes.io/projected/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-kube-api-access-fw9gb\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.766309 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.766199    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-root\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.766309 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.766227    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-node-exporter-textfile\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.766309 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.766261    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-sys\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.766309 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.766291    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-node-exporter-tls\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.766611 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.766316    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-node-exporter-wtmp\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.766611 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.766405    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-sys\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.766611 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.766415    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-root\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.766611 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.766473    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-node-exporter-wtmp\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.766829 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.766775    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-metrics-client-ca\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.766829 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.766774    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-node-exporter-textfile\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.766940 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.766904    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-node-exporter-accelerators-collector-config\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.768747 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.768716    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.768864 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.768827    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-node-exporter-tls\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.773945 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.773922    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw9gb\" (UniqueName: \"kubernetes.io/projected/a5f7d4ab-eb5a-4600-b052-2ad1f99cef14-kube-api-access-fw9gb\") pod \"node-exporter-djqrt\" (UID: \"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14\") " pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.853312 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:11.853278    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-djqrt"
Sep 11 11:53:11.900513 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:53:11.900481    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5f7d4ab_eb5a_4600_b052_2ad1f99cef14.slice/crio-a247276ad1d58758e42e9c5ad2f6d13b641ebc697400b21997b7b1be7bcfbc3e WatchSource:0}: Error finding container a247276ad1d58758e42e9c5ad2f6d13b641ebc697400b21997b7b1be7bcfbc3e: Status 404 returned error can't find the container with id a247276ad1d58758e42e9c5ad2f6d13b641ebc697400b21997b7b1be7bcfbc3e
Sep 11 11:53:12.260547 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:12.260513    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-djqrt" event={"ID":"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14","Type":"ContainerStarted","Data":"a247276ad1d58758e42e9c5ad2f6d13b641ebc697400b21997b7b1be7bcfbc3e"}
Sep 11 11:53:13.266106 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:13.266072    2565 generic.go:356] "Generic (PLEG): container finished" podID="a5f7d4ab-eb5a-4600-b052-2ad1f99cef14" containerID="0e516af255ef175aca8a80fbed7c9051e7c043bbd34cd193e31c0994d116cc59" exitCode=0
Sep 11 11:53:13.266504 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:13.266124    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-djqrt" event={"ID":"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14","Type":"ContainerDied","Data":"0e516af255ef175aca8a80fbed7c9051e7c043bbd34cd193e31c0994d116cc59"}
Sep 11 11:53:14.272213 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:14.272182    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-djqrt" event={"ID":"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14","Type":"ContainerStarted","Data":"15b67ef0e1b03f6ace89a5e27d2c6aff064ec36f43768dfb4d7e67bee877599e"}
Sep 11 11:53:14.272559 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:14.272232    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-djqrt" event={"ID":"a5f7d4ab-eb5a-4600-b052-2ad1f99cef14","Type":"ContainerStarted","Data":"eaf75a82bd91c8373a26efb06a622a046604cfb9d6068af9b1fc4683eb62b78e"}
Sep 11 11:53:14.292087 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:14.292034    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-djqrt" podStartSLOduration=2.040458468 podStartE2EDuration="3.292017384s" totalImagesPullingTime="1.191706048s" totalInitContainerRuntime="59.852868ms" isStatefulPod=true podCreationTimestamp="2026-09-11 11:53:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:53:14.290064336 +0000 UTC m=+107.972463849" watchObservedRunningTime="2026-09-11 11:53:14.292017384 +0000 UTC m=+107.974416882"
Sep 11 11:53:17.243804 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:17.243770    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5csdj"
Sep 11 11:53:17.463744 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:17.463711    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d999f4bdd-vmwn8"]
Sep 11 11:53:27.471554 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:27.471523    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:53:36.557570 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:36.557519    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs\") pod \"network-metrics-daemon-jcs8z\" (UID: \"5b7c905b-ecae-4cbe-a5c2-3962ec391672\") " pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:53:36.559780 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:36.559758    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b7c905b-ecae-4cbe-a5c2-3962ec391672-metrics-certs\") pod \"network-metrics-daemon-jcs8z\" (UID: \"5b7c905b-ecae-4cbe-a5c2-3962ec391672\") " pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:53:36.854144 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:36.854063    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-74fqm\""
Sep 11 11:53:36.861578 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:36.861560    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jcs8z"
Sep 11 11:53:37.132594 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:37.132522    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jcs8z"]
Sep 11 11:53:37.134942 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:53:37.134915    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b7c905b_ecae_4cbe_a5c2_3962ec391672.slice/crio-175a16c50e0b081bb712bfdfad1f0fe32c76279d33dcdd584263147a1cc925d7 WatchSource:0}: Error finding container 175a16c50e0b081bb712bfdfad1f0fe32c76279d33dcdd584263147a1cc925d7: Status 404 returned error can't find the container with id 175a16c50e0b081bb712bfdfad1f0fe32c76279d33dcdd584263147a1cc925d7
Sep 11 11:53:37.349944 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:37.349908    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jcs8z" event={"ID":"5b7c905b-ecae-4cbe-a5c2-3962ec391672","Type":"ContainerStarted","Data":"175a16c50e0b081bb712bfdfad1f0fe32c76279d33dcdd584263147a1cc925d7"}
Sep 11 11:53:39.358352 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:39.358316    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jcs8z" event={"ID":"5b7c905b-ecae-4cbe-a5c2-3962ec391672","Type":"ContainerStarted","Data":"6043fc7d0eb2780b809e325c3579ce5ef08dc33f6d5dec3a53bee6ba1d45220f"}
Sep 11 11:53:39.358751 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:39.358374    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jcs8z" event={"ID":"5b7c905b-ecae-4cbe-a5c2-3962ec391672","Type":"ContainerStarted","Data":"769d7973825a8d0490ec19f49ed0647807673f6dfe2c155fd005e7fdae8fe56d"}
Sep 11 11:53:39.374147 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:39.374101    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jcs8z" podStartSLOduration=131.079815707 podStartE2EDuration="2m12.374087063s" totalImagesPullingTime="1.294271356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:51:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:53:39.372524839 +0000 UTC m=+133.054924349" watchObservedRunningTime="2026-09-11 11:53:39.374087063 +0000 UTC m=+133.056486616"
Sep 11 11:53:42.482706 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:42.482652    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8" podUID="ce076ee4-4421-459e-96ee-6cab9a0c807c" containerName="registry" containerID="cri-o://3874a77491e5dd998ade1d2b812af86c262942219e6e19f879e1ac75bbf35f75" gracePeriod=30
Sep 11 11:53:42.718224 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:42.718202    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:53:42.801240 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:42.801160    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce076ee4-4421-459e-96ee-6cab9a0c807c-image-registry-private-configuration\") pod \"ce076ee4-4421-459e-96ee-6cab9a0c807c\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") "
Sep 11 11:53:42.801240 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:42.801200    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce076ee4-4421-459e-96ee-6cab9a0c807c-trusted-ca\") pod \"ce076ee4-4421-459e-96ee-6cab9a0c807c\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") "
Sep 11 11:53:42.801240 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:42.801239    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce076ee4-4421-459e-96ee-6cab9a0c807c-ca-trust-extracted\") pod \"ce076ee4-4421-459e-96ee-6cab9a0c807c\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") "
Sep 11 11:53:42.801497 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:42.801267    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls\") pod \"ce076ee4-4421-459e-96ee-6cab9a0c807c\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") "
Sep 11 11:53:42.801497 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:42.801300    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-certificates\") pod \"ce076ee4-4421-459e-96ee-6cab9a0c807c\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") "
Sep 11 11:53:42.801497 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:42.801338    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7w2zd\" (UniqueName: \"kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-kube-api-access-7w2zd\") pod \"ce076ee4-4421-459e-96ee-6cab9a0c807c\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") "
Sep 11 11:53:42.801497 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:42.801370    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce076ee4-4421-459e-96ee-6cab9a0c807c-installation-pull-secrets\") pod \"ce076ee4-4421-459e-96ee-6cab9a0c807c\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") "
Sep 11 11:53:42.801497 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:42.801408    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-bound-sa-token\") pod \"ce076ee4-4421-459e-96ee-6cab9a0c807c\" (UID: \"ce076ee4-4421-459e-96ee-6cab9a0c807c\") "
Sep 11 11:53:42.801771 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:42.801741    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce076ee4-4421-459e-96ee-6cab9a0c807c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ce076ee4-4421-459e-96ee-6cab9a0c807c" (UID: "ce076ee4-4421-459e-96ee-6cab9a0c807c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:53:42.801839 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:42.801801    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ce076ee4-4421-459e-96ee-6cab9a0c807c" (UID: "ce076ee4-4421-459e-96ee-6cab9a0c807c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:53:42.803800 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:42.803753    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce076ee4-4421-459e-96ee-6cab9a0c807c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ce076ee4-4421-459e-96ee-6cab9a0c807c" (UID: "ce076ee4-4421-459e-96ee-6cab9a0c807c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 11:53:42.803980 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:42.803946    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ce076ee4-4421-459e-96ee-6cab9a0c807c" (UID: "ce076ee4-4421-459e-96ee-6cab9a0c807c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:53:42.804047 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:42.803973    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce076ee4-4421-459e-96ee-6cab9a0c807c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ce076ee4-4421-459e-96ee-6cab9a0c807c" (UID: "ce076ee4-4421-459e-96ee-6cab9a0c807c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 11:53:42.804047 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:42.804008    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ce076ee4-4421-459e-96ee-6cab9a0c807c" (UID: "ce076ee4-4421-459e-96ee-6cab9a0c807c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:53:42.804158 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:42.804035    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-kube-api-access-7w2zd" (OuterVolumeSpecName: "kube-api-access-7w2zd") pod "ce076ee4-4421-459e-96ee-6cab9a0c807c" (UID: "ce076ee4-4421-459e-96ee-6cab9a0c807c"). InnerVolumeSpecName "kube-api-access-7w2zd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:53:42.809773 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:42.809745    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce076ee4-4421-459e-96ee-6cab9a0c807c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ce076ee4-4421-459e-96ee-6cab9a0c807c" (UID: "ce076ee4-4421-459e-96ee-6cab9a0c807c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:53:42.902384 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:42.902358    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce076ee4-4421-459e-96ee-6cab9a0c807c-trusted-ca\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:53:42.902384 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:42.902383    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce076ee4-4421-459e-96ee-6cab9a0c807c-ca-trust-extracted\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:53:42.902548 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:42.902393    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-tls\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:53:42.902548 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:42.902402    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce076ee4-4421-459e-96ee-6cab9a0c807c-registry-certificates\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:53:42.902548 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:42.902411    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7w2zd\" (UniqueName: \"kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-kube-api-access-7w2zd\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:53:42.902548 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:42.902420    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce076ee4-4421-459e-96ee-6cab9a0c807c-installation-pull-secrets\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:53:42.902548 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:42.902428    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce076ee4-4421-459e-96ee-6cab9a0c807c-bound-sa-token\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:53:42.902548 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:42.902438    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce076ee4-4421-459e-96ee-6cab9a0c807c-image-registry-private-configuration\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:53:43.372773 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:43.372739    2565 generic.go:356] "Generic (PLEG): container finished" podID="ce076ee4-4421-459e-96ee-6cab9a0c807c" containerID="3874a77491e5dd998ade1d2b812af86c262942219e6e19f879e1ac75bbf35f75" exitCode=0
Sep 11 11:53:43.372932 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:43.372783    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8"
Sep 11 11:53:43.372932 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:43.372817    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8" event={"ID":"ce076ee4-4421-459e-96ee-6cab9a0c807c","Type":"ContainerDied","Data":"3874a77491e5dd998ade1d2b812af86c262942219e6e19f879e1ac75bbf35f75"}
Sep 11 11:53:43.372932 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:43.372854    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d999f4bdd-vmwn8" event={"ID":"ce076ee4-4421-459e-96ee-6cab9a0c807c","Type":"ContainerDied","Data":"ed3a48abd31f02c4480e04bfc2e69f12b3e265536e7545088f58e253b6ce649a"}
Sep 11 11:53:43.372932 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:43.372873    2565 scope.go:117] "RemoveContainer" containerID="3874a77491e5dd998ade1d2b812af86c262942219e6e19f879e1ac75bbf35f75"
Sep 11 11:53:43.380653 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:43.380629    2565 scope.go:117] "RemoveContainer" containerID="3874a77491e5dd998ade1d2b812af86c262942219e6e19f879e1ac75bbf35f75"
Sep 11 11:53:43.380948 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:53:43.380926    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3874a77491e5dd998ade1d2b812af86c262942219e6e19f879e1ac75bbf35f75\": container with ID starting with 3874a77491e5dd998ade1d2b812af86c262942219e6e19f879e1ac75bbf35f75 not found: ID does not exist" containerID="3874a77491e5dd998ade1d2b812af86c262942219e6e19f879e1ac75bbf35f75"
Sep 11 11:53:43.381022 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:43.380956    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3874a77491e5dd998ade1d2b812af86c262942219e6e19f879e1ac75bbf35f75"} err="failed to get container status \"3874a77491e5dd998ade1d2b812af86c262942219e6e19f879e1ac75bbf35f75\": rpc error: code = NotFound desc = could not find container \"3874a77491e5dd998ade1d2b812af86c262942219e6e19f879e1ac75bbf35f75\": container with ID starting with 3874a77491e5dd998ade1d2b812af86c262942219e6e19f879e1ac75bbf35f75 not found: ID does not exist"
Sep 11 11:53:43.390173 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:43.390146    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d999f4bdd-vmwn8"]
Sep 11 11:53:43.393398 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:43.393378    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-d999f4bdd-vmwn8"]
Sep 11 11:53:44.840400 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:53:44.840366    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce076ee4-4421-459e-96ee-6cab9a0c807c" path="/var/lib/kubelet/pods/ce076ee4-4421-459e-96ee-6cab9a0c807c/volumes"
Sep 11 11:55:11.322502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:11.322467    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz"]
Sep 11 11:55:11.322946 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:11.322706    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce076ee4-4421-459e-96ee-6cab9a0c807c" containerName="registry"
Sep 11 11:55:11.322946 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:11.322717    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce076ee4-4421-459e-96ee-6cab9a0c807c" containerName="registry"
Sep 11 11:55:11.322946 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:11.322765    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce076ee4-4421-459e-96ee-6cab9a0c807c" containerName="registry"
Sep 11 11:55:11.325724 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:11.325705    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz"
Sep 11 11:55:11.328787 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:11.328755    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 11:55:11.328921 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:11.328797    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 11:55:11.329885 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:11.329865    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dj7vq\""
Sep 11 11:55:11.335232 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:11.335202    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz"]
Sep 11 11:55:11.422225 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:11.422172    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45a97078-28cb-4e2a-8fc2-ddeb7e31745e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz\" (UID: \"45a97078-28cb-4e2a-8fc2-ddeb7e31745e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz"
Sep 11 11:55:11.422407 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:11.422228    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66v87\" (UniqueName: \"kubernetes.io/projected/45a97078-28cb-4e2a-8fc2-ddeb7e31745e-kube-api-access-66v87\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz\" (UID: \"45a97078-28cb-4e2a-8fc2-ddeb7e31745e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz"
Sep 11 11:55:11.422407 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:11.422298    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45a97078-28cb-4e2a-8fc2-ddeb7e31745e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz\" (UID: \"45a97078-28cb-4e2a-8fc2-ddeb7e31745e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz"
Sep 11 11:55:11.522911 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:11.522871    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66v87\" (UniqueName: \"kubernetes.io/projected/45a97078-28cb-4e2a-8fc2-ddeb7e31745e-kube-api-access-66v87\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz\" (UID: \"45a97078-28cb-4e2a-8fc2-ddeb7e31745e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz"
Sep 11 11:55:11.522911 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:11.522911    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45a97078-28cb-4e2a-8fc2-ddeb7e31745e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz\" (UID: \"45a97078-28cb-4e2a-8fc2-ddeb7e31745e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz"
Sep 11 11:55:11.523121 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:11.522964    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45a97078-28cb-4e2a-8fc2-ddeb7e31745e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz\" (UID: \"45a97078-28cb-4e2a-8fc2-ddeb7e31745e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz"
Sep 11 11:55:11.523307 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:11.523288    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45a97078-28cb-4e2a-8fc2-ddeb7e31745e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz\" (UID: \"45a97078-28cb-4e2a-8fc2-ddeb7e31745e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz"
Sep 11 11:55:11.523346 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:11.523329    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45a97078-28cb-4e2a-8fc2-ddeb7e31745e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz\" (UID: \"45a97078-28cb-4e2a-8fc2-ddeb7e31745e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz"
Sep 11 11:55:11.532061 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:11.532029    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66v87\" (UniqueName: \"kubernetes.io/projected/45a97078-28cb-4e2a-8fc2-ddeb7e31745e-kube-api-access-66v87\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz\" (UID: \"45a97078-28cb-4e2a-8fc2-ddeb7e31745e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz"
Sep 11 11:55:11.634675 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:11.634645    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz"
Sep 11 11:55:11.906668 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:11.906625    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz"]
Sep 11 11:55:11.909262 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:55:11.909238    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45a97078_28cb_4e2a_8fc2_ddeb7e31745e.slice/crio-be12949ce1b639d35871f9b11e5c415d172e29b9064955fd7870459541b65501 WatchSource:0}: Error finding container be12949ce1b639d35871f9b11e5c415d172e29b9064955fd7870459541b65501: Status 404 returned error can't find the container with id be12949ce1b639d35871f9b11e5c415d172e29b9064955fd7870459541b65501
Sep 11 11:55:12.683089 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:12.683050    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz" event={"ID":"45a97078-28cb-4e2a-8fc2-ddeb7e31745e","Type":"ContainerStarted","Data":"be12949ce1b639d35871f9b11e5c415d172e29b9064955fd7870459541b65501"}
Sep 11 11:55:18.707188 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:18.707154    2565 generic.go:356] "Generic (PLEG): container finished" podID="45a97078-28cb-4e2a-8fc2-ddeb7e31745e" containerID="10fc59c7e6d0df9d5202cb1fd2d6f00bd3b525b3ea2ec91e60d89385d0b4842b" exitCode=0
Sep 11 11:55:18.707593 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:18.707226    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz" event={"ID":"45a97078-28cb-4e2a-8fc2-ddeb7e31745e","Type":"ContainerDied","Data":"10fc59c7e6d0df9d5202cb1fd2d6f00bd3b525b3ea2ec91e60d89385d0b4842b"}
Sep 11 11:55:21.718734 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:21.718697    2565 generic.go:356] "Generic (PLEG): container finished" podID="45a97078-28cb-4e2a-8fc2-ddeb7e31745e" containerID="41caf79882875b5e6d85e09abd98f4cb2912d611ddeb5ffb87a22e85687d4592" exitCode=0
Sep 11 11:55:21.719108 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:21.718778    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz" event={"ID":"45a97078-28cb-4e2a-8fc2-ddeb7e31745e","Type":"ContainerDied","Data":"41caf79882875b5e6d85e09abd98f4cb2912d611ddeb5ffb87a22e85687d4592"}
Sep 11 11:55:28.747104 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:28.747074    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz" event={"ID":"45a97078-28cb-4e2a-8fc2-ddeb7e31745e","Type":"ContainerStarted","Data":"d49d828d9dc7541ec83483c469847d5aa25a027a93c431527e3b0518ee783925"}
Sep 11 11:55:28.763638 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:28.763591    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz" podStartSLOduration=2.576871056 podStartE2EDuration="17.763574042s" totalImagesPullingTime="15.186702986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:55:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:55:28.762215135 +0000 UTC m=+242.444614623" watchObservedRunningTime="2026-09-11 11:55:28.763574042 +0000 UTC m=+242.445973540"
Sep 11 11:55:29.752500 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:29.752465    2565 generic.go:356] "Generic (PLEG): container finished" podID="45a97078-28cb-4e2a-8fc2-ddeb7e31745e" containerID="d49d828d9dc7541ec83483c469847d5aa25a027a93c431527e3b0518ee783925" exitCode=0
Sep 11 11:55:29.752886 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:29.752522    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz" event={"ID":"45a97078-28cb-4e2a-8fc2-ddeb7e31745e","Type":"ContainerDied","Data":"d49d828d9dc7541ec83483c469847d5aa25a027a93c431527e3b0518ee783925"}
Sep 11 11:55:30.878938 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:30.878914    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz"
Sep 11 11:55:30.972248 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:30.972221    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66v87\" (UniqueName: \"kubernetes.io/projected/45a97078-28cb-4e2a-8fc2-ddeb7e31745e-kube-api-access-66v87\") pod \"45a97078-28cb-4e2a-8fc2-ddeb7e31745e\" (UID: \"45a97078-28cb-4e2a-8fc2-ddeb7e31745e\") "
Sep 11 11:55:30.972399 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:30.972289    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45a97078-28cb-4e2a-8fc2-ddeb7e31745e-bundle\") pod \"45a97078-28cb-4e2a-8fc2-ddeb7e31745e\" (UID: \"45a97078-28cb-4e2a-8fc2-ddeb7e31745e\") "
Sep 11 11:55:30.972399 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:30.972314    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45a97078-28cb-4e2a-8fc2-ddeb7e31745e-util\") pod \"45a97078-28cb-4e2a-8fc2-ddeb7e31745e\" (UID: \"45a97078-28cb-4e2a-8fc2-ddeb7e31745e\") "
Sep 11 11:55:30.972944 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:30.972918    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45a97078-28cb-4e2a-8fc2-ddeb7e31745e-bundle" (OuterVolumeSpecName: "bundle") pod "45a97078-28cb-4e2a-8fc2-ddeb7e31745e" (UID: "45a97078-28cb-4e2a-8fc2-ddeb7e31745e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:55:30.974385 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:30.974361    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45a97078-28cb-4e2a-8fc2-ddeb7e31745e-kube-api-access-66v87" (OuterVolumeSpecName: "kube-api-access-66v87") pod "45a97078-28cb-4e2a-8fc2-ddeb7e31745e" (UID: "45a97078-28cb-4e2a-8fc2-ddeb7e31745e"). InnerVolumeSpecName "kube-api-access-66v87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:55:30.976221 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:30.976200    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45a97078-28cb-4e2a-8fc2-ddeb7e31745e-util" (OuterVolumeSpecName: "util") pod "45a97078-28cb-4e2a-8fc2-ddeb7e31745e" (UID: "45a97078-28cb-4e2a-8fc2-ddeb7e31745e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:55:31.072837 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:31.072759    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66v87\" (UniqueName: \"kubernetes.io/projected/45a97078-28cb-4e2a-8fc2-ddeb7e31745e-kube-api-access-66v87\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:55:31.072837 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:31.072796    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45a97078-28cb-4e2a-8fc2-ddeb7e31745e-bundle\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:55:31.072837 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:31.072807    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45a97078-28cb-4e2a-8fc2-ddeb7e31745e-util\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:55:31.761223 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:31.761195    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz"
Sep 11 11:55:31.761223 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:31.761204    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gp8gz" event={"ID":"45a97078-28cb-4e2a-8fc2-ddeb7e31745e","Type":"ContainerDied","Data":"be12949ce1b639d35871f9b11e5c415d172e29b9064955fd7870459541b65501"}
Sep 11 11:55:31.761435 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:31.761284    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be12949ce1b639d35871f9b11e5c415d172e29b9064955fd7870459541b65501"
Sep 11 11:55:39.260275 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:39.260228    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wwlq6"]
Sep 11 11:55:39.260775 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:39.260469    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45a97078-28cb-4e2a-8fc2-ddeb7e31745e" containerName="pull"
Sep 11 11:55:39.260775 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:39.260480    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="45a97078-28cb-4e2a-8fc2-ddeb7e31745e" containerName="pull"
Sep 11 11:55:39.260775 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:39.260491    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45a97078-28cb-4e2a-8fc2-ddeb7e31745e" containerName="extract"
Sep 11 11:55:39.260775 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:39.260497    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="45a97078-28cb-4e2a-8fc2-ddeb7e31745e" containerName="extract"
Sep 11 11:55:39.260775 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:39.260507    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45a97078-28cb-4e2a-8fc2-ddeb7e31745e" containerName="util"
Sep 11 11:55:39.260775 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:39.260513    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="45a97078-28cb-4e2a-8fc2-ddeb7e31745e" containerName="util"
Sep 11 11:55:39.260775 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:39.260551    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="45a97078-28cb-4e2a-8fc2-ddeb7e31745e" containerName="extract"
Sep 11 11:55:39.265747 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:39.265729    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wwlq6"
Sep 11 11:55:39.268196 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:39.268176    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 11 11:55:39.268280 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:39.268253    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 11 11:55:39.268356 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:39.268335    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-29rxh\""
Sep 11 11:55:39.274643 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:39.274618    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wwlq6"]
Sep 11 11:55:39.337993 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:39.337945    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqrdf\" (UniqueName: \"kubernetes.io/projected/a78a1fb9-3441-4abf-86a6-5a318104a089-kube-api-access-gqrdf\") pod \"cert-manager-operator-controller-manager-55c444bf86-wwlq6\" (UID: \"a78a1fb9-3441-4abf-86a6-5a318104a089\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wwlq6"
Sep 11 11:55:39.338172 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:39.338008    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a78a1fb9-3441-4abf-86a6-5a318104a089-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wwlq6\" (UID: \"a78a1fb9-3441-4abf-86a6-5a318104a089\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wwlq6"
Sep 11 11:55:39.439300 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:39.439269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a78a1fb9-3441-4abf-86a6-5a318104a089-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wwlq6\" (UID: \"a78a1fb9-3441-4abf-86a6-5a318104a089\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wwlq6"
Sep 11 11:55:39.439408 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:39.439324    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqrdf\" (UniqueName: \"kubernetes.io/projected/a78a1fb9-3441-4abf-86a6-5a318104a089-kube-api-access-gqrdf\") pod \"cert-manager-operator-controller-manager-55c444bf86-wwlq6\" (UID: \"a78a1fb9-3441-4abf-86a6-5a318104a089\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wwlq6"
Sep 11 11:55:39.439703 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:39.439663    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a78a1fb9-3441-4abf-86a6-5a318104a089-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wwlq6\" (UID: \"a78a1fb9-3441-4abf-86a6-5a318104a089\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wwlq6"
Sep 11 11:55:39.450983 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:39.450952    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqrdf\" (UniqueName: \"kubernetes.io/projected/a78a1fb9-3441-4abf-86a6-5a318104a089-kube-api-access-gqrdf\") pod \"cert-manager-operator-controller-manager-55c444bf86-wwlq6\" (UID: \"a78a1fb9-3441-4abf-86a6-5a318104a089\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wwlq6"
Sep 11 11:55:39.574640 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:39.574549    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wwlq6"
Sep 11 11:55:39.847030 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:39.847003    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wwlq6"]
Sep 11 11:55:39.849834 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:55:39.849807    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda78a1fb9_3441_4abf_86a6_5a318104a089.slice/crio-ab3c6758b5138e8e9f2e41e6ad3bd06460c987ae4c2454a0d25989faa071db51 WatchSource:0}: Error finding container ab3c6758b5138e8e9f2e41e6ad3bd06460c987ae4c2454a0d25989faa071db51: Status 404 returned error can't find the container with id ab3c6758b5138e8e9f2e41e6ad3bd06460c987ae4c2454a0d25989faa071db51
Sep 11 11:55:40.793840 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:40.793806    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wwlq6" event={"ID":"a78a1fb9-3441-4abf-86a6-5a318104a089","Type":"ContainerStarted","Data":"ab3c6758b5138e8e9f2e41e6ad3bd06460c987ae4c2454a0d25989faa071db51"}
Sep 11 11:55:41.799557 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:41.799472    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wwlq6" event={"ID":"a78a1fb9-3441-4abf-86a6-5a318104a089","Type":"ContainerStarted","Data":"5ff34fec6d5a61f4bbca1ea8ccabe4ffba7894d5d80fad5f7e2e7ba6b2906986"}
Sep 11 11:55:41.819737 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:41.819664    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wwlq6" podStartSLOduration=1.2614516089999999 podStartE2EDuration="2.819646359s" totalImagesPullingTime="1.55819475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:55:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:55:41.818193792 +0000 UTC m=+255.500593317" watchObservedRunningTime="2026-09-11 11:55:41.819646359 +0000 UTC m=+255.502045858"
Sep 11 11:55:42.965216 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:42.965179    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8"]
Sep 11 11:55:42.968584 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:42.968560    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8"
Sep 11 11:55:42.971223 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:42.971200    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 11:55:42.972281 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:42.972257    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 11:55:42.972422 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:42.972261    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dj7vq\""
Sep 11 11:55:42.978170 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:42.978145    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8"]
Sep 11 11:55:43.067638 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:43.067604    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63cf86c4-3dc6-448e-ad76-a01d77663d4d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8\" (UID: \"63cf86c4-3dc6-448e-ad76-a01d77663d4d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8"
Sep 11 11:55:43.067812 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:43.067658    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pptt\" (UniqueName: \"kubernetes.io/projected/63cf86c4-3dc6-448e-ad76-a01d77663d4d-kube-api-access-4pptt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8\" (UID: \"63cf86c4-3dc6-448e-ad76-a01d77663d4d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8"
Sep 11 11:55:43.067812 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:43.067709    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63cf86c4-3dc6-448e-ad76-a01d77663d4d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8\" (UID: \"63cf86c4-3dc6-448e-ad76-a01d77663d4d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8"
Sep 11 11:55:43.168704 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:43.168648    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pptt\" (UniqueName: \"kubernetes.io/projected/63cf86c4-3dc6-448e-ad76-a01d77663d4d-kube-api-access-4pptt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8\" (UID: \"63cf86c4-3dc6-448e-ad76-a01d77663d4d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8"
Sep 11 11:55:43.168704 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:43.168707    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63cf86c4-3dc6-448e-ad76-a01d77663d4d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8\" (UID: \"63cf86c4-3dc6-448e-ad76-a01d77663d4d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8"
Sep 11 11:55:43.168896 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:43.168739    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63cf86c4-3dc6-448e-ad76-a01d77663d4d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8\" (UID: \"63cf86c4-3dc6-448e-ad76-a01d77663d4d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8"
Sep 11 11:55:43.169054 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:43.169039    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63cf86c4-3dc6-448e-ad76-a01d77663d4d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8\" (UID: \"63cf86c4-3dc6-448e-ad76-a01d77663d4d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8"
Sep 11 11:55:43.169091 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:43.169077    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63cf86c4-3dc6-448e-ad76-a01d77663d4d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8\" (UID: \"63cf86c4-3dc6-448e-ad76-a01d77663d4d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8"
Sep 11 11:55:43.176732 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:43.176700    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pptt\" (UniqueName: \"kubernetes.io/projected/63cf86c4-3dc6-448e-ad76-a01d77663d4d-kube-api-access-4pptt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8\" (UID: \"63cf86c4-3dc6-448e-ad76-a01d77663d4d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8"
Sep 11 11:55:43.279632 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:43.279538    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8"
Sep 11 11:55:43.547711 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:43.547613    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8"]
Sep 11 11:55:43.550296 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:55:43.550272    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63cf86c4_3dc6_448e_ad76_a01d77663d4d.slice/crio-2a271d6dfad8f320cc348a4c6aa402069d8dce3a316369db53fd1bc7f5e9d631 WatchSource:0}: Error finding container 2a271d6dfad8f320cc348a4c6aa402069d8dce3a316369db53fd1bc7f5e9d631: Status 404 returned error can't find the container with id 2a271d6dfad8f320cc348a4c6aa402069d8dce3a316369db53fd1bc7f5e9d631
Sep 11 11:55:43.807865 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:43.807782    2565 generic.go:356] "Generic (PLEG): container finished" podID="63cf86c4-3dc6-448e-ad76-a01d77663d4d" containerID="25ce68d7dcc560210f18d41e9243c578ed14c743556fe6fec64ac1ea5550c9c9" exitCode=0
Sep 11 11:55:43.807983 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:43.807877    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8" event={"ID":"63cf86c4-3dc6-448e-ad76-a01d77663d4d","Type":"ContainerDied","Data":"25ce68d7dcc560210f18d41e9243c578ed14c743556fe6fec64ac1ea5550c9c9"}
Sep 11 11:55:43.807983 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:43.807919    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8" event={"ID":"63cf86c4-3dc6-448e-ad76-a01d77663d4d","Type":"ContainerStarted","Data":"2a271d6dfad8f320cc348a4c6aa402069d8dce3a316369db53fd1bc7f5e9d631"}
Sep 11 11:55:46.820569 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:46.820529    2565 generic.go:356] "Generic (PLEG): container finished" podID="63cf86c4-3dc6-448e-ad76-a01d77663d4d" containerID="9b0f40d6137f45f30210c81aaf446024b69b20e2717ec6b5bdddf90ea886764d" exitCode=0
Sep 11 11:55:46.820979 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:46.820609    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8" event={"ID":"63cf86c4-3dc6-448e-ad76-a01d77663d4d","Type":"ContainerDied","Data":"9b0f40d6137f45f30210c81aaf446024b69b20e2717ec6b5bdddf90ea886764d"}
Sep 11 11:55:47.826274 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:47.826241    2565 generic.go:356] "Generic (PLEG): container finished" podID="63cf86c4-3dc6-448e-ad76-a01d77663d4d" containerID="c9dad647f2489fb22dee2e2bfc0eedf35e4d86cf914dd1dae872066aa8515d33" exitCode=0
Sep 11 11:55:47.826636 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:47.826336    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8" event={"ID":"63cf86c4-3dc6-448e-ad76-a01d77663d4d","Type":"ContainerDied","Data":"c9dad647f2489fb22dee2e2bfc0eedf35e4d86cf914dd1dae872066aa8515d33"}
Sep 11 11:55:48.952802 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:48.952777    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8"
Sep 11 11:55:49.111657 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:49.111531    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63cf86c4-3dc6-448e-ad76-a01d77663d4d-bundle\") pod \"63cf86c4-3dc6-448e-ad76-a01d77663d4d\" (UID: \"63cf86c4-3dc6-448e-ad76-a01d77663d4d\") "
Sep 11 11:55:49.111657 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:49.111630    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63cf86c4-3dc6-448e-ad76-a01d77663d4d-util\") pod \"63cf86c4-3dc6-448e-ad76-a01d77663d4d\" (UID: \"63cf86c4-3dc6-448e-ad76-a01d77663d4d\") "
Sep 11 11:55:49.111897 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:49.111741    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pptt\" (UniqueName: \"kubernetes.io/projected/63cf86c4-3dc6-448e-ad76-a01d77663d4d-kube-api-access-4pptt\") pod \"63cf86c4-3dc6-448e-ad76-a01d77663d4d\" (UID: \"63cf86c4-3dc6-448e-ad76-a01d77663d4d\") "
Sep 11 11:55:49.111975 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:49.111957    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63cf86c4-3dc6-448e-ad76-a01d77663d4d-bundle" (OuterVolumeSpecName: "bundle") pod "63cf86c4-3dc6-448e-ad76-a01d77663d4d" (UID: "63cf86c4-3dc6-448e-ad76-a01d77663d4d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:55:49.114233 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:49.114205    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63cf86c4-3dc6-448e-ad76-a01d77663d4d-kube-api-access-4pptt" (OuterVolumeSpecName: "kube-api-access-4pptt") pod "63cf86c4-3dc6-448e-ad76-a01d77663d4d" (UID: "63cf86c4-3dc6-448e-ad76-a01d77663d4d"). InnerVolumeSpecName "kube-api-access-4pptt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:55:49.116730 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:49.116705    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63cf86c4-3dc6-448e-ad76-a01d77663d4d-util" (OuterVolumeSpecName: "util") pod "63cf86c4-3dc6-448e-ad76-a01d77663d4d" (UID: "63cf86c4-3dc6-448e-ad76-a01d77663d4d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:55:49.212818 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:49.212788    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63cf86c4-3dc6-448e-ad76-a01d77663d4d-util\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:55:49.212818 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:49.212816    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pptt\" (UniqueName: \"kubernetes.io/projected/63cf86c4-3dc6-448e-ad76-a01d77663d4d-kube-api-access-4pptt\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:55:49.213012 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:49.212830    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63cf86c4-3dc6-448e-ad76-a01d77663d4d-bundle\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:55:49.841368 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:49.841342    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8"
Sep 11 11:55:49.841541 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:49.841338    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fbsbf8" event={"ID":"63cf86c4-3dc6-448e-ad76-a01d77663d4d","Type":"ContainerDied","Data":"2a271d6dfad8f320cc348a4c6aa402069d8dce3a316369db53fd1bc7f5e9d631"}
Sep 11 11:55:49.841541 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:49.841464    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a271d6dfad8f320cc348a4c6aa402069d8dce3a316369db53fd1bc7f5e9d631"
Sep 11 11:55:51.424226 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:51.424189    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tdxc2"]
Sep 11 11:55:51.424624 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:51.424432    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63cf86c4-3dc6-448e-ad76-a01d77663d4d" containerName="util"
Sep 11 11:55:51.424624 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:51.424442    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="63cf86c4-3dc6-448e-ad76-a01d77663d4d" containerName="util"
Sep 11 11:55:51.424624 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:51.424450    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63cf86c4-3dc6-448e-ad76-a01d77663d4d" containerName="extract"
Sep 11 11:55:51.424624 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:51.424456    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="63cf86c4-3dc6-448e-ad76-a01d77663d4d" containerName="extract"
Sep 11 11:55:51.424624 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:51.424463    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63cf86c4-3dc6-448e-ad76-a01d77663d4d" containerName="pull"
Sep 11 11:55:51.424624 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:51.424468    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="63cf86c4-3dc6-448e-ad76-a01d77663d4d" containerName="pull"
Sep 11 11:55:51.424624 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:51.424506    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="63cf86c4-3dc6-448e-ad76-a01d77663d4d" containerName="extract"
Sep 11 11:55:51.428839 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:51.428820    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdxc2"
Sep 11 11:55:51.431402 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:51.431381    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 11:55:51.432367 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:51.432346    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-2n8qr\""
Sep 11 11:55:51.432472 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:51.432399    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 11:55:51.434410 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:51.434388    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tdxc2"]
Sep 11 11:55:51.529487 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:51.529452    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9hvr\" (UniqueName: \"kubernetes.io/projected/1dbcc82e-aa2d-4645-941a-2f36f4580773-kube-api-access-t9hvr\") pod \"cert-manager-cainjector-559cdd8c87-tdxc2\" (UID: \"1dbcc82e-aa2d-4645-941a-2f36f4580773\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdxc2"
Sep 11 11:55:51.529652 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:51.529493    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1dbcc82e-aa2d-4645-941a-2f36f4580773-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tdxc2\" (UID: \"1dbcc82e-aa2d-4645-941a-2f36f4580773\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdxc2"
Sep 11 11:55:51.630279 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:51.630241    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9hvr\" (UniqueName: \"kubernetes.io/projected/1dbcc82e-aa2d-4645-941a-2f36f4580773-kube-api-access-t9hvr\") pod \"cert-manager-cainjector-559cdd8c87-tdxc2\" (UID: \"1dbcc82e-aa2d-4645-941a-2f36f4580773\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdxc2"
Sep 11 11:55:51.630439 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:51.630292    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1dbcc82e-aa2d-4645-941a-2f36f4580773-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tdxc2\" (UID: \"1dbcc82e-aa2d-4645-941a-2f36f4580773\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdxc2"
Sep 11 11:55:51.638581 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:51.638549    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1dbcc82e-aa2d-4645-941a-2f36f4580773-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tdxc2\" (UID: \"1dbcc82e-aa2d-4645-941a-2f36f4580773\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdxc2"
Sep 11 11:55:51.638700 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:51.638593    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9hvr\" (UniqueName: \"kubernetes.io/projected/1dbcc82e-aa2d-4645-941a-2f36f4580773-kube-api-access-t9hvr\") pod \"cert-manager-cainjector-559cdd8c87-tdxc2\" (UID: \"1dbcc82e-aa2d-4645-941a-2f36f4580773\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdxc2"
Sep 11 11:55:51.738222 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:51.738143    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdxc2"
Sep 11 11:55:52.005117 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:52.005091    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tdxc2"]
Sep 11 11:55:52.007198 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:55:52.007167    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1dbcc82e_aa2d_4645_941a_2f36f4580773.slice/crio-5d0004388bfb3266fc349d787c6bdbd8071fd98d12c0b1b8af32a54603537e1a WatchSource:0}: Error finding container 5d0004388bfb3266fc349d787c6bdbd8071fd98d12c0b1b8af32a54603537e1a: Status 404 returned error can't find the container with id 5d0004388bfb3266fc349d787c6bdbd8071fd98d12c0b1b8af32a54603537e1a
Sep 11 11:55:52.853801 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:52.853748    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdxc2" event={"ID":"1dbcc82e-aa2d-4645-941a-2f36f4580773","Type":"ContainerStarted","Data":"5d0004388bfb3266fc349d787c6bdbd8071fd98d12c0b1b8af32a54603537e1a"}
Sep 11 11:55:53.560962 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:53.560924    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8hx9"]
Sep 11 11:55:53.564518 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:53.564486    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8hx9"
Sep 11 11:55:53.567138 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:53.567112    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 11 11:55:53.568205 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:53.568180    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-p2mkd\""
Sep 11 11:55:53.568315 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:53.568237    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 11 11:55:53.575145 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:53.574953    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8hx9"]
Sep 11 11:55:53.646694 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:53.646645    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2487a775-dcd0-4d8d-b9d4-2c60d8adf78b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q8hx9\" (UID: \"2487a775-dcd0-4d8d-b9d4-2c60d8adf78b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8hx9"
Sep 11 11:55:53.646859 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:53.646706    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4l9m\" (UniqueName: \"kubernetes.io/projected/2487a775-dcd0-4d8d-b9d4-2c60d8adf78b-kube-api-access-b4l9m\") pod \"openshift-lws-operator-fd8ccff4c-q8hx9\" (UID: \"2487a775-dcd0-4d8d-b9d4-2c60d8adf78b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8hx9"
Sep 11 11:55:53.747770 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:53.747739    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2487a775-dcd0-4d8d-b9d4-2c60d8adf78b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q8hx9\" (UID: \"2487a775-dcd0-4d8d-b9d4-2c60d8adf78b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8hx9"
Sep 11 11:55:53.747770 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:53.747775    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4l9m\" (UniqueName: \"kubernetes.io/projected/2487a775-dcd0-4d8d-b9d4-2c60d8adf78b-kube-api-access-b4l9m\") pod \"openshift-lws-operator-fd8ccff4c-q8hx9\" (UID: \"2487a775-dcd0-4d8d-b9d4-2c60d8adf78b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8hx9"
Sep 11 11:55:53.748213 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:53.748186    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2487a775-dcd0-4d8d-b9d4-2c60d8adf78b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q8hx9\" (UID: \"2487a775-dcd0-4d8d-b9d4-2c60d8adf78b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8hx9"
Sep 11 11:55:53.756226 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:53.756201    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4l9m\" (UniqueName: \"kubernetes.io/projected/2487a775-dcd0-4d8d-b9d4-2c60d8adf78b-kube-api-access-b4l9m\") pod \"openshift-lws-operator-fd8ccff4c-q8hx9\" (UID: \"2487a775-dcd0-4d8d-b9d4-2c60d8adf78b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8hx9"
Sep 11 11:55:53.875308 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:53.875217    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8hx9"
Sep 11 11:55:54.780775 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:54.780747    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8hx9"]
Sep 11 11:55:54.782694 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:55:54.782657    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2487a775_dcd0_4d8d_b9d4_2c60d8adf78b.slice/crio-d86df05cab9c9c254fb0e1d9f6f18334a47234abf6c7ad3adbb7867f3f3a3075 WatchSource:0}: Error finding container d86df05cab9c9c254fb0e1d9f6f18334a47234abf6c7ad3adbb7867f3f3a3075: Status 404 returned error can't find the container with id d86df05cab9c9c254fb0e1d9f6f18334a47234abf6c7ad3adbb7867f3f3a3075
Sep 11 11:55:54.864337 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:54.864293    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8hx9" event={"ID":"2487a775-dcd0-4d8d-b9d4-2c60d8adf78b","Type":"ContainerStarted","Data":"d86df05cab9c9c254fb0e1d9f6f18334a47234abf6c7ad3adbb7867f3f3a3075"}
Sep 11 11:55:54.865849 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:54.865825    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdxc2" event={"ID":"1dbcc82e-aa2d-4645-941a-2f36f4580773","Type":"ContainerStarted","Data":"4044c665882857704325aa5128b0ddd7fbada65429468687cc1f3802ce8dff36"}
Sep 11 11:55:54.880927 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:54.880876    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdxc2" podStartSLOduration=1.312512164 podStartE2EDuration="3.880857365s" totalImagesPullingTime="2.568345201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:55:54.880211998 +0000 UTC m=+268.562611495" watchObservedRunningTime="2026-09-11 11:55:54.880857365 +0000 UTC m=+268.563256865"
Sep 11 11:55:56.877057 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:56.876964    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8hx9" event={"ID":"2487a775-dcd0-4d8d-b9d4-2c60d8adf78b","Type":"ContainerStarted","Data":"2e2c2693700961f857a3d32353ade9678365e09e721bea35d26d63182b3b9ca8"}
Sep 11 11:55:56.893310 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:56.893263    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8hx9" podStartSLOduration=2.278390419 podStartE2EDuration="3.893249778s" totalImagesPullingTime="1.614859359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:55:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:55:56.891646046 +0000 UTC m=+270.574045547" watchObservedRunningTime="2026-09-11 11:55:56.893249778 +0000 UTC m=+270.575649277"
Sep 11 11:55:59.746848 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:59.746815    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv"]
Sep 11 11:55:59.749658 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:59.749639    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv"
Sep 11 11:55:59.752478 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:59.752451    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dj7vq\""
Sep 11 11:55:59.752575 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:59.752477    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 11:55:59.752575 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:59.752459    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 11:55:59.758317 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:59.758296    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv"]
Sep 11 11:55:59.898856 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:59.898825    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64b45814-de52-479d-afa5-cedee8f3eead-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv\" (UID: \"64b45814-de52-479d-afa5-cedee8f3eead\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv"
Sep 11 11:55:59.898856 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:59.898858    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64b45814-de52-479d-afa5-cedee8f3eead-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv\" (UID: \"64b45814-de52-479d-afa5-cedee8f3eead\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv"
Sep 11 11:55:59.899031 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:59.898936    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g95t\" (UniqueName: \"kubernetes.io/projected/64b45814-de52-479d-afa5-cedee8f3eead-kube-api-access-4g95t\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv\" (UID: \"64b45814-de52-479d-afa5-cedee8f3eead\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv"
Sep 11 11:55:59.999981 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:59.999889    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g95t\" (UniqueName: \"kubernetes.io/projected/64b45814-de52-479d-afa5-cedee8f3eead-kube-api-access-4g95t\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv\" (UID: \"64b45814-de52-479d-afa5-cedee8f3eead\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv"
Sep 11 11:56:00.000167 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:55:59.999990    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64b45814-de52-479d-afa5-cedee8f3eead-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv\" (UID: \"64b45814-de52-479d-afa5-cedee8f3eead\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv"
Sep 11 11:56:00.000289 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:00.000259    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64b45814-de52-479d-afa5-cedee8f3eead-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv\" (UID: \"64b45814-de52-479d-afa5-cedee8f3eead\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv"
Sep 11 11:56:00.000395 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:00.000357    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64b45814-de52-479d-afa5-cedee8f3eead-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv\" (UID: \"64b45814-de52-479d-afa5-cedee8f3eead\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv"
Sep 11 11:56:00.000532 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:00.000513    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64b45814-de52-479d-afa5-cedee8f3eead-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv\" (UID: \"64b45814-de52-479d-afa5-cedee8f3eead\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv"
Sep 11 11:56:00.008271 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:00.008241    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g95t\" (UniqueName: \"kubernetes.io/projected/64b45814-de52-479d-afa5-cedee8f3eead-kube-api-access-4g95t\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv\" (UID: \"64b45814-de52-479d-afa5-cedee8f3eead\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv"
Sep 11 11:56:00.059192 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:00.059155    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv"
Sep 11 11:56:00.331179 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:00.331156    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv"]
Sep 11 11:56:00.333405 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:56:00.333376    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64b45814_de52_479d_afa5_cedee8f3eead.slice/crio-82cc8b23ff378fb34c343ae43fb1a292a06986b85ea4e694f6172b08ff65aa70 WatchSource:0}: Error finding container 82cc8b23ff378fb34c343ae43fb1a292a06986b85ea4e694f6172b08ff65aa70: Status 404 returned error can't find the container with id 82cc8b23ff378fb34c343ae43fb1a292a06986b85ea4e694f6172b08ff65aa70
Sep 11 11:56:00.894126 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:00.894091    2565 generic.go:356] "Generic (PLEG): container finished" podID="64b45814-de52-479d-afa5-cedee8f3eead" containerID="00dc79a63d1389212302ac49fe6ed9e5aea1a5d6274ad6e8aaf877dd8c435aa0" exitCode=0
Sep 11 11:56:00.894495 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:00.894175    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv" event={"ID":"64b45814-de52-479d-afa5-cedee8f3eead","Type":"ContainerDied","Data":"00dc79a63d1389212302ac49fe6ed9e5aea1a5d6274ad6e8aaf877dd8c435aa0"}
Sep 11 11:56:00.894495 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:00.894224    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv" event={"ID":"64b45814-de52-479d-afa5-cedee8f3eead","Type":"ContainerStarted","Data":"82cc8b23ff378fb34c343ae43fb1a292a06986b85ea4e694f6172b08ff65aa70"}
Sep 11 11:56:01.900499 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:01.900462    2565 generic.go:356] "Generic (PLEG): container finished" podID="64b45814-de52-479d-afa5-cedee8f3eead" containerID="8633d1ed7b0181379b3660c527b2e5fe97fa1b28be0d2fc98b3e497dfd1d42b4" exitCode=0
Sep 11 11:56:01.900910 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:01.900545    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv" event={"ID":"64b45814-de52-479d-afa5-cedee8f3eead","Type":"ContainerDied","Data":"8633d1ed7b0181379b3660c527b2e5fe97fa1b28be0d2fc98b3e497dfd1d42b4"}
Sep 11 11:56:02.907080 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:02.907046    2565 generic.go:356] "Generic (PLEG): container finished" podID="64b45814-de52-479d-afa5-cedee8f3eead" containerID="21f950e2c3d4b102a7fb81ddfc8f9852482aef941f3c1e7f95b605bc9b29d879" exitCode=0
Sep 11 11:56:02.907481 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:02.907127    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv" event={"ID":"64b45814-de52-479d-afa5-cedee8f3eead","Type":"ContainerDied","Data":"21f950e2c3d4b102a7fb81ddfc8f9852482aef941f3c1e7f95b605bc9b29d879"}
Sep 11 11:56:03.762241 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:03.762205    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rsc9k"]
Sep 11 11:56:03.765308 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:03.765289    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-rsc9k"
Sep 11 11:56:03.767887 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:03.767864    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-llt4z\""
Sep 11 11:56:03.775378 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:03.775354    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rsc9k"]
Sep 11 11:56:03.931146 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:03.931112    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7aab660-727b-489f-b2e4-dbdf085fbdf4-bound-sa-token\") pod \"cert-manager-55b4d954d5-rsc9k\" (UID: \"d7aab660-727b-489f-b2e4-dbdf085fbdf4\") " pod="cert-manager/cert-manager-55b4d954d5-rsc9k"
Sep 11 11:56:03.931503 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:03.931189    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqqqx\" (UniqueName: \"kubernetes.io/projected/d7aab660-727b-489f-b2e4-dbdf085fbdf4-kube-api-access-tqqqx\") pod \"cert-manager-55b4d954d5-rsc9k\" (UID: \"d7aab660-727b-489f-b2e4-dbdf085fbdf4\") " pod="cert-manager/cert-manager-55b4d954d5-rsc9k"
Sep 11 11:56:04.032319 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:04.032293    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7aab660-727b-489f-b2e4-dbdf085fbdf4-bound-sa-token\") pod \"cert-manager-55b4d954d5-rsc9k\" (UID: \"d7aab660-727b-489f-b2e4-dbdf085fbdf4\") " pod="cert-manager/cert-manager-55b4d954d5-rsc9k"
Sep 11 11:56:04.032483 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:04.032341    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqqqx\" (UniqueName: \"kubernetes.io/projected/d7aab660-727b-489f-b2e4-dbdf085fbdf4-kube-api-access-tqqqx\") pod \"cert-manager-55b4d954d5-rsc9k\" (UID: \"d7aab660-727b-489f-b2e4-dbdf085fbdf4\") " pod="cert-manager/cert-manager-55b4d954d5-rsc9k"
Sep 11 11:56:04.036603 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:04.036576    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv"
Sep 11 11:56:04.040665 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:04.040639    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqqqx\" (UniqueName: \"kubernetes.io/projected/d7aab660-727b-489f-b2e4-dbdf085fbdf4-kube-api-access-tqqqx\") pod \"cert-manager-55b4d954d5-rsc9k\" (UID: \"d7aab660-727b-489f-b2e4-dbdf085fbdf4\") " pod="cert-manager/cert-manager-55b4d954d5-rsc9k"
Sep 11 11:56:04.041033 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:04.041001    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7aab660-727b-489f-b2e4-dbdf085fbdf4-bound-sa-token\") pod \"cert-manager-55b4d954d5-rsc9k\" (UID: \"d7aab660-727b-489f-b2e4-dbdf085fbdf4\") " pod="cert-manager/cert-manager-55b4d954d5-rsc9k"
Sep 11 11:56:04.074487 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:04.074453    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-rsc9k"
Sep 11 11:56:04.133154 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:04.133117    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64b45814-de52-479d-afa5-cedee8f3eead-bundle\") pod \"64b45814-de52-479d-afa5-cedee8f3eead\" (UID: \"64b45814-de52-479d-afa5-cedee8f3eead\") "
Sep 11 11:56:04.133301 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:04.133176    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64b45814-de52-479d-afa5-cedee8f3eead-util\") pod \"64b45814-de52-479d-afa5-cedee8f3eead\" (UID: \"64b45814-de52-479d-afa5-cedee8f3eead\") "
Sep 11 11:56:04.133301 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:04.133211    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4g95t\" (UniqueName: \"kubernetes.io/projected/64b45814-de52-479d-afa5-cedee8f3eead-kube-api-access-4g95t\") pod \"64b45814-de52-479d-afa5-cedee8f3eead\" (UID: \"64b45814-de52-479d-afa5-cedee8f3eead\") "
Sep 11 11:56:04.134433 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:04.134377    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64b45814-de52-479d-afa5-cedee8f3eead-bundle" (OuterVolumeSpecName: "bundle") pod "64b45814-de52-479d-afa5-cedee8f3eead" (UID: "64b45814-de52-479d-afa5-cedee8f3eead"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:56:04.134876 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:04.134843    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64b45814-de52-479d-afa5-cedee8f3eead-bundle\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:56:04.137739 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:04.137712    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64b45814-de52-479d-afa5-cedee8f3eead-kube-api-access-4g95t" (OuterVolumeSpecName: "kube-api-access-4g95t") pod "64b45814-de52-479d-afa5-cedee8f3eead" (UID: "64b45814-de52-479d-afa5-cedee8f3eead"). InnerVolumeSpecName "kube-api-access-4g95t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:56:04.139693 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:04.139658    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64b45814-de52-479d-afa5-cedee8f3eead-util" (OuterVolumeSpecName: "util") pod "64b45814-de52-479d-afa5-cedee8f3eead" (UID: "64b45814-de52-479d-afa5-cedee8f3eead"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:56:04.235481 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:04.235427    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64b45814-de52-479d-afa5-cedee8f3eead-util\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:56:04.235481 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:04.235475    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g95t\" (UniqueName: \"kubernetes.io/projected/64b45814-de52-479d-afa5-cedee8f3eead-kube-api-access-4g95t\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:56:04.342600 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:04.342511    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rsc9k"]
Sep 11 11:56:04.345257 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:56:04.345231    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7aab660_727b_489f_b2e4_dbdf085fbdf4.slice/crio-100e3678307c204c25d72f095bffd3282b767ceb77fc308873ced736e5ecf44d WatchSource:0}: Error finding container 100e3678307c204c25d72f095bffd3282b767ceb77fc308873ced736e5ecf44d: Status 404 returned error can't find the container with id 100e3678307c204c25d72f095bffd3282b767ceb77fc308873ced736e5ecf44d
Sep 11 11:56:04.916717 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:04.916666    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-rsc9k" event={"ID":"d7aab660-727b-489f-b2e4-dbdf085fbdf4","Type":"ContainerStarted","Data":"7d92e6e0bc0044e24d07a0bf99617d1e41050cd5a344eeded4e109a3e99960e4"}
Sep 11 11:56:04.916870 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:04.916731    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-rsc9k" event={"ID":"d7aab660-727b-489f-b2e4-dbdf085fbdf4","Type":"ContainerStarted","Data":"100e3678307c204c25d72f095bffd3282b767ceb77fc308873ced736e5ecf44d"}
Sep 11 11:56:04.918584 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:04.918563    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv"
Sep 11 11:56:04.918584 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:04.918569    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8gmqv" event={"ID":"64b45814-de52-479d-afa5-cedee8f3eead","Type":"ContainerDied","Data":"82cc8b23ff378fb34c343ae43fb1a292a06986b85ea4e694f6172b08ff65aa70"}
Sep 11 11:56:04.918746 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:04.918602    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82cc8b23ff378fb34c343ae43fb1a292a06986b85ea4e694f6172b08ff65aa70"
Sep 11 11:56:04.932227 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:04.932182    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-rsc9k" podStartSLOduration=1.932168961 podStartE2EDuration="1.932168961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:56:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:56:04.930935451 +0000 UTC m=+278.613334951" watchObservedRunningTime="2026-09-11 11:56:04.932168961 +0000 UTC m=+278.614568458"
Sep 11 11:56:16.741086 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:16.741050    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz"]
Sep 11 11:56:16.741533 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:16.741297    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64b45814-de52-479d-afa5-cedee8f3eead" containerName="util"
Sep 11 11:56:16.741533 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:16.741308    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="64b45814-de52-479d-afa5-cedee8f3eead" containerName="util"
Sep 11 11:56:16.741533 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:16.741317    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64b45814-de52-479d-afa5-cedee8f3eead" containerName="pull"
Sep 11 11:56:16.741533 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:16.741322    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="64b45814-de52-479d-afa5-cedee8f3eead" containerName="pull"
Sep 11 11:56:16.741533 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:16.741328    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64b45814-de52-479d-afa5-cedee8f3eead" containerName="extract"
Sep 11 11:56:16.741533 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:16.741334    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="64b45814-de52-479d-afa5-cedee8f3eead" containerName="extract"
Sep 11 11:56:16.741533 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:16.741382    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="64b45814-de52-479d-afa5-cedee8f3eead" containerName="extract"
Sep 11 11:56:16.747407 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:16.747389    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz"
Sep 11 11:56:16.750121 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:16.750099    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 11:56:16.750247 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:16.750142    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 11:56:16.750247 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:16.750149    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dj7vq\""
Sep 11 11:56:16.756133 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:16.756112    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz"]
Sep 11 11:56:16.820332 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:16.820293    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64fe1cf2-69ae-48bd-8b66-f34a775af3f7-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz\" (UID: \"64fe1cf2-69ae-48bd-8b66-f34a775af3f7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz"
Sep 11 11:56:16.820490 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:16.820347    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64fe1cf2-69ae-48bd-8b66-f34a775af3f7-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz\" (UID: \"64fe1cf2-69ae-48bd-8b66-f34a775af3f7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz"
Sep 11 11:56:16.820490 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:16.820389    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n2fz\" (UniqueName: \"kubernetes.io/projected/64fe1cf2-69ae-48bd-8b66-f34a775af3f7-kube-api-access-4n2fz\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz\" (UID: \"64fe1cf2-69ae-48bd-8b66-f34a775af3f7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz"
Sep 11 11:56:16.921299 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:16.921267    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64fe1cf2-69ae-48bd-8b66-f34a775af3f7-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz\" (UID: \"64fe1cf2-69ae-48bd-8b66-f34a775af3f7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz"
Sep 11 11:56:16.921299 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:16.921311    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64fe1cf2-69ae-48bd-8b66-f34a775af3f7-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz\" (UID: \"64fe1cf2-69ae-48bd-8b66-f34a775af3f7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz"
Sep 11 11:56:16.921511 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:16.921342    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n2fz\" (UniqueName: \"kubernetes.io/projected/64fe1cf2-69ae-48bd-8b66-f34a775af3f7-kube-api-access-4n2fz\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz\" (UID: \"64fe1cf2-69ae-48bd-8b66-f34a775af3f7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz"
Sep 11 11:56:16.921671 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:16.921652    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64fe1cf2-69ae-48bd-8b66-f34a775af3f7-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz\" (UID: \"64fe1cf2-69ae-48bd-8b66-f34a775af3f7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz"
Sep 11 11:56:16.921724 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:16.921677    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64fe1cf2-69ae-48bd-8b66-f34a775af3f7-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz\" (UID: \"64fe1cf2-69ae-48bd-8b66-f34a775af3f7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz"
Sep 11 11:56:16.933583 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:16.933546    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n2fz\" (UniqueName: \"kubernetes.io/projected/64fe1cf2-69ae-48bd-8b66-f34a775af3f7-kube-api-access-4n2fz\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz\" (UID: \"64fe1cf2-69ae-48bd-8b66-f34a775af3f7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz"
Sep 11 11:56:17.056680 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:17.056591    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz"
Sep 11 11:56:17.325857 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:17.325827    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz"]
Sep 11 11:56:17.328122 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:56:17.328095    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64fe1cf2_69ae_48bd_8b66_f34a775af3f7.slice/crio-fbbc7c69d184b04bc55f43fbcc3b70896a82a28eb6a1dddf40f62d634c946050 WatchSource:0}: Error finding container fbbc7c69d184b04bc55f43fbcc3b70896a82a28eb6a1dddf40f62d634c946050: Status 404 returned error can't find the container with id fbbc7c69d184b04bc55f43fbcc3b70896a82a28eb6a1dddf40f62d634c946050
Sep 11 11:56:17.929400 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:17.929364    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q"]
Sep 11 11:56:17.933098 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:17.933076    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q"
Sep 11 11:56:17.937199 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:17.936905    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ns5m5\""
Sep 11 11:56:17.937199 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:17.936909    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 11:56:17.937840 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:17.937819    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 11:56:17.937971 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:17.937951    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 11:56:17.939986 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:17.939969    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 11:56:17.953297 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:17.953269    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q"]
Sep 11 11:56:17.969276 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:17.969243    2565 generic.go:356] "Generic (PLEG): container finished" podID="64fe1cf2-69ae-48bd-8b66-f34a775af3f7" containerID="3ac64f4f83523bcd945ed5da0219bbc682892d08fe5e9e9c3489289a13133067" exitCode=0
Sep 11 11:56:17.969383 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:17.969333    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz" event={"ID":"64fe1cf2-69ae-48bd-8b66-f34a775af3f7","Type":"ContainerDied","Data":"3ac64f4f83523bcd945ed5da0219bbc682892d08fe5e9e9c3489289a13133067"}
Sep 11 11:56:17.969435 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:17.969383    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz" event={"ID":"64fe1cf2-69ae-48bd-8b66-f34a775af3f7","Type":"ContainerStarted","Data":"fbbc7c69d184b04bc55f43fbcc3b70896a82a28eb6a1dddf40f62d634c946050"}
Sep 11 11:56:18.027990 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:18.027947    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a900ed8c-4e7a-4655-81e5-3bb6e45bbdce-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cbb9c7bc-8275q\" (UID: \"a900ed8c-4e7a-4655-81e5-3bb6e45bbdce\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q"
Sep 11 11:56:18.028183 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:18.028000    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a900ed8c-4e7a-4655-81e5-3bb6e45bbdce-manifests\") pod \"opendatahub-operator-controller-manager-76cbb9c7bc-8275q\" (UID: \"a900ed8c-4e7a-4655-81e5-3bb6e45bbdce\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q"
Sep 11 11:56:18.028183 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:18.028054    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a900ed8c-4e7a-4655-81e5-3bb6e45bbdce-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cbb9c7bc-8275q\" (UID: \"a900ed8c-4e7a-4655-81e5-3bb6e45bbdce\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q"
Sep 11 11:56:18.028183 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:18.028111    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a900ed8c-4e7a-4655-81e5-3bb6e45bbdce-tmp\") pod \"opendatahub-operator-controller-manager-76cbb9c7bc-8275q\" (UID: \"a900ed8c-4e7a-4655-81e5-3bb6e45bbdce\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q"
Sep 11 11:56:18.028183 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:18.028144    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rgl5\" (UniqueName: \"kubernetes.io/projected/a900ed8c-4e7a-4655-81e5-3bb6e45bbdce-kube-api-access-9rgl5\") pod \"opendatahub-operator-controller-manager-76cbb9c7bc-8275q\" (UID: \"a900ed8c-4e7a-4655-81e5-3bb6e45bbdce\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q"
Sep 11 11:56:18.129202 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:18.129169    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a900ed8c-4e7a-4655-81e5-3bb6e45bbdce-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cbb9c7bc-8275q\" (UID: \"a900ed8c-4e7a-4655-81e5-3bb6e45bbdce\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q"
Sep 11 11:56:18.129202 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:18.129214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a900ed8c-4e7a-4655-81e5-3bb6e45bbdce-manifests\") pod \"opendatahub-operator-controller-manager-76cbb9c7bc-8275q\" (UID: \"a900ed8c-4e7a-4655-81e5-3bb6e45bbdce\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q"
Sep 11 11:56:18.129431 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:18.129233    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a900ed8c-4e7a-4655-81e5-3bb6e45bbdce-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cbb9c7bc-8275q\" (UID: \"a900ed8c-4e7a-4655-81e5-3bb6e45bbdce\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q"
Sep 11 11:56:18.129431 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:18.129356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a900ed8c-4e7a-4655-81e5-3bb6e45bbdce-tmp\") pod \"opendatahub-operator-controller-manager-76cbb9c7bc-8275q\" (UID: \"a900ed8c-4e7a-4655-81e5-3bb6e45bbdce\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q"
Sep 11 11:56:18.129431 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:18.129406    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rgl5\" (UniqueName: \"kubernetes.io/projected/a900ed8c-4e7a-4655-81e5-3bb6e45bbdce-kube-api-access-9rgl5\") pod \"opendatahub-operator-controller-manager-76cbb9c7bc-8275q\" (UID: \"a900ed8c-4e7a-4655-81e5-3bb6e45bbdce\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q"
Sep 11 11:56:18.129649 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:18.129624    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a900ed8c-4e7a-4655-81e5-3bb6e45bbdce-manifests\") pod \"opendatahub-operator-controller-manager-76cbb9c7bc-8275q\" (UID: \"a900ed8c-4e7a-4655-81e5-3bb6e45bbdce\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q"
Sep 11 11:56:18.131493 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:18.131467    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a900ed8c-4e7a-4655-81e5-3bb6e45bbdce-tmp\") pod \"opendatahub-operator-controller-manager-76cbb9c7bc-8275q\" (UID: \"a900ed8c-4e7a-4655-81e5-3bb6e45bbdce\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q"
Sep 11 11:56:18.131746 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:18.131726    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a900ed8c-4e7a-4655-81e5-3bb6e45bbdce-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cbb9c7bc-8275q\" (UID: \"a900ed8c-4e7a-4655-81e5-3bb6e45bbdce\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q"
Sep 11 11:56:18.131872 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:18.131854    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a900ed8c-4e7a-4655-81e5-3bb6e45bbdce-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cbb9c7bc-8275q\" (UID: \"a900ed8c-4e7a-4655-81e5-3bb6e45bbdce\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q"
Sep 11 11:56:18.137996 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:18.137971    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rgl5\" (UniqueName: \"kubernetes.io/projected/a900ed8c-4e7a-4655-81e5-3bb6e45bbdce-kube-api-access-9rgl5\") pod \"opendatahub-operator-controller-manager-76cbb9c7bc-8275q\" (UID: \"a900ed8c-4e7a-4655-81e5-3bb6e45bbdce\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q"
Sep 11 11:56:18.246860 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:18.246771    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q"
Sep 11 11:56:18.520638 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:18.520609    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q"]
Sep 11 11:56:18.523303 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:56:18.523274    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda900ed8c_4e7a_4655_81e5_3bb6e45bbdce.slice/crio-c7ac512c6b274d3a6fc3a20ec0fe5c6770939e7d12e20129873c9497aeb43ba8 WatchSource:0}: Error finding container c7ac512c6b274d3a6fc3a20ec0fe5c6770939e7d12e20129873c9497aeb43ba8: Status 404 returned error can't find the container with id c7ac512c6b274d3a6fc3a20ec0fe5c6770939e7d12e20129873c9497aeb43ba8
Sep 11 11:56:18.975134 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:18.975097    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q" event={"ID":"a900ed8c-4e7a-4655-81e5-3bb6e45bbdce","Type":"ContainerStarted","Data":"c7ac512c6b274d3a6fc3a20ec0fe5c6770939e7d12e20129873c9497aeb43ba8"}
Sep 11 11:56:18.976975 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:18.976947    2565 generic.go:356] "Generic (PLEG): container finished" podID="64fe1cf2-69ae-48bd-8b66-f34a775af3f7" containerID="7cdec814d907f41af3f4238560ddfe7c396f9b6013ce7d50ef9671eab9561d0e" exitCode=0
Sep 11 11:56:18.977109 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:18.977013    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz" event={"ID":"64fe1cf2-69ae-48bd-8b66-f34a775af3f7","Type":"ContainerDied","Data":"7cdec814d907f41af3f4238560ddfe7c396f9b6013ce7d50ef9671eab9561d0e"}
Sep 11 11:56:19.985425 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:19.985385    2565 generic.go:356] "Generic (PLEG): container finished" podID="64fe1cf2-69ae-48bd-8b66-f34a775af3f7" containerID="95d59b8d43732ff2b022139bcb38024cd4fac3a7fb844e0247e6ffb8c3d6e6f9" exitCode=0
Sep 11 11:56:19.985837 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:19.985448    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz" event={"ID":"64fe1cf2-69ae-48bd-8b66-f34a775af3f7","Type":"ContainerDied","Data":"95d59b8d43732ff2b022139bcb38024cd4fac3a7fb844e0247e6ffb8c3d6e6f9"}
Sep 11 11:56:21.436117 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:21.436087    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz"
Sep 11 11:56:21.453849 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:21.453825    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64fe1cf2-69ae-48bd-8b66-f34a775af3f7-bundle\") pod \"64fe1cf2-69ae-48bd-8b66-f34a775af3f7\" (UID: \"64fe1cf2-69ae-48bd-8b66-f34a775af3f7\") "
Sep 11 11:56:21.453975 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:21.453857    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64fe1cf2-69ae-48bd-8b66-f34a775af3f7-util\") pod \"64fe1cf2-69ae-48bd-8b66-f34a775af3f7\" (UID: \"64fe1cf2-69ae-48bd-8b66-f34a775af3f7\") "
Sep 11 11:56:21.453975 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:21.453885    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4n2fz\" (UniqueName: \"kubernetes.io/projected/64fe1cf2-69ae-48bd-8b66-f34a775af3f7-kube-api-access-4n2fz\") pod \"64fe1cf2-69ae-48bd-8b66-f34a775af3f7\" (UID: \"64fe1cf2-69ae-48bd-8b66-f34a775af3f7\") "
Sep 11 11:56:21.454523 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:21.454496    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64fe1cf2-69ae-48bd-8b66-f34a775af3f7-bundle" (OuterVolumeSpecName: "bundle") pod "64fe1cf2-69ae-48bd-8b66-f34a775af3f7" (UID: "64fe1cf2-69ae-48bd-8b66-f34a775af3f7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:56:21.456214 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:21.456151    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64fe1cf2-69ae-48bd-8b66-f34a775af3f7-kube-api-access-4n2fz" (OuterVolumeSpecName: "kube-api-access-4n2fz") pod "64fe1cf2-69ae-48bd-8b66-f34a775af3f7" (UID: "64fe1cf2-69ae-48bd-8b66-f34a775af3f7"). InnerVolumeSpecName "kube-api-access-4n2fz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:56:21.459794 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:21.459749    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64fe1cf2-69ae-48bd-8b66-f34a775af3f7-util" (OuterVolumeSpecName: "util") pod "64fe1cf2-69ae-48bd-8b66-f34a775af3f7" (UID: "64fe1cf2-69ae-48bd-8b66-f34a775af3f7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:56:21.554591 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:21.554550    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64fe1cf2-69ae-48bd-8b66-f34a775af3f7-bundle\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:56:21.554591 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:21.554578    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64fe1cf2-69ae-48bd-8b66-f34a775af3f7-util\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:56:21.554591 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:21.554588    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4n2fz\" (UniqueName: \"kubernetes.io/projected/64fe1cf2-69ae-48bd-8b66-f34a775af3f7-kube-api-access-4n2fz\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:56:21.997634 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:21.997593    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q" event={"ID":"a900ed8c-4e7a-4655-81e5-3bb6e45bbdce","Type":"ContainerStarted","Data":"73e28faf434ad31f943dfe9ca477dbe522f8f49edaa339394928626bd829dcc5"}
Sep 11 11:56:21.999398 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:21.999374    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz"
Sep 11 11:56:21.999521 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:21.999376    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05f7hz" event={"ID":"64fe1cf2-69ae-48bd-8b66-f34a775af3f7","Type":"ContainerDied","Data":"fbbc7c69d184b04bc55f43fbcc3b70896a82a28eb6a1dddf40f62d634c946050"}
Sep 11 11:56:21.999521 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:21.999489    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fbbc7c69d184b04bc55f43fbcc3b70896a82a28eb6a1dddf40f62d634c946050"
Sep 11 11:56:23.004935 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:23.004904    2565 generic.go:356] "Generic (PLEG): container finished" podID="a900ed8c-4e7a-4655-81e5-3bb6e45bbdce" containerID="73e28faf434ad31f943dfe9ca477dbe522f8f49edaa339394928626bd829dcc5" exitCode=0
Sep 11 11:56:23.005380 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:23.004984    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q" event={"ID":"a900ed8c-4e7a-4655-81e5-3bb6e45bbdce","Type":"ContainerDied","Data":"73e28faf434ad31f943dfe9ca477dbe522f8f49edaa339394928626bd829dcc5"}
Sep 11 11:56:24.011097 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:24.011063    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q" event={"ID":"a900ed8c-4e7a-4655-81e5-3bb6e45bbdce","Type":"ContainerStarted","Data":"2c45d61d40afe9e85a3fe2e3caf7c39a341f0470ade68f91b2b9a354371f1fc2"}
Sep 11 11:56:24.011520 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:24.011133    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q"
Sep 11 11:56:24.033351 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:24.033297    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q" podStartSLOduration=2.635500652 podStartE2EDuration="7.033280832s" totalImagesPullingTime="3.380625687s" totalInitContainerRuntime="1.017154493s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:56:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:56:24.031024421 +0000 UTC m=+297.713423919" watchObservedRunningTime="2026-09-11 11:56:24.033280832 +0000 UTC m=+297.715680329"
Sep 11 11:56:26.748530 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:26.748497    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5pnqx_2233f21d-d3f8-44fc-92bf-03a86f7456ce/console-operator/1.log"
Sep 11 11:56:26.751132 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:26.751105    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5pnqx_2233f21d-d3f8-44fc-92bf-03a86f7456ce/console-operator/1.log"
Sep 11 11:56:26.757134 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:26.757110    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wzvlx_2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b/ovn-acl-logging/0.log"
Sep 11 11:56:26.759427 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:26.759400    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wzvlx_2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b/ovn-acl-logging/0.log"
Sep 11 11:56:26.760509 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:26.760491    2565 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 11:56:35.017314 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:35.017281    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-76cbb9c7bc-8275q"
Sep 11 11:56:47.673776 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.673739    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8478ddd598-t8k7h"]
Sep 11 11:56:47.674266 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.674005    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64fe1cf2-69ae-48bd-8b66-f34a775af3f7" containerName="extract"
Sep 11 11:56:47.674266 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.674016    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="64fe1cf2-69ae-48bd-8b66-f34a775af3f7" containerName="extract"
Sep 11 11:56:47.674266 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.674036    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64fe1cf2-69ae-48bd-8b66-f34a775af3f7" containerName="pull"
Sep 11 11:56:47.674266 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.674042    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="64fe1cf2-69ae-48bd-8b66-f34a775af3f7" containerName="pull"
Sep 11 11:56:47.674266 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.674050    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64fe1cf2-69ae-48bd-8b66-f34a775af3f7" containerName="util"
Sep 11 11:56:47.674266 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.674055    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="64fe1cf2-69ae-48bd-8b66-f34a775af3f7" containerName="util"
Sep 11 11:56:47.674266 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.674102    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="64fe1cf2-69ae-48bd-8b66-f34a775af3f7" containerName="extract"
Sep 11 11:56:47.677072 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.677047    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8478ddd598-t8k7h"
Sep 11 11:56:47.680051 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.680029    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 11:56:47.680161 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.680032    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-l9tc8\""
Sep 11 11:56:47.681028 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.681010    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 11:56:47.681028 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.681022    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 11:56:47.681176 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.681020    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 11:56:47.685888 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.685868    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8478ddd598-t8k7h"]
Sep 11 11:56:47.736802 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.736767    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ceab4d9-986f-48c2-a3f3-a4233cc76972-tmp\") pod \"kube-auth-proxy-8478ddd598-t8k7h\" (UID: \"8ceab4d9-986f-48c2-a3f3-a4233cc76972\") " pod="openshift-ingress/kube-auth-proxy-8478ddd598-t8k7h"
Sep 11 11:56:47.736960 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.736825    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ceab4d9-986f-48c2-a3f3-a4233cc76972-tls-certs\") pod \"kube-auth-proxy-8478ddd598-t8k7h\" (UID: \"8ceab4d9-986f-48c2-a3f3-a4233cc76972\") " pod="openshift-ingress/kube-auth-proxy-8478ddd598-t8k7h"
Sep 11 11:56:47.736960 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.736886    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xms6n\" (UniqueName: \"kubernetes.io/projected/8ceab4d9-986f-48c2-a3f3-a4233cc76972-kube-api-access-xms6n\") pod \"kube-auth-proxy-8478ddd598-t8k7h\" (UID: \"8ceab4d9-986f-48c2-a3f3-a4233cc76972\") " pod="openshift-ingress/kube-auth-proxy-8478ddd598-t8k7h"
Sep 11 11:56:47.837280 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.837243    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ceab4d9-986f-48c2-a3f3-a4233cc76972-tmp\") pod \"kube-auth-proxy-8478ddd598-t8k7h\" (UID: \"8ceab4d9-986f-48c2-a3f3-a4233cc76972\") " pod="openshift-ingress/kube-auth-proxy-8478ddd598-t8k7h"
Sep 11 11:56:47.837280 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.837286    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ceab4d9-986f-48c2-a3f3-a4233cc76972-tls-certs\") pod \"kube-auth-proxy-8478ddd598-t8k7h\" (UID: \"8ceab4d9-986f-48c2-a3f3-a4233cc76972\") " pod="openshift-ingress/kube-auth-proxy-8478ddd598-t8k7h"
Sep 11 11:56:47.837500 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.837326    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xms6n\" (UniqueName: \"kubernetes.io/projected/8ceab4d9-986f-48c2-a3f3-a4233cc76972-kube-api-access-xms6n\") pod \"kube-auth-proxy-8478ddd598-t8k7h\" (UID: \"8ceab4d9-986f-48c2-a3f3-a4233cc76972\") " pod="openshift-ingress/kube-auth-proxy-8478ddd598-t8k7h"
Sep 11 11:56:47.837500 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:56:47.837410    2565 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 11 11:56:47.837500 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:56:47.837482    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ceab4d9-986f-48c2-a3f3-a4233cc76972-tls-certs podName:8ceab4d9-986f-48c2-a3f3-a4233cc76972 nodeName:}" failed. No retries permitted until 2026-09-11 11:56:48.337466267 +0000 UTC m=+322.019865743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/8ceab4d9-986f-48c2-a3f3-a4233cc76972-tls-certs") pod "kube-auth-proxy-8478ddd598-t8k7h" (UID: "8ceab4d9-986f-48c2-a3f3-a4233cc76972") : secret "kube-auth-proxy-tls" not found
Sep 11 11:56:47.839526 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.839502    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ceab4d9-986f-48c2-a3f3-a4233cc76972-tmp\") pod \"kube-auth-proxy-8478ddd598-t8k7h\" (UID: \"8ceab4d9-986f-48c2-a3f3-a4233cc76972\") " pod="openshift-ingress/kube-auth-proxy-8478ddd598-t8k7h"
Sep 11 11:56:47.848464 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.848439    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xms6n\" (UniqueName: \"kubernetes.io/projected/8ceab4d9-986f-48c2-a3f3-a4233cc76972-kube-api-access-xms6n\") pod \"kube-auth-proxy-8478ddd598-t8k7h\" (UID: \"8ceab4d9-986f-48c2-a3f3-a4233cc76972\") " pod="openshift-ingress/kube-auth-proxy-8478ddd598-t8k7h"
Sep 11 11:56:47.883284 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.883258    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9ggdp"]
Sep 11 11:56:47.886343 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.886324    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9ggdp"
Sep 11 11:56:47.889150 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.889130    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-zlxw8\""
Sep 11 11:56:47.889243 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.889157    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 11 11:56:47.897301 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.897275    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9ggdp"]
Sep 11 11:56:47.938427 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.938078    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f0cbcf9-7958-4697-b00f-474179f9c874-cert\") pod \"odh-model-controller-7998c67dc4-9ggdp\" (UID: \"4f0cbcf9-7958-4697-b00f-474179f9c874\") " pod="opendatahub/odh-model-controller-7998c67dc4-9ggdp"
Sep 11 11:56:47.938427 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:47.938132    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4zdd\" (UniqueName: \"kubernetes.io/projected/4f0cbcf9-7958-4697-b00f-474179f9c874-kube-api-access-h4zdd\") pod \"odh-model-controller-7998c67dc4-9ggdp\" (UID: \"4f0cbcf9-7958-4697-b00f-474179f9c874\") " pod="opendatahub/odh-model-controller-7998c67dc4-9ggdp"
Sep 11 11:56:48.039156 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.039114    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f0cbcf9-7958-4697-b00f-474179f9c874-cert\") pod \"odh-model-controller-7998c67dc4-9ggdp\" (UID: \"4f0cbcf9-7958-4697-b00f-474179f9c874\") " pod="opendatahub/odh-model-controller-7998c67dc4-9ggdp"
Sep 11 11:56:48.039322 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.039162    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4zdd\" (UniqueName: \"kubernetes.io/projected/4f0cbcf9-7958-4697-b00f-474179f9c874-kube-api-access-h4zdd\") pod \"odh-model-controller-7998c67dc4-9ggdp\" (UID: \"4f0cbcf9-7958-4697-b00f-474179f9c874\") " pod="opendatahub/odh-model-controller-7998c67dc4-9ggdp"
Sep 11 11:56:48.039322 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:56:48.039272    2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 11 11:56:48.039411 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:56:48.039337    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f0cbcf9-7958-4697-b00f-474179f9c874-cert podName:4f0cbcf9-7958-4697-b00f-474179f9c874 nodeName:}" failed. No retries permitted until 2026-09-11 11:56:48.539320969 +0000 UTC m=+322.221720445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4f0cbcf9-7958-4697-b00f-474179f9c874-cert") pod "odh-model-controller-7998c67dc4-9ggdp" (UID: "4f0cbcf9-7958-4697-b00f-474179f9c874") : secret "odh-model-controller-webhook-cert" not found
Sep 11 11:56:48.050367 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.050333    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4zdd\" (UniqueName: \"kubernetes.io/projected/4f0cbcf9-7958-4697-b00f-474179f9c874-kube-api-access-h4zdd\") pod \"odh-model-controller-7998c67dc4-9ggdp\" (UID: \"4f0cbcf9-7958-4697-b00f-474179f9c874\") " pod="opendatahub/odh-model-controller-7998c67dc4-9ggdp"
Sep 11 11:56:48.341427 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.341342    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ceab4d9-986f-48c2-a3f3-a4233cc76972-tls-certs\") pod \"kube-auth-proxy-8478ddd598-t8k7h\" (UID: \"8ceab4d9-986f-48c2-a3f3-a4233cc76972\") " pod="openshift-ingress/kube-auth-proxy-8478ddd598-t8k7h"
Sep 11 11:56:48.343795 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.343770    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ceab4d9-986f-48c2-a3f3-a4233cc76972-tls-certs\") pod \"kube-auth-proxy-8478ddd598-t8k7h\" (UID: \"8ceab4d9-986f-48c2-a3f3-a4233cc76972\") " pod="openshift-ingress/kube-auth-proxy-8478ddd598-t8k7h"
Sep 11 11:56:48.543157 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.543116    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f0cbcf9-7958-4697-b00f-474179f9c874-cert\") pod \"odh-model-controller-7998c67dc4-9ggdp\" (UID: \"4f0cbcf9-7958-4697-b00f-474179f9c874\") " pod="opendatahub/odh-model-controller-7998c67dc4-9ggdp"
Sep 11 11:56:48.543558 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.543529    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gbgb4"]
Sep 11 11:56:48.545716 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.545674    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f0cbcf9-7958-4697-b00f-474179f9c874-cert\") pod \"odh-model-controller-7998c67dc4-9ggdp\" (UID: \"4f0cbcf9-7958-4697-b00f-474179f9c874\") " pod="opendatahub/odh-model-controller-7998c67dc4-9ggdp"
Sep 11 11:56:48.547232 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.547214    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gbgb4"
Sep 11 11:56:48.549660 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.549635    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 11 11:56:48.549762 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.549719    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-7jbn2\""
Sep 11 11:56:48.558889 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.558867    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gbgb4"]
Sep 11 11:56:48.588104 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.588078    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8478ddd598-t8k7h"
Sep 11 11:56:48.644496 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.644431    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppk7q\" (UniqueName: \"kubernetes.io/projected/4d327ca3-43ad-454f-ab85-4bc69a5270fc-kube-api-access-ppk7q\") pod \"model-serving-api-54d89bd5fc-gbgb4\" (UID: \"4d327ca3-43ad-454f-ab85-4bc69a5270fc\") " pod="opendatahub/model-serving-api-54d89bd5fc-gbgb4"
Sep 11 11:56:48.644649 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.644475    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d327ca3-43ad-454f-ab85-4bc69a5270fc-tls-certs\") pod \"model-serving-api-54d89bd5fc-gbgb4\" (UID: \"4d327ca3-43ad-454f-ab85-4bc69a5270fc\") " pod="opendatahub/model-serving-api-54d89bd5fc-gbgb4"
Sep 11 11:56:48.727735 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.727698    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"]
Sep 11 11:56:48.731206 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.731182    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:56:48.733904 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.733879    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 11:56:48.733904 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.733890    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 11:56:48.734145 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.734129    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 11:56:48.734216 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.734146    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jszth\""
Sep 11 11:56:48.734216 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.734161    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 11:56:48.742950 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.742929    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"]
Sep 11 11:56:48.746024 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.745995    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d327ca3-43ad-454f-ab85-4bc69a5270fc-tls-certs\") pod \"model-serving-api-54d89bd5fc-gbgb4\" (UID: \"4d327ca3-43ad-454f-ab85-4bc69a5270fc\") " pod="opendatahub/model-serving-api-54d89bd5fc-gbgb4"
Sep 11 11:56:48.746149 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.746129    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppk7q\" (UniqueName: \"kubernetes.io/projected/4d327ca3-43ad-454f-ab85-4bc69a5270fc-kube-api-access-ppk7q\") pod \"model-serving-api-54d89bd5fc-gbgb4\" (UID: \"4d327ca3-43ad-454f-ab85-4bc69a5270fc\") " pod="opendatahub/model-serving-api-54d89bd5fc-gbgb4"
Sep 11 11:56:48.746217 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:56:48.746151    2565 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 11 11:56:48.746217 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:56:48.746213    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d327ca3-43ad-454f-ab85-4bc69a5270fc-tls-certs podName:4d327ca3-43ad-454f-ab85-4bc69a5270fc nodeName:}" failed. No retries permitted until 2026-09-11 11:56:49.246194375 +0000 UTC m=+322.928593858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4d327ca3-43ad-454f-ab85-4bc69a5270fc-tls-certs") pod "model-serving-api-54d89bd5fc-gbgb4" (UID: "4d327ca3-43ad-454f-ab85-4bc69a5270fc") : secret "model-serving-api-tls" not found
Sep 11 11:56:48.760079 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.760054    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppk7q\" (UniqueName: \"kubernetes.io/projected/4d327ca3-43ad-454f-ab85-4bc69a5270fc-kube-api-access-ppk7q\") pod \"model-serving-api-54d89bd5fc-gbgb4\" (UID: \"4d327ca3-43ad-454f-ab85-4bc69a5270fc\") " pod="opendatahub/model-serving-api-54d89bd5fc-gbgb4"
Sep 11 11:56:48.796878 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.796848    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9ggdp"
Sep 11 11:56:48.848206 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.847066    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/48ef3fa0-9709-4026-a696-6d52bb891f3f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-prd7x\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:56:48.848206 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.847123    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh8gl\" (UniqueName: \"kubernetes.io/projected/48ef3fa0-9709-4026-a696-6d52bb891f3f-kube-api-access-gh8gl\") pod \"istiod-openshift-gateway-7b7995d5cd-prd7x\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:56:48.848206 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.847170    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48ef3fa0-9709-4026-a696-6d52bb891f3f-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-prd7x\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:56:48.848206 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.847199    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/48ef3fa0-9709-4026-a696-6d52bb891f3f-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-prd7x\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:56:48.848206 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.847225    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/48ef3fa0-9709-4026-a696-6d52bb891f3f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-prd7x\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:56:48.848206 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.847287    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/48ef3fa0-9709-4026-a696-6d52bb891f3f-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-prd7x\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:56:48.848206 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.847319    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/48ef3fa0-9709-4026-a696-6d52bb891f3f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-prd7x\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:56:48.863789 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:56:48.863761    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ceab4d9_986f_48c2_a3f3_a4233cc76972.slice/crio-b82c9edfe7753928ce47f038ef1015754b09403cfde497527deeeab1a919048e WatchSource:0}: Error finding container b82c9edfe7753928ce47f038ef1015754b09403cfde497527deeeab1a919048e: Status 404 returned error can't find the container with id b82c9edfe7753928ce47f038ef1015754b09403cfde497527deeeab1a919048e
Sep 11 11:56:48.863903 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.863874    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8478ddd598-t8k7h"]
Sep 11 11:56:48.866724 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.866705    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 11:56:48.948613 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.948557    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/48ef3fa0-9709-4026-a696-6d52bb891f3f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-prd7x\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:56:48.948613 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.948624    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh8gl\" (UniqueName: \"kubernetes.io/projected/48ef3fa0-9709-4026-a696-6d52bb891f3f-kube-api-access-gh8gl\") pod \"istiod-openshift-gateway-7b7995d5cd-prd7x\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:56:48.948894 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.948664    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48ef3fa0-9709-4026-a696-6d52bb891f3f-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-prd7x\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:56:48.948894 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.948709    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/48ef3fa0-9709-4026-a696-6d52bb891f3f-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-prd7x\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:56:48.948894 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.948734    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/48ef3fa0-9709-4026-a696-6d52bb891f3f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-prd7x\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:56:48.948894 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.948788    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/48ef3fa0-9709-4026-a696-6d52bb891f3f-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-prd7x\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:56:48.948894 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.948814    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/48ef3fa0-9709-4026-a696-6d52bb891f3f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-prd7x\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:56:48.949317 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.949286    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/48ef3fa0-9709-4026-a696-6d52bb891f3f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-prd7x\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:56:48.951043 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.951010    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/48ef3fa0-9709-4026-a696-6d52bb891f3f-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-prd7x\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:56:48.951300 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.951282    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/48ef3fa0-9709-4026-a696-6d52bb891f3f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-prd7x\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:56:48.951364 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.951283    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/48ef3fa0-9709-4026-a696-6d52bb891f3f-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-prd7x\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:56:48.951364 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.951286    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/48ef3fa0-9709-4026-a696-6d52bb891f3f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-prd7x\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:56:48.956277 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.956254    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48ef3fa0-9709-4026-a696-6d52bb891f3f-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-prd7x\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:56:48.956509 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:48.956490    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh8gl\" (UniqueName: \"kubernetes.io/projected/48ef3fa0-9709-4026-a696-6d52bb891f3f-kube-api-access-gh8gl\") pod \"istiod-openshift-gateway-7b7995d5cd-prd7x\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:56:49.042570 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:49.042537    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:56:49.066906 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:49.066821    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9ggdp"]
Sep 11 11:56:49.119552 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:49.119522    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9ggdp" event={"ID":"4f0cbcf9-7958-4697-b00f-474179f9c874","Type":"ContainerStarted","Data":"29901ea51e41cc16582b993f2f62ef865bdf50682fba3320275f5893cac24ad6"}
Sep 11 11:56:49.120702 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:49.120665    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8478ddd598-t8k7h" event={"ID":"8ceab4d9-986f-48c2-a3f3-a4233cc76972","Type":"ContainerStarted","Data":"b82c9edfe7753928ce47f038ef1015754b09403cfde497527deeeab1a919048e"}
Sep 11 11:56:49.251615 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:49.251576    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d327ca3-43ad-454f-ab85-4bc69a5270fc-tls-certs\") pod \"model-serving-api-54d89bd5fc-gbgb4\" (UID: \"4d327ca3-43ad-454f-ab85-4bc69a5270fc\") " pod="opendatahub/model-serving-api-54d89bd5fc-gbgb4"
Sep 11 11:56:49.253904 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:49.253881    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d327ca3-43ad-454f-ab85-4bc69a5270fc-tls-certs\") pod \"model-serving-api-54d89bd5fc-gbgb4\" (UID: \"4d327ca3-43ad-454f-ab85-4bc69a5270fc\") " pod="opendatahub/model-serving-api-54d89bd5fc-gbgb4"
Sep 11 11:56:49.327336 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:49.327292    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"]
Sep 11 11:56:49.329130 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:56:49.329099    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48ef3fa0_9709_4026_a696_6d52bb891f3f.slice/crio-132b24f408518693fdf08b40dd46cd63ff5ff8c280683387414d5f3b7acfe1d9 WatchSource:0}: Error finding container 132b24f408518693fdf08b40dd46cd63ff5ff8c280683387414d5f3b7acfe1d9: Status 404 returned error can't find the container with id 132b24f408518693fdf08b40dd46cd63ff5ff8c280683387414d5f3b7acfe1d9
Sep 11 11:56:49.462151 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:49.462112    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gbgb4"
Sep 11 11:56:49.753336 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:49.753198    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gbgb4"]
Sep 11 11:56:49.756431 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:56:49.756391    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d327ca3_43ad_454f_ab85_4bc69a5270fc.slice/crio-5d99da2797e5cfdf78b2447348f007e62f516a2ddc0497b2c2d52df1d6d7f3fd WatchSource:0}: Error finding container 5d99da2797e5cfdf78b2447348f007e62f516a2ddc0497b2c2d52df1d6d7f3fd: Status 404 returned error can't find the container with id 5d99da2797e5cfdf78b2447348f007e62f516a2ddc0497b2c2d52df1d6d7f3fd
Sep 11 11:56:50.128826 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:50.128752    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x" event={"ID":"48ef3fa0-9709-4026-a696-6d52bb891f3f","Type":"ContainerStarted","Data":"132b24f408518693fdf08b40dd46cd63ff5ff8c280683387414d5f3b7acfe1d9"}
Sep 11 11:56:50.135461 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:50.135422    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gbgb4" event={"ID":"4d327ca3-43ad-454f-ab85-4bc69a5270fc","Type":"ContainerStarted","Data":"5d99da2797e5cfdf78b2447348f007e62f516a2ddc0497b2c2d52df1d6d7f3fd"}
Sep 11 11:56:54.823104 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:54.823070    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 11:56:54.823644 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:54.823150    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 11:56:55.165107 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:55.165073    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x" event={"ID":"48ef3fa0-9709-4026-a696-6d52bb891f3f","Type":"ContainerStarted","Data":"6207cde5d6a14ee1289ec3b687dff5a2098dd5cdba0ef7912b6165a9e49308b0"}
Sep 11 11:56:55.165296 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:55.165228    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:56:55.167003 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:55.166974    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9ggdp" event={"ID":"4f0cbcf9-7958-4697-b00f-474179f9c874","Type":"ContainerStarted","Data":"65eac1b4975c35107068fa24d4f11a2ea23f52fc54c5c44ab021dd7261af58a3"}
Sep 11 11:56:55.167151 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:55.167051    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-9ggdp"
Sep 11 11:56:55.167314 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:55.167274    2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-prd7x container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 11:56:55.167385 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:55.167321    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x" podUID="48ef3fa0-9709-4026-a696-6d52bb891f3f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 11:56:55.168661 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:55.168635    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8478ddd598-t8k7h" event={"ID":"8ceab4d9-986f-48c2-a3f3-a4233cc76972","Type":"ContainerStarted","Data":"be01fc4a9cdd41756fb31843ee2deef1c7ac91b9ae1936c2d6e19ac266224f42"}
Sep 11 11:56:55.170174 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:55.170152    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gbgb4" event={"ID":"4d327ca3-43ad-454f-ab85-4bc69a5270fc","Type":"ContainerStarted","Data":"0ae134388505cda62f0c80b61b5dadf686e1e1a841488fb92043cd8db1da7083"}
Sep 11 11:56:55.170255 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:55.170207    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-gbgb4"
Sep 11 11:56:55.189496 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:55.189443    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x" podStartSLOduration=1.69844788 podStartE2EDuration="7.189426115s" totalImagesPullingTime="5.490978235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:56:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:56:55.186210139 +0000 UTC m=+328.868609634" watchObservedRunningTime="2026-09-11 11:56:55.189426115 +0000 UTC m=+328.871825613"
Sep 11 11:56:55.205534 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:55.205483    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-9ggdp" podStartSLOduration=2.477242151 podStartE2EDuration="8.205464195s" totalImagesPullingTime="5.728222044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:56:55.203116573 +0000 UTC m=+328.885516071" watchObservedRunningTime="2026-09-11 11:56:55.205464195 +0000 UTC m=+328.887863694"
Sep 11 11:56:55.221800 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:55.221751    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8478ddd598-t8k7h" podStartSLOduration=2.272515767 podStartE2EDuration="8.221736469s" totalImagesPullingTime="5.949220702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:56:55.220940588 +0000 UTC m=+328.903340087" watchObservedRunningTime="2026-09-11 11:56:55.221736469 +0000 UTC m=+328.904135969"
Sep 11 11:56:55.241718 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:55.241641    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-gbgb4" podStartSLOduration=2.184382221 podStartE2EDuration="7.241621398s" totalImagesPullingTime="5.057239177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:56:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:56:55.239640968 +0000 UTC m=+328.922040464" watchObservedRunningTime="2026-09-11 11:56:55.241621398 +0000 UTC m=+328.924020897"
Sep 11 11:56:56.148595 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.148560    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"]
Sep 11 11:56:56.151941 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.151923    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.156133 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.156109    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-dxkql\""
Sep 11 11:56:56.176595 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.176569    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:56:56.188773 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.188747    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"]
Sep 11 11:56:56.209349 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.209322    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75217bc8-7b9d-441c-8313-390105642653-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.209456 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.209358    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75217bc8-7b9d-441c-8313-390105642653-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.209456 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.209388    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75217bc8-7b9d-441c-8313-390105642653-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.209456 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.209412    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75217bc8-7b9d-441c-8313-390105642653-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.209456 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.209451    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75217bc8-7b9d-441c-8313-390105642653-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.209594 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.209479    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75217bc8-7b9d-441c-8313-390105642653-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.209594 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.209527    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf68g\" (UniqueName: \"kubernetes.io/projected/75217bc8-7b9d-441c-8313-390105642653-kube-api-access-lf68g\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.209594 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.209574    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75217bc8-7b9d-441c-8313-390105642653-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.209711 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.209603    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75217bc8-7b9d-441c-8313-390105642653-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.310417 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.310382    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75217bc8-7b9d-441c-8313-390105642653-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.310417 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.310417    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf68g\" (UniqueName: \"kubernetes.io/projected/75217bc8-7b9d-441c-8313-390105642653-kube-api-access-lf68g\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.310668 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.310494    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75217bc8-7b9d-441c-8313-390105642653-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.310668 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.310541    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75217bc8-7b9d-441c-8313-390105642653-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.310815 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.310697    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75217bc8-7b9d-441c-8313-390105642653-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.310815 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.310753    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75217bc8-7b9d-441c-8313-390105642653-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.310917 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.310873    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75217bc8-7b9d-441c-8313-390105642653-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.310917 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.310905    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75217bc8-7b9d-441c-8313-390105642653-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.311015 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.310963    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75217bc8-7b9d-441c-8313-390105642653-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.311161 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.311137    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75217bc8-7b9d-441c-8313-390105642653-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.311567 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.311211    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75217bc8-7b9d-441c-8313-390105642653-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.311567 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.311356    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75217bc8-7b9d-441c-8313-390105642653-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.311567 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.311542    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75217bc8-7b9d-441c-8313-390105642653-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.311851 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.311599    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75217bc8-7b9d-441c-8313-390105642653-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.313369 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.313340    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75217bc8-7b9d-441c-8313-390105642653-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.313593 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.313572    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75217bc8-7b9d-441c-8313-390105642653-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.319592 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.319565    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf68g\" (UniqueName: \"kubernetes.io/projected/75217bc8-7b9d-441c-8313-390105642653-kube-api-access-lf68g\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.319953 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.319911    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75217bc8-7b9d-441c-8313-390105642653-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm\" (UID: \"75217bc8-7b9d-441c-8313-390105642653\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.461648 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.461565    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:56:56.743074 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:56.743048    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"]
Sep 11 11:56:56.744896 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:56:56.744868    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75217bc8_7b9d_441c_8313_390105642653.slice/crio-add411e39d20f693874823bc699f7222e4bbcda72c77131539846124b8a586f4 WatchSource:0}: Error finding container add411e39d20f693874823bc699f7222e4bbcda72c77131539846124b8a586f4: Status 404 returned error can't find the container with id add411e39d20f693874823bc699f7222e4bbcda72c77131539846124b8a586f4
Sep 11 11:56:57.181224 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:57.181184    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm" event={"ID":"75217bc8-7b9d-441c-8313-390105642653","Type":"ContainerStarted","Data":"add411e39d20f693874823bc699f7222e4bbcda72c77131539846124b8a586f4"}
Sep 11 11:56:58.276112 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:58.275663    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fg7hm"]
Sep 11 11:56:58.280403 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:58.280380    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fg7hm"
Sep 11 11:56:58.283080 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:58.283053    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 11 11:56:58.283193 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:58.283056    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-bssb7\""
Sep 11 11:56:58.290409 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:58.290384    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-s878r"]
Sep 11 11:56:58.305098 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:58.305073    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fg7hm"]
Sep 11 11:56:58.305224 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:58.305118    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-s878r"]
Sep 11 11:56:58.305224 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:58.305209    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s878r"
Sep 11 11:56:58.308274 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:58.308248    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 11 11:56:58.308574 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:58.308549    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-sbrbb\""
Sep 11 11:56:58.329247 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:58.329219    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/635116a6-736f-4a5b-9f99-c041b6838fe1-cert\") pod \"kserve-controller-manager-d6f4b65b8-fg7hm\" (UID: \"635116a6-736f-4a5b-9f99-c041b6838fe1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fg7hm"
Sep 11 11:56:58.329452 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:58.329432    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwj8j\" (UniqueName: \"kubernetes.io/projected/635116a6-736f-4a5b-9f99-c041b6838fe1-kube-api-access-pwj8j\") pod \"kserve-controller-manager-d6f4b65b8-fg7hm\" (UID: \"635116a6-736f-4a5b-9f99-c041b6838fe1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fg7hm"
Sep 11 11:56:58.430070 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:58.430025    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39fad017-21bc-46c1-8fea-ff787bf83e53-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s878r\" (UID: \"39fad017-21bc-46c1-8fea-ff787bf83e53\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s878r"
Sep 11 11:56:58.430251 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:58.430082    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwj8j\" (UniqueName: \"kubernetes.io/projected/635116a6-736f-4a5b-9f99-c041b6838fe1-kube-api-access-pwj8j\") pod \"kserve-controller-manager-d6f4b65b8-fg7hm\" (UID: \"635116a6-736f-4a5b-9f99-c041b6838fe1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fg7hm"
Sep 11 11:56:58.430251 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:58.430192    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmwzp\" (UniqueName: \"kubernetes.io/projected/39fad017-21bc-46c1-8fea-ff787bf83e53-kube-api-access-pmwzp\") pod \"llmisvc-controller-manager-777c6bd7d5-s878r\" (UID: \"39fad017-21bc-46c1-8fea-ff787bf83e53\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s878r"
Sep 11 11:56:58.430251 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:58.430228    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/635116a6-736f-4a5b-9f99-c041b6838fe1-cert\") pod \"kserve-controller-manager-d6f4b65b8-fg7hm\" (UID: \"635116a6-736f-4a5b-9f99-c041b6838fe1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fg7hm"
Sep 11 11:56:58.430411 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:56:58.430333    2565 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 11 11:56:58.430411 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:56:58.430390    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/635116a6-736f-4a5b-9f99-c041b6838fe1-cert podName:635116a6-736f-4a5b-9f99-c041b6838fe1 nodeName:}" failed. No retries permitted until 2026-09-11 11:56:58.930368132 +0000 UTC m=+332.612767626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/635116a6-736f-4a5b-9f99-c041b6838fe1-cert") pod "kserve-controller-manager-d6f4b65b8-fg7hm" (UID: "635116a6-736f-4a5b-9f99-c041b6838fe1") : secret "kserve-webhook-server-cert" not found
Sep 11 11:56:58.442284 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:58.442223    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwj8j\" (UniqueName: \"kubernetes.io/projected/635116a6-736f-4a5b-9f99-c041b6838fe1-kube-api-access-pwj8j\") pod \"kserve-controller-manager-d6f4b65b8-fg7hm\" (UID: \"635116a6-736f-4a5b-9f99-c041b6838fe1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fg7hm"
Sep 11 11:56:58.531633 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:58.531531    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39fad017-21bc-46c1-8fea-ff787bf83e53-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s878r\" (UID: \"39fad017-21bc-46c1-8fea-ff787bf83e53\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s878r"
Sep 11 11:56:58.531824 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:58.531649    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmwzp\" (UniqueName: \"kubernetes.io/projected/39fad017-21bc-46c1-8fea-ff787bf83e53-kube-api-access-pmwzp\") pod \"llmisvc-controller-manager-777c6bd7d5-s878r\" (UID: \"39fad017-21bc-46c1-8fea-ff787bf83e53\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s878r"
Sep 11 11:56:58.535725 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:58.535497    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39fad017-21bc-46c1-8fea-ff787bf83e53-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s878r\" (UID: \"39fad017-21bc-46c1-8fea-ff787bf83e53\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s878r"
Sep 11 11:56:58.549452 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:58.549392    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmwzp\" (UniqueName: \"kubernetes.io/projected/39fad017-21bc-46c1-8fea-ff787bf83e53-kube-api-access-pmwzp\") pod \"llmisvc-controller-manager-777c6bd7d5-s878r\" (UID: \"39fad017-21bc-46c1-8fea-ff787bf83e53\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s878r"
Sep 11 11:56:58.618801 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:58.618750    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s878r"
Sep 11 11:56:58.902346 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:58.902311    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-s878r"]
Sep 11 11:56:58.935031 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:58.934995    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/635116a6-736f-4a5b-9f99-c041b6838fe1-cert\") pod \"kserve-controller-manager-d6f4b65b8-fg7hm\" (UID: \"635116a6-736f-4a5b-9f99-c041b6838fe1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fg7hm"
Sep 11 11:56:58.937599 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:58.937571    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/635116a6-736f-4a5b-9f99-c041b6838fe1-cert\") pod \"kserve-controller-manager-d6f4b65b8-fg7hm\" (UID: \"635116a6-736f-4a5b-9f99-c041b6838fe1\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fg7hm"
Sep 11 11:56:59.198555 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:59.198478    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fg7hm"
Sep 11 11:56:59.799382 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:56:59.799346    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod39fad017_21bc_46c1_8fea_ff787bf83e53.slice/crio-f1cf8bb30373e70b96154b95a08ab491af3d64abbde94b7c9d293de1e2192d94 WatchSource:0}: Error finding container f1cf8bb30373e70b96154b95a08ab491af3d64abbde94b7c9d293de1e2192d94: Status 404 returned error can't find the container with id f1cf8bb30373e70b96154b95a08ab491af3d64abbde94b7c9d293de1e2192d94
Sep 11 11:56:59.878973 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:59.878928    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 11:56:59.879100 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:59.879038    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 11:56:59.879100 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:56:59.879077    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 11:57:00.070463 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:00.070435    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fg7hm"]
Sep 11 11:57:00.071619 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:57:00.071589    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod635116a6_736f_4a5b_9f99_c041b6838fe1.slice/crio-e9ac4dc043b199ab10e51861d216908a454deac535360a799f7076e3a1860d46 WatchSource:0}: Error finding container e9ac4dc043b199ab10e51861d216908a454deac535360a799f7076e3a1860d46: Status 404 returned error can't find the container with id e9ac4dc043b199ab10e51861d216908a454deac535360a799f7076e3a1860d46
Sep 11 11:57:00.201503 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:00.201458    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s878r" event={"ID":"39fad017-21bc-46c1-8fea-ff787bf83e53","Type":"ContainerStarted","Data":"f1cf8bb30373e70b96154b95a08ab491af3d64abbde94b7c9d293de1e2192d94"}
Sep 11 11:57:00.202974 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:00.202942    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fg7hm" event={"ID":"635116a6-736f-4a5b-9f99-c041b6838fe1","Type":"ContainerStarted","Data":"e9ac4dc043b199ab10e51861d216908a454deac535360a799f7076e3a1860d46"}
Sep 11 11:57:00.204767 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:00.204736    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm" event={"ID":"75217bc8-7b9d-441c-8313-390105642653","Type":"ContainerStarted","Data":"a22a3f29a12f9584ccc685160c29c1a989c21b76d26f709243dc5f7584abb4a0"}
Sep 11 11:57:00.240832 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:00.240783    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm" podStartSLOduration=1.109062761 podStartE2EDuration="4.24076791s" totalImagesPullingTime="3.131705149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:56:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:57:00.239110413 +0000 UTC m=+333.921509912" watchObservedRunningTime="2026-09-11 11:57:00.24076791 +0000 UTC m=+333.923167420"
Sep 11 11:57:00.462800 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:00.462747    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:57:00.464550 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:00.464505    2565 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Sep 11 11:57:00.464714 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:00.464571    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm" podUID="75217bc8-7b9d-441c-8313-390105642653" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Sep 11 11:57:00.591813 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:00.591781    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"]
Sep 11 11:57:00.591975 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:00.591954    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x" podUID="48ef3fa0-9709-4026-a696-6d52bb891f3f" containerName="discovery" containerID="cri-o://6207cde5d6a14ee1289ec3b687dff5a2098dd5cdba0ef7912b6165a9e49308b0" gracePeriod=30
Sep 11 11:57:00.950587 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:00.950299    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:57:01.054851 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.054783    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/48ef3fa0-9709-4026-a696-6d52bb891f3f-local-certs\") pod \"48ef3fa0-9709-4026-a696-6d52bb891f3f\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") "
Sep 11 11:57:01.054851 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.054830    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/48ef3fa0-9709-4026-a696-6d52bb891f3f-istio-kubeconfig\") pod \"48ef3fa0-9709-4026-a696-6d52bb891f3f\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") "
Sep 11 11:57:01.055019 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.054859    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gh8gl\" (UniqueName: \"kubernetes.io/projected/48ef3fa0-9709-4026-a696-6d52bb891f3f-kube-api-access-gh8gl\") pod \"48ef3fa0-9709-4026-a696-6d52bb891f3f\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") "
Sep 11 11:57:01.055019 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.054889    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/48ef3fa0-9709-4026-a696-6d52bb891f3f-istio-csr-dns-cert\") pod \"48ef3fa0-9709-4026-a696-6d52bb891f3f\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") "
Sep 11 11:57:01.055019 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.054926    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/48ef3fa0-9709-4026-a696-6d52bb891f3f-cacerts\") pod \"48ef3fa0-9709-4026-a696-6d52bb891f3f\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") "
Sep 11 11:57:01.055019 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.054967    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/48ef3fa0-9709-4026-a696-6d52bb891f3f-istio-csr-ca-configmap\") pod \"48ef3fa0-9709-4026-a696-6d52bb891f3f\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") "
Sep 11 11:57:01.055019 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.055017    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48ef3fa0-9709-4026-a696-6d52bb891f3f-istio-token\") pod \"48ef3fa0-9709-4026-a696-6d52bb891f3f\" (UID: \"48ef3fa0-9709-4026-a696-6d52bb891f3f\") "
Sep 11 11:57:01.056365 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.056330    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48ef3fa0-9709-4026-a696-6d52bb891f3f-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "48ef3fa0-9709-4026-a696-6d52bb891f3f" (UID: "48ef3fa0-9709-4026-a696-6d52bb891f3f"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 11:57:01.059067 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.058839    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48ef3fa0-9709-4026-a696-6d52bb891f3f-cacerts" (OuterVolumeSpecName: "cacerts") pod "48ef3fa0-9709-4026-a696-6d52bb891f3f" (UID: "48ef3fa0-9709-4026-a696-6d52bb891f3f"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 11:57:01.059067 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.058876    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48ef3fa0-9709-4026-a696-6d52bb891f3f-local-certs" (OuterVolumeSpecName: "local-certs") pod "48ef3fa0-9709-4026-a696-6d52bb891f3f" (UID: "48ef3fa0-9709-4026-a696-6d52bb891f3f"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:57:01.059067 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.058973    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48ef3fa0-9709-4026-a696-6d52bb891f3f-istio-token" (OuterVolumeSpecName: "istio-token") pod "48ef3fa0-9709-4026-a696-6d52bb891f3f" (UID: "48ef3fa0-9709-4026-a696-6d52bb891f3f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:57:01.059290 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.059263    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48ef3fa0-9709-4026-a696-6d52bb891f3f-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "48ef3fa0-9709-4026-a696-6d52bb891f3f" (UID: "48ef3fa0-9709-4026-a696-6d52bb891f3f"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 11:57:01.059593 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.059563    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48ef3fa0-9709-4026-a696-6d52bb891f3f-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "48ef3fa0-9709-4026-a696-6d52bb891f3f" (UID: "48ef3fa0-9709-4026-a696-6d52bb891f3f"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 11:57:01.059944 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.059903    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48ef3fa0-9709-4026-a696-6d52bb891f3f-kube-api-access-gh8gl" (OuterVolumeSpecName: "kube-api-access-gh8gl") pod "48ef3fa0-9709-4026-a696-6d52bb891f3f" (UID: "48ef3fa0-9709-4026-a696-6d52bb891f3f"). InnerVolumeSpecName "kube-api-access-gh8gl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:57:01.155906 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.155877    2565 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/48ef3fa0-9709-4026-a696-6d52bb891f3f-local-certs\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:57:01.155906 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.155908    2565 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/48ef3fa0-9709-4026-a696-6d52bb891f3f-istio-kubeconfig\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:57:01.156197 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.155924    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gh8gl\" (UniqueName: \"kubernetes.io/projected/48ef3fa0-9709-4026-a696-6d52bb891f3f-kube-api-access-gh8gl\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:57:01.156197 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.155939    2565 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/48ef3fa0-9709-4026-a696-6d52bb891f3f-istio-csr-dns-cert\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:57:01.156197 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.155954    2565 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/48ef3fa0-9709-4026-a696-6d52bb891f3f-cacerts\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:57:01.156197 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.155968    2565 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/48ef3fa0-9709-4026-a696-6d52bb891f3f-istio-csr-ca-configmap\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:57:01.156197 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.155982    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48ef3fa0-9709-4026-a696-6d52bb891f3f-istio-token\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:57:01.213827 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.213792    2565 generic.go:356] "Generic (PLEG): container finished" podID="48ef3fa0-9709-4026-a696-6d52bb891f3f" containerID="6207cde5d6a14ee1289ec3b687dff5a2098dd5cdba0ef7912b6165a9e49308b0" exitCode=0
Sep 11 11:57:01.213970 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.213929    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"
Sep 11 11:57:01.214046 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.213964    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x" event={"ID":"48ef3fa0-9709-4026-a696-6d52bb891f3f","Type":"ContainerDied","Data":"6207cde5d6a14ee1289ec3b687dff5a2098dd5cdba0ef7912b6165a9e49308b0"}
Sep 11 11:57:01.214046 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.214016    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x" event={"ID":"48ef3fa0-9709-4026-a696-6d52bb891f3f","Type":"ContainerDied","Data":"132b24f408518693fdf08b40dd46cd63ff5ff8c280683387414d5f3b7acfe1d9"}
Sep 11 11:57:01.214046 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.214044    2565 scope.go:117] "RemoveContainer" containerID="6207cde5d6a14ee1289ec3b687dff5a2098dd5cdba0ef7912b6165a9e49308b0"
Sep 11 11:57:01.225358 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.225336    2565 scope.go:117] "RemoveContainer" containerID="6207cde5d6a14ee1289ec3b687dff5a2098dd5cdba0ef7912b6165a9e49308b0"
Sep 11 11:57:01.225843 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:57:01.225816    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6207cde5d6a14ee1289ec3b687dff5a2098dd5cdba0ef7912b6165a9e49308b0\": container with ID starting with 6207cde5d6a14ee1289ec3b687dff5a2098dd5cdba0ef7912b6165a9e49308b0 not found: ID does not exist" containerID="6207cde5d6a14ee1289ec3b687dff5a2098dd5cdba0ef7912b6165a9e49308b0"
Sep 11 11:57:01.225940 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.225854    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6207cde5d6a14ee1289ec3b687dff5a2098dd5cdba0ef7912b6165a9e49308b0"} err="failed to get container status \"6207cde5d6a14ee1289ec3b687dff5a2098dd5cdba0ef7912b6165a9e49308b0\": rpc error: code = NotFound desc = could not find container \"6207cde5d6a14ee1289ec3b687dff5a2098dd5cdba0ef7912b6165a9e49308b0\": container with ID starting with 6207cde5d6a14ee1289ec3b687dff5a2098dd5cdba0ef7912b6165a9e49308b0 not found: ID does not exist"
Sep 11 11:57:01.239561 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.239535    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"]
Sep 11 11:57:01.242730 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.242706    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-prd7x"]
Sep 11 11:57:01.466002 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:01.465969    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:57:02.220698 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:02.220647    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:57:02.221671 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:02.221648    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm"
Sep 11 11:57:02.841199 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:02.841165    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48ef3fa0-9709-4026-a696-6d52bb891f3f" path="/var/lib/kubelet/pods/48ef3fa0-9709-4026-a696-6d52bb891f3f/volumes"
Sep 11 11:57:03.226547 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:03.226513    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s878r" event={"ID":"39fad017-21bc-46c1-8fea-ff787bf83e53","Type":"ContainerStarted","Data":"95b3f34184cb7f31febc010c2c8728b7b842cf00d8718e53c6dda86841a85005"}
Sep 11 11:57:03.226992 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:03.226600    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s878r"
Sep 11 11:57:03.228195 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:03.228169    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fg7hm" event={"ID":"635116a6-736f-4a5b-9f99-c041b6838fe1","Type":"ContainerStarted","Data":"68420068f8e69b36f7da28d16953a7a5a2361087a06af3f48d9e5e64f8cfa74d"}
Sep 11 11:57:03.228338 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:03.228211    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fg7hm"
Sep 11 11:57:03.247951 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:03.247901    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s878r" podStartSLOduration=2.218393287 podStartE2EDuration="5.247887851s" totalImagesPullingTime="3.029494564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:56:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:57:03.246607231 +0000 UTC m=+336.929006733" watchObservedRunningTime="2026-09-11 11:57:03.247887851 +0000 UTC m=+336.930287387"
Sep 11 11:57:03.263805 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:03.263761    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fg7hm" podStartSLOduration=2.505284508 podStartE2EDuration="5.263748634s" totalImagesPullingTime="2.758464126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:56:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:57:03.26242266 +0000 UTC m=+336.944822172" watchObservedRunningTime="2026-09-11 11:57:03.263748634 +0000 UTC m=+336.946148131"
Sep 11 11:57:06.178567 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:06.178534    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-9ggdp"
Sep 11 11:57:06.180346 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:06.180323    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-gbgb4"
Sep 11 11:57:34.234750 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:34.234716    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s878r"
Sep 11 11:57:34.237789 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:34.237765    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fg7hm"
Sep 11 11:57:52.367882 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.367845    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz"]
Sep 11 11:57:52.371462 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.368710    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48ef3fa0-9709-4026-a696-6d52bb891f3f" containerName="discovery"
Sep 11 11:57:52.371462 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.368744    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="48ef3fa0-9709-4026-a696-6d52bb891f3f" containerName="discovery"
Sep 11 11:57:52.371462 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.368960    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="48ef3fa0-9709-4026-a696-6d52bb891f3f" containerName="discovery"
Sep 11 11:57:52.373888 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.373856    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz"
Sep 11 11:57:52.377857 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.377824    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 11:57:52.377990 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.377862    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dj7vq\""
Sep 11 11:57:52.377990 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.377936    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 11:57:52.379833 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.379793    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz"]
Sep 11 11:57:52.464899 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.464860    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57730c33-b37d-4c01-ba4f-492bd6a6b995-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz\" (UID: \"57730c33-b37d-4c01-ba4f-492bd6a6b995\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz"
Sep 11 11:57:52.465093 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.464924    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx4qp\" (UniqueName: \"kubernetes.io/projected/57730c33-b37d-4c01-ba4f-492bd6a6b995-kube-api-access-zx4qp\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz\" (UID: \"57730c33-b37d-4c01-ba4f-492bd6a6b995\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz"
Sep 11 11:57:52.465093 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.464977    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57730c33-b37d-4c01-ba4f-492bd6a6b995-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz\" (UID: \"57730c33-b37d-4c01-ba4f-492bd6a6b995\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz"
Sep 11 11:57:52.467084 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.467058    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb"]
Sep 11 11:57:52.470513 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.470496    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb"
Sep 11 11:57:52.478509 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.478485    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb"]
Sep 11 11:57:52.564885 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.564850    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff"]
Sep 11 11:57:52.566281 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.566260    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9343ebc-f368-46fe-8344-c81a412b4c85-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb\" (UID: \"e9343ebc-f368-46fe-8344-c81a412b4c85\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb"
Sep 11 11:57:52.566364 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.566293    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckgj8\" (UniqueName: \"kubernetes.io/projected/e9343ebc-f368-46fe-8344-c81a412b4c85-kube-api-access-ckgj8\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb\" (UID: \"e9343ebc-f368-46fe-8344-c81a412b4c85\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb"
Sep 11 11:57:52.566364 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.566331    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57730c33-b37d-4c01-ba4f-492bd6a6b995-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz\" (UID: \"57730c33-b37d-4c01-ba4f-492bd6a6b995\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz"
Sep 11 11:57:52.566486 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.566402    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57730c33-b37d-4c01-ba4f-492bd6a6b995-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz\" (UID: \"57730c33-b37d-4c01-ba4f-492bd6a6b995\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz"
Sep 11 11:57:52.566486 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.566461    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9343ebc-f368-46fe-8344-c81a412b4c85-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb\" (UID: \"e9343ebc-f368-46fe-8344-c81a412b4c85\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb"
Sep 11 11:57:52.566560 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.566488    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx4qp\" (UniqueName: \"kubernetes.io/projected/57730c33-b37d-4c01-ba4f-492bd6a6b995-kube-api-access-zx4qp\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz\" (UID: \"57730c33-b37d-4c01-ba4f-492bd6a6b995\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz"
Sep 11 11:57:52.566722 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.566703    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57730c33-b37d-4c01-ba4f-492bd6a6b995-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz\" (UID: \"57730c33-b37d-4c01-ba4f-492bd6a6b995\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz"
Sep 11 11:57:52.566765 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.566727    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57730c33-b37d-4c01-ba4f-492bd6a6b995-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz\" (UID: \"57730c33-b37d-4c01-ba4f-492bd6a6b995\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz"
Sep 11 11:57:52.568391 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.568376    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff"
Sep 11 11:57:52.575930 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.575904    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff"]
Sep 11 11:57:52.577749 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.577728    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx4qp\" (UniqueName: \"kubernetes.io/projected/57730c33-b37d-4c01-ba4f-492bd6a6b995-kube-api-access-zx4qp\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz\" (UID: \"57730c33-b37d-4c01-ba4f-492bd6a6b995\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz"
Sep 11 11:57:52.665209 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.665175    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t"]
Sep 11 11:57:52.667601 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.667579    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9343ebc-f368-46fe-8344-c81a412b4c85-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb\" (UID: \"e9343ebc-f368-46fe-8344-c81a412b4c85\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb"
Sep 11 11:57:52.667711 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.667613    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77946a96-a46d-4146-9605-eb488fd0d059-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff\" (UID: \"77946a96-a46d-4146-9605-eb488fd0d059\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff"
Sep 11 11:57:52.667711 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.667638    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr8jq\" (UniqueName: \"kubernetes.io/projected/77946a96-a46d-4146-9605-eb488fd0d059-kube-api-access-gr8jq\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff\" (UID: \"77946a96-a46d-4146-9605-eb488fd0d059\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff"
Sep 11 11:57:52.667711 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.667666    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9343ebc-f368-46fe-8344-c81a412b4c85-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb\" (UID: \"e9343ebc-f368-46fe-8344-c81a412b4c85\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb"
Sep 11 11:57:52.667711 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.667704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckgj8\" (UniqueName: \"kubernetes.io/projected/e9343ebc-f368-46fe-8344-c81a412b4c85-kube-api-access-ckgj8\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb\" (UID: \"e9343ebc-f368-46fe-8344-c81a412b4c85\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb"
Sep 11 11:57:52.667909 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.667738    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77946a96-a46d-4146-9605-eb488fd0d059-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff\" (UID: \"77946a96-a46d-4146-9605-eb488fd0d059\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff"
Sep 11 11:57:52.668049 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.668028    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9343ebc-f368-46fe-8344-c81a412b4c85-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb\" (UID: \"e9343ebc-f368-46fe-8344-c81a412b4c85\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb"
Sep 11 11:57:52.668084 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.668028    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9343ebc-f368-46fe-8344-c81a412b4c85-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb\" (UID: \"e9343ebc-f368-46fe-8344-c81a412b4c85\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb"
Sep 11 11:57:52.668577 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.668561    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t"
Sep 11 11:57:52.677174 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.677148    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t"]
Sep 11 11:57:52.678701 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.678656    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckgj8\" (UniqueName: \"kubernetes.io/projected/e9343ebc-f368-46fe-8344-c81a412b4c85-kube-api-access-ckgj8\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb\" (UID: \"e9343ebc-f368-46fe-8344-c81a412b4c85\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb"
Sep 11 11:57:52.685326 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.685301    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz"
Sep 11 11:57:52.768346 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.768314    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77946a96-a46d-4146-9605-eb488fd0d059-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff\" (UID: \"77946a96-a46d-4146-9605-eb488fd0d059\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff"
Sep 11 11:57:52.768482 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.768397    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77946a96-a46d-4146-9605-eb488fd0d059-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff\" (UID: \"77946a96-a46d-4146-9605-eb488fd0d059\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff"
Sep 11 11:57:52.768482 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.768439    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr8jq\" (UniqueName: \"kubernetes.io/projected/77946a96-a46d-4146-9605-eb488fd0d059-kube-api-access-gr8jq\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff\" (UID: \"77946a96-a46d-4146-9605-eb488fd0d059\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff"
Sep 11 11:57:52.768482 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.768470    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01489e0d-a6ce-4264-ba7a-c3d5318b346c-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t\" (UID: \"01489e0d-a6ce-4264-ba7a-c3d5318b346c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t"
Sep 11 11:57:52.768592 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.768509    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjqfg\" (UniqueName: \"kubernetes.io/projected/01489e0d-a6ce-4264-ba7a-c3d5318b346c-kube-api-access-wjqfg\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t\" (UID: \"01489e0d-a6ce-4264-ba7a-c3d5318b346c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t"
Sep 11 11:57:52.768592 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.768545    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01489e0d-a6ce-4264-ba7a-c3d5318b346c-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t\" (UID: \"01489e0d-a6ce-4264-ba7a-c3d5318b346c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t"
Sep 11 11:57:52.769615 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.768977    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77946a96-a46d-4146-9605-eb488fd0d059-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff\" (UID: \"77946a96-a46d-4146-9605-eb488fd0d059\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff"
Sep 11 11:57:52.769615 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.769248    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77946a96-a46d-4146-9605-eb488fd0d059-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff\" (UID: \"77946a96-a46d-4146-9605-eb488fd0d059\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff"
Sep 11 11:57:52.778183 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.778153    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr8jq\" (UniqueName: \"kubernetes.io/projected/77946a96-a46d-4146-9605-eb488fd0d059-kube-api-access-gr8jq\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff\" (UID: \"77946a96-a46d-4146-9605-eb488fd0d059\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff"
Sep 11 11:57:52.779445 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.779426    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb"
Sep 11 11:57:52.869339 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.869308    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01489e0d-a6ce-4264-ba7a-c3d5318b346c-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t\" (UID: \"01489e0d-a6ce-4264-ba7a-c3d5318b346c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t"
Sep 11 11:57:52.869480 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.869351    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjqfg\" (UniqueName: \"kubernetes.io/projected/01489e0d-a6ce-4264-ba7a-c3d5318b346c-kube-api-access-wjqfg\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t\" (UID: \"01489e0d-a6ce-4264-ba7a-c3d5318b346c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t"
Sep 11 11:57:52.869480 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.869374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01489e0d-a6ce-4264-ba7a-c3d5318b346c-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t\" (UID: \"01489e0d-a6ce-4264-ba7a-c3d5318b346c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t"
Sep 11 11:57:52.869730 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.869706    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01489e0d-a6ce-4264-ba7a-c3d5318b346c-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t\" (UID: \"01489e0d-a6ce-4264-ba7a-c3d5318b346c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t"
Sep 11 11:57:52.869824 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.869769    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01489e0d-a6ce-4264-ba7a-c3d5318b346c-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t\" (UID: \"01489e0d-a6ce-4264-ba7a-c3d5318b346c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t"
Sep 11 11:57:52.877810 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.877783    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff"
Sep 11 11:57:52.878105 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.878086    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjqfg\" (UniqueName: \"kubernetes.io/projected/01489e0d-a6ce-4264-ba7a-c3d5318b346c-kube-api-access-wjqfg\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t\" (UID: \"01489e0d-a6ce-4264-ba7a-c3d5318b346c\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t"
Sep 11 11:57:52.963461 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.963431    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz"]
Sep 11 11:57:52.966623 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:57:52.966593    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57730c33_b37d_4c01_ba4f_492bd6a6b995.slice/crio-80eb5911f2ad2bccecdd65d3f61e1332fd8f18d44e873aed0529ac8a18a0de7d WatchSource:0}: Error finding container 80eb5911f2ad2bccecdd65d3f61e1332fd8f18d44e873aed0529ac8a18a0de7d: Status 404 returned error can't find the container with id 80eb5911f2ad2bccecdd65d3f61e1332fd8f18d44e873aed0529ac8a18a0de7d
Sep 11 11:57:52.978488 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:52.978467    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t"
Sep 11 11:57:53.073268 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:53.073237    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb"]
Sep 11 11:57:53.101619 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:57:53.101588    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9343ebc_f368_46fe_8344_c81a412b4c85.slice/crio-fbba95c6f8d93b8038ac5feeb75363d558daf8c58f17cce4e64a43e18159c074 WatchSource:0}: Error finding container fbba95c6f8d93b8038ac5feeb75363d558daf8c58f17cce4e64a43e18159c074: Status 404 returned error can't find the container with id fbba95c6f8d93b8038ac5feeb75363d558daf8c58f17cce4e64a43e18159c074
Sep 11 11:57:53.153390 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:53.153365    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff"]
Sep 11 11:57:53.156252 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:57:53.156221    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77946a96_a46d_4146_9605_eb488fd0d059.slice/crio-a3518269eb6451cb408b831f8fe437a01a9c7333ba6c8f08d9e636768b7810da WatchSource:0}: Error finding container a3518269eb6451cb408b831f8fe437a01a9c7333ba6c8f08d9e636768b7810da: Status 404 returned error can't find the container with id a3518269eb6451cb408b831f8fe437a01a9c7333ba6c8f08d9e636768b7810da
Sep 11 11:57:53.250286 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:53.250258    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t"]
Sep 11 11:57:53.255147 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:57:53.255126    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01489e0d_a6ce_4264_ba7a_c3d5318b346c.slice/crio-5f3c14a51449828e66ba4c07cd846c07ba1cf4f5fec6dfb6407a441478c53069 WatchSource:0}: Error finding container 5f3c14a51449828e66ba4c07cd846c07ba1cf4f5fec6dfb6407a441478c53069: Status 404 returned error can't find the container with id 5f3c14a51449828e66ba4c07cd846c07ba1cf4f5fec6dfb6407a441478c53069
Sep 11 11:57:53.459142 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:53.459044    2565 generic.go:356] "Generic (PLEG): container finished" podID="e9343ebc-f368-46fe-8344-c81a412b4c85" containerID="75b4697bca8ddf60e074937e92cbb7b29e0fe1f3d8f966267974a8aafd7aa877" exitCode=0
Sep 11 11:57:53.459142 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:53.459128    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb" event={"ID":"e9343ebc-f368-46fe-8344-c81a412b4c85","Type":"ContainerDied","Data":"75b4697bca8ddf60e074937e92cbb7b29e0fe1f3d8f966267974a8aafd7aa877"}
Sep 11 11:57:53.459651 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:53.459180    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb" event={"ID":"e9343ebc-f368-46fe-8344-c81a412b4c85","Type":"ContainerStarted","Data":"fbba95c6f8d93b8038ac5feeb75363d558daf8c58f17cce4e64a43e18159c074"}
Sep 11 11:57:53.460908 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:53.460706    2565 generic.go:356] "Generic (PLEG): container finished" podID="77946a96-a46d-4146-9605-eb488fd0d059" containerID="4adc5e8751de2db28a52e9e86164da39b321b25829289ec90463e051c5edcb7b" exitCode=0
Sep 11 11:57:53.460908 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:53.460767    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff" event={"ID":"77946a96-a46d-4146-9605-eb488fd0d059","Type":"ContainerDied","Data":"4adc5e8751de2db28a52e9e86164da39b321b25829289ec90463e051c5edcb7b"}
Sep 11 11:57:53.460908 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:53.460808    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff" event={"ID":"77946a96-a46d-4146-9605-eb488fd0d059","Type":"ContainerStarted","Data":"a3518269eb6451cb408b831f8fe437a01a9c7333ba6c8f08d9e636768b7810da"}
Sep 11 11:57:53.462309 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:53.462290    2565 generic.go:356] "Generic (PLEG): container finished" podID="57730c33-b37d-4c01-ba4f-492bd6a6b995" containerID="444b9dea158db5838e2c94257dbbcf1aa9bea2c14410fe2e42697f2de7cfe4e4" exitCode=0
Sep 11 11:57:53.462387 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:53.462372    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz" event={"ID":"57730c33-b37d-4c01-ba4f-492bd6a6b995","Type":"ContainerDied","Data":"444b9dea158db5838e2c94257dbbcf1aa9bea2c14410fe2e42697f2de7cfe4e4"}
Sep 11 11:57:53.462485 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:53.462410    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz" event={"ID":"57730c33-b37d-4c01-ba4f-492bd6a6b995","Type":"ContainerStarted","Data":"80eb5911f2ad2bccecdd65d3f61e1332fd8f18d44e873aed0529ac8a18a0de7d"}
Sep 11 11:57:53.464019 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:53.463989    2565 generic.go:356] "Generic (PLEG): container finished" podID="01489e0d-a6ce-4264-ba7a-c3d5318b346c" containerID="5ef764c8530f06d3647bcda3e16e872462b9682c8ee0324c7533a1a49269cc32" exitCode=0
Sep 11 11:57:53.464102 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:53.464057    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t" event={"ID":"01489e0d-a6ce-4264-ba7a-c3d5318b346c","Type":"ContainerDied","Data":"5ef764c8530f06d3647bcda3e16e872462b9682c8ee0324c7533a1a49269cc32"}
Sep 11 11:57:53.464102 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:53.464089    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t" event={"ID":"01489e0d-a6ce-4264-ba7a-c3d5318b346c","Type":"ContainerStarted","Data":"5f3c14a51449828e66ba4c07cd846c07ba1cf4f5fec6dfb6407a441478c53069"}
Sep 11 11:57:54.470312 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:54.470282    2565 generic.go:356] "Generic (PLEG): container finished" podID="57730c33-b37d-4c01-ba4f-492bd6a6b995" containerID="a270ebfa549df2bfeedf998760582a9f0c952adc46319fbc75f9246a7e2d39a0" exitCode=0
Sep 11 11:57:54.470615 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:54.470379    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz" event={"ID":"57730c33-b37d-4c01-ba4f-492bd6a6b995","Type":"ContainerDied","Data":"a270ebfa549df2bfeedf998760582a9f0c952adc46319fbc75f9246a7e2d39a0"}
Sep 11 11:57:55.477051 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:55.477014    2565 generic.go:356] "Generic (PLEG): container finished" podID="57730c33-b37d-4c01-ba4f-492bd6a6b995" containerID="270253bea6301249b79c487751ca70555d9e2724e03bb08db6eb0d1e707a972b" exitCode=0
Sep 11 11:57:55.477495 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:55.477086    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz" event={"ID":"57730c33-b37d-4c01-ba4f-492bd6a6b995","Type":"ContainerDied","Data":"270253bea6301249b79c487751ca70555d9e2724e03bb08db6eb0d1e707a972b"}
Sep 11 11:57:55.478994 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:55.478963    2565 generic.go:356] "Generic (PLEG): container finished" podID="01489e0d-a6ce-4264-ba7a-c3d5318b346c" containerID="bff7d38507dadae1b9a67935312a9ac156b952def53791e53d2fa03b77622d54" exitCode=0
Sep 11 11:57:55.479107 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:55.479051    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t" event={"ID":"01489e0d-a6ce-4264-ba7a-c3d5318b346c","Type":"ContainerDied","Data":"bff7d38507dadae1b9a67935312a9ac156b952def53791e53d2fa03b77622d54"}
Sep 11 11:57:55.480972 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:55.480950    2565 generic.go:356] "Generic (PLEG): container finished" podID="e9343ebc-f368-46fe-8344-c81a412b4c85" containerID="c36e832d1209c0fe432a80599313c0dabdbaf31656cc179d0d53dcde52b3b42d" exitCode=0
Sep 11 11:57:55.481074 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:55.480986    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb" event={"ID":"e9343ebc-f368-46fe-8344-c81a412b4c85","Type":"ContainerDied","Data":"c36e832d1209c0fe432a80599313c0dabdbaf31656cc179d0d53dcde52b3b42d"}
Sep 11 11:57:56.487654 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:56.487617    2565 generic.go:356] "Generic (PLEG): container finished" podID="01489e0d-a6ce-4264-ba7a-c3d5318b346c" containerID="8f3f2b5e72fef63756678d961d024fa71e7bbcc5798e1c025de109c50f03f2b8" exitCode=0
Sep 11 11:57:56.488112 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:56.487720    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t" event={"ID":"01489e0d-a6ce-4264-ba7a-c3d5318b346c","Type":"ContainerDied","Data":"8f3f2b5e72fef63756678d961d024fa71e7bbcc5798e1c025de109c50f03f2b8"}
Sep 11 11:57:56.489817 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:56.489796    2565 generic.go:356] "Generic (PLEG): container finished" podID="e9343ebc-f368-46fe-8344-c81a412b4c85" containerID="b8d3782d5cafe5fe5fc6033af9ac7cfde10f29fdcde903a468aaf44ea4532c27" exitCode=0
Sep 11 11:57:56.489919 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:56.489873    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb" event={"ID":"e9343ebc-f368-46fe-8344-c81a412b4c85","Type":"ContainerDied","Data":"b8d3782d5cafe5fe5fc6033af9ac7cfde10f29fdcde903a468aaf44ea4532c27"}
Sep 11 11:57:56.614830 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:56.614800    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz"
Sep 11 11:57:56.702524 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:56.702493    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57730c33-b37d-4c01-ba4f-492bd6a6b995-bundle\") pod \"57730c33-b37d-4c01-ba4f-492bd6a6b995\" (UID: \"57730c33-b37d-4c01-ba4f-492bd6a6b995\") "
Sep 11 11:57:56.702729 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:56.702550    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zx4qp\" (UniqueName: \"kubernetes.io/projected/57730c33-b37d-4c01-ba4f-492bd6a6b995-kube-api-access-zx4qp\") pod \"57730c33-b37d-4c01-ba4f-492bd6a6b995\" (UID: \"57730c33-b37d-4c01-ba4f-492bd6a6b995\") "
Sep 11 11:57:56.702729 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:56.702589    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57730c33-b37d-4c01-ba4f-492bd6a6b995-util\") pod \"57730c33-b37d-4c01-ba4f-492bd6a6b995\" (UID: \"57730c33-b37d-4c01-ba4f-492bd6a6b995\") "
Sep 11 11:57:56.703041 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:56.703017    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57730c33-b37d-4c01-ba4f-492bd6a6b995-bundle" (OuterVolumeSpecName: "bundle") pod "57730c33-b37d-4c01-ba4f-492bd6a6b995" (UID: "57730c33-b37d-4c01-ba4f-492bd6a6b995"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:57:56.704651 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:56.704628    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57730c33-b37d-4c01-ba4f-492bd6a6b995-kube-api-access-zx4qp" (OuterVolumeSpecName: "kube-api-access-zx4qp") pod "57730c33-b37d-4c01-ba4f-492bd6a6b995" (UID: "57730c33-b37d-4c01-ba4f-492bd6a6b995"). InnerVolumeSpecName "kube-api-access-zx4qp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:57:56.710572 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:56.710545    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57730c33-b37d-4c01-ba4f-492bd6a6b995-util" (OuterVolumeSpecName: "util") pod "57730c33-b37d-4c01-ba4f-492bd6a6b995" (UID: "57730c33-b37d-4c01-ba4f-492bd6a6b995"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:57:56.804130 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:56.804051    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57730c33-b37d-4c01-ba4f-492bd6a6b995-bundle\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:57:56.804130 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:56.804082    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zx4qp\" (UniqueName: \"kubernetes.io/projected/57730c33-b37d-4c01-ba4f-492bd6a6b995-kube-api-access-zx4qp\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:57:56.804130 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:56.804090    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57730c33-b37d-4c01-ba4f-492bd6a6b995-util\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:57:57.496672 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:57.496632    2565 generic.go:356] "Generic (PLEG): container finished" podID="77946a96-a46d-4146-9605-eb488fd0d059" containerID="d04b238061f409c2ee6fbf0f78b791cfb6af1cf0148467d98d5f5d3bbf0c0298" exitCode=0
Sep 11 11:57:57.497179 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:57.496721    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff" event={"ID":"77946a96-a46d-4146-9605-eb488fd0d059","Type":"ContainerDied","Data":"d04b238061f409c2ee6fbf0f78b791cfb6af1cf0148467d98d5f5d3bbf0c0298"}
Sep 11 11:57:57.498788 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:57.498765    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz"
Sep 11 11:57:57.498898 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:57.498782    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cs4wqz" event={"ID":"57730c33-b37d-4c01-ba4f-492bd6a6b995","Type":"ContainerDied","Data":"80eb5911f2ad2bccecdd65d3f61e1332fd8f18d44e873aed0529ac8a18a0de7d"}
Sep 11 11:57:57.498898 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:57.498822    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80eb5911f2ad2bccecdd65d3f61e1332fd8f18d44e873aed0529ac8a18a0de7d"
Sep 11 11:57:57.634240 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:57.634218    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb"
Sep 11 11:57:57.687847 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:57.687822    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t"
Sep 11 11:57:57.713217 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:57.713185    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9343ebc-f368-46fe-8344-c81a412b4c85-bundle\") pod \"e9343ebc-f368-46fe-8344-c81a412b4c85\" (UID: \"e9343ebc-f368-46fe-8344-c81a412b4c85\") "
Sep 11 11:57:57.713334 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:57.713265    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckgj8\" (UniqueName: \"kubernetes.io/projected/e9343ebc-f368-46fe-8344-c81a412b4c85-kube-api-access-ckgj8\") pod \"e9343ebc-f368-46fe-8344-c81a412b4c85\" (UID: \"e9343ebc-f368-46fe-8344-c81a412b4c85\") "
Sep 11 11:57:57.713395 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:57.713351    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9343ebc-f368-46fe-8344-c81a412b4c85-util\") pod \"e9343ebc-f368-46fe-8344-c81a412b4c85\" (UID: \"e9343ebc-f368-46fe-8344-c81a412b4c85\") "
Sep 11 11:57:57.714047 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:57.714015    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9343ebc-f368-46fe-8344-c81a412b4c85-bundle" (OuterVolumeSpecName: "bundle") pod "e9343ebc-f368-46fe-8344-c81a412b4c85" (UID: "e9343ebc-f368-46fe-8344-c81a412b4c85"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:57:57.715872 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:57.715841    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9343ebc-f368-46fe-8344-c81a412b4c85-kube-api-access-ckgj8" (OuterVolumeSpecName: "kube-api-access-ckgj8") pod "e9343ebc-f368-46fe-8344-c81a412b4c85" (UID: "e9343ebc-f368-46fe-8344-c81a412b4c85"). InnerVolumeSpecName "kube-api-access-ckgj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:57:57.719139 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:57.719112    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9343ebc-f368-46fe-8344-c81a412b4c85-util" (OuterVolumeSpecName: "util") pod "e9343ebc-f368-46fe-8344-c81a412b4c85" (UID: "e9343ebc-f368-46fe-8344-c81a412b4c85"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:57:57.814291 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:57.814205    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01489e0d-a6ce-4264-ba7a-c3d5318b346c-util\") pod \"01489e0d-a6ce-4264-ba7a-c3d5318b346c\" (UID: \"01489e0d-a6ce-4264-ba7a-c3d5318b346c\") "
Sep 11 11:57:57.814456 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:57.814295    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01489e0d-a6ce-4264-ba7a-c3d5318b346c-bundle\") pod \"01489e0d-a6ce-4264-ba7a-c3d5318b346c\" (UID: \"01489e0d-a6ce-4264-ba7a-c3d5318b346c\") "
Sep 11 11:57:57.814456 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:57.814426    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjqfg\" (UniqueName: \"kubernetes.io/projected/01489e0d-a6ce-4264-ba7a-c3d5318b346c-kube-api-access-wjqfg\") pod \"01489e0d-a6ce-4264-ba7a-c3d5318b346c\" (UID: \"01489e0d-a6ce-4264-ba7a-c3d5318b346c\") "
Sep 11 11:57:57.814630 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:57.814614    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckgj8\" (UniqueName: \"kubernetes.io/projected/e9343ebc-f368-46fe-8344-c81a412b4c85-kube-api-access-ckgj8\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:57:57.814713 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:57.814631    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9343ebc-f368-46fe-8344-c81a412b4c85-util\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:57:57.814713 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:57.814641    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9343ebc-f368-46fe-8344-c81a412b4c85-bundle\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:57:57.814713 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:57.814676    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01489e0d-a6ce-4264-ba7a-c3d5318b346c-bundle" (OuterVolumeSpecName: "bundle") pod "01489e0d-a6ce-4264-ba7a-c3d5318b346c" (UID: "01489e0d-a6ce-4264-ba7a-c3d5318b346c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:57:57.816377 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:57.816355    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01489e0d-a6ce-4264-ba7a-c3d5318b346c-kube-api-access-wjqfg" (OuterVolumeSpecName: "kube-api-access-wjqfg") pod "01489e0d-a6ce-4264-ba7a-c3d5318b346c" (UID: "01489e0d-a6ce-4264-ba7a-c3d5318b346c"). InnerVolumeSpecName "kube-api-access-wjqfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:57:57.819702 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:57.819655    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01489e0d-a6ce-4264-ba7a-c3d5318b346c-util" (OuterVolumeSpecName: "util") pod "01489e0d-a6ce-4264-ba7a-c3d5318b346c" (UID: "01489e0d-a6ce-4264-ba7a-c3d5318b346c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:57:57.916033 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:57.915995    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01489e0d-a6ce-4264-ba7a-c3d5318b346c-bundle\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:57:57.916033 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:57.916027    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjqfg\" (UniqueName: \"kubernetes.io/projected/01489e0d-a6ce-4264-ba7a-c3d5318b346c-kube-api-access-wjqfg\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:57:57.916033 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:57.916037    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01489e0d-a6ce-4264-ba7a-c3d5318b346c-util\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:57:58.506348 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:58.506314    2565 generic.go:356] "Generic (PLEG): container finished" podID="77946a96-a46d-4146-9605-eb488fd0d059" containerID="c858742c303fb9d5302b3c35a759fa85aeb6f6a202b4d59e0381ae8f7e4c2230" exitCode=0
Sep 11 11:57:58.506811 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:58.506402    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff" event={"ID":"77946a96-a46d-4146-9605-eb488fd0d059","Type":"ContainerDied","Data":"c858742c303fb9d5302b3c35a759fa85aeb6f6a202b4d59e0381ae8f7e4c2230"}
Sep 11 11:57:58.508222 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:58.508203    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t"
Sep 11 11:57:58.508332 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:58.508243    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d79m62t" event={"ID":"01489e0d-a6ce-4264-ba7a-c3d5318b346c","Type":"ContainerDied","Data":"5f3c14a51449828e66ba4c07cd846c07ba1cf4f5fec6dfb6407a441478c53069"}
Sep 11 11:57:58.508332 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:58.508292    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f3c14a51449828e66ba4c07cd846c07ba1cf4f5fec6dfb6407a441478c53069"
Sep 11 11:57:58.510327 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:58.510297    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb" event={"ID":"e9343ebc-f368-46fe-8344-c81a412b4c85","Type":"ContainerDied","Data":"fbba95c6f8d93b8038ac5feeb75363d558daf8c58f17cce4e64a43e18159c074"}
Sep 11 11:57:58.510327 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:58.510316    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adhwlb"
Sep 11 11:57:58.510327 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:58.510328    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fbba95c6f8d93b8038ac5feeb75363d558daf8c58f17cce4e64a43e18159c074"
Sep 11 11:57:59.640821 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:59.640798    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff"
Sep 11 11:57:59.726959 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:59.726929    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77946a96-a46d-4146-9605-eb488fd0d059-util\") pod \"77946a96-a46d-4146-9605-eb488fd0d059\" (UID: \"77946a96-a46d-4146-9605-eb488fd0d059\") "
Sep 11 11:57:59.727128 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:59.726984    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77946a96-a46d-4146-9605-eb488fd0d059-bundle\") pod \"77946a96-a46d-4146-9605-eb488fd0d059\" (UID: \"77946a96-a46d-4146-9605-eb488fd0d059\") "
Sep 11 11:57:59.727128 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:59.727024    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gr8jq\" (UniqueName: \"kubernetes.io/projected/77946a96-a46d-4146-9605-eb488fd0d059-kube-api-access-gr8jq\") pod \"77946a96-a46d-4146-9605-eb488fd0d059\" (UID: \"77946a96-a46d-4146-9605-eb488fd0d059\") "
Sep 11 11:57:59.727432 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:59.727406    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77946a96-a46d-4146-9605-eb488fd0d059-bundle" (OuterVolumeSpecName: "bundle") pod "77946a96-a46d-4146-9605-eb488fd0d059" (UID: "77946a96-a46d-4146-9605-eb488fd0d059"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:57:59.729097 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:59.729070    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77946a96-a46d-4146-9605-eb488fd0d059-kube-api-access-gr8jq" (OuterVolumeSpecName: "kube-api-access-gr8jq") pod "77946a96-a46d-4146-9605-eb488fd0d059" (UID: "77946a96-a46d-4146-9605-eb488fd0d059"). InnerVolumeSpecName "kube-api-access-gr8jq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:57:59.731560 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:59.731522    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77946a96-a46d-4146-9605-eb488fd0d059-util" (OuterVolumeSpecName: "util") pod "77946a96-a46d-4146-9605-eb488fd0d059" (UID: "77946a96-a46d-4146-9605-eb488fd0d059"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:57:59.828440 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:59.828375    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77946a96-a46d-4146-9605-eb488fd0d059-bundle\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:57:59.828440 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:59.828400    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gr8jq\" (UniqueName: \"kubernetes.io/projected/77946a96-a46d-4146-9605-eb488fd0d059-kube-api-access-gr8jq\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:57:59.828440 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:57:59.828410    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77946a96-a46d-4146-9605-eb488fd0d059-util\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:58:00.521787 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:00.521747    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff" event={"ID":"77946a96-a46d-4146-9605-eb488fd0d059","Type":"ContainerDied","Data":"a3518269eb6451cb408b831f8fe437a01a9c7333ba6c8f08d9e636768b7810da"}
Sep 11 11:58:00.521967 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:00.521836    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3518269eb6451cb408b831f8fe437a01a9c7333ba6c8f08d9e636768b7810da"
Sep 11 11:58:00.521967 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:00.521749    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kt4ff"
Sep 11 11:58:09.191637 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.191601    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r"]
Sep 11 11:58:09.192012 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.191898    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57730c33-b37d-4c01-ba4f-492bd6a6b995" containerName="util"
Sep 11 11:58:09.192012 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.191909    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="57730c33-b37d-4c01-ba4f-492bd6a6b995" containerName="util"
Sep 11 11:58:09.192012 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.191916    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77946a96-a46d-4146-9605-eb488fd0d059" containerName="util"
Sep 11 11:58:09.192012 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.191922    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="77946a96-a46d-4146-9605-eb488fd0d059" containerName="util"
Sep 11 11:58:09.192012 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.191929    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57730c33-b37d-4c01-ba4f-492bd6a6b995" containerName="extract"
Sep 11 11:58:09.192012 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.191935    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="57730c33-b37d-4c01-ba4f-492bd6a6b995" containerName="extract"
Sep 11 11:58:09.192012 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.191942    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9343ebc-f368-46fe-8344-c81a412b4c85" containerName="pull"
Sep 11 11:58:09.192012 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.191949    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9343ebc-f368-46fe-8344-c81a412b4c85" containerName="pull"
Sep 11 11:58:09.192012 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.191959    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77946a96-a46d-4146-9605-eb488fd0d059" containerName="extract"
Sep 11 11:58:09.192012 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.191964    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="77946a96-a46d-4146-9605-eb488fd0d059" containerName="extract"
Sep 11 11:58:09.192012 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.191977    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01489e0d-a6ce-4264-ba7a-c3d5318b346c" containerName="util"
Sep 11 11:58:09.192012 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.191981    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="01489e0d-a6ce-4264-ba7a-c3d5318b346c" containerName="util"
Sep 11 11:58:09.192012 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.191987    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57730c33-b37d-4c01-ba4f-492bd6a6b995" containerName="pull"
Sep 11 11:58:09.192012 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.191992    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="57730c33-b37d-4c01-ba4f-492bd6a6b995" containerName="pull"
Sep 11 11:58:09.192012 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.191999    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9343ebc-f368-46fe-8344-c81a412b4c85" containerName="util"
Sep 11 11:58:09.192012 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.192004    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9343ebc-f368-46fe-8344-c81a412b4c85" containerName="util"
Sep 11 11:58:09.192012 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.192010    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01489e0d-a6ce-4264-ba7a-c3d5318b346c" containerName="pull"
Sep 11 11:58:09.192012 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.192015    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="01489e0d-a6ce-4264-ba7a-c3d5318b346c" containerName="pull"
Sep 11 11:58:09.192012 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.192020    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01489e0d-a6ce-4264-ba7a-c3d5318b346c" containerName="extract"
Sep 11 11:58:09.192564 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.192026    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="01489e0d-a6ce-4264-ba7a-c3d5318b346c" containerName="extract"
Sep 11 11:58:09.192564 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.192034    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9343ebc-f368-46fe-8344-c81a412b4c85" containerName="extract"
Sep 11 11:58:09.192564 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.192038    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9343ebc-f368-46fe-8344-c81a412b4c85" containerName="extract"
Sep 11 11:58:09.192564 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.192044    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77946a96-a46d-4146-9605-eb488fd0d059" containerName="pull"
Sep 11 11:58:09.192564 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.192049    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="77946a96-a46d-4146-9605-eb488fd0d059" containerName="pull"
Sep 11 11:58:09.192564 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.192102    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="77946a96-a46d-4146-9605-eb488fd0d059" containerName="extract"
Sep 11 11:58:09.192564 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.192110    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9343ebc-f368-46fe-8344-c81a412b4c85" containerName="extract"
Sep 11 11:58:09.192564 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.192117    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="01489e0d-a6ce-4264-ba7a-c3d5318b346c" containerName="extract"
Sep 11 11:58:09.192564 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.192124    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="57730c33-b37d-4c01-ba4f-492bd6a6b995" containerName="extract"
Sep 11 11:58:09.195789 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.195766    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r"
Sep 11 11:58:09.198543 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.198514    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 11:58:09.198662 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.198514    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 11:58:09.199812 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.199792    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-n8c6m\""
Sep 11 11:58:09.214726 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.214701    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r"]
Sep 11 11:58:09.310004 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.309976    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz7j2\" (UniqueName: \"kubernetes.io/projected/1c0dbcb9-1f0b-4662-90dc-5691ef836b03-kube-api-access-vz7j2\") pod \"limitador-operator-controller-manager-74495c69f8-lcg7r\" (UID: \"1c0dbcb9-1f0b-4662-90dc-5691ef836b03\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r"
Sep 11 11:58:09.411292 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.411258    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz7j2\" (UniqueName: \"kubernetes.io/projected/1c0dbcb9-1f0b-4662-90dc-5691ef836b03-kube-api-access-vz7j2\") pod \"limitador-operator-controller-manager-74495c69f8-lcg7r\" (UID: \"1c0dbcb9-1f0b-4662-90dc-5691ef836b03\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r"
Sep 11 11:58:09.421745 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.421723    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz7j2\" (UniqueName: \"kubernetes.io/projected/1c0dbcb9-1f0b-4662-90dc-5691ef836b03-kube-api-access-vz7j2\") pod \"limitador-operator-controller-manager-74495c69f8-lcg7r\" (UID: \"1c0dbcb9-1f0b-4662-90dc-5691ef836b03\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r"
Sep 11 11:58:09.506402 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.506307    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r"
Sep 11 11:58:09.784958 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:09.784934    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r"]
Sep 11 11:58:09.786626 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:58:09.786590    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c0dbcb9_1f0b_4662_90dc_5691ef836b03.slice/crio-8b0dc2dd8c6e6f0aa6c5f7b1004f466e5f74fca3d9b8d3faf52973b1b37cb078 WatchSource:0}: Error finding container 8b0dc2dd8c6e6f0aa6c5f7b1004f466e5f74fca3d9b8d3faf52973b1b37cb078: Status 404 returned error can't find the container with id 8b0dc2dd8c6e6f0aa6c5f7b1004f466e5f74fca3d9b8d3faf52973b1b37cb078
Sep 11 11:58:10.579117 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:10.579069    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r" event={"ID":"1c0dbcb9-1f0b-4662-90dc-5691ef836b03","Type":"ContainerStarted","Data":"8b0dc2dd8c6e6f0aa6c5f7b1004f466e5f74fca3d9b8d3faf52973b1b37cb078"}
Sep 11 11:58:11.639754 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:11.639714    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-j7rpx"]
Sep 11 11:58:11.650916 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:11.650856    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-j7rpx"
Sep 11 11:58:11.653668 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:11.653574    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-kns2j\""
Sep 11 11:58:11.654301 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:11.654261    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-j7rpx"]
Sep 11 11:58:11.733930 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:11.733883    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b7z6\" (UniqueName: \"kubernetes.io/projected/6e5ab5a7-2173-4591-bad5-9333f082fecb-kube-api-access-7b7z6\") pod \"authorino-operator-76b478bd78-j7rpx\" (UID: \"6e5ab5a7-2173-4591-bad5-9333f082fecb\") " pod="kuadrant-system/authorino-operator-76b478bd78-j7rpx"
Sep 11 11:58:11.834852 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:11.834810    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b7z6\" (UniqueName: \"kubernetes.io/projected/6e5ab5a7-2173-4591-bad5-9333f082fecb-kube-api-access-7b7z6\") pod \"authorino-operator-76b478bd78-j7rpx\" (UID: \"6e5ab5a7-2173-4591-bad5-9333f082fecb\") " pod="kuadrant-system/authorino-operator-76b478bd78-j7rpx"
Sep 11 11:58:11.844101 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:11.844074    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b7z6\" (UniqueName: \"kubernetes.io/projected/6e5ab5a7-2173-4591-bad5-9333f082fecb-kube-api-access-7b7z6\") pod \"authorino-operator-76b478bd78-j7rpx\" (UID: \"6e5ab5a7-2173-4591-bad5-9333f082fecb\") " pod="kuadrant-system/authorino-operator-76b478bd78-j7rpx"
Sep 11 11:58:11.965806 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:11.965725    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-j7rpx"
Sep 11 11:58:12.295528 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:12.295502    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-j7rpx"]
Sep 11 11:58:12.296654 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:58:12.296628    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e5ab5a7_2173_4591_bad5_9333f082fecb.slice/crio-120e27919a994b10602b636af4625accab6c473cbff61c55a713bc13d853e1f1 WatchSource:0}: Error finding container 120e27919a994b10602b636af4625accab6c473cbff61c55a713bc13d853e1f1: Status 404 returned error can't find the container with id 120e27919a994b10602b636af4625accab6c473cbff61c55a713bc13d853e1f1
Sep 11 11:58:12.592140 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:12.592041    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r" event={"ID":"1c0dbcb9-1f0b-4662-90dc-5691ef836b03","Type":"ContainerStarted","Data":"e371d53ff2a4b4e8ac4429a1f357065267cde4ac4d835bb3ecf589dcf150765f"}
Sep 11 11:58:12.592140 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:12.592098    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r"
Sep 11 11:58:12.593372 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:12.593341    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-j7rpx" event={"ID":"6e5ab5a7-2173-4591-bad5-9333f082fecb","Type":"ContainerStarted","Data":"120e27919a994b10602b636af4625accab6c473cbff61c55a713bc13d853e1f1"}
Sep 11 11:58:12.611469 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:12.611427    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r" podStartSLOduration=1.304900151 podStartE2EDuration="3.611413982s" totalImagesPullingTime="2.306513831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:58:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:58:12.610471431 +0000 UTC m=+406.292870939" watchObservedRunningTime="2026-09-11 11:58:12.611413982 +0000 UTC m=+406.293813479"
Sep 11 11:58:14.264671 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:14.264635    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-582k7"]
Sep 11 11:58:14.267933 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:14.267916    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-582k7"
Sep 11 11:58:14.271833 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:14.271811    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-ll86k\""
Sep 11 11:58:14.272054 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:14.272036    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 11 11:58:14.296027 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:14.296004    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-582k7"]
Sep 11 11:58:14.355181 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:14.355150    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqc9t\" (UniqueName: \"kubernetes.io/projected/6e17d76e-d693-4cb6-9306-e1ff79ea6745-kube-api-access-tqc9t\") pod \"dns-operator-controller-manager-7b84cd7c9c-582k7\" (UID: \"6e17d76e-d693-4cb6-9306-e1ff79ea6745\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-582k7"
Sep 11 11:58:14.456376 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:14.456336    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqc9t\" (UniqueName: \"kubernetes.io/projected/6e17d76e-d693-4cb6-9306-e1ff79ea6745-kube-api-access-tqc9t\") pod \"dns-operator-controller-manager-7b84cd7c9c-582k7\" (UID: \"6e17d76e-d693-4cb6-9306-e1ff79ea6745\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-582k7"
Sep 11 11:58:14.464896 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:14.464866    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqc9t\" (UniqueName: \"kubernetes.io/projected/6e17d76e-d693-4cb6-9306-e1ff79ea6745-kube-api-access-tqc9t\") pod \"dns-operator-controller-manager-7b84cd7c9c-582k7\" (UID: \"6e17d76e-d693-4cb6-9306-e1ff79ea6745\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-582k7"
Sep 11 11:58:14.578187 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:14.578108    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-582k7"
Sep 11 11:58:14.605795 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:14.605759    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-j7rpx" event={"ID":"6e5ab5a7-2173-4591-bad5-9333f082fecb","Type":"ContainerStarted","Data":"9dbdd584396ed6592537a75d4d2679ecaa333f11c2963be76c937f3fc02ce6f7"}
Sep 11 11:58:14.605994 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:14.605850    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-j7rpx"
Sep 11 11:58:14.858925 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:14.858880    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-j7rpx" podStartSLOduration=2.608162858 podStartE2EDuration="3.858861239s" totalImagesPullingTime="1.250698381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:58:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:58:14.636255612 +0000 UTC m=+408.318655120" watchObservedRunningTime="2026-09-11 11:58:14.858861239 +0000 UTC m=+408.541260738"
Sep 11 11:58:14.859540 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:14.859525    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-582k7"]
Sep 11 11:58:14.861313 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:58:14.861288    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e17d76e_d693_4cb6_9306_e1ff79ea6745.slice/crio-a0a4b41579d6cf64b8430a37f36b7fc1b134a72641540912bc2dbcec3d5b697c WatchSource:0}: Error finding container a0a4b41579d6cf64b8430a37f36b7fc1b134a72641540912bc2dbcec3d5b697c: Status 404 returned error can't find the container with id a0a4b41579d6cf64b8430a37f36b7fc1b134a72641540912bc2dbcec3d5b697c
Sep 11 11:58:15.614494 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:15.614435    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-582k7" event={"ID":"6e17d76e-d693-4cb6-9306-e1ff79ea6745","Type":"ContainerStarted","Data":"a0a4b41579d6cf64b8430a37f36b7fc1b134a72641540912bc2dbcec3d5b697c"}
Sep 11 11:58:16.620870 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:16.620772    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-582k7" event={"ID":"6e17d76e-d693-4cb6-9306-e1ff79ea6745","Type":"ContainerStarted","Data":"3995734d6fe7ee2dc0e46b565005520e16e89e8d3d727752aae6b2434bad71ab"}
Sep 11 11:58:16.621219 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:16.620870    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-582k7"
Sep 11 11:58:16.639451 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:16.639397    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-582k7" podStartSLOduration=1.144139947 podStartE2EDuration="2.639382384s" totalImagesPullingTime="1.495242437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:58:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:58:16.637017962 +0000 UTC m=+410.319417457" watchObservedRunningTime="2026-09-11 11:58:16.639382384 +0000 UTC m=+410.321781882"
Sep 11 11:58:18.314950 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:18.314912    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"]
Sep 11 11:58:18.318356 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:18.318339    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"
Sep 11 11:58:18.321218 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:18.321199    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xbl99\""
Sep 11 11:58:18.329093 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:18.329068    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"]
Sep 11 11:58:18.395376 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:18.395337    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t5qq\" (UniqueName: \"kubernetes.io/projected/1ee35ef6-43c4-4286-b53c-24176fc5d737-kube-api-access-2t5qq\") pod \"kuadrant-operator-controller-manager-76f8f686bf-x6jqm\" (UID: \"1ee35ef6-43c4-4286-b53c-24176fc5d737\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"
Sep 11 11:58:18.395549 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:18.395418    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ee35ef6-43c4-4286-b53c-24176fc5d737-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-x6jqm\" (UID: \"1ee35ef6-43c4-4286-b53c-24176fc5d737\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"
Sep 11 11:58:18.496375 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:18.496315    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t5qq\" (UniqueName: \"kubernetes.io/projected/1ee35ef6-43c4-4286-b53c-24176fc5d737-kube-api-access-2t5qq\") pod \"kuadrant-operator-controller-manager-76f8f686bf-x6jqm\" (UID: \"1ee35ef6-43c4-4286-b53c-24176fc5d737\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"
Sep 11 11:58:18.496554 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:18.496455    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ee35ef6-43c4-4286-b53c-24176fc5d737-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-x6jqm\" (UID: \"1ee35ef6-43c4-4286-b53c-24176fc5d737\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"
Sep 11 11:58:18.496906 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:18.496885    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ee35ef6-43c4-4286-b53c-24176fc5d737-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-x6jqm\" (UID: \"1ee35ef6-43c4-4286-b53c-24176fc5d737\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"
Sep 11 11:58:18.504566 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:18.504542    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t5qq\" (UniqueName: \"kubernetes.io/projected/1ee35ef6-43c4-4286-b53c-24176fc5d737-kube-api-access-2t5qq\") pod \"kuadrant-operator-controller-manager-76f8f686bf-x6jqm\" (UID: \"1ee35ef6-43c4-4286-b53c-24176fc5d737\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"
Sep 11 11:58:18.628184 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:18.628088    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"
Sep 11 11:58:18.922656 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:18.922625    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"]
Sep 11 11:58:18.924254 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:58:18.924224    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ee35ef6_43c4_4286_b53c_24176fc5d737.slice/crio-2e335ae6bb27fe1298ed00e08f990393b7da12847f7ddb5a6328af46e930e0bd WatchSource:0}: Error finding container 2e335ae6bb27fe1298ed00e08f990393b7da12847f7ddb5a6328af46e930e0bd: Status 404 returned error can't find the container with id 2e335ae6bb27fe1298ed00e08f990393b7da12847f7ddb5a6328af46e930e0bd
Sep 11 11:58:19.646502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:19.646458    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm" event={"ID":"1ee35ef6-43c4-4286-b53c-24176fc5d737","Type":"ContainerStarted","Data":"2e335ae6bb27fe1298ed00e08f990393b7da12847f7ddb5a6328af46e930e0bd"}
Sep 11 11:58:22.666386 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:22.666340    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm" event={"ID":"1ee35ef6-43c4-4286-b53c-24176fc5d737","Type":"ContainerStarted","Data":"28660d96087b6573cff34428e23f4d65622fbcf255bb5bc7b28fc493a055ba50"}
Sep 11 11:58:22.666769 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:22.666502    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"
Sep 11 11:58:22.688132 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:22.688086    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm" podStartSLOduration=1.164472428 podStartE2EDuration="4.688067982s" totalImagesPullingTime="3.523595554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:58:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:58:22.684953179 +0000 UTC m=+416.367352678" watchObservedRunningTime="2026-09-11 11:58:22.688067982 +0000 UTC m=+416.370467480"
Sep 11 11:58:23.600560 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:23.600528    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r"
Sep 11 11:58:25.616980 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:25.616942    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-j7rpx"
Sep 11 11:58:27.628940 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:27.628907    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-582k7"
Sep 11 11:58:33.674214 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:33.674178    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"
Sep 11 11:58:35.713360 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.713321    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"]
Sep 11 11:58:35.713856 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.713586    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm" podUID="1ee35ef6-43c4-4286-b53c-24176fc5d737" containerName="manager" containerID="cri-o://28660d96087b6573cff34428e23f4d65622fbcf255bb5bc7b28fc493a055ba50" gracePeriod=2
Sep 11 11:58:35.725391 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.725347    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"]
Sep 11 11:58:35.734844 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:58:35.734801    2565 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"1ee35ef6-43c4-4286-b53c-24176fc5d737\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-x6jqm\": pods \"kuadrant-operator-controller-manager-76f8f686bf-x6jqm\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"
Sep 11 11:58:35.739139 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.739112    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2m4d6"]
Sep 11 11:58:35.739444 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.739430    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ee35ef6-43c4-4286-b53c-24176fc5d737" containerName="manager"
Sep 11 11:58:35.739506 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.739447    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ee35ef6-43c4-4286-b53c-24176fc5d737" containerName="manager"
Sep 11 11:58:35.739559 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.739551    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ee35ef6-43c4-4286-b53c-24176fc5d737" containerName="manager"
Sep 11 11:58:35.742700 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.742662    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r"]
Sep 11 11:58:35.742872 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.742847    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r" podUID="1c0dbcb9-1f0b-4662-90dc-5691ef836b03" containerName="manager" containerID="cri-o://e371d53ff2a4b4e8ac4429a1f357065267cde4ac4d835bb3ecf589dcf150765f" gracePeriod=2
Sep 11 11:58:35.743094 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.743068    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2m4d6"
Sep 11 11:58:35.743482 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.743459    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r"]
Sep 11 11:58:35.745316 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:58:35.745289    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-x6jqm\" is forbidden: User \"system:node:ip-10-0-138-111.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-111.ec2.internal' and this object" podUID="1ee35ef6-43c4-4286-b53c-24176fc5d737" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"
Sep 11 11:58:35.747453 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:58:35.747422    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-lcg7r\" is forbidden: User \"system:node:ip-10-0-138-111.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-111.ec2.internal' and this object" podUID="1c0dbcb9-1f0b-4662-90dc-5691ef836b03" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r"
Sep 11 11:58:35.749864 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:58:35.749833    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-lcg7r\" is forbidden: User \"system:node:ip-10-0-138-111.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-111.ec2.internal' and this object" podUID="1c0dbcb9-1f0b-4662-90dc-5691ef836b03" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r"
Sep 11 11:58:35.754831 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.754807    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2m4d6"]
Sep 11 11:58:35.764401 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.764376    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8pp5"]
Sep 11 11:58:35.764866 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.764851    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c0dbcb9-1f0b-4662-90dc-5691ef836b03" containerName="manager"
Sep 11 11:58:35.764916 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.764870    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c0dbcb9-1f0b-4662-90dc-5691ef836b03" containerName="manager"
Sep 11 11:58:35.764963 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.764953    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c0dbcb9-1f0b-4662-90dc-5691ef836b03" containerName="manager"
Sep 11 11:58:35.769580 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.769558    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8pp5"
Sep 11 11:58:35.782851 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.782824    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8pp5"]
Sep 11 11:58:35.788783 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:58:35.788753    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-x6jqm\" is forbidden: User \"system:node:ip-10-0-138-111.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-111.ec2.internal' and this object" podUID="1ee35ef6-43c4-4286-b53c-24176fc5d737" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"
Sep 11 11:58:35.791359 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:58:35.791330    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-x6jqm\" is forbidden: User \"system:node:ip-10-0-138-111.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-111.ec2.internal' and this object" podUID="1ee35ef6-43c4-4286-b53c-24176fc5d737" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"
Sep 11 11:58:35.813760 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:58:35.813731    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-lcg7r\" is forbidden: User \"system:node:ip-10-0-138-111.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-111.ec2.internal' and this object" podUID="1c0dbcb9-1f0b-4662-90dc-5691ef836b03" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r"
Sep 11 11:58:35.841402 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.841375    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00ef0df3-72ca-48d2-a412-d83be51c74fa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-2m4d6\" (UID: \"00ef0df3-72ca-48d2-a412-d83be51c74fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2m4d6"
Sep 11 11:58:35.841503 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.841407    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phtlh\" (UniqueName: \"kubernetes.io/projected/dac8da16-a702-461f-ac08-9e64388e1b68-kube-api-access-phtlh\") pod \"limitador-operator-controller-manager-74495c69f8-m8pp5\" (UID: \"dac8da16-a702-461f-ac08-9e64388e1b68\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8pp5"
Sep 11 11:58:35.841503 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.841453    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj4q5\" (UniqueName: \"kubernetes.io/projected/00ef0df3-72ca-48d2-a412-d83be51c74fa-kube-api-access-dj4q5\") pod \"kuadrant-operator-controller-manager-76f8f686bf-2m4d6\" (UID: \"00ef0df3-72ca-48d2-a412-d83be51c74fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2m4d6"
Sep 11 11:58:35.942313 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.942275    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj4q5\" (UniqueName: \"kubernetes.io/projected/00ef0df3-72ca-48d2-a412-d83be51c74fa-kube-api-access-dj4q5\") pod \"kuadrant-operator-controller-manager-76f8f686bf-2m4d6\" (UID: \"00ef0df3-72ca-48d2-a412-d83be51c74fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2m4d6"
Sep 11 11:58:35.942460 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.942368    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00ef0df3-72ca-48d2-a412-d83be51c74fa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-2m4d6\" (UID: \"00ef0df3-72ca-48d2-a412-d83be51c74fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2m4d6"
Sep 11 11:58:35.942460 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.942395    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phtlh\" (UniqueName: \"kubernetes.io/projected/dac8da16-a702-461f-ac08-9e64388e1b68-kube-api-access-phtlh\") pod \"limitador-operator-controller-manager-74495c69f8-m8pp5\" (UID: \"dac8da16-a702-461f-ac08-9e64388e1b68\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8pp5"
Sep 11 11:58:35.942809 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.942786    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00ef0df3-72ca-48d2-a412-d83be51c74fa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-2m4d6\" (UID: \"00ef0df3-72ca-48d2-a412-d83be51c74fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2m4d6"
Sep 11 11:58:35.951757 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.951727    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phtlh\" (UniqueName: \"kubernetes.io/projected/dac8da16-a702-461f-ac08-9e64388e1b68-kube-api-access-phtlh\") pod \"limitador-operator-controller-manager-74495c69f8-m8pp5\" (UID: \"dac8da16-a702-461f-ac08-9e64388e1b68\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8pp5"
Sep 11 11:58:35.951757 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.951752    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj4q5\" (UniqueName: \"kubernetes.io/projected/00ef0df3-72ca-48d2-a412-d83be51c74fa-kube-api-access-dj4q5\") pod \"kuadrant-operator-controller-manager-76f8f686bf-2m4d6\" (UID: \"00ef0df3-72ca-48d2-a412-d83be51c74fa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2m4d6"
Sep 11 11:58:35.981164 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.981142    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"
Sep 11 11:58:35.983221 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:35.983201    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r"
Sep 11 11:58:35.983398 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:58:35.983381    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-lcg7r\" is forbidden: User \"system:node:ip-10-0-138-111.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-111.ec2.internal' and this object" podUID="1c0dbcb9-1f0b-4662-90dc-5691ef836b03" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r"
Sep 11 11:58:35.985429 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:58:35.985404    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-x6jqm\" is forbidden: User \"system:node:ip-10-0-138-111.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-111.ec2.internal' and this object" podUID="1ee35ef6-43c4-4286-b53c-24176fc5d737" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"
Sep 11 11:58:35.987519 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:58:35.987495    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-x6jqm\" is forbidden: User \"system:node:ip-10-0-138-111.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-111.ec2.internal' and this object" podUID="1ee35ef6-43c4-4286-b53c-24176fc5d737" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"
Sep 11 11:58:35.989575 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:58:35.989555    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-lcg7r\" is forbidden: User \"system:node:ip-10-0-138-111.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-111.ec2.internal' and this object" podUID="1c0dbcb9-1f0b-4662-90dc-5691ef836b03" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r"
Sep 11 11:58:36.043059 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.043025    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vz7j2\" (UniqueName: \"kubernetes.io/projected/1c0dbcb9-1f0b-4662-90dc-5691ef836b03-kube-api-access-vz7j2\") pod \"1c0dbcb9-1f0b-4662-90dc-5691ef836b03\" (UID: \"1c0dbcb9-1f0b-4662-90dc-5691ef836b03\") "
Sep 11 11:58:36.043214 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.043087    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2t5qq\" (UniqueName: \"kubernetes.io/projected/1ee35ef6-43c4-4286-b53c-24176fc5d737-kube-api-access-2t5qq\") pod \"1ee35ef6-43c4-4286-b53c-24176fc5d737\" (UID: \"1ee35ef6-43c4-4286-b53c-24176fc5d737\") "
Sep 11 11:58:36.043214 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.043127    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ee35ef6-43c4-4286-b53c-24176fc5d737-extensions-socket-volume\") pod \"1ee35ef6-43c4-4286-b53c-24176fc5d737\" (UID: \"1ee35ef6-43c4-4286-b53c-24176fc5d737\") "
Sep 11 11:58:36.043531 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.043505    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ee35ef6-43c4-4286-b53c-24176fc5d737-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1ee35ef6-43c4-4286-b53c-24176fc5d737" (UID: "1ee35ef6-43c4-4286-b53c-24176fc5d737"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:58:36.045245 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.045222    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c0dbcb9-1f0b-4662-90dc-5691ef836b03-kube-api-access-vz7j2" (OuterVolumeSpecName: "kube-api-access-vz7j2") pod "1c0dbcb9-1f0b-4662-90dc-5691ef836b03" (UID: "1c0dbcb9-1f0b-4662-90dc-5691ef836b03"). InnerVolumeSpecName "kube-api-access-vz7j2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:58:36.045329 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.045242    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ee35ef6-43c4-4286-b53c-24176fc5d737-kube-api-access-2t5qq" (OuterVolumeSpecName: "kube-api-access-2t5qq") pod "1ee35ef6-43c4-4286-b53c-24176fc5d737" (UID: "1ee35ef6-43c4-4286-b53c-24176fc5d737"). InnerVolumeSpecName "kube-api-access-2t5qq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:58:36.125438 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.125402    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2m4d6"
Sep 11 11:58:36.132392 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.132365    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8pp5"
Sep 11 11:58:36.144112 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.144090    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ee35ef6-43c4-4286-b53c-24176fc5d737-extensions-socket-volume\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:58:36.144190 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.144116    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vz7j2\" (UniqueName: \"kubernetes.io/projected/1c0dbcb9-1f0b-4662-90dc-5691ef836b03-kube-api-access-vz7j2\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:58:36.144190 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.144133    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2t5qq\" (UniqueName: \"kubernetes.io/projected/1ee35ef6-43c4-4286-b53c-24176fc5d737-kube-api-access-2t5qq\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:58:36.424291 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.424260    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2m4d6"]
Sep 11 11:58:36.425856 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:58:36.425716    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00ef0df3_72ca_48d2_a412_d83be51c74fa.slice/crio-cc922d3e815052d7e85f3c48cbdaebcd44935543922b9751eb568214c2568b91 WatchSource:0}: Error finding container cc922d3e815052d7e85f3c48cbdaebcd44935543922b9751eb568214c2568b91: Status 404 returned error can't find the container with id cc922d3e815052d7e85f3c48cbdaebcd44935543922b9751eb568214c2568b91
Sep 11 11:58:36.426813 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.426793    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8pp5"]
Sep 11 11:58:36.427868 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:58:36.427834    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddac8da16_a702_461f_ac08_9e64388e1b68.slice/crio-d30d6d13075bfeacd1cc257aa0c11f2b28f3d08ec0f4c28edd5bc72503e16d87 WatchSource:0}: Error finding container d30d6d13075bfeacd1cc257aa0c11f2b28f3d08ec0f4c28edd5bc72503e16d87: Status 404 returned error can't find the container with id d30d6d13075bfeacd1cc257aa0c11f2b28f3d08ec0f4c28edd5bc72503e16d87
Sep 11 11:58:36.743341 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.743305    2565 generic.go:356] "Generic (PLEG): container finished" podID="1c0dbcb9-1f0b-4662-90dc-5691ef836b03" containerID="e371d53ff2a4b4e8ac4429a1f357065267cde4ac4d835bb3ecf589dcf150765f" exitCode=0
Sep 11 11:58:36.743763 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.743348    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r"
Sep 11 11:58:36.743763 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.743397    2565 scope.go:117] "RemoveContainer" containerID="e371d53ff2a4b4e8ac4429a1f357065267cde4ac4d835bb3ecf589dcf150765f"
Sep 11 11:58:36.744944 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.744919    2565 generic.go:356] "Generic (PLEG): container finished" podID="1ee35ef6-43c4-4286-b53c-24176fc5d737" containerID="28660d96087b6573cff34428e23f4d65622fbcf255bb5bc7b28fc493a055ba50" exitCode=0
Sep 11 11:58:36.745056 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.744971    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"
Sep 11 11:58:36.745933 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:58:36.745897    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-x6jqm\" is forbidden: User \"system:node:ip-10-0-138-111.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-111.ec2.internal' and this object" podUID="1ee35ef6-43c4-4286-b53c-24176fc5d737" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"
Sep 11 11:58:36.747449 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.747405    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2m4d6" event={"ID":"00ef0df3-72ca-48d2-a412-d83be51c74fa","Type":"ContainerStarted","Data":"3d8585eb6d483de08b04cdede59e2c333e2cf28e7b1c80b00947dbc9256c4a20"}
Sep 11 11:58:36.747564 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.747464    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2m4d6" event={"ID":"00ef0df3-72ca-48d2-a412-d83be51c74fa","Type":"ContainerStarted","Data":"cc922d3e815052d7e85f3c48cbdaebcd44935543922b9751eb568214c2568b91"}
Sep 11 11:58:36.747818 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.747664    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2m4d6"
Sep 11 11:58:36.748246 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:58:36.748213    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-lcg7r\" is forbidden: User \"system:node:ip-10-0-138-111.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-111.ec2.internal' and this object" podUID="1c0dbcb9-1f0b-4662-90dc-5691ef836b03" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r"
Sep 11 11:58:36.749442 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.749357    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8pp5" event={"ID":"dac8da16-a702-461f-ac08-9e64388e1b68","Type":"ContainerStarted","Data":"7db9d77baa6c3d3a2b89fe91e7a993419a8d39dcfedfb0c485cfe78f2c605052"}
Sep 11 11:58:36.749442 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.749406    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8pp5" event={"ID":"dac8da16-a702-461f-ac08-9e64388e1b68","Type":"ContainerStarted","Data":"d30d6d13075bfeacd1cc257aa0c11f2b28f3d08ec0f4c28edd5bc72503e16d87"}
Sep 11 11:58:36.749663 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.749517    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8pp5"
Sep 11 11:58:36.750437 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:58:36.750413    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-x6jqm\" is forbidden: User \"system:node:ip-10-0-138-111.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-111.ec2.internal' and this object" podUID="1ee35ef6-43c4-4286-b53c-24176fc5d737" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"
Sep 11 11:58:36.752516 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:58:36.752488    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-lcg7r\" is forbidden: User \"system:node:ip-10-0-138-111.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-111.ec2.internal' and this object" podUID="1c0dbcb9-1f0b-4662-90dc-5691ef836b03" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r"
Sep 11 11:58:36.753868 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.753848    2565 scope.go:117] "RemoveContainer" containerID="e371d53ff2a4b4e8ac4429a1f357065267cde4ac4d835bb3ecf589dcf150765f"
Sep 11 11:58:36.754202 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:58:36.754178    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e371d53ff2a4b4e8ac4429a1f357065267cde4ac4d835bb3ecf589dcf150765f\": container with ID starting with e371d53ff2a4b4e8ac4429a1f357065267cde4ac4d835bb3ecf589dcf150765f not found: ID does not exist" containerID="e371d53ff2a4b4e8ac4429a1f357065267cde4ac4d835bb3ecf589dcf150765f"
Sep 11 11:58:36.754283 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.754224    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e371d53ff2a4b4e8ac4429a1f357065267cde4ac4d835bb3ecf589dcf150765f"} err="failed to get container status \"e371d53ff2a4b4e8ac4429a1f357065267cde4ac4d835bb3ecf589dcf150765f\": rpc error: code = NotFound desc = could not find container \"e371d53ff2a4b4e8ac4429a1f357065267cde4ac4d835bb3ecf589dcf150765f\": container with ID starting with e371d53ff2a4b4e8ac4429a1f357065267cde4ac4d835bb3ecf589dcf150765f not found: ID does not exist"
Sep 11 11:58:36.754283 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.754249    2565 scope.go:117] "RemoveContainer" containerID="28660d96087b6573cff34428e23f4d65622fbcf255bb5bc7b28fc493a055ba50"
Sep 11 11:58:36.763047 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.763029    2565 scope.go:117] "RemoveContainer" containerID="28660d96087b6573cff34428e23f4d65622fbcf255bb5bc7b28fc493a055ba50"
Sep 11 11:58:36.763311 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:58:36.763288    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28660d96087b6573cff34428e23f4d65622fbcf255bb5bc7b28fc493a055ba50\": container with ID starting with 28660d96087b6573cff34428e23f4d65622fbcf255bb5bc7b28fc493a055ba50 not found: ID does not exist" containerID="28660d96087b6573cff34428e23f4d65622fbcf255bb5bc7b28fc493a055ba50"
Sep 11 11:58:36.763361 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.763319    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28660d96087b6573cff34428e23f4d65622fbcf255bb5bc7b28fc493a055ba50"} err="failed to get container status \"28660d96087b6573cff34428e23f4d65622fbcf255bb5bc7b28fc493a055ba50\": rpc error: code = NotFound desc = could not find container \"28660d96087b6573cff34428e23f4d65622fbcf255bb5bc7b28fc493a055ba50\": container with ID starting with 28660d96087b6573cff34428e23f4d65622fbcf255bb5bc7b28fc493a055ba50 not found: ID does not exist"
Sep 11 11:58:36.775821 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.775775    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2m4d6" podStartSLOduration=1.775761844 podStartE2EDuration="1.775761844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:58:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:58:36.774195652 +0000 UTC m=+430.456595150" watchObservedRunningTime="2026-09-11 11:58:36.775761844 +0000 UTC m=+430.458161339"
Sep 11 11:58:36.776804 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:58:36.776781    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-x6jqm\" is forbidden: User \"system:node:ip-10-0-138-111.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-111.ec2.internal' and this object" podUID="1ee35ef6-43c4-4286-b53c-24176fc5d737" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"
Sep 11 11:58:36.804926 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.804881    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8pp5" podStartSLOduration=1.8048683030000001 podStartE2EDuration="1.804868303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:58:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:58:36.803791539 +0000 UTC m=+430.486191037" watchObservedRunningTime="2026-09-11 11:58:36.804868303 +0000 UTC m=+430.487267801"
Sep 11 11:58:36.806470 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:58:36.806445    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-lcg7r\" is forbidden: User \"system:node:ip-10-0-138-111.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-111.ec2.internal' and this object" podUID="1c0dbcb9-1f0b-4662-90dc-5691ef836b03" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r"
Sep 11 11:58:36.843221 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.843194    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c0dbcb9-1f0b-4662-90dc-5691ef836b03" path="/var/lib/kubelet/pods/1c0dbcb9-1f0b-4662-90dc-5691ef836b03/volumes"
Sep 11 11:58:36.843433 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:58:36.843404    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-x6jqm\" is forbidden: User \"system:node:ip-10-0-138-111.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-111.ec2.internal' and this object" podUID="1ee35ef6-43c4-4286-b53c-24176fc5d737" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-x6jqm"
Sep 11 11:58:36.843707 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:36.843666    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ee35ef6-43c4-4286-b53c-24176fc5d737" path="/var/lib/kubelet/pods/1ee35ef6-43c4-4286-b53c-24176fc5d737/volumes"
Sep 11 11:58:36.845594 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:58:36.845574    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-lcg7r\" is forbidden: User \"system:node:ip-10-0-138-111.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-111.ec2.internal' and this object" podUID="1c0dbcb9-1f0b-4662-90dc-5691ef836b03" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lcg7r"
Sep 11 11:58:47.758558 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:47.758526    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-m8pp5"
Sep 11 11:58:47.758988 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:47.758596    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2m4d6"
Sep 11 11:58:51.806318 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:51.806242    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2m4d6"]
Sep 11 11:58:51.806798 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:51.806441    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2m4d6" podUID="00ef0df3-72ca-48d2-a412-d83be51c74fa" containerName="manager" containerID="cri-o://3d8585eb6d483de08b04cdede59e2c333e2cf28e7b1c80b00947dbc9256c4a20" gracePeriod=10
Sep 11 11:58:52.025971 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.025938    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cwgfv"]
Sep 11 11:58:52.029439 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.029416    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cwgfv"
Sep 11 11:58:52.042455 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.042426    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cwgfv"]
Sep 11 11:58:52.048502 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.048471    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb26c757-b700-4fa3-b195-f29a520f11ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-cwgfv\" (UID: \"bb26c757-b700-4fa3-b195-f29a520f11ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cwgfv"
Sep 11 11:58:52.048621 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.048527    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ghjb\" (UniqueName: \"kubernetes.io/projected/bb26c757-b700-4fa3-b195-f29a520f11ed-kube-api-access-2ghjb\") pod \"kuadrant-operator-controller-manager-5769f99d9f-cwgfv\" (UID: \"bb26c757-b700-4fa3-b195-f29a520f11ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cwgfv"
Sep 11 11:58:52.060464 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.060405    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2m4d6"
Sep 11 11:58:52.149512 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.149478    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb26c757-b700-4fa3-b195-f29a520f11ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-cwgfv\" (UID: \"bb26c757-b700-4fa3-b195-f29a520f11ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cwgfv"
Sep 11 11:58:52.149512 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.149521    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ghjb\" (UniqueName: \"kubernetes.io/projected/bb26c757-b700-4fa3-b195-f29a520f11ed-kube-api-access-2ghjb\") pod \"kuadrant-operator-controller-manager-5769f99d9f-cwgfv\" (UID: \"bb26c757-b700-4fa3-b195-f29a520f11ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cwgfv"
Sep 11 11:58:52.149919 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.149898    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb26c757-b700-4fa3-b195-f29a520f11ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-cwgfv\" (UID: \"bb26c757-b700-4fa3-b195-f29a520f11ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cwgfv"
Sep 11 11:58:52.158029 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.158006    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ghjb\" (UniqueName: \"kubernetes.io/projected/bb26c757-b700-4fa3-b195-f29a520f11ed-kube-api-access-2ghjb\") pod \"kuadrant-operator-controller-manager-5769f99d9f-cwgfv\" (UID: \"bb26c757-b700-4fa3-b195-f29a520f11ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cwgfv"
Sep 11 11:58:52.250836 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.250801    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dj4q5\" (UniqueName: \"kubernetes.io/projected/00ef0df3-72ca-48d2-a412-d83be51c74fa-kube-api-access-dj4q5\") pod \"00ef0df3-72ca-48d2-a412-d83be51c74fa\" (UID: \"00ef0df3-72ca-48d2-a412-d83be51c74fa\") "
Sep 11 11:58:52.250976 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.250869    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00ef0df3-72ca-48d2-a412-d83be51c74fa-extensions-socket-volume\") pod \"00ef0df3-72ca-48d2-a412-d83be51c74fa\" (UID: \"00ef0df3-72ca-48d2-a412-d83be51c74fa\") "
Sep 11 11:58:52.251317 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.251286    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00ef0df3-72ca-48d2-a412-d83be51c74fa-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "00ef0df3-72ca-48d2-a412-d83be51c74fa" (UID: "00ef0df3-72ca-48d2-a412-d83be51c74fa"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 11:58:52.252908 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.252883    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00ef0df3-72ca-48d2-a412-d83be51c74fa-kube-api-access-dj4q5" (OuterVolumeSpecName: "kube-api-access-dj4q5") pod "00ef0df3-72ca-48d2-a412-d83be51c74fa" (UID: "00ef0df3-72ca-48d2-a412-d83be51c74fa"). InnerVolumeSpecName "kube-api-access-dj4q5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:58:52.351476 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.351391    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00ef0df3-72ca-48d2-a412-d83be51c74fa-extensions-socket-volume\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:58:52.351476 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.351426    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dj4q5\" (UniqueName: \"kubernetes.io/projected/00ef0df3-72ca-48d2-a412-d83be51c74fa-kube-api-access-dj4q5\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:58:52.355283 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.355262    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cwgfv"
Sep 11 11:58:52.635368 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.635341    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cwgfv"]
Sep 11 11:58:52.636063 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:58:52.636037    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb26c757_b700_4fa3_b195_f29a520f11ed.slice/crio-2189322b391ead307bbb12e52bf27a7e4912e152dd18fc21d789e9d5c6607f49 WatchSource:0}: Error finding container 2189322b391ead307bbb12e52bf27a7e4912e152dd18fc21d789e9d5c6607f49: Status 404 returned error can't find the container with id 2189322b391ead307bbb12e52bf27a7e4912e152dd18fc21d789e9d5c6607f49
Sep 11 11:58:52.851574 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.851284    2565 generic.go:356] "Generic (PLEG): container finished" podID="00ef0df3-72ca-48d2-a412-d83be51c74fa" containerID="3d8585eb6d483de08b04cdede59e2c333e2cf28e7b1c80b00947dbc9256c4a20" exitCode=0
Sep 11 11:58:52.851574 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.851360    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2m4d6"
Sep 11 11:58:52.851574 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.851359    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2m4d6" event={"ID":"00ef0df3-72ca-48d2-a412-d83be51c74fa","Type":"ContainerDied","Data":"3d8585eb6d483de08b04cdede59e2c333e2cf28e7b1c80b00947dbc9256c4a20"}
Sep 11 11:58:52.852062 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.851588    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2m4d6" event={"ID":"00ef0df3-72ca-48d2-a412-d83be51c74fa","Type":"ContainerDied","Data":"cc922d3e815052d7e85f3c48cbdaebcd44935543922b9751eb568214c2568b91"}
Sep 11 11:58:52.852062 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.851620    2565 scope.go:117] "RemoveContainer" containerID="3d8585eb6d483de08b04cdede59e2c333e2cf28e7b1c80b00947dbc9256c4a20"
Sep 11 11:58:52.853777 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.853755    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cwgfv" event={"ID":"bb26c757-b700-4fa3-b195-f29a520f11ed","Type":"ContainerStarted","Data":"077102f88672ef7859def5ac5e85e9e320c70a95e55b70f962d77460d7e40874"}
Sep 11 11:58:52.853892 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.853801    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cwgfv" event={"ID":"bb26c757-b700-4fa3-b195-f29a520f11ed","Type":"ContainerStarted","Data":"2189322b391ead307bbb12e52bf27a7e4912e152dd18fc21d789e9d5c6607f49"}
Sep 11 11:58:52.853959 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.853940    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cwgfv"
Sep 11 11:58:52.861049 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.861030    2565 scope.go:117] "RemoveContainer" containerID="3d8585eb6d483de08b04cdede59e2c333e2cf28e7b1c80b00947dbc9256c4a20"
Sep 11 11:58:52.861294 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:58:52.861276    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d8585eb6d483de08b04cdede59e2c333e2cf28e7b1c80b00947dbc9256c4a20\": container with ID starting with 3d8585eb6d483de08b04cdede59e2c333e2cf28e7b1c80b00947dbc9256c4a20 not found: ID does not exist" containerID="3d8585eb6d483de08b04cdede59e2c333e2cf28e7b1c80b00947dbc9256c4a20"
Sep 11 11:58:52.861368 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.861303    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d8585eb6d483de08b04cdede59e2c333e2cf28e7b1c80b00947dbc9256c4a20"} err="failed to get container status \"3d8585eb6d483de08b04cdede59e2c333e2cf28e7b1c80b00947dbc9256c4a20\": rpc error: code = NotFound desc = could not find container \"3d8585eb6d483de08b04cdede59e2c333e2cf28e7b1c80b00947dbc9256c4a20\": container with ID starting with 3d8585eb6d483de08b04cdede59e2c333e2cf28e7b1c80b00947dbc9256c4a20 not found: ID does not exist"
Sep 11 11:58:52.873471 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.873434    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cwgfv" podStartSLOduration=0.873423012 podStartE2EDuration="873.423012ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:58:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:58:52.872717136 +0000 UTC m=+446.555116630" watchObservedRunningTime="2026-09-11 11:58:52.873423012 +0000 UTC m=+446.555822507"
Sep 11 11:58:52.891969 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.891946    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2m4d6"]
Sep 11 11:58:52.895261 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:52.895239    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2m4d6"]
Sep 11 11:58:54.841655 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:58:54.841619    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00ef0df3-72ca-48d2-a412-d83be51c74fa" path="/var/lib/kubelet/pods/00ef0df3-72ca-48d2-a412-d83be51c74fa/volumes"
Sep 11 11:59:03.862999 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:03.862961    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cwgfv"
Sep 11 11:59:08.094588 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.094547    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"]
Sep 11 11:59:08.095040 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.094995    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00ef0df3-72ca-48d2-a412-d83be51c74fa" containerName="manager"
Sep 11 11:59:08.095040 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.095010    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="00ef0df3-72ca-48d2-a412-d83be51c74fa" containerName="manager"
Sep 11 11:59:08.095118 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.095075    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="00ef0df3-72ca-48d2-a412-d83be51c74fa" containerName="manager"
Sep 11 11:59:08.099273 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.099248    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.102111 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.102089    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-fkr9m\""
Sep 11 11:59:08.109827 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.109802    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"]
Sep 11 11:59:08.181920 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.181892    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/626e4a08-50c2-4625-b145-656b540edc43-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.182092 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.181931    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/626e4a08-50c2-4625-b145-656b540edc43-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.182092 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.181966    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/626e4a08-50c2-4625-b145-656b540edc43-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.182092 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.181984    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/626e4a08-50c2-4625-b145-656b540edc43-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.182092 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.182019    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm6tx\" (UniqueName: \"kubernetes.io/projected/626e4a08-50c2-4625-b145-656b540edc43-kube-api-access-vm6tx\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.182297 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.182093    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/626e4a08-50c2-4625-b145-656b540edc43-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.182297 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.182134    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/626e4a08-50c2-4625-b145-656b540edc43-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.182297 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.182170    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/626e4a08-50c2-4625-b145-656b540edc43-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.182297 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.182187    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/626e4a08-50c2-4625-b145-656b540edc43-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.283365 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.283331    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm6tx\" (UniqueName: \"kubernetes.io/projected/626e4a08-50c2-4625-b145-656b540edc43-kube-api-access-vm6tx\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.283553 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.283375    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/626e4a08-50c2-4625-b145-656b540edc43-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.283553 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.283392    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/626e4a08-50c2-4625-b145-656b540edc43-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.283660 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.283583    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/626e4a08-50c2-4625-b145-656b540edc43-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.283660 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.283616    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/626e4a08-50c2-4625-b145-656b540edc43-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.283797 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.283750    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/626e4a08-50c2-4625-b145-656b540edc43-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.283853 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.283792    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/626e4a08-50c2-4625-b145-656b540edc43-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.283908 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.283853    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/626e4a08-50c2-4625-b145-656b540edc43-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.283908 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.283877    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/626e4a08-50c2-4625-b145-656b540edc43-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.284002 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.283958    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/626e4a08-50c2-4625-b145-656b540edc43-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.284054 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.284033    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/626e4a08-50c2-4625-b145-656b540edc43-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.284188 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.284165    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/626e4a08-50c2-4625-b145-656b540edc43-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.284244 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.284197    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/626e4a08-50c2-4625-b145-656b540edc43-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.284299 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.284274    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/626e4a08-50c2-4625-b145-656b540edc43-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.285759 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.285743    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/626e4a08-50c2-4625-b145-656b540edc43-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.286151 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.286134    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/626e4a08-50c2-4625-b145-656b540edc43-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.291220 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.291196    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/626e4a08-50c2-4625-b145-656b540edc43-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.291358 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.291334    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm6tx\" (UniqueName: \"kubernetes.io/projected/626e4a08-50c2-4625-b145-656b540edc43-kube-api-access-vm6tx\") pod \"maas-default-gateway-openshift-default-78bb78ff78-k2frv\" (UID: \"626e4a08-50c2-4625-b145-656b540edc43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.411691 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.411661    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:08.685160 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.685128    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"]
Sep 11 11:59:08.686100 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:59:08.686078    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod626e4a08_50c2_4625_b145_656b540edc43.slice/crio-f5eee9d244392f13d78ea52d81b56f44feabe0f34196ee34c3816bd74a858cc7 WatchSource:0}: Error finding container f5eee9d244392f13d78ea52d81b56f44feabe0f34196ee34c3816bd74a858cc7: Status 404 returned error can't find the container with id f5eee9d244392f13d78ea52d81b56f44feabe0f34196ee34c3816bd74a858cc7
Sep 11 11:59:08.688588 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.688558    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 11:59:08.688699 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.688636    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 11:59:08.688699 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.688677    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 11:59:08.942057 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.941965    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv" event={"ID":"626e4a08-50c2-4625-b145-656b540edc43","Type":"ContainerStarted","Data":"28fab0e457e6520205fb1cb8f67f1be236aa8ecf0c021c0a8c726b5361c0cc4e"}
Sep 11 11:59:08.942057 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.942034    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv" event={"ID":"626e4a08-50c2-4625-b145-656b540edc43","Type":"ContainerStarted","Data":"f5eee9d244392f13d78ea52d81b56f44feabe0f34196ee34c3816bd74a858cc7"}
Sep 11 11:59:08.960868 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:08.960816    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv" podStartSLOduration=0.960800564 podStartE2EDuration="960.800564ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:59:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:59:08.959432526 +0000 UTC m=+462.641832025" watchObservedRunningTime="2026-09-11 11:59:08.960800564 +0000 UTC m=+462.643200061"
Sep 11 11:59:09.412489 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:09.412455    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:09.417895 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:09.417864    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:09.947987 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:09.947953    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:09.948788 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:09.948765    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 11:59:21.555930 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:21.555897    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-kt7m9"]
Sep 11 11:59:21.559208 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:21.559190    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-kt7m9"
Sep 11 11:59:21.561875 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:21.561852    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-t8brk\""
Sep 11 11:59:21.568654 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:21.568632    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-kt7m9"]
Sep 11 11:59:21.695712 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:21.695655    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4kdq\" (UniqueName: \"kubernetes.io/projected/c98e6644-4b69-45ec-adcf-3a9ae786b2c2-kube-api-access-b4kdq\") pod \"authorino-7bcfd8f9cd-kt7m9\" (UID: \"c98e6644-4b69-45ec-adcf-3a9ae786b2c2\") " pod="kuadrant-system/authorino-7bcfd8f9cd-kt7m9"
Sep 11 11:59:21.796294 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:21.796253    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4kdq\" (UniqueName: \"kubernetes.io/projected/c98e6644-4b69-45ec-adcf-3a9ae786b2c2-kube-api-access-b4kdq\") pod \"authorino-7bcfd8f9cd-kt7m9\" (UID: \"c98e6644-4b69-45ec-adcf-3a9ae786b2c2\") " pod="kuadrant-system/authorino-7bcfd8f9cd-kt7m9"
Sep 11 11:59:21.804280 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:21.804251    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4kdq\" (UniqueName: \"kubernetes.io/projected/c98e6644-4b69-45ec-adcf-3a9ae786b2c2-kube-api-access-b4kdq\") pod \"authorino-7bcfd8f9cd-kt7m9\" (UID: \"c98e6644-4b69-45ec-adcf-3a9ae786b2c2\") " pod="kuadrant-system/authorino-7bcfd8f9cd-kt7m9"
Sep 11 11:59:21.869353 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:21.869288    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-kt7m9"
Sep 11 11:59:22.138334 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:22.138307    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-kt7m9"]
Sep 11 11:59:22.139904 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:59:22.139877    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc98e6644_4b69_45ec_adcf_3a9ae786b2c2.slice/crio-43251e316ea4af4cfba1bd47f14de2a757d7e349cff46b7e13331e959d1fd6c0 WatchSource:0}: Error finding container 43251e316ea4af4cfba1bd47f14de2a757d7e349cff46b7e13331e959d1fd6c0: Status 404 returned error can't find the container with id 43251e316ea4af4cfba1bd47f14de2a757d7e349cff46b7e13331e959d1fd6c0
Sep 11 11:59:23.020165 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:23.020124    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-kt7m9" event={"ID":"c98e6644-4b69-45ec-adcf-3a9ae786b2c2","Type":"ContainerStarted","Data":"43251e316ea4af4cfba1bd47f14de2a757d7e349cff46b7e13331e959d1fd6c0"}
Sep 11 11:59:24.010044 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:24.010008    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-kt7m9"]
Sep 11 11:59:24.027882 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:24.027854    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-kt7m9" event={"ID":"c98e6644-4b69-45ec-adcf-3a9ae786b2c2","Type":"ContainerStarted","Data":"d902382027e0d8f7f4f1377ad44b3f597c3b17738e35fd27904f21fdc91405da"}
Sep 11 11:59:24.042283 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:24.042232    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-kt7m9" podStartSLOduration=1.3253727739999999 podStartE2EDuration="3.042210905s" totalImagesPullingTime="1.716838131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:59:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:59:24.040333633 +0000 UTC m=+477.722733131" watchObservedRunningTime="2026-09-11 11:59:24.042210905 +0000 UTC m=+477.724610416"
Sep 11 11:59:25.034239 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:25.034197    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-kt7m9" podUID="c98e6644-4b69-45ec-adcf-3a9ae786b2c2" containerName="authorino" containerID="cri-o://d902382027e0d8f7f4f1377ad44b3f597c3b17738e35fd27904f21fdc91405da" gracePeriod=30
Sep 11 11:59:25.279839 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:25.279814    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-kt7m9"
Sep 11 11:59:25.429416 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:25.429382    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4kdq\" (UniqueName: \"kubernetes.io/projected/c98e6644-4b69-45ec-adcf-3a9ae786b2c2-kube-api-access-b4kdq\") pod \"c98e6644-4b69-45ec-adcf-3a9ae786b2c2\" (UID: \"c98e6644-4b69-45ec-adcf-3a9ae786b2c2\") "
Sep 11 11:59:25.435388 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:25.432469    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c98e6644-4b69-45ec-adcf-3a9ae786b2c2-kube-api-access-b4kdq" (OuterVolumeSpecName: "kube-api-access-b4kdq") pod "c98e6644-4b69-45ec-adcf-3a9ae786b2c2" (UID: "c98e6644-4b69-45ec-adcf-3a9ae786b2c2"). InnerVolumeSpecName "kube-api-access-b4kdq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:59:25.531322 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:25.531285    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4kdq\" (UniqueName: \"kubernetes.io/projected/c98e6644-4b69-45ec-adcf-3a9ae786b2c2-kube-api-access-b4kdq\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:59:26.040647 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:26.040609    2565 generic.go:356] "Generic (PLEG): container finished" podID="c98e6644-4b69-45ec-adcf-3a9ae786b2c2" containerID="d902382027e0d8f7f4f1377ad44b3f597c3b17738e35fd27904f21fdc91405da" exitCode=0
Sep 11 11:59:26.041154 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:26.040664    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-kt7m9"
Sep 11 11:59:26.041154 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:26.040676    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-kt7m9" event={"ID":"c98e6644-4b69-45ec-adcf-3a9ae786b2c2","Type":"ContainerDied","Data":"d902382027e0d8f7f4f1377ad44b3f597c3b17738e35fd27904f21fdc91405da"}
Sep 11 11:59:26.041154 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:26.040733    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-kt7m9" event={"ID":"c98e6644-4b69-45ec-adcf-3a9ae786b2c2","Type":"ContainerDied","Data":"43251e316ea4af4cfba1bd47f14de2a757d7e349cff46b7e13331e959d1fd6c0"}
Sep 11 11:59:26.041154 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:26.040750    2565 scope.go:117] "RemoveContainer" containerID="d902382027e0d8f7f4f1377ad44b3f597c3b17738e35fd27904f21fdc91405da"
Sep 11 11:59:26.049737 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:26.049718    2565 scope.go:117] "RemoveContainer" containerID="d902382027e0d8f7f4f1377ad44b3f597c3b17738e35fd27904f21fdc91405da"
Sep 11 11:59:26.050011 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:59:26.049993    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d902382027e0d8f7f4f1377ad44b3f597c3b17738e35fd27904f21fdc91405da\": container with ID starting with d902382027e0d8f7f4f1377ad44b3f597c3b17738e35fd27904f21fdc91405da not found: ID does not exist" containerID="d902382027e0d8f7f4f1377ad44b3f597c3b17738e35fd27904f21fdc91405da"
Sep 11 11:59:26.050066 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:26.050019    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d902382027e0d8f7f4f1377ad44b3f597c3b17738e35fd27904f21fdc91405da"} err="failed to get container status \"d902382027e0d8f7f4f1377ad44b3f597c3b17738e35fd27904f21fdc91405da\": rpc error: code = NotFound desc = could not find container \"d902382027e0d8f7f4f1377ad44b3f597c3b17738e35fd27904f21fdc91405da\": container with ID starting with d902382027e0d8f7f4f1377ad44b3f597c3b17738e35fd27904f21fdc91405da not found: ID does not exist"
Sep 11 11:59:26.061189 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:26.061160    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-kt7m9"]
Sep 11 11:59:26.063134 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:26.063113    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-kt7m9"]
Sep 11 11:59:26.842068 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:26.842036    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c98e6644-4b69-45ec-adcf-3a9ae786b2c2" path="/var/lib/kubelet/pods/c98e6644-4b69-45ec-adcf-3a9ae786b2c2/volumes"
Sep 11 11:59:48.831721 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:48.831671    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-86fvn"]
Sep 11 11:59:48.832109 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:48.832045    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c98e6644-4b69-45ec-adcf-3a9ae786b2c2" containerName="authorino"
Sep 11 11:59:48.832109 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:48.832057    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c98e6644-4b69-45ec-adcf-3a9ae786b2c2" containerName="authorino"
Sep 11 11:59:48.832184 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:48.832115    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c98e6644-4b69-45ec-adcf-3a9ae786b2c2" containerName="authorino"
Sep 11 11:59:48.837970 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:48.837932    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-86fvn"
Sep 11 11:59:48.840552 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:48.840522    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-t8brk\""
Sep 11 11:59:48.845881 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:48.845662    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-86fvn"]
Sep 11 11:59:48.899308 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:48.899265    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-86fvn"]
Sep 11 11:59:48.899578 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:59:48.899541    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-tntph], unattached volumes=[], failed to process volumes=[kube-api-access-tntph]: context canceled" pod="kuadrant-system/authorino-557f876f69-86fvn" podUID="6f60ea6f-eebe-4bb8-82b4-5df56a528d04"
Sep 11 11:59:48.919512 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:48.919479    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tntph\" (UniqueName: \"kubernetes.io/projected/6f60ea6f-eebe-4bb8-82b4-5df56a528d04-kube-api-access-tntph\") pod \"authorino-557f876f69-86fvn\" (UID: \"6f60ea6f-eebe-4bb8-82b4-5df56a528d04\") " pod="kuadrant-system/authorino-557f876f69-86fvn"
Sep 11 11:59:48.926624 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:48.926597    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-lzk8k"]
Sep 11 11:59:48.930643 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:48.930625    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-lzk8k"
Sep 11 11:59:48.933020 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:48.932996    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 11 11:59:48.936422 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:48.936402    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-lzk8k"]
Sep 11 11:59:49.020137 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.020102    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb-tls-cert\") pod \"authorino-6d4dfc649f-lzk8k\" (UID: \"71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb\") " pod="kuadrant-system/authorino-6d4dfc649f-lzk8k"
Sep 11 11:59:49.020309 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.020157    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrlnd\" (UniqueName: \"kubernetes.io/projected/71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb-kube-api-access-vrlnd\") pod \"authorino-6d4dfc649f-lzk8k\" (UID: \"71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb\") " pod="kuadrant-system/authorino-6d4dfc649f-lzk8k"
Sep 11 11:59:49.020309 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.020245    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tntph\" (UniqueName: \"kubernetes.io/projected/6f60ea6f-eebe-4bb8-82b4-5df56a528d04-kube-api-access-tntph\") pod \"authorino-557f876f69-86fvn\" (UID: \"6f60ea6f-eebe-4bb8-82b4-5df56a528d04\") " pod="kuadrant-system/authorino-557f876f69-86fvn"
Sep 11 11:59:49.028049 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.028026    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tntph\" (UniqueName: \"kubernetes.io/projected/6f60ea6f-eebe-4bb8-82b4-5df56a528d04-kube-api-access-tntph\") pod \"authorino-557f876f69-86fvn\" (UID: \"6f60ea6f-eebe-4bb8-82b4-5df56a528d04\") " pod="kuadrant-system/authorino-557f876f69-86fvn"
Sep 11 11:59:49.069182 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.069140    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-lzk8k"]
Sep 11 11:59:49.069426 ip-10-0-138-111 kubenswrapper[2565]: E0911 11:59:49.069407    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-vrlnd tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-lzk8k" podUID="71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb"
Sep 11 11:59:49.096263 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.096198    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-684bff778d-tl6np"]
Sep 11 11:59:49.100095 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.100078    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-684bff778d-tl6np"
Sep 11 11:59:49.107490 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.107234    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-684bff778d-tl6np"]
Sep 11 11:59:49.121695 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.121650    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5n59\" (UniqueName: \"kubernetes.io/projected/278552f6-005e-4603-82fe-6ba551f7ebfe-kube-api-access-r5n59\") pod \"authorino-684bff778d-tl6np\" (UID: \"278552f6-005e-4603-82fe-6ba551f7ebfe\") " pod="kuadrant-system/authorino-684bff778d-tl6np"
Sep 11 11:59:49.121807 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.121731    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb-tls-cert\") pod \"authorino-6d4dfc649f-lzk8k\" (UID: \"71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb\") " pod="kuadrant-system/authorino-6d4dfc649f-lzk8k"
Sep 11 11:59:49.121807 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.121785    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/278552f6-005e-4603-82fe-6ba551f7ebfe-tls-cert\") pod \"authorino-684bff778d-tl6np\" (UID: \"278552f6-005e-4603-82fe-6ba551f7ebfe\") " pod="kuadrant-system/authorino-684bff778d-tl6np"
Sep 11 11:59:49.121879 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.121812    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrlnd\" (UniqueName: \"kubernetes.io/projected/71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb-kube-api-access-vrlnd\") pod \"authorino-6d4dfc649f-lzk8k\" (UID: \"71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb\") " pod="kuadrant-system/authorino-6d4dfc649f-lzk8k"
Sep 11 11:59:49.124158 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.124134    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb-tls-cert\") pod \"authorino-6d4dfc649f-lzk8k\" (UID: \"71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb\") " pod="kuadrant-system/authorino-6d4dfc649f-lzk8k"
Sep 11 11:59:49.129730 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.129709    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrlnd\" (UniqueName: \"kubernetes.io/projected/71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb-kube-api-access-vrlnd\") pod \"authorino-6d4dfc649f-lzk8k\" (UID: \"71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb\") " pod="kuadrant-system/authorino-6d4dfc649f-lzk8k"
Sep 11 11:59:49.163163 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.163134    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-lzk8k"
Sep 11 11:59:49.163278 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.163134    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-86fvn"
Sep 11 11:59:49.171177 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.171155    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-lzk8k"
Sep 11 11:59:49.173938 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.173918    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-86fvn"
Sep 11 11:59:49.222713 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.222673    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb-tls-cert\") pod \"71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb\" (UID: \"71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb\") "
Sep 11 11:59:49.222713 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.222715    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrlnd\" (UniqueName: \"kubernetes.io/projected/71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb-kube-api-access-vrlnd\") pod \"71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb\" (UID: \"71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb\") "
Sep 11 11:59:49.222893 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.222748    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tntph\" (UniqueName: \"kubernetes.io/projected/6f60ea6f-eebe-4bb8-82b4-5df56a528d04-kube-api-access-tntph\") pod \"6f60ea6f-eebe-4bb8-82b4-5df56a528d04\" (UID: \"6f60ea6f-eebe-4bb8-82b4-5df56a528d04\") "
Sep 11 11:59:49.222939 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.222914    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/278552f6-005e-4603-82fe-6ba551f7ebfe-tls-cert\") pod \"authorino-684bff778d-tl6np\" (UID: \"278552f6-005e-4603-82fe-6ba551f7ebfe\") " pod="kuadrant-system/authorino-684bff778d-tl6np"
Sep 11 11:59:49.223036 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.223020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5n59\" (UniqueName: \"kubernetes.io/projected/278552f6-005e-4603-82fe-6ba551f7ebfe-kube-api-access-r5n59\") pod \"authorino-684bff778d-tl6np\" (UID: \"278552f6-005e-4603-82fe-6ba551f7ebfe\") " pod="kuadrant-system/authorino-684bff778d-tl6np"
Sep 11 11:59:49.224971 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.224942    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb" (UID: "71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 11:59:49.225204 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.225185    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb-kube-api-access-vrlnd" (OuterVolumeSpecName: "kube-api-access-vrlnd") pod "71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb" (UID: "71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb"). InnerVolumeSpecName "kube-api-access-vrlnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:59:49.225288 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.225197    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f60ea6f-eebe-4bb8-82b4-5df56a528d04-kube-api-access-tntph" (OuterVolumeSpecName: "kube-api-access-tntph") pod "6f60ea6f-eebe-4bb8-82b4-5df56a528d04" (UID: "6f60ea6f-eebe-4bb8-82b4-5df56a528d04"). InnerVolumeSpecName "kube-api-access-tntph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 11:59:49.225342 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.225323    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/278552f6-005e-4603-82fe-6ba551f7ebfe-tls-cert\") pod \"authorino-684bff778d-tl6np\" (UID: \"278552f6-005e-4603-82fe-6ba551f7ebfe\") " pod="kuadrant-system/authorino-684bff778d-tl6np"
Sep 11 11:59:49.230776 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.230623    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5n59\" (UniqueName: \"kubernetes.io/projected/278552f6-005e-4603-82fe-6ba551f7ebfe-kube-api-access-r5n59\") pod \"authorino-684bff778d-tl6np\" (UID: \"278552f6-005e-4603-82fe-6ba551f7ebfe\") " pod="kuadrant-system/authorino-684bff778d-tl6np"
Sep 11 11:59:49.324159 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.324131    2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb-tls-cert\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:59:49.324159 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.324156    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrlnd\" (UniqueName: \"kubernetes.io/projected/71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb-kube-api-access-vrlnd\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:59:49.324331 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.324166    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tntph\" (UniqueName: \"kubernetes.io/projected/6f60ea6f-eebe-4bb8-82b4-5df56a528d04-kube-api-access-tntph\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 11:59:49.410471 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.410443    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-684bff778d-tl6np"
Sep 11 11:59:49.679492 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:49.679464    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-684bff778d-tl6np"]
Sep 11 11:59:49.680520 ip-10-0-138-111 kubenswrapper[2565]: W0911 11:59:49.680492    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod278552f6_005e_4603_82fe_6ba551f7ebfe.slice/crio-ebc3948247d18f4fa4802cb5cca2ff5c652762d152c4429de6cea1ead5b222fb WatchSource:0}: Error finding container ebc3948247d18f4fa4802cb5cca2ff5c652762d152c4429de6cea1ead5b222fb: Status 404 returned error can't find the container with id ebc3948247d18f4fa4802cb5cca2ff5c652762d152c4429de6cea1ead5b222fb
Sep 11 11:59:50.172883 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:50.172858    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-86fvn"
Sep 11 11:59:50.172883 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:50.172866    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-684bff778d-tl6np" event={"ID":"278552f6-005e-4603-82fe-6ba551f7ebfe","Type":"ContainerStarted","Data":"ebc3948247d18f4fa4802cb5cca2ff5c652762d152c4429de6cea1ead5b222fb"}
Sep 11 11:59:50.173268 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:50.172888    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-lzk8k"
Sep 11 11:59:50.204611 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:50.204588    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-86fvn"]
Sep 11 11:59:50.206770 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:50.206748    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-86fvn"]
Sep 11 11:59:50.226182 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:50.226148    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-lzk8k"]
Sep 11 11:59:50.229611 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:50.229582    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-lzk8k"]
Sep 11 11:59:50.842435 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:50.842401    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f60ea6f-eebe-4bb8-82b4-5df56a528d04" path="/var/lib/kubelet/pods/6f60ea6f-eebe-4bb8-82b4-5df56a528d04/volumes"
Sep 11 11:59:50.842662 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:50.842650    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb" path="/var/lib/kubelet/pods/71b48aa0-9e9d-4f8e-9fa8-0d201cb9b8eb/volumes"
Sep 11 11:59:51.179851 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:51.179818    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-684bff778d-tl6np" event={"ID":"278552f6-005e-4603-82fe-6ba551f7ebfe","Type":"ContainerStarted","Data":"59d86de106cf3969a8ec7b13416cf7a5f3b034f248a77703a60006842f48edfe"}
Sep 11 11:59:51.194759 ip-10-0-138-111 kubenswrapper[2565]: I0911 11:59:51.194711    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-684bff778d-tl6np" podStartSLOduration=1.7390065 podStartE2EDuration="2.194674357s" totalImagesPullingTime="455.667857ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 11:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 11:59:51.194492058 +0000 UTC m=+504.876891557" watchObservedRunningTime="2026-09-11 11:59:51.194674357 +0000 UTC m=+504.877073855"
Sep 11 12:00:43.472219 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:00:43.472132    2565 generic.go:356] "Generic (PLEG): container finished" podID="626e4a08-50c2-4625-b145-656b540edc43" containerID="28fab0e457e6520205fb1cb8f67f1be236aa8ecf0c021c0a8c726b5361c0cc4e" exitCode=0
Sep 11 12:00:43.472747 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:00:43.472204    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv" event={"ID":"626e4a08-50c2-4625-b145-656b540edc43","Type":"ContainerDied","Data":"28fab0e457e6520205fb1cb8f67f1be236aa8ecf0c021c0a8c726b5361c0cc4e"}
Sep 11 12:00:43.472747 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:00:43.472739    2565 scope.go:117] "RemoveContainer" containerID="28fab0e457e6520205fb1cb8f67f1be236aa8ecf0c021c0a8c726b5361c0cc4e"
Sep 11 12:00:43.473802 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:00:43.473772    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:00:43.473894 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:00:43.473837    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:00:43.473894 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:00:43.473873    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:00:44.480372 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:00:44.480338    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv" event={"ID":"626e4a08-50c2-4625-b145-656b540edc43","Type":"ContainerStarted","Data":"6af04248dfb0a381e8046add8d4aa8314b544ac4d7b0acbba452f899d56d4702"}
Sep 11 12:00:45.412604 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:00:45.412563    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 12:00:45.412875 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:00:45.412848    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-k2frv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 11 12:00:45.412927 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:00:45.412903    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv" podUID="626e4a08-50c2-4625-b145-656b540edc43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 11 12:00:46.412938 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:00:46.412897    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-k2frv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 11 12:00:46.413423 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:00:46.412965    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv" podUID="626e4a08-50c2-4625-b145-656b540edc43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 11 12:00:47.412298 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:00:47.412250    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-k2frv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 11 12:00:47.412515 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:00:47.412321    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv" podUID="626e4a08-50c2-4625-b145-656b540edc43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 11 12:00:48.413004 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:00:48.412958    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-k2frv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 11 12:00:48.413402 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:00:48.413028    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv" podUID="626e4a08-50c2-4625-b145-656b540edc43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 11 12:00:49.446325 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:00:49.446276    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 12:00:49.446816 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:00:49.446732    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 12:00:49.447665 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:00:49.447642    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k2frv"
Sep 11 12:01:02.812307 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:02.812274    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"]
Sep 11 12:01:02.815554 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:02.815532    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"
Sep 11 12:01:02.819198 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:02.819174    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 12:01:02.819893 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:02.819876    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 11 12:01:02.820750 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:02.820735    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 12:01:02.820836 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:02.820763    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7x4n7\""
Sep 11 12:01:02.827316 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:02.827287    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"]
Sep 11 12:01:02.872596 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:02.872551    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b70a6cc-a620-4d84-97b8-e4c6e325b032-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws\" (UID: \"2b70a6cc-a620-4d84-97b8-e4c6e325b032\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"
Sep 11 12:01:02.872811 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:02.872608    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b70a6cc-a620-4d84-97b8-e4c6e325b032-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws\" (UID: \"2b70a6cc-a620-4d84-97b8-e4c6e325b032\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"
Sep 11 12:01:02.872811 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:02.872657    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b70a6cc-a620-4d84-97b8-e4c6e325b032-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws\" (UID: \"2b70a6cc-a620-4d84-97b8-e4c6e325b032\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"
Sep 11 12:01:02.872811 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:02.872741    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f652v\" (UniqueName: \"kubernetes.io/projected/2b70a6cc-a620-4d84-97b8-e4c6e325b032-kube-api-access-f652v\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws\" (UID: \"2b70a6cc-a620-4d84-97b8-e4c6e325b032\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"
Sep 11 12:01:02.872811 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:02.872809    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b70a6cc-a620-4d84-97b8-e4c6e325b032-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws\" (UID: \"2b70a6cc-a620-4d84-97b8-e4c6e325b032\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"
Sep 11 12:01:02.872975 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:02.872832    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b70a6cc-a620-4d84-97b8-e4c6e325b032-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws\" (UID: \"2b70a6cc-a620-4d84-97b8-e4c6e325b032\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"
Sep 11 12:01:02.974069 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:02.974033    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b70a6cc-a620-4d84-97b8-e4c6e325b032-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws\" (UID: \"2b70a6cc-a620-4d84-97b8-e4c6e325b032\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"
Sep 11 12:01:02.974069 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:02.974070    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b70a6cc-a620-4d84-97b8-e4c6e325b032-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws\" (UID: \"2b70a6cc-a620-4d84-97b8-e4c6e325b032\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"
Sep 11 12:01:02.974310 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:02.974252    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b70a6cc-a620-4d84-97b8-e4c6e325b032-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws\" (UID: \"2b70a6cc-a620-4d84-97b8-e4c6e325b032\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"
Sep 11 12:01:02.974377 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:02.974325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b70a6cc-a620-4d84-97b8-e4c6e325b032-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws\" (UID: \"2b70a6cc-a620-4d84-97b8-e4c6e325b032\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"
Sep 11 12:01:02.974436 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:02.974375    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b70a6cc-a620-4d84-97b8-e4c6e325b032-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws\" (UID: \"2b70a6cc-a620-4d84-97b8-e4c6e325b032\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"
Sep 11 12:01:02.974507 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:02.974488    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f652v\" (UniqueName: \"kubernetes.io/projected/2b70a6cc-a620-4d84-97b8-e4c6e325b032-kube-api-access-f652v\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws\" (UID: \"2b70a6cc-a620-4d84-97b8-e4c6e325b032\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"
Sep 11 12:01:02.974826 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:02.974538    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b70a6cc-a620-4d84-97b8-e4c6e325b032-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws\" (UID: \"2b70a6cc-a620-4d84-97b8-e4c6e325b032\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"
Sep 11 12:01:02.975179 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:02.975133    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b70a6cc-a620-4d84-97b8-e4c6e325b032-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws\" (UID: \"2b70a6cc-a620-4d84-97b8-e4c6e325b032\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"
Sep 11 12:01:02.975314 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:02.975230    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b70a6cc-a620-4d84-97b8-e4c6e325b032-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws\" (UID: \"2b70a6cc-a620-4d84-97b8-e4c6e325b032\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"
Sep 11 12:01:02.977088 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:02.976961    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b70a6cc-a620-4d84-97b8-e4c6e325b032-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws\" (UID: \"2b70a6cc-a620-4d84-97b8-e4c6e325b032\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"
Sep 11 12:01:02.977088 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:02.977059    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b70a6cc-a620-4d84-97b8-e4c6e325b032-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws\" (UID: \"2b70a6cc-a620-4d84-97b8-e4c6e325b032\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"
Sep 11 12:01:02.983953 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:02.983926    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f652v\" (UniqueName: \"kubernetes.io/projected/2b70a6cc-a620-4d84-97b8-e4c6e325b032-kube-api-access-f652v\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws\" (UID: \"2b70a6cc-a620-4d84-97b8-e4c6e325b032\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"
Sep 11 12:01:03.126177 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:03.126083    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"
Sep 11 12:01:03.406408 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:03.406360    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"]
Sep 11 12:01:03.407984 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:01:03.407955    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b70a6cc_a620_4d84_97b8_e4c6e325b032.slice/crio-0b0996fd65e51cfb8b3dce5e0392f1b7a767034dc90ebe34c2a23d6388e63c24 WatchSource:0}: Error finding container 0b0996fd65e51cfb8b3dce5e0392f1b7a767034dc90ebe34c2a23d6388e63c24: Status 404 returned error can't find the container with id 0b0996fd65e51cfb8b3dce5e0392f1b7a767034dc90ebe34c2a23d6388e63c24
Sep 11 12:01:03.592499 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:03.592458    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws" event={"ID":"2b70a6cc-a620-4d84-97b8-e4c6e325b032","Type":"ContainerStarted","Data":"0b0996fd65e51cfb8b3dce5e0392f1b7a767034dc90ebe34c2a23d6388e63c24"}
Sep 11 12:01:05.605452 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:05.605408    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws" event={"ID":"2b70a6cc-a620-4d84-97b8-e4c6e325b032","Type":"ContainerStarted","Data":"46cc41850891a4af4018dcc86f578a064a4bff9c0ebfc7634c4a12fd8511aaa1"}
Sep 11 12:01:05.626693 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:05.626622    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws" podStartSLOduration=2.46615356 podStartE2EDuration="3.626605876s" totalImagesPullingTime="1.160452316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:01:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:01:05.62382483 +0000 UTC m=+579.306224328" watchObservedRunningTime="2026-09-11 12:01:05.626605876 +0000 UTC m=+579.309005372"
Sep 11 12:01:13.126862 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:13.126826    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"
Sep 11 12:01:13.127453 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:13.126892    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"
Sep 11 12:01:13.139367 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:13.139338    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"
Sep 11 12:01:13.662150 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:13.662120    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws"
Sep 11 12:01:26.789251 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:26.789224    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5pnqx_2233f21d-d3f8-44fc-92bf-03a86f7456ce/console-operator/1.log"
Sep 11 12:01:26.789660 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:26.789283    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5pnqx_2233f21d-d3f8-44fc-92bf-03a86f7456ce/console-operator/1.log"
Sep 11 12:01:26.796882 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:26.796856    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wzvlx_2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b/ovn-acl-logging/0.log"
Sep 11 12:01:26.797086 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:26.796942    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wzvlx_2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b/ovn-acl-logging/0.log"
Sep 11 12:01:29.408664 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:29.408630    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"]
Sep 11 12:01:29.413126 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:29.413101    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"
Sep 11 12:01:29.416388 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:29.416367    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 11 12:01:29.423384 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:29.423359    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"]
Sep 11 12:01:29.604504 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:29.604468    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c6e984f-5325-4e36-bf34-3cc0ec1788bd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt\" (UID: \"2c6e984f-5325-4e36-bf34-3cc0ec1788bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"
Sep 11 12:01:29.604504 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:29.604518    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c6e984f-5325-4e36-bf34-3cc0ec1788bd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt\" (UID: \"2c6e984f-5325-4e36-bf34-3cc0ec1788bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"
Sep 11 12:01:29.604772 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:29.604541    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c6e984f-5325-4e36-bf34-3cc0ec1788bd-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt\" (UID: \"2c6e984f-5325-4e36-bf34-3cc0ec1788bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"
Sep 11 12:01:29.604772 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:29.604594    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88rsn\" (UniqueName: \"kubernetes.io/projected/2c6e984f-5325-4e36-bf34-3cc0ec1788bd-kube-api-access-88rsn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt\" (UID: \"2c6e984f-5325-4e36-bf34-3cc0ec1788bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"
Sep 11 12:01:29.604772 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:29.604692    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c6e984f-5325-4e36-bf34-3cc0ec1788bd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt\" (UID: \"2c6e984f-5325-4e36-bf34-3cc0ec1788bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"
Sep 11 12:01:29.604772 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:29.604747    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c6e984f-5325-4e36-bf34-3cc0ec1788bd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt\" (UID: \"2c6e984f-5325-4e36-bf34-3cc0ec1788bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"
Sep 11 12:01:29.705628 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:29.705525    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c6e984f-5325-4e36-bf34-3cc0ec1788bd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt\" (UID: \"2c6e984f-5325-4e36-bf34-3cc0ec1788bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"
Sep 11 12:01:29.705628 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:29.705573    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c6e984f-5325-4e36-bf34-3cc0ec1788bd-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt\" (UID: \"2c6e984f-5325-4e36-bf34-3cc0ec1788bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"
Sep 11 12:01:29.705628 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:29.705593    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88rsn\" (UniqueName: \"kubernetes.io/projected/2c6e984f-5325-4e36-bf34-3cc0ec1788bd-kube-api-access-88rsn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt\" (UID: \"2c6e984f-5325-4e36-bf34-3cc0ec1788bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"
Sep 11 12:01:29.705628 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:29.705619    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c6e984f-5325-4e36-bf34-3cc0ec1788bd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt\" (UID: \"2c6e984f-5325-4e36-bf34-3cc0ec1788bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"
Sep 11 12:01:29.706027 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:29.705656    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c6e984f-5325-4e36-bf34-3cc0ec1788bd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt\" (UID: \"2c6e984f-5325-4e36-bf34-3cc0ec1788bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"
Sep 11 12:01:29.706027 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:29.705854    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c6e984f-5325-4e36-bf34-3cc0ec1788bd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt\" (UID: \"2c6e984f-5325-4e36-bf34-3cc0ec1788bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"
Sep 11 12:01:29.706027 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:29.705979    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c6e984f-5325-4e36-bf34-3cc0ec1788bd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt\" (UID: \"2c6e984f-5325-4e36-bf34-3cc0ec1788bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"
Sep 11 12:01:29.706027 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:29.706018    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c6e984f-5325-4e36-bf34-3cc0ec1788bd-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt\" (UID: \"2c6e984f-5325-4e36-bf34-3cc0ec1788bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"
Sep 11 12:01:29.706189 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:29.706165    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c6e984f-5325-4e36-bf34-3cc0ec1788bd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt\" (UID: \"2c6e984f-5325-4e36-bf34-3cc0ec1788bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"
Sep 11 12:01:29.707914 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:29.707890    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c6e984f-5325-4e36-bf34-3cc0ec1788bd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt\" (UID: \"2c6e984f-5325-4e36-bf34-3cc0ec1788bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"
Sep 11 12:01:29.708090 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:29.708072    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c6e984f-5325-4e36-bf34-3cc0ec1788bd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt\" (UID: \"2c6e984f-5325-4e36-bf34-3cc0ec1788bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"
Sep 11 12:01:29.717368 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:29.717337    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88rsn\" (UniqueName: \"kubernetes.io/projected/2c6e984f-5325-4e36-bf34-3cc0ec1788bd-kube-api-access-88rsn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt\" (UID: \"2c6e984f-5325-4e36-bf34-3cc0ec1788bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"
Sep 11 12:01:29.723841 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:29.723818    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"
Sep 11 12:01:30.004831 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:30.004734    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"]
Sep 11 12:01:30.009764 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:01:30.009736    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c6e984f_5325_4e36_bf34_3cc0ec1788bd.slice/crio-cdfcb0cbe8720c82460a0b0347f73f1864e1288d67e6fb49253bfb8b5c6dcb12 WatchSource:0}: Error finding container cdfcb0cbe8720c82460a0b0347f73f1864e1288d67e6fb49253bfb8b5c6dcb12: Status 404 returned error can't find the container with id cdfcb0cbe8720c82460a0b0347f73f1864e1288d67e6fb49253bfb8b5c6dcb12
Sep 11 12:01:30.746250 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:30.746208    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt" event={"ID":"2c6e984f-5325-4e36-bf34-3cc0ec1788bd","Type":"ContainerStarted","Data":"f5fabf082af762fd4ad65d0abaad1f0aa3cf514c142e22b79b41c4daab15637a"}
Sep 11 12:01:30.746918 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:30.746266    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt" event={"ID":"2c6e984f-5325-4e36-bf34-3cc0ec1788bd","Type":"ContainerStarted","Data":"cdfcb0cbe8720c82460a0b0347f73f1864e1288d67e6fb49253bfb8b5c6dcb12"}
Sep 11 12:01:30.768186 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:30.768133    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt" podStartSLOduration=1.581748153 podStartE2EDuration="1.768116585s" totalImagesPullingTime="186.368432ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:01:30.767070245 +0000 UTC m=+604.449469743" watchObservedRunningTime="2026-09-11 12:01:30.768116585 +0000 UTC m=+604.450516079"
Sep 11 12:01:39.724840 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:39.724781    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"
Sep 11 12:01:39.725267 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:39.724864    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"
Sep 11 12:01:39.737720 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:39.737674    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"
Sep 11 12:01:39.807131 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:39.807095    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt"
Sep 11 12:01:42.832526 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:42.832493    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"]
Sep 11 12:01:42.836235 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:42.836203    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"
Sep 11 12:01:42.839903 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:42.839869    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 11 12:01:42.851219 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:42.851189    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"]
Sep 11 12:01:42.909779 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:42.909745    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f41e666a-8097-4d2b-a5e5-4d82c9325eaf-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c559w\" (UID: \"f41e666a-8097-4d2b-a5e5-4d82c9325eaf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"
Sep 11 12:01:42.909779 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:42.909779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f41e666a-8097-4d2b-a5e5-4d82c9325eaf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c559w\" (UID: \"f41e666a-8097-4d2b-a5e5-4d82c9325eaf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"
Sep 11 12:01:42.910010 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:42.909805    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f41e666a-8097-4d2b-a5e5-4d82c9325eaf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c559w\" (UID: \"f41e666a-8097-4d2b-a5e5-4d82c9325eaf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"
Sep 11 12:01:42.910010 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:42.909854    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f41e666a-8097-4d2b-a5e5-4d82c9325eaf-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c559w\" (UID: \"f41e666a-8097-4d2b-a5e5-4d82c9325eaf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"
Sep 11 12:01:42.910010 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:42.909914    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79jbq\" (UniqueName: \"kubernetes.io/projected/f41e666a-8097-4d2b-a5e5-4d82c9325eaf-kube-api-access-79jbq\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c559w\" (UID: \"f41e666a-8097-4d2b-a5e5-4d82c9325eaf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"
Sep 11 12:01:42.910220 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:42.910200    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f41e666a-8097-4d2b-a5e5-4d82c9325eaf-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c559w\" (UID: \"f41e666a-8097-4d2b-a5e5-4d82c9325eaf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"
Sep 11 12:01:43.010946 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:43.010907    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f41e666a-8097-4d2b-a5e5-4d82c9325eaf-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c559w\" (UID: \"f41e666a-8097-4d2b-a5e5-4d82c9325eaf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"
Sep 11 12:01:43.010946 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:43.010957    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f41e666a-8097-4d2b-a5e5-4d82c9325eaf-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c559w\" (UID: \"f41e666a-8097-4d2b-a5e5-4d82c9325eaf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"
Sep 11 12:01:43.011229 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:43.010983    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f41e666a-8097-4d2b-a5e5-4d82c9325eaf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c559w\" (UID: \"f41e666a-8097-4d2b-a5e5-4d82c9325eaf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"
Sep 11 12:01:43.011229 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:43.011008    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f41e666a-8097-4d2b-a5e5-4d82c9325eaf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c559w\" (UID: \"f41e666a-8097-4d2b-a5e5-4d82c9325eaf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"
Sep 11 12:01:43.011229 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:43.011204    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f41e666a-8097-4d2b-a5e5-4d82c9325eaf-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c559w\" (UID: \"f41e666a-8097-4d2b-a5e5-4d82c9325eaf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"
Sep 11 12:01:43.011378 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:43.011243    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79jbq\" (UniqueName: \"kubernetes.io/projected/f41e666a-8097-4d2b-a5e5-4d82c9325eaf-kube-api-access-79jbq\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c559w\" (UID: \"f41e666a-8097-4d2b-a5e5-4d82c9325eaf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"
Sep 11 12:01:43.011439 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:43.011393    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f41e666a-8097-4d2b-a5e5-4d82c9325eaf-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c559w\" (UID: \"f41e666a-8097-4d2b-a5e5-4d82c9325eaf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"
Sep 11 12:01:43.011439 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:43.011417    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f41e666a-8097-4d2b-a5e5-4d82c9325eaf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c559w\" (UID: \"f41e666a-8097-4d2b-a5e5-4d82c9325eaf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"
Sep 11 12:01:43.011556 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:43.011539    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f41e666a-8097-4d2b-a5e5-4d82c9325eaf-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c559w\" (UID: \"f41e666a-8097-4d2b-a5e5-4d82c9325eaf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"
Sep 11 12:01:43.013260 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:43.013231    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f41e666a-8097-4d2b-a5e5-4d82c9325eaf-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c559w\" (UID: \"f41e666a-8097-4d2b-a5e5-4d82c9325eaf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"
Sep 11 12:01:43.013513 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:43.013496    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f41e666a-8097-4d2b-a5e5-4d82c9325eaf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c559w\" (UID: \"f41e666a-8097-4d2b-a5e5-4d82c9325eaf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"
Sep 11 12:01:43.021996 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:43.021970    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79jbq\" (UniqueName: \"kubernetes.io/projected/f41e666a-8097-4d2b-a5e5-4d82c9325eaf-kube-api-access-79jbq\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-c559w\" (UID: \"f41e666a-8097-4d2b-a5e5-4d82c9325eaf\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"
Sep 11 12:01:43.148311 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:43.148280    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"
Sep 11 12:01:43.429319 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:43.429291    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"]
Sep 11 12:01:43.430581 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:01:43.430554    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf41e666a_8097_4d2b_a5e5_4d82c9325eaf.slice/crio-44a43b5805a8a50221f3a4a3c8e139b0b848f2945f01c9a8fd7102bedf61ef67 WatchSource:0}: Error finding container 44a43b5805a8a50221f3a4a3c8e139b0b848f2945f01c9a8fd7102bedf61ef67: Status 404 returned error can't find the container with id 44a43b5805a8a50221f3a4a3c8e139b0b848f2945f01c9a8fd7102bedf61ef67
Sep 11 12:01:43.820656 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:43.820600    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w" event={"ID":"f41e666a-8097-4d2b-a5e5-4d82c9325eaf","Type":"ContainerStarted","Data":"74b2af877e28d09aa236b0e28b9163a696d845a5456340e060dd273eac26e94b"}
Sep 11 12:01:43.820930 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:43.820670    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w" event={"ID":"f41e666a-8097-4d2b-a5e5-4d82c9325eaf","Type":"ContainerStarted","Data":"44a43b5805a8a50221f3a4a3c8e139b0b848f2945f01c9a8fd7102bedf61ef67"}
Sep 11 12:01:43.843260 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:43.843200    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w" podStartSLOduration=1.646701915 podStartE2EDuration="1.843179727s" totalImagesPullingTime="196.477812ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:01:43.842036695 +0000 UTC m=+617.524436192" watchObservedRunningTime="2026-09-11 12:01:43.843179727 +0000 UTC m=+617.525579226"
Sep 11 12:01:53.149469 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:53.149371    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"
Sep 11 12:01:53.149967 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:53.149469    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"
Sep 11 12:01:53.162637 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:53.162608    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"
Sep 11 12:01:53.890990 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:01:53.890955    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-c559w"
Sep 11 12:03:28.155137 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:28.155099    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-684bff778d-tl6np"]
Sep 11 12:03:28.155702 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:28.155350    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-684bff778d-tl6np" podUID="278552f6-005e-4603-82fe-6ba551f7ebfe" containerName="authorino" containerID="cri-o://59d86de106cf3969a8ec7b13416cf7a5f3b034f248a77703a60006842f48edfe" gracePeriod=30
Sep 11 12:03:28.391117 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:28.391080    2565 generic.go:356] "Generic (PLEG): container finished" podID="278552f6-005e-4603-82fe-6ba551f7ebfe" containerID="59d86de106cf3969a8ec7b13416cf7a5f3b034f248a77703a60006842f48edfe" exitCode=0
Sep 11 12:03:28.391233 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:28.391138    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-684bff778d-tl6np" event={"ID":"278552f6-005e-4603-82fe-6ba551f7ebfe","Type":"ContainerDied","Data":"59d86de106cf3969a8ec7b13416cf7a5f3b034f248a77703a60006842f48edfe"}
Sep 11 12:03:28.391233 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:28.391177    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-684bff778d-tl6np" event={"ID":"278552f6-005e-4603-82fe-6ba551f7ebfe","Type":"ContainerDied","Data":"ebc3948247d18f4fa4802cb5cca2ff5c652762d152c4429de6cea1ead5b222fb"}
Sep 11 12:03:28.391233 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:28.391188    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ebc3948247d18f4fa4802cb5cca2ff5c652762d152c4429de6cea1ead5b222fb"
Sep 11 12:03:28.399589 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:28.399564    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-684bff778d-tl6np"
Sep 11 12:03:28.434564 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:28.434487    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/278552f6-005e-4603-82fe-6ba551f7ebfe-tls-cert\") pod \"278552f6-005e-4603-82fe-6ba551f7ebfe\" (UID: \"278552f6-005e-4603-82fe-6ba551f7ebfe\") "
Sep 11 12:03:28.434564 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:28.434545    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5n59\" (UniqueName: \"kubernetes.io/projected/278552f6-005e-4603-82fe-6ba551f7ebfe-kube-api-access-r5n59\") pod \"278552f6-005e-4603-82fe-6ba551f7ebfe\" (UID: \"278552f6-005e-4603-82fe-6ba551f7ebfe\") "
Sep 11 12:03:28.436458 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:28.436432    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/278552f6-005e-4603-82fe-6ba551f7ebfe-kube-api-access-r5n59" (OuterVolumeSpecName: "kube-api-access-r5n59") pod "278552f6-005e-4603-82fe-6ba551f7ebfe" (UID: "278552f6-005e-4603-82fe-6ba551f7ebfe"). InnerVolumeSpecName "kube-api-access-r5n59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:03:28.444352 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:28.444326    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/278552f6-005e-4603-82fe-6ba551f7ebfe-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "278552f6-005e-4603-82fe-6ba551f7ebfe" (UID: "278552f6-005e-4603-82fe-6ba551f7ebfe"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:03:28.536076 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:28.536041    2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/278552f6-005e-4603-82fe-6ba551f7ebfe-tls-cert\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:03:28.536076 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:28.536071    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5n59\" (UniqueName: \"kubernetes.io/projected/278552f6-005e-4603-82fe-6ba551f7ebfe-kube-api-access-r5n59\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:03:29.396092 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:29.396060    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-684bff778d-tl6np"
Sep 11 12:03:29.416478 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:29.416443    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-684bff778d-tl6np"]
Sep 11 12:03:29.418601 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:29.418580    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-684bff778d-tl6np"]
Sep 11 12:03:30.843268 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:30.843231    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="278552f6-005e-4603-82fe-6ba551f7ebfe" path="/var/lib/kubelet/pods/278552f6-005e-4603-82fe-6ba551f7ebfe/volumes"
Sep 11 12:03:45.685793 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.685760    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"]
Sep 11 12:03:45.686237 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.686148    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="278552f6-005e-4603-82fe-6ba551f7ebfe" containerName="authorino"
Sep 11 12:03:45.686237 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.686160    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="278552f6-005e-4603-82fe-6ba551f7ebfe" containerName="authorino"
Sep 11 12:03:45.686237 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.686229    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="278552f6-005e-4603-82fe-6ba551f7ebfe" containerName="authorino"
Sep 11 12:03:45.689772 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.689751    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.692672 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.692642    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-34511f-openshift-default-dockercfg-x7s2k\""
Sep 11 12:03:45.703012 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.702986    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"]
Sep 11 12:03:45.782307 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.782272    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-workload-socket\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.782477 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.782320    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-workload-certs\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.782477 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.782395    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e914ee1-7489-45ce-8a06-4afc671cdc39-istiod-ca-cert\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.782477 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.782434    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-istio-data\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.782477 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.782459    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbwkj\" (UniqueName: \"kubernetes.io/projected/8e914ee1-7489-45ce-8a06-4afc671cdc39-kube-api-access-dbwkj\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.782710 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.782507    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-istio-envoy\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.782710 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.782542    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-credential-socket\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.782710 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.782557    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e914ee1-7489-45ce-8a06-4afc671cdc39-istio-podinfo\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.782710 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.782571    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e914ee1-7489-45ce-8a06-4afc671cdc39-istio-token\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.883324 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.883289    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-istio-envoy\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.883501 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.883336    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-credential-socket\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.883501 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.883446    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e914ee1-7489-45ce-8a06-4afc671cdc39-istio-podinfo\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.883501 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.883496    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e914ee1-7489-45ce-8a06-4afc671cdc39-istio-token\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.883632 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.883593    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-workload-socket\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.883709 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.883633    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-workload-certs\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.883709 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.883647    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-credential-socket\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.883709 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.883661    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e914ee1-7489-45ce-8a06-4afc671cdc39-istiod-ca-cert\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.883867 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.883731    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-istio-data\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.883867 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.883769    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbwkj\" (UniqueName: \"kubernetes.io/projected/8e914ee1-7489-45ce-8a06-4afc671cdc39-kube-api-access-dbwkj\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.884057 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.884006    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-workload-socket\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.884057 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.884036    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-workload-certs\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.884258 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.884236    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-istio-data\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.884504 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.884482    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e914ee1-7489-45ce-8a06-4afc671cdc39-istiod-ca-cert\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.885646 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.885621    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-istio-envoy\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.885924 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.885906    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e914ee1-7489-45ce-8a06-4afc671cdc39-istio-podinfo\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.891909 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.891879    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e914ee1-7489-45ce-8a06-4afc671cdc39-istio-token\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:45.892110 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:45.892091    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbwkj\" (UniqueName: \"kubernetes.io/projected/8e914ee1-7489-45ce-8a06-4afc671cdc39-kube-api-access-dbwkj\") pod \"e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") " pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:46.002312 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:46.002192    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:46.280150 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:46.280122    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"]
Sep 11 12:03:46.282875 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:03:46.282832    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e914ee1_7489_45ce_8a06_4afc671cdc39.slice/crio-6218f0db2d592927522af64c02d777c79e15b1a61e601acbb42737caa5ff4295 WatchSource:0}: Error finding container 6218f0db2d592927522af64c02d777c79e15b1a61e601acbb42737caa5ff4295: Status 404 returned error can't find the container with id 6218f0db2d592927522af64c02d777c79e15b1a61e601acbb42737caa5ff4295
Sep 11 12:03:46.285287 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:46.285248    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:03:46.285368 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:46.285335    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:03:46.285415 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:46.285400    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:03:46.493549 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:46.493505    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg" event={"ID":"8e914ee1-7489-45ce-8a06-4afc671cdc39","Type":"ContainerStarted","Data":"5168217b24e2774892a4c5e852264afb3ac8e3867ca4c4054c299ec6bdc56e1f"}
Sep 11 12:03:46.493785 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:46.493571    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg" event={"ID":"8e914ee1-7489-45ce-8a06-4afc671cdc39","Type":"ContainerStarted","Data":"6218f0db2d592927522af64c02d777c79e15b1a61e601acbb42737caa5ff4295"}
Sep 11 12:03:46.516260 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:46.516201    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg" podStartSLOduration=1.516179986 podStartE2EDuration="1.516179986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:03:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:03:46.513888234 +0000 UTC m=+740.196287736" watchObservedRunningTime="2026-09-11 12:03:46.516179986 +0000 UTC m=+740.198579680"
Sep 11 12:03:47.003068 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:47.003027    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:47.004612 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:47.004586    2565 patch_prober.go:28] interesting pod/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 11 12:03:47.004723 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:47.004641    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg" podUID="8e914ee1-7489-45ce-8a06-4afc671cdc39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 11 12:03:47.441785 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:47.441744    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7788-48ac58"]
Sep 11 12:03:47.445859 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:47.445829    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-48ac58"
Sep 11 12:03:47.448606 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:47.448577    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7788-48ac58"]
Sep 11 12:03:47.448801 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:47.448782    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-sw5w8\""
Sep 11 12:03:47.497208 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:47.497169    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz5hs\" (UniqueName: \"kubernetes.io/projected/c5a54c6d-ccc8-4b19-8116-0e64978fc2c9-kube-api-access-sz5hs\") pod \"test-curl-7788-48ac58\" (UID: \"c5a54c6d-ccc8-4b19-8116-0e64978fc2c9\") " pod="opendatahub/test-curl-7788-48ac58"
Sep 11 12:03:47.598513 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:47.598476    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz5hs\" (UniqueName: \"kubernetes.io/projected/c5a54c6d-ccc8-4b19-8116-0e64978fc2c9-kube-api-access-sz5hs\") pod \"test-curl-7788-48ac58\" (UID: \"c5a54c6d-ccc8-4b19-8116-0e64978fc2c9\") " pod="opendatahub/test-curl-7788-48ac58"
Sep 11 12:03:47.607473 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:47.607444    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz5hs\" (UniqueName: \"kubernetes.io/projected/c5a54c6d-ccc8-4b19-8116-0e64978fc2c9-kube-api-access-sz5hs\") pod \"test-curl-7788-48ac58\" (UID: \"c5a54c6d-ccc8-4b19-8116-0e64978fc2c9\") " pod="opendatahub/test-curl-7788-48ac58"
Sep 11 12:03:47.756329 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:47.756241    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-48ac58"
Sep 11 12:03:48.006928 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:48.006845    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:48.026058 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:48.026034    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7788-48ac58"]
Sep 11 12:03:48.027736 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:03:48.027705    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5a54c6d_ccc8_4b19_8116_0e64978fc2c9.slice/crio-020c49fa7d8a1da0be825abe69758e0be7bee69c847da185e58e8869bdbc55de WatchSource:0}: Error finding container 020c49fa7d8a1da0be825abe69758e0be7bee69c847da185e58e8869bdbc55de: Status 404 returned error can't find the container with id 020c49fa7d8a1da0be825abe69758e0be7bee69c847da185e58e8869bdbc55de
Sep 11 12:03:48.029780 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:48.029759    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 12:03:48.505751 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:48.505711    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7788-48ac58" event={"ID":"c5a54c6d-ccc8-4b19-8116-0e64978fc2c9","Type":"ContainerStarted","Data":"020c49fa7d8a1da0be825abe69758e0be7bee69c847da185e58e8869bdbc55de"}
Sep 11 12:03:48.505977 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:48.505957    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:48.507058 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:48.507035    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:03:49.513895 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:49.513851    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7788-48ac58" event={"ID":"c5a54c6d-ccc8-4b19-8116-0e64978fc2c9","Type":"ContainerStarted","Data":"5b0cb30f5d832524326b49691df34d7d2b2c5430eef908d5ec46fc306a820575"}
Sep 11 12:03:49.529642 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:49.529585    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7788-48ac58" podStartSLOduration=1.810917893 podStartE2EDuration="2.529566283s" totalImagesPullingTime="718.64839ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:03:49.528064778 +0000 UTC m=+743.210464276" watchObservedRunningTime="2026-09-11 12:03:49.529566283 +0000 UTC m=+743.211965782"
Sep 11 12:03:50.133228 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:50.133194    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7788-48ac58"]
Sep 11 12:03:50.137752 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:50.137724    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7788-48ac58"]
Sep 11 12:03:50.519889 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:03:50.519854    2565 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7788-48ac58" container="test-curl-7788-48ac58"
Sep 11 12:03:51.526193 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:51.526151    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7788-48ac58" podUID="c5a54c6d-ccc8-4b19-8116-0e64978fc2c9" containerName="test-curl-7788-48ac58" containerID="cri-o://5b0cb30f5d832524326b49691df34d7d2b2c5430eef908d5ec46fc306a820575" gracePeriod=2
Sep 11 12:03:53.694270 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.694242    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-48ac58"
Sep 11 12:03:53.722393 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.722359    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"]
Sep 11 12:03:53.722989 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.722965    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5a54c6d-ccc8-4b19-8116-0e64978fc2c9" containerName="test-curl-7788-48ac58"
Sep 11 12:03:53.722989 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.722988    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5a54c6d-ccc8-4b19-8116-0e64978fc2c9" containerName="test-curl-7788-48ac58"
Sep 11 12:03:53.723164 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.723135    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5a54c6d-ccc8-4b19-8116-0e64978fc2c9" containerName="test-curl-7788-48ac58"
Sep 11 12:03:53.733847 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.733781    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.736824 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.736794    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a9aab05d-openshift-default-dockercfg-tdrnh\""
Sep 11 12:03:53.738657 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.738633    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"]
Sep 11 12:03:53.752218 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.752194    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sz5hs\" (UniqueName: \"kubernetes.io/projected/c5a54c6d-ccc8-4b19-8116-0e64978fc2c9-kube-api-access-sz5hs\") pod \"c5a54c6d-ccc8-4b19-8116-0e64978fc2c9\" (UID: \"c5a54c6d-ccc8-4b19-8116-0e64978fc2c9\") "
Sep 11 12:03:53.754381 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.754355    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5a54c6d-ccc8-4b19-8116-0e64978fc2c9-kube-api-access-sz5hs" (OuterVolumeSpecName: "kube-api-access-sz5hs") pod "c5a54c6d-ccc8-4b19-8116-0e64978fc2c9" (UID: "c5a54c6d-ccc8-4b19-8116-0e64978fc2c9"). InnerVolumeSpecName "kube-api-access-sz5hs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:03:53.852924 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.852838    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istio-token\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.852924 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.852889    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-workload-socket\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.852924 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.852910    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istio-podinfo\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.852924 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.852925    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl7dw\" (UniqueName: \"kubernetes.io/projected/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-kube-api-access-wl7dw\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.853211 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.852964    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-credential-socket\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.853211 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.852979    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istio-data\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.853211 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.853000    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-workload-certs\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.853211 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.853029    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istio-envoy\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.853211 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.853059    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istiod-ca-cert\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.853211 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.853098    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sz5hs\" (UniqueName: \"kubernetes.io/projected/c5a54c6d-ccc8-4b19-8116-0e64978fc2c9-kube-api-access-sz5hs\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:03:53.954152 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.954114    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-workload-certs\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.954152 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.954154    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istio-envoy\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.954386 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.954181    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istiod-ca-cert\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.954386 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.954246    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istio-token\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.954386 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.954303    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-workload-socket\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.954386 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.954326    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istio-podinfo\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.954386 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.954351    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl7dw\" (UniqueName: \"kubernetes.io/projected/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-kube-api-access-wl7dw\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.954386 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.954385    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-credential-socket\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.954637 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.954411    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istio-data\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.954637 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.954612    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-workload-certs\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.954808 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.954786    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istio-data\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.954873 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.954814    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-workload-socket\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.955036 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.955011    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istiod-ca-cert\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.955191 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.955166    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-credential-socket\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.956627 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.956607    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istio-envoy\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.957440 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.957421    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istio-podinfo\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.962723 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.962679    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl7dw\" (UniqueName: \"kubernetes.io/projected/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-kube-api-access-wl7dw\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:53.962814 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:53.962709    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istio-token\") pod \"e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") " pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:54.047929 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.047894    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:54.324044 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.324018    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"]
Sep 11 12:03:54.325315 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:03:54.325283    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7aba9c1_d9a7_4e2b_8c2f_98479cb5dbe7.slice/crio-65a7c5bcbc151e86b9f22d404d456e40c7349f1df33e9732bab6ec3bb35364ee WatchSource:0}: Error finding container 65a7c5bcbc151e86b9f22d404d456e40c7349f1df33e9732bab6ec3bb35364ee: Status 404 returned error can't find the container with id 65a7c5bcbc151e86b9f22d404d456e40c7349f1df33e9732bab6ec3bb35364ee
Sep 11 12:03:54.327301 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.327271    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:03:54.327365 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.327335    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:03:54.327446 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.327365    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:03:54.548227 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.548178    2565 generic.go:356] "Generic (PLEG): container finished" podID="c5a54c6d-ccc8-4b19-8116-0e64978fc2c9" containerID="5b0cb30f5d832524326b49691df34d7d2b2c5430eef908d5ec46fc306a820575" exitCode=137
Sep 11 12:03:54.548401 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.548256    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7788-48ac58"
Sep 11 12:03:54.548401 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.548306    2565 scope.go:117] "RemoveContainer" containerID="5b0cb30f5d832524326b49691df34d7d2b2c5430eef908d5ec46fc306a820575"
Sep 11 12:03:54.553098 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.553070    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k" event={"ID":"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7","Type":"ContainerStarted","Data":"bd2c42509f0a9ada5a17ed44cc5cd52236f33cf16f574536c277cc347f3550f8"}
Sep 11 12:03:54.553246 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.553120    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k" event={"ID":"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7","Type":"ContainerStarted","Data":"65a7c5bcbc151e86b9f22d404d456e40c7349f1df33e9732bab6ec3bb35364ee"}
Sep 11 12:03:54.559636 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.559513    2565 scope.go:117] "RemoveContainer" containerID="5b0cb30f5d832524326b49691df34d7d2b2c5430eef908d5ec46fc306a820575"
Sep 11 12:03:54.559896 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:03:54.559871    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b0cb30f5d832524326b49691df34d7d2b2c5430eef908d5ec46fc306a820575\": container with ID starting with 5b0cb30f5d832524326b49691df34d7d2b2c5430eef908d5ec46fc306a820575 not found: ID does not exist" containerID="5b0cb30f5d832524326b49691df34d7d2b2c5430eef908d5ec46fc306a820575"
Sep 11 12:03:54.559958 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.559909    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b0cb30f5d832524326b49691df34d7d2b2c5430eef908d5ec46fc306a820575"} err="failed to get container status \"5b0cb30f5d832524326b49691df34d7d2b2c5430eef908d5ec46fc306a820575\": rpc error: code = NotFound desc = could not find container \"5b0cb30f5d832524326b49691df34d7d2b2c5430eef908d5ec46fc306a820575\": container with ID starting with 5b0cb30f5d832524326b49691df34d7d2b2c5430eef908d5ec46fc306a820575 not found: ID does not exist"
Sep 11 12:03:54.575730 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:03:54.575621    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7788-48ac58\" is forbidden: User \"system:node:ip-10-0-138-111.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-111.ec2.internal' and this object" podUID="c5a54c6d-ccc8-4b19-8116-0e64978fc2c9" pod="opendatahub/test-curl-7788-48ac58"
Sep 11 12:03:54.576814 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.576768    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k" podStartSLOduration=1.5767512909999999 podStartE2EDuration="1.576751291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:03:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:03:54.573162152 +0000 UTC m=+748.255561651" watchObservedRunningTime="2026-09-11 12:03:54.576751291 +0000 UTC m=+748.259150793"
Sep 11 12:03:54.709922 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.709886    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"]
Sep 11 12:03:54.715246 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.715221    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.717915 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:03:54.717883    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7788-48ac58\" is forbidden: User \"system:node:ip-10-0-138-111.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-111.ec2.internal' and this object" podUID="c5a54c6d-ccc8-4b19-8116-0e64978fc2c9" pod="opendatahub/test-curl-7788-48ac58"
Sep 11 12:03:54.718816 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.718793    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-2c2847-openshift-default-dockercfg-mmr44\""
Sep 11 12:03:54.725960 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.725932    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"]
Sep 11 12:03:54.843761 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.843665    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5a54c6d-ccc8-4b19-8116-0e64978fc2c9" path="/var/lib/kubelet/pods/c5a54c6d-ccc8-4b19-8116-0e64978fc2c9/volumes"
Sep 11 12:03:54.862886 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.862855    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-workload-socket\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.862886 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.862890    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/341acf93-ad2c-4e56-bd38-09b10984f410-istio-token\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.863085 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.862913    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-credential-socket\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.863085 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.862948    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-istio-data\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.863085 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.862966    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-workload-certs\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.863085 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.862990    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwwsk\" (UniqueName: \"kubernetes.io/projected/341acf93-ad2c-4e56-bd38-09b10984f410-kube-api-access-hwwsk\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.863220 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.863109    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-istio-envoy\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.863220 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.863148    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/341acf93-ad2c-4e56-bd38-09b10984f410-istio-podinfo\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.863220 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.863192    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/341acf93-ad2c-4e56-bd38-09b10984f410-istiod-ca-cert\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.964432 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.964394    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-workload-socket\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.964619 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.964438    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/341acf93-ad2c-4e56-bd38-09b10984f410-istio-token\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.964619 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.964561    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-credential-socket\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.964619 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.964599    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-istio-data\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.964619 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.964619    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-workload-certs\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.965008 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.964658    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwwsk\" (UniqueName: \"kubernetes.io/projected/341acf93-ad2c-4e56-bd38-09b10984f410-kube-api-access-hwwsk\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.965008 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.964775    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-istio-envoy\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.965008 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.964803    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/341acf93-ad2c-4e56-bd38-09b10984f410-istio-podinfo\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.965008 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.964848    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/341acf93-ad2c-4e56-bd38-09b10984f410-istiod-ca-cert\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.965008 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.964873    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-workload-socket\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.965008 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.964905    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-credential-socket\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.965312 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.965020    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-istio-data\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.965312 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.965082    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-workload-certs\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.965465 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.965442    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/341acf93-ad2c-4e56-bd38-09b10984f410-istiod-ca-cert\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.967212 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.967187    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-istio-envoy\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.967380 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.967358    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/341acf93-ad2c-4e56-bd38-09b10984f410-istio-podinfo\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.975651 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.975630    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/341acf93-ad2c-4e56-bd38-09b10984f410-istio-token\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:54.975816 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:54.975795    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwwsk\" (UniqueName: \"kubernetes.io/projected/341acf93-ad2c-4e56-bd38-09b10984f410-kube-api-access-hwwsk\") pod \"e2e-autores-2c2847-openshift-default-68f79b9558-sknp2\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") " pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:55.028546 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:55.028516    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:55.048538 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:55.048508    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:55.054546 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:55.054478    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:55.307619 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:55.307584    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"]
Sep 11 12:03:55.308519 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:03:55.308492    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod341acf93_ad2c_4e56_bd38_09b10984f410.slice/crio-ce5d0912c7a52f2f61c8b31cb53a734a088bc7060f7a8e1635497fac60eb4352 WatchSource:0}: Error finding container ce5d0912c7a52f2f61c8b31cb53a734a088bc7060f7a8e1635497fac60eb4352: Status 404 returned error can't find the container with id ce5d0912c7a52f2f61c8b31cb53a734a088bc7060f7a8e1635497fac60eb4352
Sep 11 12:03:55.310736 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:55.310704    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:03:55.310803 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:55.310775    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:03:55.310837 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:55.310803    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:03:55.562504 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:55.562416    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2" event={"ID":"341acf93-ad2c-4e56-bd38-09b10984f410","Type":"ContainerStarted","Data":"e59b2c87510551ccb86e7a515076c2022eef22fa27b5aafb0e03556b6201caf6"}
Sep 11 12:03:55.562504 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:55.562481    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2" event={"ID":"341acf93-ad2c-4e56-bd38-09b10984f410","Type":"ContainerStarted","Data":"ce5d0912c7a52f2f61c8b31cb53a734a088bc7060f7a8e1635497fac60eb4352"}
Sep 11 12:03:55.562876 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:55.562845    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:55.563774 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:55.563754    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:03:55.583563 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:55.583514    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2" podStartSLOduration=1.583496313 podStartE2EDuration="1.583496313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:03:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:03:55.582386417 +0000 UTC m=+749.264785915" watchObservedRunningTime="2026-09-11 12:03:55.583496313 +0000 UTC m=+749.265895810"
Sep 11 12:03:56.029190 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:56.029151    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:56.034708 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:56.034659    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:56.569252 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:56.569214    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:03:56.570274 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:03:56.570253    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:04:04.547966 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:04.547920    2565 patch_prober.go:28] interesting pod/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 12:04:04.548352 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:04.548022    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg" podUID="8e914ee1-7489-45ce-8a06-4afc671cdc39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 12:04:05.628168 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:05.628136    2565 generic.go:356] "Generic (PLEG): container finished" podID="8e914ee1-7489-45ce-8a06-4afc671cdc39" containerID="5168217b24e2774892a4c5e852264afb3ac8e3867ca4c4054c299ec6bdc56e1f" exitCode=0
Sep 11 12:04:05.628563 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:05.628208    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg" event={"ID":"8e914ee1-7489-45ce-8a06-4afc671cdc39","Type":"ContainerDied","Data":"5168217b24e2774892a4c5e852264afb3ac8e3867ca4c4054c299ec6bdc56e1f"}
Sep 11 12:04:05.628617 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:05.628603    2565 scope.go:117] "RemoveContainer" containerID="5168217b24e2774892a4c5e852264afb3ac8e3867ca4c4054c299ec6bdc56e1f"
Sep 11 12:04:05.629717 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:05.629672    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:04:05.629775 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:05.629761    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:04:05.629814 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:05.629794    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:04:06.635404 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:06.635367    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg" event={"ID":"8e914ee1-7489-45ce-8a06-4afc671cdc39","Type":"ContainerStarted","Data":"fa509a1f38d7be1b7857526eced298535267cd92a75569e5cea3507b022b2436"}
Sep 11 12:04:07.014136 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:07.014026    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:04:07.015284 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:07.014523    2565 patch_prober.go:28] interesting pod/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 11 12:04:07.015284 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:07.014587    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg" podUID="8e914ee1-7489-45ce-8a06-4afc671cdc39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 11 12:04:08.002780 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:08.002733    2565 patch_prober.go:28] interesting pod/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 11 12:04:08.003282 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:08.002807    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg" podUID="8e914ee1-7489-45ce-8a06-4afc671cdc39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 11 12:04:09.002778 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:09.002729    2565 patch_prober.go:28] interesting pod/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 11 12:04:09.003077 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:09.003027    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg" podUID="8e914ee1-7489-45ce-8a06-4afc671cdc39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 11 12:04:10.002987 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:10.002938    2565 patch_prober.go:28] interesting pod/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 11 12:04:10.003211 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:10.003016    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg" podUID="8e914ee1-7489-45ce-8a06-4afc671cdc39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 11 12:04:11.002924 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:11.002883    2565 patch_prober.go:28] interesting pod/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 11 12:04:11.003261 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:11.003221    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg" podUID="8e914ee1-7489-45ce-8a06-4afc671cdc39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 11 12:04:12.331519 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:12.331474    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:04:12.332426 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:12.332394    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:04:12.333358 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:12.333334    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:04:13.980814 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:13.980771    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"]
Sep 11 12:04:13.984861 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:13.984834    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:13.988708 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:13.988543    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-e42660-openshift-default-dockercfg-9hkws\""
Sep 11 12:04:14.001498 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.001461    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"]
Sep 11 12:04:14.088591 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.088551    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-workload-certs\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.088808 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.088605    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f26bx\" (UniqueName: \"kubernetes.io/projected/a71357a7-4f9a-4315-908f-f74ba755eba4-kube-api-access-f26bx\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.088808 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.088710    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-istio-envoy\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.088808 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.088759    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-credential-socket\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.088808 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.088794    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-istio-data\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.089031 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.088823    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-workload-socket\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.089031 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.088849    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a71357a7-4f9a-4315-908f-f74ba755eba4-istio-token\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.089031 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.088875    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a71357a7-4f9a-4315-908f-f74ba755eba4-istiod-ca-cert\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.089031 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.088917    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a71357a7-4f9a-4315-908f-f74ba755eba4-istio-podinfo\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.189950 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.189910    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-workload-socket\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.190120 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.189964    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a71357a7-4f9a-4315-908f-f74ba755eba4-istio-token\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.190120 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.189989    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a71357a7-4f9a-4315-908f-f74ba755eba4-istiod-ca-cert\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.190120 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.190033    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a71357a7-4f9a-4315-908f-f74ba755eba4-istio-podinfo\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.190120 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.190101    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-workload-certs\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.190266 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.190132    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f26bx\" (UniqueName: \"kubernetes.io/projected/a71357a7-4f9a-4315-908f-f74ba755eba4-kube-api-access-f26bx\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.190266 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.190205    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-istio-envoy\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.190266 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.190238    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-credential-socket\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.190406 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.190279    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-istio-data\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.190509 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.190484    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-workload-socket\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.191015 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.190991    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-istio-data\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.191193 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.191013    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-credential-socket\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.191292 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.191061    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-workload-certs\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.191676 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.191648    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a71357a7-4f9a-4315-908f-f74ba755eba4-istiod-ca-cert\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.193181 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.193161    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-istio-envoy\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.193503 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.193481    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a71357a7-4f9a-4315-908f-f74ba755eba4-istio-podinfo\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.209222 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.209195    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a71357a7-4f9a-4315-908f-f74ba755eba4-istio-token\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.210100 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.210075    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f26bx\" (UniqueName: \"kubernetes.io/projected/a71357a7-4f9a-4315-908f-f74ba755eba4-kube-api-access-f26bx\") pod \"e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") " pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.302438 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.302337    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:14.595444 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.595415    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"]
Sep 11 12:04:14.597697 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:04:14.597638    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda71357a7_4f9a_4315_908f_f74ba755eba4.slice/crio-f78f584cd178bf78a0f518e7d45132e20be8f0d6c42ad835c5c95b20a494a344 WatchSource:0}: Error finding container f78f584cd178bf78a0f518e7d45132e20be8f0d6c42ad835c5c95b20a494a344: Status 404 returned error can't find the container with id f78f584cd178bf78a0f518e7d45132e20be8f0d6c42ad835c5c95b20a494a344
Sep 11 12:04:14.600763 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.600728    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:04:14.600854 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.600797    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:04:14.600854 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.600831    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:04:14.714785 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.714739    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4" event={"ID":"a71357a7-4f9a-4315-908f-f74ba755eba4","Type":"ContainerStarted","Data":"3500f8c56ff5538b19e4a4190c85faf98d2f9d396ed172b14ee970069ad8ee8f"}
Sep 11 12:04:14.714966 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.714835    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4" event={"ID":"a71357a7-4f9a-4315-908f-f74ba755eba4","Type":"ContainerStarted","Data":"f78f584cd178bf78a0f518e7d45132e20be8f0d6c42ad835c5c95b20a494a344"}
Sep 11 12:04:14.738327 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:14.738261    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4" podStartSLOduration=1.73823871 podStartE2EDuration="1.73823871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:04:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:04:14.73495653 +0000 UTC m=+768.417356028" watchObservedRunningTime="2026-09-11 12:04:14.73823871 +0000 UTC m=+768.420638209"
Sep 11 12:04:15.302596 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:15.302550    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:15.308133 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:15.308095    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:15.722154 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:15.722122    2565 generic.go:356] "Generic (PLEG): container finished" podID="341acf93-ad2c-4e56-bd38-09b10984f410" containerID="e59b2c87510551ccb86e7a515076c2022eef22fa27b5aafb0e03556b6201caf6" exitCode=0
Sep 11 12:04:15.722322 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:15.722196    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2" event={"ID":"341acf93-ad2c-4e56-bd38-09b10984f410","Type":"ContainerDied","Data":"e59b2c87510551ccb86e7a515076c2022eef22fa27b5aafb0e03556b6201caf6"}
Sep 11 12:04:15.722490 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:15.722464    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:15.722810 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:15.722794    2565 scope.go:117] "RemoveContainer" containerID="e59b2c87510551ccb86e7a515076c2022eef22fa27b5aafb0e03556b6201caf6"
Sep 11 12:04:15.723619 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:15.723598    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:15.723969 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:15.723902    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:04:15.723969 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:15.723965    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:04:15.724090 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:15.724008    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:04:16.736567 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:16.736522    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2" event={"ID":"341acf93-ad2c-4e56-bd38-09b10984f410","Type":"ContainerStarted","Data":"3ae60716b46d0360d8d3f3a247234bb2de81355598336f0ed4ea62366825dc2d"}
Sep 11 12:04:16.738165 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:16.738144    2565 generic.go:356] "Generic (PLEG): container finished" podID="e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7" containerID="bd2c42509f0a9ada5a17ed44cc5cd52236f33cf16f574536c277cc347f3550f8" exitCode=0
Sep 11 12:04:16.738295 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:16.738201    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k" event={"ID":"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7","Type":"ContainerDied","Data":"bd2c42509f0a9ada5a17ed44cc5cd52236f33cf16f574536c277cc347f3550f8"}
Sep 11 12:04:16.738701 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:16.738669    2565 scope.go:117] "RemoveContainer" containerID="bd2c42509f0a9ada5a17ed44cc5cd52236f33cf16f574536c277cc347f3550f8"
Sep 11 12:04:16.739998 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:16.739964    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:04:16.740200 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:16.740179    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:04:16.740348 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:16.740327    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:04:17.029037 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:17.028925    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:04:17.029674 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:17.029647    2565 patch_prober.go:28] interesting pod/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 11 12:04:17.030180 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:17.030152    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2" podUID="341acf93-ad2c-4e56-bd38-09b10984f410" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 11 12:04:17.750900 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:17.750858    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k" event={"ID":"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7","Type":"ContainerStarted","Data":"57795bcd8a31ad9c71e95989d37d1a4c04ac21146c515db6d3337cbabbf092ce"}
Sep 11 12:04:18.029703 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:18.029597    2565 patch_prober.go:28] interesting pod/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 11 12:04:18.029703 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:18.029658    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2" podUID="341acf93-ad2c-4e56-bd38-09b10984f410" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 11 12:04:18.048828 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:18.048734    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:04:18.049169 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:18.049141    2565 patch_prober.go:28] interesting pod/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 11 12:04:18.049343 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:18.049321    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k" podUID="e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 11 12:04:19.029964 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:19.029920    2565 patch_prober.go:28] interesting pod/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 11 12:04:19.030369 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:19.029979    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2" podUID="341acf93-ad2c-4e56-bd38-09b10984f410" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 11 12:04:19.048505 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:19.048463    2565 patch_prober.go:28] interesting pod/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 11 12:04:19.048837 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:19.048800    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k" podUID="e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 11 12:04:20.029608 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:20.029567    2565 patch_prober.go:28] interesting pod/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 11 12:04:20.029811 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:20.029625    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2" podUID="341acf93-ad2c-4e56-bd38-09b10984f410" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 11 12:04:20.048541 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:20.048505    2565 patch_prober.go:28] interesting pod/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 11 12:04:20.049144 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:20.049099    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k" podUID="e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 11 12:04:21.029289 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:21.029251    2565 patch_prober.go:28] interesting pod/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 11 12:04:21.029479 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:21.029311    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2" podUID="341acf93-ad2c-4e56-bd38-09b10984f410" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 11 12:04:21.049498 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:21.049448    2565 patch_prober.go:28] interesting pod/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 11 12:04:21.050137 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:21.050077    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k" podUID="e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 11 12:04:21.536388 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:21.536353    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a9aab05d-7qt7b"]
Sep 11 12:04:21.540036 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:21.540004    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a9aab05d-7qt7b"
Sep 11 12:04:21.543404 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:21.543370    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:04:21.543863 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:21.543841    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r95fz\""
Sep 11 12:04:21.550231 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:21.550077    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a9aab05d-7qt7b"]
Sep 11 12:04:21.594707 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:21.594296    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aabfc715-bdf3-46c4-ac11-30d42f085893-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a9aab05d-7qt7b\" (UID: \"aabfc715-bdf3-46c4-ac11-30d42f085893\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a9aab05d-7qt7b"
Sep 11 12:04:21.695246 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:21.695195    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aabfc715-bdf3-46c4-ac11-30d42f085893-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a9aab05d-7qt7b\" (UID: \"aabfc715-bdf3-46c4-ac11-30d42f085893\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a9aab05d-7qt7b"
Sep 11 12:04:21.696245 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:21.696199    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aabfc715-bdf3-46c4-ac11-30d42f085893-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a9aab05d-7qt7b\" (UID: \"aabfc715-bdf3-46c4-ac11-30d42f085893\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a9aab05d-7qt7b"
Sep 11 12:04:21.855542 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:21.855439    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a9aab05d-7qt7b"
Sep 11 12:04:22.029253 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:22.029209    2565 patch_prober.go:28] interesting pod/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 11 12:04:22.029442 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:22.029271    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2" podUID="341acf93-ad2c-4e56-bd38-09b10984f410" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 11 12:04:22.055570 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:22.055097    2565 patch_prober.go:28] interesting pod/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 11 12:04:22.055570 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:22.055164    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k" podUID="e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 11 12:04:22.191724 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:22.191134    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a9aab05d-7qt7b"]
Sep 11 12:04:22.199808 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:04:22.199776    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaabfc715_bdf3_46c4_ac11_30d42f085893.slice/crio-0d121143d763a6a7bbefa53a375208577dbd135392d24c4c84b5f627d83b5c8c WatchSource:0}: Error finding container 0d121143d763a6a7bbefa53a375208577dbd135392d24c4c84b5f627d83b5c8c: Status 404 returned error can't find the container with id 0d121143d763a6a7bbefa53a375208577dbd135392d24c4c84b5f627d83b5c8c
Sep 11 12:04:22.798309 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:22.798265    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a9aab05d-7qt7b" event={"ID":"aabfc715-bdf3-46c4-ac11-30d42f085893","Type":"ContainerStarted","Data":"0d121143d763a6a7bbefa53a375208577dbd135392d24c4c84b5f627d83b5c8c"}
Sep 11 12:04:23.036207 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:23.036175    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:04:23.036552 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:23.036527    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:04:23.037756 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:23.037726    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:04:23.050388 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:23.049960    2565 patch_prober.go:28] interesting pod/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 11 12:04:23.050388 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:23.050018    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k" podUID="e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 11 12:04:24.141918 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:24.141852    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:04:24.143001 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:24.142934    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:04:24.143636 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:24.143609    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:04:25.819623 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:25.819586    2565 generic.go:356] "Generic (PLEG): container finished" podID="aabfc715-bdf3-46c4-ac11-30d42f085893" containerID="e3bfe68313b0f2dcce9efedb3267bf267cf1ecb8949ef07b970413be58816377" exitCode=0
Sep 11 12:04:25.820030 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:25.819661    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a9aab05d-7qt7b" event={"ID":"aabfc715-bdf3-46c4-ac11-30d42f085893","Type":"ContainerDied","Data":"e3bfe68313b0f2dcce9efedb3267bf267cf1ecb8949ef07b970413be58816377"}
Sep 11 12:04:26.963441 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:26.963417    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a9aab05d-7qt7b"
Sep 11 12:04:27.058843 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:27.058807    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aabfc715-bdf3-46c4-ac11-30d42f085893-maas-api-service-ca\") pod \"aabfc715-bdf3-46c4-ac11-30d42f085893\" (UID: \"aabfc715-bdf3-46c4-ac11-30d42f085893\") "
Sep 11 12:04:27.059159 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:27.059135    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aabfc715-bdf3-46c4-ac11-30d42f085893-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "aabfc715-bdf3-46c4-ac11-30d42f085893" (UID: "aabfc715-bdf3-46c4-ac11-30d42f085893"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:04:27.160198 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:27.160155    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aabfc715-bdf3-46c4-ac11-30d42f085893-maas-api-service-ca\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:04:27.833256 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:27.833224    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a9aab05d-7qt7b"
Sep 11 12:04:27.833256 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:27.833235    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a9aab05d-7qt7b" event={"ID":"aabfc715-bdf3-46c4-ac11-30d42f085893","Type":"ContainerDied","Data":"0d121143d763a6a7bbefa53a375208577dbd135392d24c4c84b5f627d83b5c8c"}
Sep 11 12:04:27.833523 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:27.833278    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d121143d763a6a7bbefa53a375208577dbd135392d24c4c84b5f627d83b5c8c"
Sep 11 12:04:37.912496 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:37.912411    2565 generic.go:356] "Generic (PLEG): container finished" podID="a71357a7-4f9a-4315-908f-f74ba755eba4" containerID="3500f8c56ff5538b19e4a4190c85faf98d2f9d396ed172b14ee970069ad8ee8f" exitCode=0
Sep 11 12:04:37.912496 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:37.912483    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4" event={"ID":"a71357a7-4f9a-4315-908f-f74ba755eba4","Type":"ContainerDied","Data":"3500f8c56ff5538b19e4a4190c85faf98d2f9d396ed172b14ee970069ad8ee8f"}
Sep 11 12:04:37.912963 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:37.912908    2565 scope.go:117] "RemoveContainer" containerID="3500f8c56ff5538b19e4a4190c85faf98d2f9d396ed172b14ee970069ad8ee8f"
Sep 11 12:04:37.914028 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:37.913999    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:04:37.914140 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:37.914067    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:04:37.914140 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:37.914096    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:04:38.312949 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:38.312860    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a9aab05d-7qt7b"]
Sep 11 12:04:38.316215 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:38.316185    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a9aab05d-7qt7b"]
Sep 11 12:04:38.442340 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:38.441881    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"]
Sep 11 12:04:38.442340 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:38.442261    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k" podUID="e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7" containerName="istio-proxy" containerID="cri-o://57795bcd8a31ad9c71e95989d37d1a4c04ac21146c515db6d3337cbabbf092ce" gracePeriod=30
Sep 11 12:04:38.862067 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:38.862031    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aabfc715-bdf3-46c4-ac11-30d42f085893" path="/var/lib/kubelet/pods/aabfc715-bdf3-46c4-ac11-30d42f085893/volumes"
Sep 11 12:04:38.921123 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:38.921089    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4" event={"ID":"a71357a7-4f9a-4315-908f-f74ba755eba4","Type":"ContainerStarted","Data":"033f9ff0f0aeb4ce6911a230caf4331b1f6d4e5445ca97ed5fae1b3ae75f3bc1"}
Sep 11 12:04:39.145501 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.145462    2565 patch_prober.go:28] interesting pod/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 11 12:04:39.145830 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.145798    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k" podUID="e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 12:04:39.303457 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.303419    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:39.303633 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.303610    2565 patch_prober.go:28] interesting pod/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 11 12:04:39.303676 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.303662    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4" podUID="a71357a7-4f9a-4315-908f-f74ba755eba4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 11 12:04:39.358053 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.358015    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"]
Sep 11 12:04:39.359039 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.359013    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aabfc715-bdf3-46c4-ac11-30d42f085893" containerName="revoke-keys"
Sep 11 12:04:39.359208 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.359196    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aabfc715-bdf3-46c4-ac11-30d42f085893" containerName="revoke-keys"
Sep 11 12:04:39.359471 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.359455    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="aabfc715-bdf3-46c4-ac11-30d42f085893" containerName="revoke-keys"
Sep 11 12:04:39.364306 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.364284    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.369610 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.369564    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-a6d3d15b-gw-openshift-default-dockercfg-2nrr9\""
Sep 11 12:04:39.385281 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.381478    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"]
Sep 11 12:04:39.483972 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.483880    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-istio-data\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.484478 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.484457    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-workload-socket\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.484698 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.484666    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-workload-certs\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.484962 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.484946    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4f402cc-8b88-4152-b1c1-b777203fee24-istio-podinfo\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.485148 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.485133    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4f402cc-8b88-4152-b1c1-b777203fee24-istio-token\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.485292 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.485279    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-istio-envoy\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.485453 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.485439    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-credential-socket\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.485622 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.485608    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9t7f\" (UniqueName: \"kubernetes.io/projected/f4f402cc-8b88-4152-b1c1-b777203fee24-kube-api-access-q9t7f\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.485785 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.485772    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4f402cc-8b88-4152-b1c1-b777203fee24-istiod-ca-cert\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.586864 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.586826    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4f402cc-8b88-4152-b1c1-b777203fee24-istio-token\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.586864 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.586880    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-istio-envoy\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.587144 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.586899    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-credential-socket\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.587144 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.586927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9t7f\" (UniqueName: \"kubernetes.io/projected/f4f402cc-8b88-4152-b1c1-b777203fee24-kube-api-access-q9t7f\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.587144 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.586948    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4f402cc-8b88-4152-b1c1-b777203fee24-istiod-ca-cert\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.587144 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.586984    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-istio-data\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.587144 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.587014    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-workload-socket\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.587144 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.587039    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-workload-certs\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.587144 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.587058    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4f402cc-8b88-4152-b1c1-b777203fee24-istio-podinfo\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.587468 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.587417    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-credential-socket\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.587509 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.587478    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-istio-data\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.587935 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.587901    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-workload-certs\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.588058 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.587940    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4f402cc-8b88-4152-b1c1-b777203fee24-istiod-ca-cert\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.588130 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.588081    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-workload-socket\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.589285 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.589256    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-istio-envoy\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.589562 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.589545    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4f402cc-8b88-4152-b1c1-b777203fee24-istio-podinfo\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.598926 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.598895    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9t7f\" (UniqueName: \"kubernetes.io/projected/f4f402cc-8b88-4152-b1c1-b777203fee24-kube-api-access-q9t7f\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.599078 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.599059    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4f402cc-8b88-4152-b1c1-b777203fee24-istio-token\") pod \"e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") " pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:39.700050 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:39.700013    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:40.010097 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:40.010067    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"]
Sep 11 12:04:40.010871 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:04:40.010846    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4f402cc_8b88_4152_b1c1_b777203fee24.slice/crio-cbca5f59328b6c885a3b3a2b5c0caed74d650749f14cc6e212a0a2478519b02d WatchSource:0}: Error finding container cbca5f59328b6c885a3b3a2b5c0caed74d650749f14cc6e212a0a2478519b02d: Status 404 returned error can't find the container with id cbca5f59328b6c885a3b3a2b5c0caed74d650749f14cc6e212a0a2478519b02d
Sep 11 12:04:40.013086 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:40.013052    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:04:40.013179 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:40.013115    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:04:40.013179 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:40.013145    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:04:40.303123 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:40.303037    2565 patch_prober.go:28] interesting pod/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 11 12:04:40.303123 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:40.303097    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4" podUID="a71357a7-4f9a-4315-908f-f74ba755eba4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 11 12:04:40.935199 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:40.935157    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn" event={"ID":"f4f402cc-8b88-4152-b1c1-b777203fee24","Type":"ContainerStarted","Data":"65f5d57da470f669d3813a1cbe8c1656d1ddd90d176c4974ef381287d349728e"}
Sep 11 12:04:40.935396 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:40.935221    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn" event={"ID":"f4f402cc-8b88-4152-b1c1-b777203fee24","Type":"ContainerStarted","Data":"cbca5f59328b6c885a3b3a2b5c0caed74d650749f14cc6e212a0a2478519b02d"}
Sep 11 12:04:40.958426 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:40.958356    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn" podStartSLOduration=1.958318562 podStartE2EDuration="1.958318562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:04:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:04:40.955281826 +0000 UTC m=+794.637681324" watchObservedRunningTime="2026-09-11 12:04:40.958318562 +0000 UTC m=+794.640718073"
Sep 11 12:04:41.303800 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:41.303709    2565 patch_prober.go:28] interesting pod/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 11 12:04:41.303800 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:41.303770    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4" podUID="a71357a7-4f9a-4315-908f-f74ba755eba4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 11 12:04:41.701202 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:41.701164    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:41.706844 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:41.706816    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:41.943623 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:41.943585    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:41.946555 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:41.946527    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:04:42.303247 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:42.303210    2565 patch_prober.go:28] interesting pod/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 11 12:04:42.303399 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:42.303264    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4" podUID="a71357a7-4f9a-4315-908f-f74ba755eba4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 11 12:04:43.302902 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.302865    2565 patch_prober.go:28] interesting pod/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 11 12:04:43.303360 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.302931    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4" podUID="a71357a7-4f9a-4315-908f-f74ba755eba4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 11 12:04:43.731367 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.731342    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:04:43.832292 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.832198    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-workload-socket\") pod \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") "
Sep 11 12:04:43.832292 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.832243    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wl7dw\" (UniqueName: \"kubernetes.io/projected/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-kube-api-access-wl7dw\") pod \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") "
Sep 11 12:04:43.832292 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.832280    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istio-podinfo\") pod \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") "
Sep 11 12:04:43.832583 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.832339    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istio-data\") pod \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") "
Sep 11 12:04:43.832583 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.832374    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istio-envoy\") pod \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") "
Sep 11 12:04:43.832583 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.832411    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istio-token\") pod \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") "
Sep 11 12:04:43.832583 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.832451    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-workload-certs\") pod \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") "
Sep 11 12:04:43.832583 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.832483    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7" (UID: "e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:04:43.832583 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.832509    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-credential-socket\") pod \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") "
Sep 11 12:04:43.832583 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.832538    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istiod-ca-cert\") pod \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\" (UID: \"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7\") "
Sep 11 12:04:43.832989 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.832654    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istio-data" (OuterVolumeSpecName: "istio-data") pod "e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7" (UID: "e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:04:43.832989 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.832911    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istio-data\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:04:43.832989 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.832931    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-workload-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:04:43.832989 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.832917    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7" (UID: "e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:04:43.833215 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.832993    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7" (UID: "e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:04:43.833269 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.833222    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7" (UID: "e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:04:43.834731 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.834702    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-kube-api-access-wl7dw" (OuterVolumeSpecName: "kube-api-access-wl7dw") pod "e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7" (UID: "e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7"). InnerVolumeSpecName "kube-api-access-wl7dw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:04:43.834902 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.834746    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istio-token" (OuterVolumeSpecName: "istio-token") pod "e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7" (UID: "e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:04:43.834998 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.834963    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7" (UID: "e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:04:43.835055 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.835040    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7" (UID: "e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:04:43.933664 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.933625    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istio-envoy\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:04:43.933664 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.933656    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istio-token\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:04:43.933664 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.933668    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-workload-certs\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:04:43.933934 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.933709    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-credential-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:04:43.933934 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.933723    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istiod-ca-cert\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:04:43.933934 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.933735    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wl7dw\" (UniqueName: \"kubernetes.io/projected/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-kube-api-access-wl7dw\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:04:43.933934 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.933746    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7-istio-podinfo\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:04:43.959737 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.959666    2565 generic.go:356] "Generic (PLEG): container finished" podID="e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7" containerID="57795bcd8a31ad9c71e95989d37d1a4c04ac21146c515db6d3337cbabbf092ce" exitCode=0
Sep 11 12:04:43.959737 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.959727    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"
Sep 11 12:04:43.959936 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.959745    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k" event={"ID":"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7","Type":"ContainerDied","Data":"57795bcd8a31ad9c71e95989d37d1a4c04ac21146c515db6d3337cbabbf092ce"}
Sep 11 12:04:43.959936 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.959808    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k" event={"ID":"e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7","Type":"ContainerDied","Data":"65a7c5bcbc151e86b9f22d404d456e40c7349f1df33e9732bab6ec3bb35364ee"}
Sep 11 12:04:43.959936 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.959844    2565 scope.go:117] "RemoveContainer" containerID="57795bcd8a31ad9c71e95989d37d1a4c04ac21146c515db6d3337cbabbf092ce"
Sep 11 12:04:43.970056 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.970031    2565 scope.go:117] "RemoveContainer" containerID="bd2c42509f0a9ada5a17ed44cc5cd52236f33cf16f574536c277cc347f3550f8"
Sep 11 12:04:43.978677 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.978656    2565 scope.go:117] "RemoveContainer" containerID="57795bcd8a31ad9c71e95989d37d1a4c04ac21146c515db6d3337cbabbf092ce"
Sep 11 12:04:43.979004 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:04:43.978980    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57795bcd8a31ad9c71e95989d37d1a4c04ac21146c515db6d3337cbabbf092ce\": container with ID starting with 57795bcd8a31ad9c71e95989d37d1a4c04ac21146c515db6d3337cbabbf092ce not found: ID does not exist" containerID="57795bcd8a31ad9c71e95989d37d1a4c04ac21146c515db6d3337cbabbf092ce"
Sep 11 12:04:43.979070 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.979011    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57795bcd8a31ad9c71e95989d37d1a4c04ac21146c515db6d3337cbabbf092ce"} err="failed to get container status \"57795bcd8a31ad9c71e95989d37d1a4c04ac21146c515db6d3337cbabbf092ce\": rpc error: code = NotFound desc = could not find container \"57795bcd8a31ad9c71e95989d37d1a4c04ac21146c515db6d3337cbabbf092ce\": container with ID starting with 57795bcd8a31ad9c71e95989d37d1a4c04ac21146c515db6d3337cbabbf092ce not found: ID does not exist"
Sep 11 12:04:43.979070 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.979026    2565 scope.go:117] "RemoveContainer" containerID="bd2c42509f0a9ada5a17ed44cc5cd52236f33cf16f574536c277cc347f3550f8"
Sep 11 12:04:43.979277 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:04:43.979260    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd2c42509f0a9ada5a17ed44cc5cd52236f33cf16f574536c277cc347f3550f8\": container with ID starting with bd2c42509f0a9ada5a17ed44cc5cd52236f33cf16f574536c277cc347f3550f8 not found: ID does not exist" containerID="bd2c42509f0a9ada5a17ed44cc5cd52236f33cf16f574536c277cc347f3550f8"
Sep 11 12:04:43.979322 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.979280    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd2c42509f0a9ada5a17ed44cc5cd52236f33cf16f574536c277cc347f3550f8"} err="failed to get container status \"bd2c42509f0a9ada5a17ed44cc5cd52236f33cf16f574536c277cc347f3550f8\": rpc error: code = NotFound desc = could not find container \"bd2c42509f0a9ada5a17ed44cc5cd52236f33cf16f574536c277cc347f3550f8\": container with ID starting with bd2c42509f0a9ada5a17ed44cc5cd52236f33cf16f574536c277cc347f3550f8 not found: ID does not exist"
Sep 11 12:04:43.985039 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.985006    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"]
Sep 11 12:04:43.991012 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:43.990990    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a9aab05d-openshift-default-857cd8c674-q5t8k"]
Sep 11 12:04:44.337660 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:44.337622    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:44.338160 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:44.338052    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:44.339751 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:44.339719    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:04:44.844075 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:44.844037    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7" path="/var/lib/kubelet/pods/e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7/volumes"
Sep 11 12:04:57.985856 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:57.985815    2565 patch_prober.go:28] interesting pod/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 12:04:57.986286 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:57.985888    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn" podUID="f4f402cc-8b88-4152-b1c1-b777203fee24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 12:04:59.054247 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:59.054210    2565 generic.go:356] "Generic (PLEG): container finished" podID="f4f402cc-8b88-4152-b1c1-b777203fee24" containerID="65f5d57da470f669d3813a1cbe8c1656d1ddd90d176c4974ef381287d349728e" exitCode=0
Sep 11 12:04:59.054739 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:59.054293    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn" event={"ID":"f4f402cc-8b88-4152-b1c1-b777203fee24","Type":"ContainerDied","Data":"65f5d57da470f669d3813a1cbe8c1656d1ddd90d176c4974ef381287d349728e"}
Sep 11 12:04:59.054830 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:59.054760    2565 scope.go:117] "RemoveContainer" containerID="65f5d57da470f669d3813a1cbe8c1656d1ddd90d176c4974ef381287d349728e"
Sep 11 12:04:59.055941 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:59.055910    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:04:59.056000 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:59.055989    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:04:59.056067 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:04:59.056053    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:05:00.070228 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:00.070186    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn" event={"ID":"f4f402cc-8b88-4152-b1c1-b777203fee24","Type":"ContainerStarted","Data":"e05a8e8e04aa7e28d5ced635eccae7e0129d436721851c30afd9e3e1adac2919"}
Sep 11 12:05:00.700282 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:00.700246    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:05:00.700512 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:00.700488    2565 patch_prober.go:28] interesting pod/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 11 12:05:00.700569 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:00.700551    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn" podUID="f4f402cc-8b88-4152-b1c1-b777203fee24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 11 12:05:01.700849 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:01.700808    2565 patch_prober.go:28] interesting pod/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 11 12:05:01.701276 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:01.700869    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn" podUID="f4f402cc-8b88-4152-b1c1-b777203fee24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 11 12:05:02.700559 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:02.700519    2565 patch_prober.go:28] interesting pod/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 11 12:05:02.700781 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:02.700581    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn" podUID="f4f402cc-8b88-4152-b1c1-b777203fee24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 11 12:05:03.701074 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:03.701031    2565 patch_prober.go:28] interesting pod/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 11 12:05:03.701553 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:03.701098    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn" podUID="f4f402cc-8b88-4152-b1c1-b777203fee24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 11 12:05:04.701490 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:04.701450    2565 patch_prober.go:28] interesting pod/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 11 12:05:04.701921 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:04.701510    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn" podUID="f4f402cc-8b88-4152-b1c1-b777203fee24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 11 12:05:05.704530 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:05.704495    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:05:05.704997 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:05.704917    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:05:05.705703 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:05.705665    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:05:07.345262 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:07.345226    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6d3d15b-j4pdh"]
Sep 11 12:05:07.345805 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:07.345787    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7" containerName="istio-proxy"
Sep 11 12:05:07.345861 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:07.345807    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7" containerName="istio-proxy"
Sep 11 12:05:07.345861 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:07.345826    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7" containerName="istio-proxy"
Sep 11 12:05:07.345861 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:07.345832    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7" containerName="istio-proxy"
Sep 11 12:05:07.345961 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:07.345901    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7" containerName="istio-proxy"
Sep 11 12:05:07.345961 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:07.345910    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7aba9c1-d9a7-4e2b-8c2f-98479cb5dbe7" containerName="istio-proxy"
Sep 11 12:05:07.349020 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:07.348994    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6d3d15b-j4pdh"
Sep 11 12:05:07.352883 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:07.352850    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:05:07.353040 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:07.352852    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r95fz\""
Sep 11 12:05:07.357522 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:07.357305    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6d3d15b-j4pdh"]
Sep 11 12:05:07.500871 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:07.500833    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5997fa4-a133-46cc-9624-c490af14942b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a6d3d15b-j4pdh\" (UID: \"a5997fa4-a133-46cc-9624-c490af14942b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6d3d15b-j4pdh"
Sep 11 12:05:07.602297 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:07.602216    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5997fa4-a133-46cc-9624-c490af14942b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a6d3d15b-j4pdh\" (UID: \"a5997fa4-a133-46cc-9624-c490af14942b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6d3d15b-j4pdh"
Sep 11 12:05:07.602880 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:07.602858    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5997fa4-a133-46cc-9624-c490af14942b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a6d3d15b-j4pdh\" (UID: \"a5997fa4-a133-46cc-9624-c490af14942b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6d3d15b-j4pdh"
Sep 11 12:05:07.661462 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:07.661429    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6d3d15b-j4pdh"
Sep 11 12:05:07.934735 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:07.934708    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6d3d15b-j4pdh"]
Sep 11 12:05:07.936189 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:05:07.936163    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5997fa4_a133_46cc_9624_c490af14942b.slice/crio-65194fc78a110577ad943b08975e81a22c8337fe45bfcc4a36d76de70f9b9f05 WatchSource:0}: Error finding container 65194fc78a110577ad943b08975e81a22c8337fe45bfcc4a36d76de70f9b9f05: Status 404 returned error can't find the container with id 65194fc78a110577ad943b08975e81a22c8337fe45bfcc4a36d76de70f9b9f05
Sep 11 12:05:08.119224 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:08.119182    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6d3d15b-j4pdh" event={"ID":"a5997fa4-a133-46cc-9624-c490af14942b","Type":"ContainerStarted","Data":"65194fc78a110577ad943b08975e81a22c8337fe45bfcc4a36d76de70f9b9f05"}
Sep 11 12:05:09.126528 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:09.126448    2565 generic.go:356] "Generic (PLEG): container finished" podID="a5997fa4-a133-46cc-9624-c490af14942b" containerID="9799447f304e1d03dcfddac34109a07bc19bb551171afd8b66b7e6bf5f890ecb" exitCode=0
Sep 11 12:05:09.126902 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:09.126534    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6d3d15b-j4pdh" event={"ID":"a5997fa4-a133-46cc-9624-c490af14942b","Type":"ContainerDied","Data":"9799447f304e1d03dcfddac34109a07bc19bb551171afd8b66b7e6bf5f890ecb"}
Sep 11 12:05:10.274175 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:10.274145    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6d3d15b-j4pdh"
Sep 11 12:05:10.328012 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:10.327979    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5997fa4-a133-46cc-9624-c490af14942b-maas-api-service-ca\") pod \"a5997fa4-a133-46cc-9624-c490af14942b\" (UID: \"a5997fa4-a133-46cc-9624-c490af14942b\") "
Sep 11 12:05:10.328374 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:10.328348    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5997fa4-a133-46cc-9624-c490af14942b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a5997fa4-a133-46cc-9624-c490af14942b" (UID: "a5997fa4-a133-46cc-9624-c490af14942b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:05:10.428638 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:10.428588    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5997fa4-a133-46cc-9624-c490af14942b-maas-api-service-ca\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:05:11.139315 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:11.139286    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6d3d15b-j4pdh"
Sep 11 12:05:11.139500 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:11.139283    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6d3d15b-j4pdh" event={"ID":"a5997fa4-a133-46cc-9624-c490af14942b","Type":"ContainerDied","Data":"65194fc78a110577ad943b08975e81a22c8337fe45bfcc4a36d76de70f9b9f05"}
Sep 11 12:05:11.139500 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:11.139424    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65194fc78a110577ad943b08975e81a22c8337fe45bfcc4a36d76de70f9b9f05"
Sep 11 12:05:13.819817 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:13.819780    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6d3d15b-j4pdh"]
Sep 11 12:05:13.823035 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:13.823008    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a6d3d15b-j4pdh"]
Sep 11 12:05:13.966932 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:13.966882    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"]
Sep 11 12:05:13.967205 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:13.967143    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn" podUID="f4f402cc-8b88-4152-b1c1-b777203fee24" containerName="istio-proxy" containerID="cri-o://e05a8e8e04aa7e28d5ced635eccae7e0129d436721851c30afd9e3e1adac2919" gracePeriod=30
Sep 11 12:05:14.770189 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.770147    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"]
Sep 11 12:05:14.770611 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.770596    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5997fa4-a133-46cc-9624-c490af14942b" containerName="revoke-keys"
Sep 11 12:05:14.770659 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.770615    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5997fa4-a133-46cc-9624-c490af14942b" containerName="revoke-keys"
Sep 11 12:05:14.770730 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.770696    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5997fa4-a133-46cc-9624-c490af14942b" containerName="revoke-keys"
Sep 11 12:05:14.773924 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.773902    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.776659 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.776635    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-24d087d2-openshift-default-dockercfg-bnfj5\""
Sep 11 12:05:14.786799 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.786769    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"]
Sep 11 12:05:14.843662 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.843629    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5997fa4-a133-46cc-9624-c490af14942b" path="/var/lib/kubelet/pods/a5997fa4-a133-46cc-9624-c490af14942b/volumes"
Sep 11 12:05:14.866215 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.866180    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5778j\" (UniqueName: \"kubernetes.io/projected/bb11c1c2-eac3-4562-8457-d05d525c8e43-kube-api-access-5778j\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.866421 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.866232    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb11c1c2-eac3-4562-8457-d05d525c8e43-istio-podinfo\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.866421 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.866303    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-workload-certs\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.866421 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.866339    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-istio-envoy\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.866421 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.866366    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb11c1c2-eac3-4562-8457-d05d525c8e43-istio-token\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.866421 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.866397    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-workload-socket\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.866765 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.866431    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb11c1c2-eac3-4562-8457-d05d525c8e43-istiod-ca-cert\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.866765 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.866490    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-credential-socket\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.866765 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.866518    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-istio-data\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.967103 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.967058    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb11c1c2-eac3-4562-8457-d05d525c8e43-istio-podinfo\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.967278 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.967151    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-workload-certs\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.967278 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.967195    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-istio-envoy\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.967278 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.967224    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb11c1c2-eac3-4562-8457-d05d525c8e43-istio-token\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.967278 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.967255    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-workload-socket\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.967470 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.967291    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb11c1c2-eac3-4562-8457-d05d525c8e43-istiod-ca-cert\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.967470 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.967347    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-credential-socket\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.967470 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.967371    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-istio-data\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.967470 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.967408    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5778j\" (UniqueName: \"kubernetes.io/projected/bb11c1c2-eac3-4562-8457-d05d525c8e43-kube-api-access-5778j\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.967730 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.967614    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-workload-certs\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.967730 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.967653    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-workload-socket\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.967908 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.967884    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-credential-socket\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.967975 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.967901    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-istio-data\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.968159 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.968129    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb11c1c2-eac3-4562-8457-d05d525c8e43-istiod-ca-cert\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.969664 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.969643    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-istio-envoy\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.970294 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.970273    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb11c1c2-eac3-4562-8457-d05d525c8e43-istio-podinfo\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.977787 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.977757    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb11c1c2-eac3-4562-8457-d05d525c8e43-istio-token\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:14.978005 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:14.977980    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5778j\" (UniqueName: \"kubernetes.io/projected/bb11c1c2-eac3-4562-8457-d05d525c8e43-kube-api-access-5778j\") pod \"e2e-ait-24d087d2-openshift-default-d865565d-sglpg\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") " pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:15.088485 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:15.088112    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:15.380369 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:15.380340    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"]
Sep 11 12:05:15.381562 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:05:15.381532    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb11c1c2_eac3_4562_8457_d05d525c8e43.slice/crio-53fd142d1280fe92b31aa3580bee1a15e15e798e77e3109399f163bb9b8cadef WatchSource:0}: Error finding container 53fd142d1280fe92b31aa3580bee1a15e15e798e77e3109399f163bb9b8cadef: Status 404 returned error can't find the container with id 53fd142d1280fe92b31aa3580bee1a15e15e798e77e3109399f163bb9b8cadef
Sep 11 12:05:15.384277 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:15.384244    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:05:15.384384 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:15.384309    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:05:15.384384 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:15.384340    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:05:16.178210 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:16.178169    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg" event={"ID":"bb11c1c2-eac3-4562-8457-d05d525c8e43","Type":"ContainerStarted","Data":"1994d8c3194456e66360658a66518f60ca9f4b27d4f98afc07b5592aa08c984f"}
Sep 11 12:05:16.178597 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:16.178234    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg" event={"ID":"bb11c1c2-eac3-4562-8457-d05d525c8e43","Type":"ContainerStarted","Data":"53fd142d1280fe92b31aa3580bee1a15e15e798e77e3109399f163bb9b8cadef"}
Sep 11 12:05:16.274294 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:16.274231    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg" podStartSLOduration=2.274213546 podStartE2EDuration="2.274213546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:05:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:05:16.268362296 +0000 UTC m=+829.950761795" watchObservedRunningTime="2026-09-11 12:05:16.274213546 +0000 UTC m=+829.956613091"
Sep 11 12:05:17.089454 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:17.089413    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:17.094583 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:17.094553    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:17.184676 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:17.184647    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:17.185611 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:17.185590    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:19.200933 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.200895    2565 generic.go:356] "Generic (PLEG): container finished" podID="f4f402cc-8b88-4152-b1c1-b777203fee24" containerID="e05a8e8e04aa7e28d5ced635eccae7e0129d436721851c30afd9e3e1adac2919" exitCode=0
Sep 11 12:05:19.201329 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.200966    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn" event={"ID":"f4f402cc-8b88-4152-b1c1-b777203fee24","Type":"ContainerDied","Data":"e05a8e8e04aa7e28d5ced635eccae7e0129d436721851c30afd9e3e1adac2919"}
Sep 11 12:05:19.201329 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.201050    2565 scope.go:117] "RemoveContainer" containerID="65f5d57da470f669d3813a1cbe8c1656d1ddd90d176c4974ef381287d349728e"
Sep 11 12:05:19.239080 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.239016    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:05:19.308650 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.308621    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4f402cc-8b88-4152-b1c1-b777203fee24-istiod-ca-cert\") pod \"f4f402cc-8b88-4152-b1c1-b777203fee24\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") "
Sep 11 12:05:19.308842 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.308660    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9t7f\" (UniqueName: \"kubernetes.io/projected/f4f402cc-8b88-4152-b1c1-b777203fee24-kube-api-access-q9t7f\") pod \"f4f402cc-8b88-4152-b1c1-b777203fee24\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") "
Sep 11 12:05:19.308842 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.308709    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4f402cc-8b88-4152-b1c1-b777203fee24-istio-token\") pod \"f4f402cc-8b88-4152-b1c1-b777203fee24\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") "
Sep 11 12:05:19.308842 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.308787    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-istio-data\") pod \"f4f402cc-8b88-4152-b1c1-b777203fee24\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") "
Sep 11 12:05:19.308842 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.308803    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-workload-socket\") pod \"f4f402cc-8b88-4152-b1c1-b777203fee24\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") "
Sep 11 12:05:19.308842 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.308828    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-credential-socket\") pod \"f4f402cc-8b88-4152-b1c1-b777203fee24\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") "
Sep 11 12:05:19.309140 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.308848    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4f402cc-8b88-4152-b1c1-b777203fee24-istio-podinfo\") pod \"f4f402cc-8b88-4152-b1c1-b777203fee24\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") "
Sep 11 12:05:19.309140 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.308864    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-istio-envoy\") pod \"f4f402cc-8b88-4152-b1c1-b777203fee24\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") "
Sep 11 12:05:19.309140 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.308894    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-workload-certs\") pod \"f4f402cc-8b88-4152-b1c1-b777203fee24\" (UID: \"f4f402cc-8b88-4152-b1c1-b777203fee24\") "
Sep 11 12:05:19.309140 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.309115    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-istio-data" (OuterVolumeSpecName: "istio-data") pod "f4f402cc-8b88-4152-b1c1-b777203fee24" (UID: "f4f402cc-8b88-4152-b1c1-b777203fee24"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:05:19.309335 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.309143    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4f402cc-8b88-4152-b1c1-b777203fee24-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f4f402cc-8b88-4152-b1c1-b777203fee24" (UID: "f4f402cc-8b88-4152-b1c1-b777203fee24"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:05:19.309388 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.309350    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4f402cc-8b88-4152-b1c1-b777203fee24-istiod-ca-cert\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:05:19.309388 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.309379    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-istio-data\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:05:19.309497 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.309381    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f4f402cc-8b88-4152-b1c1-b777203fee24" (UID: "f4f402cc-8b88-4152-b1c1-b777203fee24"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:05:19.309719 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.309625    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f4f402cc-8b88-4152-b1c1-b777203fee24" (UID: "f4f402cc-8b88-4152-b1c1-b777203fee24"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:05:19.309862 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.309756    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f4f402cc-8b88-4152-b1c1-b777203fee24" (UID: "f4f402cc-8b88-4152-b1c1-b777203fee24"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:05:19.311275 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.311246    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f4f402cc-8b88-4152-b1c1-b777203fee24" (UID: "f4f402cc-8b88-4152-b1c1-b777203fee24"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:05:19.311419 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.311396    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4f402cc-8b88-4152-b1c1-b777203fee24-istio-token" (OuterVolumeSpecName: "istio-token") pod "f4f402cc-8b88-4152-b1c1-b777203fee24" (UID: "f4f402cc-8b88-4152-b1c1-b777203fee24"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:05:19.311477 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.311432    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4f402cc-8b88-4152-b1c1-b777203fee24-kube-api-access-q9t7f" (OuterVolumeSpecName: "kube-api-access-q9t7f") pod "f4f402cc-8b88-4152-b1c1-b777203fee24" (UID: "f4f402cc-8b88-4152-b1c1-b777203fee24"). InnerVolumeSpecName "kube-api-access-q9t7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:05:19.311943 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.311925    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f4f402cc-8b88-4152-b1c1-b777203fee24-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f4f402cc-8b88-4152-b1c1-b777203fee24" (UID: "f4f402cc-8b88-4152-b1c1-b777203fee24"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:05:19.410604 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.410567    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9t7f\" (UniqueName: \"kubernetes.io/projected/f4f402cc-8b88-4152-b1c1-b777203fee24-kube-api-access-q9t7f\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:05:19.410604 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.410597    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4f402cc-8b88-4152-b1c1-b777203fee24-istio-token\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:05:19.410604 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.410607    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-workload-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:05:19.410859 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.410616    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-credential-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:05:19.410859 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.410629    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4f402cc-8b88-4152-b1c1-b777203fee24-istio-podinfo\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:05:19.410859 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.410639    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-istio-envoy\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:05:19.410859 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:19.410646    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4f402cc-8b88-4152-b1c1-b777203fee24-workload-certs\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:05:20.208755 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:20.208720    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"
Sep 11 12:05:20.208755 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:20.208743    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn" event={"ID":"f4f402cc-8b88-4152-b1c1-b777203fee24","Type":"ContainerDied","Data":"cbca5f59328b6c885a3b3a2b5c0caed74d650749f14cc6e212a0a2478519b02d"}
Sep 11 12:05:20.209245 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:20.208807    2565 scope.go:117] "RemoveContainer" containerID="e05a8e8e04aa7e28d5ced635eccae7e0129d436721851c30afd9e3e1adac2919"
Sep 11 12:05:20.236759 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:20.236726    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"]
Sep 11 12:05:20.239585 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:20.239547    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-a6d3d15b-gw-openshift-default-5b464ff844-mr8zn"]
Sep 11 12:05:20.844403 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:20.844366    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4f402cc-8b88-4152-b1c1-b777203fee24" path="/var/lib/kubelet/pods/f4f402cc-8b88-4152-b1c1-b777203fee24/volumes"
Sep 11 12:05:33.225855 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:33.225807    2565 patch_prober.go:28] interesting pod/e2e-ait-24d087d2-openshift-default-d865565d-sglpg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 12:05:33.226243 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:33.225870    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg" podUID="bb11c1c2-eac3-4562-8457-d05d525c8e43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 12:05:34.309282 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:34.309255    2565 generic.go:356] "Generic (PLEG): container finished" podID="bb11c1c2-eac3-4562-8457-d05d525c8e43" containerID="1994d8c3194456e66360658a66518f60ca9f4b27d4f98afc07b5592aa08c984f" exitCode=0
Sep 11 12:05:34.309741 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:34.309330    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg" event={"ID":"bb11c1c2-eac3-4562-8457-d05d525c8e43","Type":"ContainerDied","Data":"1994d8c3194456e66360658a66518f60ca9f4b27d4f98afc07b5592aa08c984f"}
Sep 11 12:05:34.309882 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:34.309864    2565 scope.go:117] "RemoveContainer" containerID="1994d8c3194456e66360658a66518f60ca9f4b27d4f98afc07b5592aa08c984f"
Sep 11 12:05:34.311073 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:34.311043    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:05:34.311186 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:34.311127    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:05:34.311186 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:34.311176    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:05:35.317662 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:35.317625    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg" event={"ID":"bb11c1c2-eac3-4562-8457-d05d525c8e43","Type":"ContainerStarted","Data":"b1f18e4ed7ec396bbeb4efbd47f71b12c09e9c383828ca435fd45750686742da"}
Sep 11 12:05:36.088779 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:36.088740    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:36.089000 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:36.088971    2565 patch_prober.go:28] interesting pod/e2e-ait-24d087d2-openshift-default-d865565d-sglpg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 11 12:05:36.089095 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:36.089057    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg" podUID="bb11c1c2-eac3-4562-8457-d05d525c8e43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 11 12:05:37.089246 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:37.089198    2565 patch_prober.go:28] interesting pod/e2e-ait-24d087d2-openshift-default-d865565d-sglpg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 11 12:05:37.089649 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:37.089278    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg" podUID="bb11c1c2-eac3-4562-8457-d05d525c8e43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 11 12:05:38.089727 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:38.089670    2565 patch_prober.go:28] interesting pod/e2e-ait-24d087d2-openshift-default-d865565d-sglpg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 11 12:05:38.090208 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:38.089750    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg" podUID="bb11c1c2-eac3-4562-8457-d05d525c8e43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 11 12:05:39.089423 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:39.089381    2565 patch_prober.go:28] interesting pod/e2e-ait-24d087d2-openshift-default-d865565d-sglpg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 11 12:05:39.089722 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:39.089439    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg" podUID="bb11c1c2-eac3-4562-8457-d05d525c8e43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 11 12:05:40.089812 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:40.089764    2565 patch_prober.go:28] interesting pod/e2e-ait-24d087d2-openshift-default-d865565d-sglpg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 11 12:05:40.090202 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:40.089833    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg" podUID="bb11c1c2-eac3-4562-8457-d05d525c8e43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 11 12:05:41.092589 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:41.092547    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:41.093019 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:41.092872    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:41.093471 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:41.093451    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:43.317727 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:43.317693    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-24d087d2-bv96d"]
Sep 11 12:05:43.318103 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:43.318083    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4f402cc-8b88-4152-b1c1-b777203fee24" containerName="istio-proxy"
Sep 11 12:05:43.318103 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:43.318095    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4f402cc-8b88-4152-b1c1-b777203fee24" containerName="istio-proxy"
Sep 11 12:05:43.318103 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:43.318102    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4f402cc-8b88-4152-b1c1-b777203fee24" containerName="istio-proxy"
Sep 11 12:05:43.318204 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:43.318108    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4f402cc-8b88-4152-b1c1-b777203fee24" containerName="istio-proxy"
Sep 11 12:05:43.318204 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:43.318166    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4f402cc-8b88-4152-b1c1-b777203fee24" containerName="istio-proxy"
Sep 11 12:05:43.321414 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:43.321392    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-24d087d2-bv96d"
Sep 11 12:05:43.324215 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:43.324192    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:05:43.324325 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:43.324257    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r95fz\""
Sep 11 12:05:43.329815 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:43.329394    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-24d087d2-bv96d"]
Sep 11 12:05:43.448155 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:43.448116    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9c57d21-2a9f-4fe1-a3ad-1f5391feeb3b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-24d087d2-bv96d\" (UID: \"d9c57d21-2a9f-4fe1-a3ad-1f5391feeb3b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-24d087d2-bv96d"
Sep 11 12:05:43.549326 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:43.549285    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9c57d21-2a9f-4fe1-a3ad-1f5391feeb3b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-24d087d2-bv96d\" (UID: \"d9c57d21-2a9f-4fe1-a3ad-1f5391feeb3b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-24d087d2-bv96d"
Sep 11 12:05:43.549988 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:43.549960    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9c57d21-2a9f-4fe1-a3ad-1f5391feeb3b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-24d087d2-bv96d\" (UID: \"d9c57d21-2a9f-4fe1-a3ad-1f5391feeb3b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-24d087d2-bv96d"
Sep 11 12:05:43.633064 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:43.632974    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-24d087d2-bv96d"
Sep 11 12:05:43.911093 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:43.911062    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-24d087d2-bv96d"]
Sep 11 12:05:43.915426 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:05:43.912525    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9c57d21_2a9f_4fe1_a3ad_1f5391feeb3b.slice/crio-dda523ce99e2f987b80f4e8abdc327da7d6c9ad7466987d3449b3f2dee6eb632 WatchSource:0}: Error finding container dda523ce99e2f987b80f4e8abdc327da7d6c9ad7466987d3449b3f2dee6eb632: Status 404 returned error can't find the container with id dda523ce99e2f987b80f4e8abdc327da7d6c9ad7466987d3449b3f2dee6eb632
Sep 11 12:05:44.379141 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:44.379109    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-24d087d2-bv96d" event={"ID":"d9c57d21-2a9f-4fe1-a3ad-1f5391feeb3b","Type":"ContainerStarted","Data":"485dd2969282ad22ae8b1f28e3c9925cfaed9aa7f2a615e8f50d1780029e674d"}
Sep 11 12:05:44.379523 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:44.379159    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-24d087d2-bv96d" event={"ID":"d9c57d21-2a9f-4fe1-a3ad-1f5391feeb3b","Type":"ContainerStarted","Data":"dda523ce99e2f987b80f4e8abdc327da7d6c9ad7466987d3449b3f2dee6eb632"}
Sep 11 12:05:44.396028 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:44.395980    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-24d087d2-bv96d" podStartSLOduration=1.395965364 podStartE2EDuration="1.395965364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:05:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:05:44.394209814 +0000 UTC m=+858.076609325" watchObservedRunningTime="2026-09-11 12:05:44.395965364 +0000 UTC m=+858.078364861"
Sep 11 12:05:45.390497 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:45.390453    2565 generic.go:356] "Generic (PLEG): container finished" podID="d9c57d21-2a9f-4fe1-a3ad-1f5391feeb3b" containerID="485dd2969282ad22ae8b1f28e3c9925cfaed9aa7f2a615e8f50d1780029e674d" exitCode=0
Sep 11 12:05:45.390968 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:45.390497    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-24d087d2-bv96d" event={"ID":"d9c57d21-2a9f-4fe1-a3ad-1f5391feeb3b","Type":"ContainerDied","Data":"485dd2969282ad22ae8b1f28e3c9925cfaed9aa7f2a615e8f50d1780029e674d"}
Sep 11 12:05:46.530046 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:46.530018    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-24d087d2-bv96d"
Sep 11 12:05:46.684073 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:46.683984    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9c57d21-2a9f-4fe1-a3ad-1f5391feeb3b-maas-api-service-ca\") pod \"d9c57d21-2a9f-4fe1-a3ad-1f5391feeb3b\" (UID: \"d9c57d21-2a9f-4fe1-a3ad-1f5391feeb3b\") "
Sep 11 12:05:46.684404 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:46.684373    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9c57d21-2a9f-4fe1-a3ad-1f5391feeb3b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d9c57d21-2a9f-4fe1-a3ad-1f5391feeb3b" (UID: "d9c57d21-2a9f-4fe1-a3ad-1f5391feeb3b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:05:46.784748 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:46.784708    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9c57d21-2a9f-4fe1-a3ad-1f5391feeb3b-maas-api-service-ca\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:05:47.403617 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:47.403578    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-24d087d2-bv96d" event={"ID":"d9c57d21-2a9f-4fe1-a3ad-1f5391feeb3b","Type":"ContainerDied","Data":"dda523ce99e2f987b80f4e8abdc327da7d6c9ad7466987d3449b3f2dee6eb632"}
Sep 11 12:05:47.403617 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:47.403603    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-24d087d2-bv96d"
Sep 11 12:05:47.403863 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:47.403637    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dda523ce99e2f987b80f4e8abdc327da7d6c9ad7466987d3449b3f2dee6eb632"
Sep 11 12:05:49.923963 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:49.923923    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-24d087d2-bv96d"]
Sep 11 12:05:49.926477 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:49.926450    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-24d087d2-bv96d"]
Sep 11 12:05:50.849628 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:50.849588    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9c57d21-2a9f-4fe1-a3ad-1f5391feeb3b" path="/var/lib/kubelet/pods/d9c57d21-2a9f-4fe1-a3ad-1f5391feeb3b/volumes"
Sep 11 12:05:51.007585 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:51.007548    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"]
Sep 11 12:05:51.007990 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:51.007827    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg" podUID="bb11c1c2-eac3-4562-8457-d05d525c8e43" containerName="istio-proxy" containerID="cri-o://b1f18e4ed7ec396bbeb4efbd47f71b12c09e9c383828ca435fd45750686742da" gracePeriod=30
Sep 11 12:05:51.819129 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:51.819094    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"]
Sep 11 12:05:51.819498 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:51.819485    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9c57d21-2a9f-4fe1-a3ad-1f5391feeb3b" containerName="revoke-keys"
Sep 11 12:05:51.819571 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:51.819499    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9c57d21-2a9f-4fe1-a3ad-1f5391feeb3b" containerName="revoke-keys"
Sep 11 12:05:51.819571 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:51.819556    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9c57d21-2a9f-4fe1-a3ad-1f5391feeb3b" containerName="revoke-keys"
Sep 11 12:05:51.819571 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:51.819566    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4f402cc-8b88-4152-b1c1-b777203fee24" containerName="istio-proxy"
Sep 11 12:05:51.822944 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:51.822924    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:51.825854 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:51.825832    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-5e4884c8-openshift-default-dockercfg-wtq68\""
Sep 11 12:05:51.835408 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:51.835384    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"]
Sep 11 12:05:51.936226 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:51.936187    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrvvj\" (UniqueName: \"kubernetes.io/projected/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-kube-api-access-hrvvj\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:51.936226 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:51.936231    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istio-podinfo\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:51.936489 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:51.936252    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-credential-socket\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:51.936489 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:51.936295    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istio-envoy\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:51.936600 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:51.936485    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istio-data\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:51.936600 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:51.936542    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istiod-ca-cert\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:51.936600 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:51.936571    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istio-token\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:51.936768 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:51.936649    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-workload-socket\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:51.936768 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:51.936676    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-workload-certs\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:52.037699 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:52.037656    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-workload-socket\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:52.038149 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:52.037730    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-workload-certs\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:52.038149 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:52.037771    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrvvj\" (UniqueName: \"kubernetes.io/projected/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-kube-api-access-hrvvj\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:52.038149 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:52.037800    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istio-podinfo\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:52.038149 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:52.037829    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-credential-socket\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:52.038149 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:52.037854    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istio-envoy\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:52.038149 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:52.037957    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istio-data\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:52.038149 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:52.038001    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istiod-ca-cert\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:52.038149 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:52.038026    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istio-token\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:52.038149 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:52.038136    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-workload-socket\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:52.038579 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:52.038359    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-credential-socket\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:52.038579 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:52.038415    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istio-data\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:52.038579 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:52.038510    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-workload-certs\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:52.038956 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:52.038928    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istiod-ca-cert\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:52.040443 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:52.040396    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istio-envoy\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:52.040629 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:52.040605    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istio-podinfo\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:52.046484 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:52.046462    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrvvj\" (UniqueName: \"kubernetes.io/projected/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-kube-api-access-hrvvj\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:52.046631 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:52.046614    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istio-token\") pod \"e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") " pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:52.133577 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:52.133483    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:52.414760 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:05:52.414725    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0425ba9c_b8aa_4953_94e9_fef6dc6357c1.slice/crio-5e78d508666e94a5f4ff652c95989bdab4a23b3b2ddf598ea7d85724127b4db4 WatchSource:0}: Error finding container 5e78d508666e94a5f4ff652c95989bdab4a23b3b2ddf598ea7d85724127b4db4: Status 404 returned error can't find the container with id 5e78d508666e94a5f4ff652c95989bdab4a23b3b2ddf598ea7d85724127b4db4
Sep 11 12:05:52.415629 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:52.415604    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"]
Sep 11 12:05:52.417101 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:52.417065    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:05:52.417213 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:52.417127    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:05:52.417213 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:52.417157    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:05:52.433653 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:52.433625    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp" event={"ID":"0425ba9c-b8aa-4953-94e9-fef6dc6357c1","Type":"ContainerStarted","Data":"5e78d508666e94a5f4ff652c95989bdab4a23b3b2ddf598ea7d85724127b4db4"}
Sep 11 12:05:53.441669 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:53.441625    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp" event={"ID":"0425ba9c-b8aa-4953-94e9-fef6dc6357c1","Type":"ContainerStarted","Data":"f2ad1b8cb7a2302f11794df940ba2f0653751410dd7c67bec06cfc20cae88c7c"}
Sep 11 12:05:53.465032 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:53.464966    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp" podStartSLOduration=2.464948383 podStartE2EDuration="2.464948383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:05:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:05:53.461964014 +0000 UTC m=+867.144363513" watchObservedRunningTime="2026-09-11 12:05:53.464948383 +0000 UTC m=+867.147347881"
Sep 11 12:05:54.134199 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:54.134166    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:54.139322 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:54.139276    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:54.447771 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:54.447735    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:54.448658 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:54.448637    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:05:56.094115 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.094081    2565 patch_prober.go:28] interesting pod/e2e-ait-24d087d2-openshift-default-d865565d-sglpg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 11 12:05:56.094503 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.094137    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg" podUID="bb11c1c2-eac3-4562-8457-d05d525c8e43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 11 12:05:56.278596 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.278530    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:56.383217 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.383184    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-workload-socket\") pod \"bb11c1c2-eac3-4562-8457-d05d525c8e43\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") "
Sep 11 12:05:56.383395 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.383246    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb11c1c2-eac3-4562-8457-d05d525c8e43-istiod-ca-cert\") pod \"bb11c1c2-eac3-4562-8457-d05d525c8e43\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") "
Sep 11 12:05:56.383395 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.383322    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5778j\" (UniqueName: \"kubernetes.io/projected/bb11c1c2-eac3-4562-8457-d05d525c8e43-kube-api-access-5778j\") pod \"bb11c1c2-eac3-4562-8457-d05d525c8e43\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") "
Sep 11 12:05:56.383395 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.383348    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-istio-data\") pod \"bb11c1c2-eac3-4562-8457-d05d525c8e43\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") "
Sep 11 12:05:56.383395 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.383385    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-workload-certs\") pod \"bb11c1c2-eac3-4562-8457-d05d525c8e43\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") "
Sep 11 12:05:56.383632 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.383511    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bb11c1c2-eac3-4562-8457-d05d525c8e43" (UID: "bb11c1c2-eac3-4562-8457-d05d525c8e43"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:05:56.383632 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.383560    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-istio-envoy\") pod \"bb11c1c2-eac3-4562-8457-d05d525c8e43\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") "
Sep 11 12:05:56.383632 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.383623    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb11c1c2-eac3-4562-8457-d05d525c8e43-istio-token\") pod \"bb11c1c2-eac3-4562-8457-d05d525c8e43\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") "
Sep 11 12:05:56.383823 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.383629    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bb11c1c2-eac3-4562-8457-d05d525c8e43" (UID: "bb11c1c2-eac3-4562-8457-d05d525c8e43"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:05:56.383823 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.383644    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-istio-data" (OuterVolumeSpecName: "istio-data") pod "bb11c1c2-eac3-4562-8457-d05d525c8e43" (UID: "bb11c1c2-eac3-4562-8457-d05d525c8e43"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:05:56.383823 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.383652    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb11c1c2-eac3-4562-8457-d05d525c8e43-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bb11c1c2-eac3-4562-8457-d05d525c8e43" (UID: "bb11c1c2-eac3-4562-8457-d05d525c8e43"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:05:56.383823 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.383739    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb11c1c2-eac3-4562-8457-d05d525c8e43-istio-podinfo\") pod \"bb11c1c2-eac3-4562-8457-d05d525c8e43\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") "
Sep 11 12:05:56.383823 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.383771    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-credential-socket\") pod \"bb11c1c2-eac3-4562-8457-d05d525c8e43\" (UID: \"bb11c1c2-eac3-4562-8457-d05d525c8e43\") "
Sep 11 12:05:56.384083 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.384048    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bb11c1c2-eac3-4562-8457-d05d525c8e43" (UID: "bb11c1c2-eac3-4562-8457-d05d525c8e43"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:05:56.384193 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.384167    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-workload-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:05:56.384252 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.384199    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb11c1c2-eac3-4562-8457-d05d525c8e43-istiod-ca-cert\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:05:56.384252 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.384213    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-istio-data\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:05:56.384252 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.384228    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-workload-certs\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:05:56.384252 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.384242    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-credential-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:05:56.385646 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.385621    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb11c1c2-eac3-4562-8457-d05d525c8e43-kube-api-access-5778j" (OuterVolumeSpecName: "kube-api-access-5778j") pod "bb11c1c2-eac3-4562-8457-d05d525c8e43" (UID: "bb11c1c2-eac3-4562-8457-d05d525c8e43"). InnerVolumeSpecName "kube-api-access-5778j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:05:56.385777 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.385697    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bb11c1c2-eac3-4562-8457-d05d525c8e43" (UID: "bb11c1c2-eac3-4562-8457-d05d525c8e43"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:05:56.386112 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.386084    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bb11c1c2-eac3-4562-8457-d05d525c8e43-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bb11c1c2-eac3-4562-8457-d05d525c8e43" (UID: "bb11c1c2-eac3-4562-8457-d05d525c8e43"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:05:56.386112 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.386103    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb11c1c2-eac3-4562-8457-d05d525c8e43-istio-token" (OuterVolumeSpecName: "istio-token") pod "bb11c1c2-eac3-4562-8457-d05d525c8e43" (UID: "bb11c1c2-eac3-4562-8457-d05d525c8e43"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:05:56.462805 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.462767    2565 generic.go:356] "Generic (PLEG): container finished" podID="bb11c1c2-eac3-4562-8457-d05d525c8e43" containerID="b1f18e4ed7ec396bbeb4efbd47f71b12c09e9c383828ca435fd45750686742da" exitCode=0
Sep 11 12:05:56.462974 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.462841    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"
Sep 11 12:05:56.462974 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.462849    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg" event={"ID":"bb11c1c2-eac3-4562-8457-d05d525c8e43","Type":"ContainerDied","Data":"b1f18e4ed7ec396bbeb4efbd47f71b12c09e9c383828ca435fd45750686742da"}
Sep 11 12:05:56.462974 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.462935    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg" event={"ID":"bb11c1c2-eac3-4562-8457-d05d525c8e43","Type":"ContainerDied","Data":"53fd142d1280fe92b31aa3580bee1a15e15e798e77e3109399f163bb9b8cadef"}
Sep 11 12:05:56.462974 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.462964    2565 scope.go:117] "RemoveContainer" containerID="b1f18e4ed7ec396bbeb4efbd47f71b12c09e9c383828ca435fd45750686742da"
Sep 11 12:05:56.475037 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.475012    2565 scope.go:117] "RemoveContainer" containerID="1994d8c3194456e66360658a66518f60ca9f4b27d4f98afc07b5592aa08c984f"
Sep 11 12:05:56.487242 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.487017    2565 scope.go:117] "RemoveContainer" containerID="b1f18e4ed7ec396bbeb4efbd47f71b12c09e9c383828ca435fd45750686742da"
Sep 11 12:05:56.487507 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:05:56.487479    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1f18e4ed7ec396bbeb4efbd47f71b12c09e9c383828ca435fd45750686742da\": container with ID starting with b1f18e4ed7ec396bbeb4efbd47f71b12c09e9c383828ca435fd45750686742da not found: ID does not exist" containerID="b1f18e4ed7ec396bbeb4efbd47f71b12c09e9c383828ca435fd45750686742da"
Sep 11 12:05:56.487632 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.487518    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1f18e4ed7ec396bbeb4efbd47f71b12c09e9c383828ca435fd45750686742da"} err="failed to get container status \"b1f18e4ed7ec396bbeb4efbd47f71b12c09e9c383828ca435fd45750686742da\": rpc error: code = NotFound desc = could not find container \"b1f18e4ed7ec396bbeb4efbd47f71b12c09e9c383828ca435fd45750686742da\": container with ID starting with b1f18e4ed7ec396bbeb4efbd47f71b12c09e9c383828ca435fd45750686742da not found: ID does not exist"
Sep 11 12:05:56.487632 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.487541    2565 scope.go:117] "RemoveContainer" containerID="1994d8c3194456e66360658a66518f60ca9f4b27d4f98afc07b5592aa08c984f"
Sep 11 12:05:56.488490 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.488015    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb11c1c2-eac3-4562-8457-d05d525c8e43-istio-envoy\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:05:56.488490 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:05:56.488027    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1994d8c3194456e66360658a66518f60ca9f4b27d4f98afc07b5592aa08c984f\": container with ID starting with 1994d8c3194456e66360658a66518f60ca9f4b27d4f98afc07b5592aa08c984f not found: ID does not exist" containerID="1994d8c3194456e66360658a66518f60ca9f4b27d4f98afc07b5592aa08c984f"
Sep 11 12:05:56.488490 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.488059    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1994d8c3194456e66360658a66518f60ca9f4b27d4f98afc07b5592aa08c984f"} err="failed to get container status \"1994d8c3194456e66360658a66518f60ca9f4b27d4f98afc07b5592aa08c984f\": rpc error: code = NotFound desc = could not find container \"1994d8c3194456e66360658a66518f60ca9f4b27d4f98afc07b5592aa08c984f\": container with ID starting with 1994d8c3194456e66360658a66518f60ca9f4b27d4f98afc07b5592aa08c984f not found: ID does not exist"
Sep 11 12:05:56.488490 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.488037    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb11c1c2-eac3-4562-8457-d05d525c8e43-istio-token\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:05:56.488490 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.488093    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb11c1c2-eac3-4562-8457-d05d525c8e43-istio-podinfo\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:05:56.488490 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.488110    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5778j\" (UniqueName: \"kubernetes.io/projected/bb11c1c2-eac3-4562-8457-d05d525c8e43-kube-api-access-5778j\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:05:56.491081 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.491058    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"]
Sep 11 12:05:56.493549 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.493527    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-24d087d2-openshift-default-d865565d-sglpg"]
Sep 11 12:05:56.844713 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:05:56.844642    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb11c1c2-eac3-4562-8457-d05d525c8e43" path="/var/lib/kubelet/pods/bb11c1c2-eac3-4562-8457-d05d525c8e43/volumes"
Sep 11 12:06:10.489918 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:10.489870    2565 patch_prober.go:28] interesting pod/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 12:06:10.490353 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:10.489937    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp" podUID="0425ba9c-b8aa-4953-94e9-fef6dc6357c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 12:06:12.574363 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:12.574327    2565 generic.go:356] "Generic (PLEG): container finished" podID="0425ba9c-b8aa-4953-94e9-fef6dc6357c1" containerID="f2ad1b8cb7a2302f11794df940ba2f0653751410dd7c67bec06cfc20cae88c7c" exitCode=0
Sep 11 12:06:12.574799 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:12.574406    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp" event={"ID":"0425ba9c-b8aa-4953-94e9-fef6dc6357c1","Type":"ContainerDied","Data":"f2ad1b8cb7a2302f11794df940ba2f0653751410dd7c67bec06cfc20cae88c7c"}
Sep 11 12:06:12.574889 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:12.574874    2565 scope.go:117] "RemoveContainer" containerID="f2ad1b8cb7a2302f11794df940ba2f0653751410dd7c67bec06cfc20cae88c7c"
Sep 11 12:06:12.576055 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:12.576031    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:06:12.576138 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:12.576099    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:06:12.576138 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:12.576130    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:06:13.583204 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:13.583172    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp" event={"ID":"0425ba9c-b8aa-4953-94e9-fef6dc6357c1","Type":"ContainerStarted","Data":"76a2d65573b45be6e5b11e70ba23fda87466bd7578e63ddfea1206bdea1ff479"}
Sep 11 12:06:14.134083 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:14.134046    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:06:14.134260 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:14.134235    2565 patch_prober.go:28] interesting pod/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 11 12:06:14.134311 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:14.134281    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp" podUID="0425ba9c-b8aa-4953-94e9-fef6dc6357c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 11 12:06:15.134204 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:15.134165    2565 patch_prober.go:28] interesting pod/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 11 12:06:15.134589 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:15.134221    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp" podUID="0425ba9c-b8aa-4953-94e9-fef6dc6357c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 11 12:06:16.134455 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:16.134417    2565 patch_prober.go:28] interesting pod/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 11 12:06:16.134876 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:16.134475    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp" podUID="0425ba9c-b8aa-4953-94e9-fef6dc6357c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 11 12:06:17.134335 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:17.134296    2565 patch_prober.go:28] interesting pod/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 11 12:06:17.134523 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:17.134366    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp" podUID="0425ba9c-b8aa-4953-94e9-fef6dc6357c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 11 12:06:18.134894 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:18.134851    2565 patch_prober.go:28] interesting pod/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 11 12:06:18.135293 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:18.134914    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp" podUID="0425ba9c-b8aa-4953-94e9-fef6dc6357c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 11 12:06:19.138581 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:19.138501    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:06:19.139019 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:19.138883    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:06:19.139852 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:19.139817    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:06:19.617976 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:19.617891    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5e4884c8-q6f5w"]
Sep 11 12:06:19.618296 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:19.618282    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb11c1c2-eac3-4562-8457-d05d525c8e43" containerName="istio-proxy"
Sep 11 12:06:19.618339 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:19.618298    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb11c1c2-eac3-4562-8457-d05d525c8e43" containerName="istio-proxy"
Sep 11 12:06:19.618339 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:19.618313    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb11c1c2-eac3-4562-8457-d05d525c8e43" containerName="istio-proxy"
Sep 11 12:06:19.618339 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:19.618319    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb11c1c2-eac3-4562-8457-d05d525c8e43" containerName="istio-proxy"
Sep 11 12:06:19.618436 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:19.618391    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb11c1c2-eac3-4562-8457-d05d525c8e43" containerName="istio-proxy"
Sep 11 12:06:19.618436 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:19.618400    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb11c1c2-eac3-4562-8457-d05d525c8e43" containerName="istio-proxy"
Sep 11 12:06:19.621744 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:19.621726    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5e4884c8-q6f5w"
Sep 11 12:06:19.624668 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:19.624629    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r95fz\""
Sep 11 12:06:19.624814 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:19.624636    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:06:19.629945 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:19.629921    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5e4884c8-q6f5w"]
Sep 11 12:06:19.720973 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:19.720930    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d8dbc85-2683-4ec9-ac33-f53b8fb81e6b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5e4884c8-q6f5w\" (UID: \"3d8dbc85-2683-4ec9-ac33-f53b8fb81e6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5e4884c8-q6f5w"
Sep 11 12:06:19.821790 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:19.821749    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d8dbc85-2683-4ec9-ac33-f53b8fb81e6b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5e4884c8-q6f5w\" (UID: \"3d8dbc85-2683-4ec9-ac33-f53b8fb81e6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5e4884c8-q6f5w"
Sep 11 12:06:19.822409 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:19.822388    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d8dbc85-2683-4ec9-ac33-f53b8fb81e6b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5e4884c8-q6f5w\" (UID: \"3d8dbc85-2683-4ec9-ac33-f53b8fb81e6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5e4884c8-q6f5w"
Sep 11 12:06:19.934570 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:19.934533    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5e4884c8-q6f5w"
Sep 11 12:06:20.206708 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:20.206659    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5e4884c8-q6f5w"]
Sep 11 12:06:20.207208 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:06:20.207186    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d8dbc85_2683_4ec9_ac33_f53b8fb81e6b.slice/crio-2a1b848e8e44e3f4ef350b6246e8f5935fe82eae1bee60ea3ca2881bc2ab773c WatchSource:0}: Error finding container 2a1b848e8e44e3f4ef350b6246e8f5935fe82eae1bee60ea3ca2881bc2ab773c: Status 404 returned error can't find the container with id 2a1b848e8e44e3f4ef350b6246e8f5935fe82eae1bee60ea3ca2881bc2ab773c
Sep 11 12:06:20.638393 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:20.638357    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5e4884c8-q6f5w" event={"ID":"3d8dbc85-2683-4ec9-ac33-f53b8fb81e6b","Type":"ContainerStarted","Data":"324f863a6580f616eab80ed5b5928aeac162f1c30886bb88deaba1d44f2487b5"}
Sep 11 12:06:20.638578 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:20.638412    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5e4884c8-q6f5w" event={"ID":"3d8dbc85-2683-4ec9-ac33-f53b8fb81e6b","Type":"ContainerStarted","Data":"2a1b848e8e44e3f4ef350b6246e8f5935fe82eae1bee60ea3ca2881bc2ab773c"}
Sep 11 12:06:20.656928 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:20.656868    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5e4884c8-q6f5w" podStartSLOduration=1.656852518 podStartE2EDuration="1.656852518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:06:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:06:20.655546228 +0000 UTC m=+894.337945725" watchObservedRunningTime="2026-09-11 12:06:20.656852518 +0000 UTC m=+894.339252015"
Sep 11 12:06:21.647276 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:21.647240    2565 generic.go:356] "Generic (PLEG): container finished" podID="3d8dbc85-2683-4ec9-ac33-f53b8fb81e6b" containerID="324f863a6580f616eab80ed5b5928aeac162f1c30886bb88deaba1d44f2487b5" exitCode=0
Sep 11 12:06:21.647740 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:21.647290    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5e4884c8-q6f5w" event={"ID":"3d8dbc85-2683-4ec9-ac33-f53b8fb81e6b","Type":"ContainerDied","Data":"324f863a6580f616eab80ed5b5928aeac162f1c30886bb88deaba1d44f2487b5"}
Sep 11 12:06:22.787345 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:22.787316    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5e4884c8-q6f5w"
Sep 11 12:06:22.952065 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:22.951958    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d8dbc85-2683-4ec9-ac33-f53b8fb81e6b-maas-api-service-ca\") pod \"3d8dbc85-2683-4ec9-ac33-f53b8fb81e6b\" (UID: \"3d8dbc85-2683-4ec9-ac33-f53b8fb81e6b\") "
Sep 11 12:06:22.952370 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:22.952340    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d8dbc85-2683-4ec9-ac33-f53b8fb81e6b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3d8dbc85-2683-4ec9-ac33-f53b8fb81e6b" (UID: "3d8dbc85-2683-4ec9-ac33-f53b8fb81e6b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:06:23.053069 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:23.053034    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d8dbc85-2683-4ec9-ac33-f53b8fb81e6b-maas-api-service-ca\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:06:23.664473 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:23.664437    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5e4884c8-q6f5w"
Sep 11 12:06:23.664668 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:23.664482    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5e4884c8-q6f5w" event={"ID":"3d8dbc85-2683-4ec9-ac33-f53b8fb81e6b","Type":"ContainerDied","Data":"2a1b848e8e44e3f4ef350b6246e8f5935fe82eae1bee60ea3ca2881bc2ab773c"}
Sep 11 12:06:23.664668 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:23.664582    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a1b848e8e44e3f4ef350b6246e8f5935fe82eae1bee60ea3ca2881bc2ab773c"
Sep 11 12:06:26.681640 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:26.681601    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5e4884c8-q6f5w"]
Sep 11 12:06:26.684251 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:26.684227    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5e4884c8-q6f5w"]
Sep 11 12:06:26.812108 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:26.812072    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"]
Sep 11 12:06:26.812581 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:26.812553    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp" podUID="0425ba9c-b8aa-4953-94e9-fef6dc6357c1" containerName="istio-proxy" containerID="cri-o://76a2d65573b45be6e5b11e70ba23fda87466bd7578e63ddfea1206bdea1ff479" gracePeriod=30
Sep 11 12:06:26.846150 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:26.846121    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d8dbc85-2683-4ec9-ac33-f53b8fb81e6b" path="/var/lib/kubelet/pods/3d8dbc85-2683-4ec9-ac33-f53b8fb81e6b/volumes"
Sep 11 12:06:26.852304 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:26.852273    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5pnqx_2233f21d-d3f8-44fc-92bf-03a86f7456ce/console-operator/1.log"
Sep 11 12:06:26.853415 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:26.853394    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5pnqx_2233f21d-d3f8-44fc-92bf-03a86f7456ce/console-operator/1.log"
Sep 11 12:06:26.860092 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:26.860067    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wzvlx_2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b/ovn-acl-logging/0.log"
Sep 11 12:06:26.861112 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:26.861095    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wzvlx_2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b/ovn-acl-logging/0.log"
Sep 11 12:06:26.890346 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:26.890315    2565 scope.go:117] "RemoveContainer" containerID="59d86de106cf3969a8ec7b13416cf7a5f3b034f248a77703a60006842f48edfe"
Sep 11 12:06:32.069746 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.069722    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:06:32.137774 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.137745    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istio-podinfo\") pod \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") "
Sep 11 12:06:32.137954 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.137795    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istio-data\") pod \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") "
Sep 11 12:06:32.137954 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.137847    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istio-token\") pod \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") "
Sep 11 12:06:32.137954 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.137895    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istio-envoy\") pod \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") "
Sep 11 12:06:32.137954 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.137925    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-workload-certs\") pod \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") "
Sep 11 12:06:32.137954 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.137948    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-credential-socket\") pod \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") "
Sep 11 12:06:32.138222 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.138002    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istiod-ca-cert\") pod \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") "
Sep 11 12:06:32.138222 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.138033    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-workload-socket\") pod \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") "
Sep 11 12:06:32.138222 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.138070    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrvvj\" (UniqueName: \"kubernetes.io/projected/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-kube-api-access-hrvvj\") pod \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\" (UID: \"0425ba9c-b8aa-4953-94e9-fef6dc6357c1\") "
Sep 11 12:06:32.138222 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.138136    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istio-data" (OuterVolumeSpecName: "istio-data") pod "0425ba9c-b8aa-4953-94e9-fef6dc6357c1" (UID: "0425ba9c-b8aa-4953-94e9-fef6dc6357c1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:06:32.138406 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.138244    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0425ba9c-b8aa-4953-94e9-fef6dc6357c1" (UID: "0425ba9c-b8aa-4953-94e9-fef6dc6357c1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:06:32.138406 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.138336    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0425ba9c-b8aa-4953-94e9-fef6dc6357c1" (UID: "0425ba9c-b8aa-4953-94e9-fef6dc6357c1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:06:32.138504 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.138455    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istio-data\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:06:32.138504 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.138475    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-workload-certs\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:06:32.138504 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.138489    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-workload-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:06:32.138635 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.138543    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0425ba9c-b8aa-4953-94e9-fef6dc6357c1" (UID: "0425ba9c-b8aa-4953-94e9-fef6dc6357c1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:06:32.147701 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.141973    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istio-token" (OuterVolumeSpecName: "istio-token") pod "0425ba9c-b8aa-4953-94e9-fef6dc6357c1" (UID: "0425ba9c-b8aa-4953-94e9-fef6dc6357c1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:06:32.147701 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.143997    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0425ba9c-b8aa-4953-94e9-fef6dc6357c1" (UID: "0425ba9c-b8aa-4953-94e9-fef6dc6357c1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:06:32.147701 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.144075    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0425ba9c-b8aa-4953-94e9-fef6dc6357c1" (UID: "0425ba9c-b8aa-4953-94e9-fef6dc6357c1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:06:32.148453 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.148424    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-kube-api-access-hrvvj" (OuterVolumeSpecName: "kube-api-access-hrvvj") pod "0425ba9c-b8aa-4953-94e9-fef6dc6357c1" (UID: "0425ba9c-b8aa-4953-94e9-fef6dc6357c1"). InnerVolumeSpecName "kube-api-access-hrvvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:06:32.151952 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.151861    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0425ba9c-b8aa-4953-94e9-fef6dc6357c1" (UID: "0425ba9c-b8aa-4953-94e9-fef6dc6357c1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:06:32.239879 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.239835    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istiod-ca-cert\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:06:32.239879 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.239881    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrvvj\" (UniqueName: \"kubernetes.io/projected/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-kube-api-access-hrvvj\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:06:32.240077 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.239897    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istio-podinfo\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:06:32.240077 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.239912    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istio-token\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:06:32.240077 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.239926    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-istio-envoy\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:06:32.240077 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.239938    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0425ba9c-b8aa-4953-94e9-fef6dc6357c1-credential-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:06:32.720925 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.720888    2565 generic.go:356] "Generic (PLEG): container finished" podID="0425ba9c-b8aa-4953-94e9-fef6dc6357c1" containerID="76a2d65573b45be6e5b11e70ba23fda87466bd7578e63ddfea1206bdea1ff479" exitCode=0
Sep 11 12:06:32.721083 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.720956    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"
Sep 11 12:06:32.721083 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.720954    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp" event={"ID":"0425ba9c-b8aa-4953-94e9-fef6dc6357c1","Type":"ContainerDied","Data":"76a2d65573b45be6e5b11e70ba23fda87466bd7578e63ddfea1206bdea1ff479"}
Sep 11 12:06:32.721176 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.721106    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp" event={"ID":"0425ba9c-b8aa-4953-94e9-fef6dc6357c1","Type":"ContainerDied","Data":"5e78d508666e94a5f4ff652c95989bdab4a23b3b2ddf598ea7d85724127b4db4"}
Sep 11 12:06:32.721176 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.721132    2565 scope.go:117] "RemoveContainer" containerID="76a2d65573b45be6e5b11e70ba23fda87466bd7578e63ddfea1206bdea1ff479"
Sep 11 12:06:32.731602 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.731581    2565 scope.go:117] "RemoveContainer" containerID="f2ad1b8cb7a2302f11794df940ba2f0653751410dd7c67bec06cfc20cae88c7c"
Sep 11 12:06:32.740722 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.740696    2565 scope.go:117] "RemoveContainer" containerID="76a2d65573b45be6e5b11e70ba23fda87466bd7578e63ddfea1206bdea1ff479"
Sep 11 12:06:32.741089 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:06:32.741069    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76a2d65573b45be6e5b11e70ba23fda87466bd7578e63ddfea1206bdea1ff479\": container with ID starting with 76a2d65573b45be6e5b11e70ba23fda87466bd7578e63ddfea1206bdea1ff479 not found: ID does not exist" containerID="76a2d65573b45be6e5b11e70ba23fda87466bd7578e63ddfea1206bdea1ff479"
Sep 11 12:06:32.741164 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.741103    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76a2d65573b45be6e5b11e70ba23fda87466bd7578e63ddfea1206bdea1ff479"} err="failed to get container status \"76a2d65573b45be6e5b11e70ba23fda87466bd7578e63ddfea1206bdea1ff479\": rpc error: code = NotFound desc = could not find container \"76a2d65573b45be6e5b11e70ba23fda87466bd7578e63ddfea1206bdea1ff479\": container with ID starting with 76a2d65573b45be6e5b11e70ba23fda87466bd7578e63ddfea1206bdea1ff479 not found: ID does not exist"
Sep 11 12:06:32.741164 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.741129    2565 scope.go:117] "RemoveContainer" containerID="f2ad1b8cb7a2302f11794df940ba2f0653751410dd7c67bec06cfc20cae88c7c"
Sep 11 12:06:32.741556 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:06:32.741481    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2ad1b8cb7a2302f11794df940ba2f0653751410dd7c67bec06cfc20cae88c7c\": container with ID starting with f2ad1b8cb7a2302f11794df940ba2f0653751410dd7c67bec06cfc20cae88c7c not found: ID does not exist" containerID="f2ad1b8cb7a2302f11794df940ba2f0653751410dd7c67bec06cfc20cae88c7c"
Sep 11 12:06:32.741556 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.741516    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2ad1b8cb7a2302f11794df940ba2f0653751410dd7c67bec06cfc20cae88c7c"} err="failed to get container status \"f2ad1b8cb7a2302f11794df940ba2f0653751410dd7c67bec06cfc20cae88c7c\": rpc error: code = NotFound desc = could not find container \"f2ad1b8cb7a2302f11794df940ba2f0653751410dd7c67bec06cfc20cae88c7c\": container with ID starting with f2ad1b8cb7a2302f11794df940ba2f0653751410dd7c67bec06cfc20cae88c7c not found: ID does not exist"
Sep 11 12:06:32.744950 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.744926    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"]
Sep 11 12:06:32.748851 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.748829    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-5e4884c8-openshift-default-7f9f6f44dd-gz2zp"]
Sep 11 12:06:32.843438 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:32.843399    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0425ba9c-b8aa-4953-94e9-fef6dc6357c1" path="/var/lib/kubelet/pods/0425ba9c-b8aa-4953-94e9-fef6dc6357c1/volumes"
Sep 11 12:06:44.140072 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:44.140038    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2c2847-p2tjt"]
Sep 11 12:06:44.140625 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:44.140478    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0425ba9c-b8aa-4953-94e9-fef6dc6357c1" containerName="istio-proxy"
Sep 11 12:06:44.140625 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:44.140492    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0425ba9c-b8aa-4953-94e9-fef6dc6357c1" containerName="istio-proxy"
Sep 11 12:06:44.140625 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:44.140503    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d8dbc85-2683-4ec9-ac33-f53b8fb81e6b" containerName="revoke-keys"
Sep 11 12:06:44.140625 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:44.140512    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d8dbc85-2683-4ec9-ac33-f53b8fb81e6b" containerName="revoke-keys"
Sep 11 12:06:44.140625 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:44.140576    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d8dbc85-2683-4ec9-ac33-f53b8fb81e6b" containerName="revoke-keys"
Sep 11 12:06:44.140625 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:44.140588    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0425ba9c-b8aa-4953-94e9-fef6dc6357c1" containerName="istio-proxy"
Sep 11 12:06:44.145175 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:44.145148    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2c2847-p2tjt"
Sep 11 12:06:44.148841 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:44.148818    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:06:44.149183 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:44.148818    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r95fz\""
Sep 11 12:06:44.151234 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:44.151212    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2c2847-p2tjt"]
Sep 11 12:06:44.246275 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:44.246239    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f05241c-cf3d-48ab-835c-a19ca0a17617-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-2c2847-p2tjt\" (UID: \"8f05241c-cf3d-48ab-835c-a19ca0a17617\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2c2847-p2tjt"
Sep 11 12:06:44.347180 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:44.347144    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f05241c-cf3d-48ab-835c-a19ca0a17617-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-2c2847-p2tjt\" (UID: \"8f05241c-cf3d-48ab-835c-a19ca0a17617\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2c2847-p2tjt"
Sep 11 12:06:44.347789 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:44.347766    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f05241c-cf3d-48ab-835c-a19ca0a17617-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-2c2847-p2tjt\" (UID: \"8f05241c-cf3d-48ab-835c-a19ca0a17617\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2c2847-p2tjt"
Sep 11 12:06:44.458250 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:44.458154    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2c2847-p2tjt"
Sep 11 12:06:44.732154 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:44.732126    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2c2847-p2tjt"]
Sep 11 12:06:44.732708 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:06:44.732650    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f05241c_cf3d_48ab_835c_a19ca0a17617.slice/crio-46e2173a7be81da633f951af90d2ab6952ac498f2318e3a3753250fa6f687bd4 WatchSource:0}: Error finding container 46e2173a7be81da633f951af90d2ab6952ac498f2318e3a3753250fa6f687bd4: Status 404 returned error can't find the container with id 46e2173a7be81da633f951af90d2ab6952ac498f2318e3a3753250fa6f687bd4
Sep 11 12:06:44.801333 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:44.801294    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2c2847-p2tjt" event={"ID":"8f05241c-cf3d-48ab-835c-a19ca0a17617","Type":"ContainerStarted","Data":"46e2173a7be81da633f951af90d2ab6952ac498f2318e3a3753250fa6f687bd4"}
Sep 11 12:06:45.809329 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:45.809219    2565 generic.go:356] "Generic (PLEG): container finished" podID="8f05241c-cf3d-48ab-835c-a19ca0a17617" containerID="a64cf8a7d8ef7c959c4d6380d58d029b034340787e2eb6096affcc780c441f42" exitCode=0
Sep 11 12:06:45.809329 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:45.809296    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2c2847-p2tjt" event={"ID":"8f05241c-cf3d-48ab-835c-a19ca0a17617","Type":"ContainerDied","Data":"a64cf8a7d8ef7c959c4d6380d58d029b034340787e2eb6096affcc780c441f42"}
Sep 11 12:06:46.954930 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:46.954904    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2c2847-p2tjt"
Sep 11 12:06:47.073590 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:47.073506    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f05241c-cf3d-48ab-835c-a19ca0a17617-maas-api-service-ca\") pod \"8f05241c-cf3d-48ab-835c-a19ca0a17617\" (UID: \"8f05241c-cf3d-48ab-835c-a19ca0a17617\") "
Sep 11 12:06:47.073891 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:47.073868    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f05241c-cf3d-48ab-835c-a19ca0a17617-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8f05241c-cf3d-48ab-835c-a19ca0a17617" (UID: "8f05241c-cf3d-48ab-835c-a19ca0a17617"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:06:47.175043 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:47.175007    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f05241c-cf3d-48ab-835c-a19ca0a17617-maas-api-service-ca\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:06:47.822483 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:47.822452    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2c2847-p2tjt"
Sep 11 12:06:47.822655 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:47.822491    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2c2847-p2tjt" event={"ID":"8f05241c-cf3d-48ab-835c-a19ca0a17617","Type":"ContainerDied","Data":"46e2173a7be81da633f951af90d2ab6952ac498f2318e3a3753250fa6f687bd4"}
Sep 11 12:06:47.822655 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:47.822545    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="46e2173a7be81da633f951af90d2ab6952ac498f2318e3a3753250fa6f687bd4"
Sep 11 12:06:54.936129 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:54.936090    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2c2847-p2tjt"]
Sep 11 12:06:54.938671 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:54.938642    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-2c2847-p2tjt"]
Sep 11 12:06:56.844591 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:06:56.844559    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f05241c-cf3d-48ab-835c-a19ca0a17617" path="/var/lib/kubelet/pods/8f05241c-cf3d-48ab-835c-a19ca0a17617/volumes"
Sep 11 12:07:01.457121 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:01.457087    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"]
Sep 11 12:07:01.457600 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:01.457293    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2" podUID="341acf93-ad2c-4e56-bd38-09b10984f410" containerName="istio-proxy" containerID="cri-o://3ae60716b46d0360d8d3f3a247234bb2de81355598336f0ed4ea62366825dc2d" gracePeriod=30
Sep 11 12:07:02.175575 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.175535    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"]
Sep 11 12:07:02.176179 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.176159    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0425ba9c-b8aa-4953-94e9-fef6dc6357c1" containerName="istio-proxy"
Sep 11 12:07:02.176227 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.176184    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0425ba9c-b8aa-4953-94e9-fef6dc6357c1" containerName="istio-proxy"
Sep 11 12:07:02.176227 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.176196    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f05241c-cf3d-48ab-835c-a19ca0a17617" containerName="revoke-keys"
Sep 11 12:07:02.176227 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.176207    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f05241c-cf3d-48ab-835c-a19ca0a17617" containerName="revoke-keys"
Sep 11 12:07:02.176316 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.176294    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f05241c-cf3d-48ab-835c-a19ca0a17617" containerName="revoke-keys"
Sep 11 12:07:02.176316 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.176312    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0425ba9c-b8aa-4953-94e9-fef6dc6357c1" containerName="istio-proxy"
Sep 11 12:07:02.179934 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.179914    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.182799 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.182770    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-176ff0-openshift-default-dockercfg-v64st\""
Sep 11 12:07:02.191066 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.191041    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"]
Sep 11 12:07:02.322115 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.322072    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-workload-socket\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.322310 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.322135    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istio-data\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.322310 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.322166    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istio-token\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.322310 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.322191    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istiod-ca-cert\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.322310 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.322214    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-credential-socket\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.322310 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.322255    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istio-envoy\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.322310 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.322287    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istio-podinfo\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.322552 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.322329    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd4lz\" (UniqueName: \"kubernetes.io/projected/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-kube-api-access-bd4lz\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.322552 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.322408    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-workload-certs\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.423430 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.423385    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-workload-certs\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.423629 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.423445    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-workload-socket\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.423629 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.423484    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istio-data\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.423629 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.423505    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istio-token\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.423629 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.423528    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istiod-ca-cert\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.423629 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.423552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-credential-socket\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.423915 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.423714    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istio-envoy\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.423915 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.423761    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istio-podinfo\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.423915 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.423803    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd4lz\" (UniqueName: \"kubernetes.io/projected/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-kube-api-access-bd4lz\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.423915 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.423833    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-workload-certs\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.424121 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.424039    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istio-data\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.424121 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.424081    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-credential-socket\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.424208 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.424117    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-workload-socket\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.424519 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.424491    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istiod-ca-cert\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.426172 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.426113    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istio-envoy\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.426259 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.426230    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istio-podinfo\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.432412 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.432387    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd4lz\" (UniqueName: \"kubernetes.io/projected/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-kube-api-access-bd4lz\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.432504 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.432473    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istio-token\") pod \"e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") " pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.491833 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.491798    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:02.771254 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.771221    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"]
Sep 11 12:07:02.772637 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:07:02.772610    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e5d6eeb_3d6f_4f2e_925f_d4774f847d9c.slice/crio-2ca73d775aff57d9a287062db30f0a9278a8395eacb38e266c11793dfccde3e8 WatchSource:0}: Error finding container 2ca73d775aff57d9a287062db30f0a9278a8395eacb38e266c11793dfccde3e8: Status 404 returned error can't find the container with id 2ca73d775aff57d9a287062db30f0a9278a8395eacb38e266c11793dfccde3e8
Sep 11 12:07:02.775178 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.775134    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:07:02.775275 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.775211    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:07:02.775275 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.775241    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:07:02.929395 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.929357    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2" event={"ID":"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c","Type":"ContainerStarted","Data":"3051ba1c9428b0b95187bb5dd8104f2ba3539bb8ec63d776e602b7a25c7cdcd7"}
Sep 11 12:07:02.929583 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.929418    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2" event={"ID":"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c","Type":"ContainerStarted","Data":"2ca73d775aff57d9a287062db30f0a9278a8395eacb38e266c11793dfccde3e8"}
Sep 11 12:07:02.948098 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:02.948043    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2" podStartSLOduration=0.948026535 podStartE2EDuration="948.026535ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:07:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:07:02.947139873 +0000 UTC m=+936.629539396" watchObservedRunningTime="2026-09-11 12:07:02.948026535 +0000 UTC m=+936.630426093"
Sep 11 12:07:03.492896 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:03.492860    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:03.497818 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:03.497789    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:03.935787 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:03.935756    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:03.936654 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:03.936635    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:06.731292 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.731165    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:07:06.869057 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.869022    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-istio-envoy\") pod \"341acf93-ad2c-4e56-bd38-09b10984f410\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") "
Sep 11 12:07:06.869057 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.869062    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/341acf93-ad2c-4e56-bd38-09b10984f410-istio-token\") pod \"341acf93-ad2c-4e56-bd38-09b10984f410\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") "
Sep 11 12:07:06.869296 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.869096    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-workload-socket\") pod \"341acf93-ad2c-4e56-bd38-09b10984f410\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") "
Sep 11 12:07:06.869296 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.869122    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwwsk\" (UniqueName: \"kubernetes.io/projected/341acf93-ad2c-4e56-bd38-09b10984f410-kube-api-access-hwwsk\") pod \"341acf93-ad2c-4e56-bd38-09b10984f410\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") "
Sep 11 12:07:06.869296 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.869164    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-credential-socket\") pod \"341acf93-ad2c-4e56-bd38-09b10984f410\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") "
Sep 11 12:07:06.869296 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.869195    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/341acf93-ad2c-4e56-bd38-09b10984f410-istio-podinfo\") pod \"341acf93-ad2c-4e56-bd38-09b10984f410\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") "
Sep 11 12:07:06.869296 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.869230    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/341acf93-ad2c-4e56-bd38-09b10984f410-istiod-ca-cert\") pod \"341acf93-ad2c-4e56-bd38-09b10984f410\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") "
Sep 11 12:07:06.869296 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.869255    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-workload-certs\") pod \"341acf93-ad2c-4e56-bd38-09b10984f410\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") "
Sep 11 12:07:06.869296 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.869280    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-istio-data\") pod \"341acf93-ad2c-4e56-bd38-09b10984f410\" (UID: \"341acf93-ad2c-4e56-bd38-09b10984f410\") "
Sep 11 12:07:06.869664 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.869486    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "341acf93-ad2c-4e56-bd38-09b10984f410" (UID: "341acf93-ad2c-4e56-bd38-09b10984f410"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:07:06.869664 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.869500    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "341acf93-ad2c-4e56-bd38-09b10984f410" (UID: "341acf93-ad2c-4e56-bd38-09b10984f410"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:07:06.869664 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.869617    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-workload-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:07:06.869664 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.869634    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-credential-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:07:06.869664 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.869641    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "341acf93-ad2c-4e56-bd38-09b10984f410" (UID: "341acf93-ad2c-4e56-bd38-09b10984f410"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:07:06.869664 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.869656    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-istio-data" (OuterVolumeSpecName: "istio-data") pod "341acf93-ad2c-4e56-bd38-09b10984f410" (UID: "341acf93-ad2c-4e56-bd38-09b10984f410"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:07:06.870158 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.870129    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/341acf93-ad2c-4e56-bd38-09b10984f410-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "341acf93-ad2c-4e56-bd38-09b10984f410" (UID: "341acf93-ad2c-4e56-bd38-09b10984f410"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:07:06.871510 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.871484    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "341acf93-ad2c-4e56-bd38-09b10984f410" (UID: "341acf93-ad2c-4e56-bd38-09b10984f410"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:07:06.871761 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.871506    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/341acf93-ad2c-4e56-bd38-09b10984f410-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "341acf93-ad2c-4e56-bd38-09b10984f410" (UID: "341acf93-ad2c-4e56-bd38-09b10984f410"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:07:06.871761 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.871694    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/341acf93-ad2c-4e56-bd38-09b10984f410-istio-token" (OuterVolumeSpecName: "istio-token") pod "341acf93-ad2c-4e56-bd38-09b10984f410" (UID: "341acf93-ad2c-4e56-bd38-09b10984f410"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:07:06.871761 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.871671    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/341acf93-ad2c-4e56-bd38-09b10984f410-kube-api-access-hwwsk" (OuterVolumeSpecName: "kube-api-access-hwwsk") pod "341acf93-ad2c-4e56-bd38-09b10984f410" (UID: "341acf93-ad2c-4e56-bd38-09b10984f410"). InnerVolumeSpecName "kube-api-access-hwwsk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:07:06.960115 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.960080    2565 generic.go:356] "Generic (PLEG): container finished" podID="341acf93-ad2c-4e56-bd38-09b10984f410" containerID="3ae60716b46d0360d8d3f3a247234bb2de81355598336f0ed4ea62366825dc2d" exitCode=0
Sep 11 12:07:06.960307 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.960167    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"
Sep 11 12:07:06.960307 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.960181    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2" event={"ID":"341acf93-ad2c-4e56-bd38-09b10984f410","Type":"ContainerDied","Data":"3ae60716b46d0360d8d3f3a247234bb2de81355598336f0ed4ea62366825dc2d"}
Sep 11 12:07:06.960307 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.960245    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2" event={"ID":"341acf93-ad2c-4e56-bd38-09b10984f410","Type":"ContainerDied","Data":"ce5d0912c7a52f2f61c8b31cb53a734a088bc7060f7a8e1635497fac60eb4352"}
Sep 11 12:07:06.960307 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.960274    2565 scope.go:117] "RemoveContainer" containerID="3ae60716b46d0360d8d3f3a247234bb2de81355598336f0ed4ea62366825dc2d"
Sep 11 12:07:06.969895 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.969875    2565 scope.go:117] "RemoveContainer" containerID="e59b2c87510551ccb86e7a515076c2022eef22fa27b5aafb0e03556b6201caf6"
Sep 11 12:07:06.970278 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.970252    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/341acf93-ad2c-4e56-bd38-09b10984f410-istiod-ca-cert\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:07:06.970362 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.970282    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-workload-certs\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:07:06.970362 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.970296    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-istio-data\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:07:06.970362 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.970308    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/341acf93-ad2c-4e56-bd38-09b10984f410-istio-envoy\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:07:06.970362 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.970321    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/341acf93-ad2c-4e56-bd38-09b10984f410-istio-token\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:07:06.970362 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.970332    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwwsk\" (UniqueName: \"kubernetes.io/projected/341acf93-ad2c-4e56-bd38-09b10984f410-kube-api-access-hwwsk\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:07:06.970362 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.970345    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/341acf93-ad2c-4e56-bd38-09b10984f410-istio-podinfo\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:07:06.981097 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.981067    2565 scope.go:117] "RemoveContainer" containerID="3ae60716b46d0360d8d3f3a247234bb2de81355598336f0ed4ea62366825dc2d"
Sep 11 12:07:06.981413 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:07:06.981358    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ae60716b46d0360d8d3f3a247234bb2de81355598336f0ed4ea62366825dc2d\": container with ID starting with 3ae60716b46d0360d8d3f3a247234bb2de81355598336f0ed4ea62366825dc2d not found: ID does not exist" containerID="3ae60716b46d0360d8d3f3a247234bb2de81355598336f0ed4ea62366825dc2d"
Sep 11 12:07:06.981413 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.981393    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ae60716b46d0360d8d3f3a247234bb2de81355598336f0ed4ea62366825dc2d"} err="failed to get container status \"3ae60716b46d0360d8d3f3a247234bb2de81355598336f0ed4ea62366825dc2d\": rpc error: code = NotFound desc = could not find container \"3ae60716b46d0360d8d3f3a247234bb2de81355598336f0ed4ea62366825dc2d\": container with ID starting with 3ae60716b46d0360d8d3f3a247234bb2de81355598336f0ed4ea62366825dc2d not found: ID does not exist"
Sep 11 12:07:06.981413 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.981412    2565 scope.go:117] "RemoveContainer" containerID="e59b2c87510551ccb86e7a515076c2022eef22fa27b5aafb0e03556b6201caf6"
Sep 11 12:07:06.981719 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:07:06.981674    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e59b2c87510551ccb86e7a515076c2022eef22fa27b5aafb0e03556b6201caf6\": container with ID starting with e59b2c87510551ccb86e7a515076c2022eef22fa27b5aafb0e03556b6201caf6 not found: ID does not exist" containerID="e59b2c87510551ccb86e7a515076c2022eef22fa27b5aafb0e03556b6201caf6"
Sep 11 12:07:06.981796 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.981722    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e59b2c87510551ccb86e7a515076c2022eef22fa27b5aafb0e03556b6201caf6"} err="failed to get container status \"e59b2c87510551ccb86e7a515076c2022eef22fa27b5aafb0e03556b6201caf6\": rpc error: code = NotFound desc = could not find container \"e59b2c87510551ccb86e7a515076c2022eef22fa27b5aafb0e03556b6201caf6\": container with ID starting with e59b2c87510551ccb86e7a515076c2022eef22fa27b5aafb0e03556b6201caf6 not found: ID does not exist"
Sep 11 12:07:06.990303 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.990270    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"]
Sep 11 12:07:06.997469 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:06.997442    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-2c2847-openshift-default-68f79b9558-sknp2"]
Sep 11 12:07:08.843359 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:08.843323    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="341acf93-ad2c-4e56-bd38-09b10984f410" path="/var/lib/kubelet/pods/341acf93-ad2c-4e56-bd38-09b10984f410/volumes"
Sep 11 12:07:26.083932 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:26.083846    2565 generic.go:356] "Generic (PLEG): container finished" podID="6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c" containerID="3051ba1c9428b0b95187bb5dd8104f2ba3539bb8ec63d776e602b7a25c7cdcd7" exitCode=0
Sep 11 12:07:26.083932 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:26.083919    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2" event={"ID":"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c","Type":"ContainerDied","Data":"3051ba1c9428b0b95187bb5dd8104f2ba3539bb8ec63d776e602b7a25c7cdcd7"}
Sep 11 12:07:26.084375 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:26.084332    2565 scope.go:117] "RemoveContainer" containerID="3051ba1c9428b0b95187bb5dd8104f2ba3539bb8ec63d776e602b7a25c7cdcd7"
Sep 11 12:07:26.086738 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:26.086333    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:07:26.086738 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:26.086435    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:07:26.086738 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:26.086485    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:07:27.093878 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:27.093835    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2" event={"ID":"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c","Type":"ContainerStarted","Data":"de2c365407c3def5fc08ed0b4f7388f4024d6a2f01b1d551eab52a6f60e7cbbb"}
Sep 11 12:07:27.492779 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:27.492731    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:27.493083 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:27.493051    2565 patch_prober.go:28] interesting pod/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 12:07:27.493174 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:27.493117    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2" podUID="6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 12:07:28.492560 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:28.492518    2565 patch_prober.go:28] interesting pod/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 12:07:28.492987 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:28.492584    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2" podUID="6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 12:07:29.492749 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:29.492710    2565 patch_prober.go:28] interesting pod/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 12:07:29.493227 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:29.492777    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2" podUID="6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 12:07:30.492496 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:30.492459    2565 patch_prober.go:28] interesting pod/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 12:07:30.492714 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:30.492513    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2" podUID="6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 12:07:31.492807 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:31.492766    2565 patch_prober.go:28] interesting pod/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 12:07:31.493203 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:31.492845    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2" podUID="6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 12:07:32.496656 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:32.496620    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:32.497101 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:32.496895    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:07:32.497582 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:07:32.497559    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:08:02.808422 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:02.808337    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"]
Sep 11 12:08:02.808905 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:02.808856    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="341acf93-ad2c-4e56-bd38-09b10984f410" containerName="istio-proxy"
Sep 11 12:08:02.808905 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:02.808872    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="341acf93-ad2c-4e56-bd38-09b10984f410" containerName="istio-proxy"
Sep 11 12:08:02.808905 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:02.808883    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="341acf93-ad2c-4e56-bd38-09b10984f410" containerName="istio-proxy"
Sep 11 12:08:02.808905 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:02.808889    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="341acf93-ad2c-4e56-bd38-09b10984f410" containerName="istio-proxy"
Sep 11 12:08:02.809324 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:02.808955    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="341acf93-ad2c-4e56-bd38-09b10984f410" containerName="istio-proxy"
Sep 11 12:08:02.809324 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:02.808964    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="341acf93-ad2c-4e56-bd38-09b10984f410" containerName="istio-proxy"
Sep 11 12:08:02.812188 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:02.812168    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:02.815343 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:02.815320    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5e9d4e44-openshift-default-dockercfg-g85hb\""
Sep 11 12:08:02.825367 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:02.825339    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"]
Sep 11 12:08:02.911487 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:02.911433    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18d27223-0935-4a36-90b1-9b4f88615d2b-istio-token\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:02.911671 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:02.911494    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18d27223-0935-4a36-90b1-9b4f88615d2b-istio-podinfo\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:02.911671 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:02.911565    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-istio-envoy\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:02.911671 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:02.911598    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t97rb\" (UniqueName: \"kubernetes.io/projected/18d27223-0935-4a36-90b1-9b4f88615d2b-kube-api-access-t97rb\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:02.911671 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:02.911655    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18d27223-0935-4a36-90b1-9b4f88615d2b-istiod-ca-cert\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:02.911897 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:02.911724    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-credential-socket\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:02.911897 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:02.911749    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-workload-certs\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:02.911897 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:02.911791    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-workload-socket\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:02.911897 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:02.911826    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-istio-data\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:03.012702 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:03.012651    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-istio-envoy\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:03.012903 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:03.012737    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t97rb\" (UniqueName: \"kubernetes.io/projected/18d27223-0935-4a36-90b1-9b4f88615d2b-kube-api-access-t97rb\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:03.012903 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:03.012767    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18d27223-0935-4a36-90b1-9b4f88615d2b-istiod-ca-cert\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:03.012903 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:03.012801    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-credential-socket\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:03.013088 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:03.012934    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-workload-certs\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:03.013088 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:03.012993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-workload-socket\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:03.013088 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:03.013039    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-istio-data\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:03.013253 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:03.013096    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18d27223-0935-4a36-90b1-9b4f88615d2b-istio-token\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:03.013253 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:03.013119    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-credential-socket\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:03.013253 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:03.013134    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18d27223-0935-4a36-90b1-9b4f88615d2b-istio-podinfo\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:03.013400 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:03.013341    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-workload-certs\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:03.013400 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:03.013391    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-workload-socket\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:03.013512 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:03.013418    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-istio-data\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:03.013512 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:03.013489    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18d27223-0935-4a36-90b1-9b4f88615d2b-istiod-ca-cert\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:03.015066 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:03.015045    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-istio-envoy\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:03.015329 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:03.015312    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18d27223-0935-4a36-90b1-9b4f88615d2b-istio-podinfo\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:03.021276 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:03.021250    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18d27223-0935-4a36-90b1-9b4f88615d2b-istio-token\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:03.021815 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:03.021793    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t97rb\" (UniqueName: \"kubernetes.io/projected/18d27223-0935-4a36-90b1-9b4f88615d2b-kube-api-access-t97rb\") pod \"e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") " pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:03.125097 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:03.125003    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:03.407854 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:03.407822    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"]
Sep 11 12:08:03.409936 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:08:03.409903    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18d27223_0935_4a36_90b1_9b4f88615d2b.slice/crio-23fe1a8ce74ca9263a6dbccc4f875ede8b41c237d91f2ce7cec2423c025daa75 WatchSource:0}: Error finding container 23fe1a8ce74ca9263a6dbccc4f875ede8b41c237d91f2ce7cec2423c025daa75: Status 404 returned error can't find the container with id 23fe1a8ce74ca9263a6dbccc4f875ede8b41c237d91f2ce7cec2423c025daa75
Sep 11 12:08:03.412330 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:03.412300    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:08:03.412403 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:03.412373    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:08:03.412438 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:03.412402    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:08:04.319137 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:04.319046    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz" event={"ID":"18d27223-0935-4a36-90b1-9b4f88615d2b","Type":"ContainerStarted","Data":"07e501656f6a1cf49eaefbe0bb2f19ece988f4ed8da83f4a5ac2c981b9517a13"}
Sep 11 12:08:04.319137 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:04.319104    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz" event={"ID":"18d27223-0935-4a36-90b1-9b4f88615d2b","Type":"ContainerStarted","Data":"23fe1a8ce74ca9263a6dbccc4f875ede8b41c237d91f2ce7cec2423c025daa75"}
Sep 11 12:08:04.344670 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:04.344600    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz" podStartSLOduration=2.344577309 podStartE2EDuration="2.344577309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:08:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:08:04.340282015 +0000 UTC m=+998.022681510" watchObservedRunningTime="2026-09-11 12:08:04.344577309 +0000 UTC m=+998.026976814"
Sep 11 12:08:05.126087 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:05.126055    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:05.131451 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:05.131420    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:05.324768 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:05.324730    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:05.325635 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:05.325613    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:21.559595 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:21.559536    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-176ff0-vfm2t"]
Sep 11 12:08:21.564162 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:21.564134    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-176ff0-vfm2t"
Sep 11 12:08:21.574703 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:21.571093    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:08:21.576326 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:21.576287    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-176ff0-vfm2t"]
Sep 11 12:08:21.576612 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:21.576582    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r95fz\""
Sep 11 12:08:21.701503 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:21.701460    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97ff87be-ec7a-475b-924f-c66a1c000ad9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-176ff0-vfm2t\" (UID: \"97ff87be-ec7a-475b-924f-c66a1c000ad9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-176ff0-vfm2t"
Sep 11 12:08:21.802073 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:21.802029    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97ff87be-ec7a-475b-924f-c66a1c000ad9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-176ff0-vfm2t\" (UID: \"97ff87be-ec7a-475b-924f-c66a1c000ad9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-176ff0-vfm2t"
Sep 11 12:08:21.802672 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:21.802650    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97ff87be-ec7a-475b-924f-c66a1c000ad9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-176ff0-vfm2t\" (UID: \"97ff87be-ec7a-475b-924f-c66a1c000ad9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-176ff0-vfm2t"
Sep 11 12:08:21.890390 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:21.890361    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-176ff0-vfm2t"
Sep 11 12:08:22.193392 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:22.193353    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-176ff0-vfm2t"]
Sep 11 12:08:22.193987 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:08:22.193961    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97ff87be_ec7a_475b_924f_c66a1c000ad9.slice/crio-8ef395749ed9fdd5f9b797f7cff5f9856e3d562b38800295b1da5b07182bc312 WatchSource:0}: Error finding container 8ef395749ed9fdd5f9b797f7cff5f9856e3d562b38800295b1da5b07182bc312: Status 404 returned error can't find the container with id 8ef395749ed9fdd5f9b797f7cff5f9856e3d562b38800295b1da5b07182bc312
Sep 11 12:08:22.434912 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:22.434877    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-176ff0-vfm2t" event={"ID":"97ff87be-ec7a-475b-924f-c66a1c000ad9","Type":"ContainerStarted","Data":"8ef395749ed9fdd5f9b797f7cff5f9856e3d562b38800295b1da5b07182bc312"}
Sep 11 12:08:23.443710 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:23.443653    2565 generic.go:356] "Generic (PLEG): container finished" podID="97ff87be-ec7a-475b-924f-c66a1c000ad9" containerID="9569d2edb06b551d952d8768f0b4fc4423ac096664c707fcfcd2334eeb6a4ed1" exitCode=0
Sep 11 12:08:23.444094 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:23.443720    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-176ff0-vfm2t" event={"ID":"97ff87be-ec7a-475b-924f-c66a1c000ad9","Type":"ContainerDied","Data":"9569d2edb06b551d952d8768f0b4fc4423ac096664c707fcfcd2334eeb6a4ed1"}
Sep 11 12:08:24.586936 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:24.586910    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-176ff0-vfm2t"
Sep 11 12:08:24.734648 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:24.734551    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97ff87be-ec7a-475b-924f-c66a1c000ad9-maas-api-service-ca\") pod \"97ff87be-ec7a-475b-924f-c66a1c000ad9\" (UID: \"97ff87be-ec7a-475b-924f-c66a1c000ad9\") "
Sep 11 12:08:24.734979 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:24.734954    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97ff87be-ec7a-475b-924f-c66a1c000ad9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "97ff87be-ec7a-475b-924f-c66a1c000ad9" (UID: "97ff87be-ec7a-475b-924f-c66a1c000ad9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:08:24.835717 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:24.835659    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97ff87be-ec7a-475b-924f-c66a1c000ad9-maas-api-service-ca\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:08:25.462095 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:25.462064    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-176ff0-vfm2t"
Sep 11 12:08:25.475348 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:25.462099    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-176ff0-vfm2t" event={"ID":"97ff87be-ec7a-475b-924f-c66a1c000ad9","Type":"ContainerDied","Data":"8ef395749ed9fdd5f9b797f7cff5f9856e3d562b38800295b1da5b07182bc312"}
Sep 11 12:08:25.475348 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:25.462147    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ef395749ed9fdd5f9b797f7cff5f9856e3d562b38800295b1da5b07182bc312"
Sep 11 12:08:26.470185 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:26.470152    2565 generic.go:356] "Generic (PLEG): container finished" podID="18d27223-0935-4a36-90b1-9b4f88615d2b" containerID="07e501656f6a1cf49eaefbe0bb2f19ece988f4ed8da83f4a5ac2c981b9517a13" exitCode=0
Sep 11 12:08:26.470575 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:26.470221    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz" event={"ID":"18d27223-0935-4a36-90b1-9b4f88615d2b","Type":"ContainerDied","Data":"07e501656f6a1cf49eaefbe0bb2f19ece988f4ed8da83f4a5ac2c981b9517a13"}
Sep 11 12:08:26.470623 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:26.470605    2565 scope.go:117] "RemoveContainer" containerID="07e501656f6a1cf49eaefbe0bb2f19ece988f4ed8da83f4a5ac2c981b9517a13"
Sep 11 12:08:26.471691 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:26.471656    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:08:26.471757 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:26.471743    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:08:26.471795 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:26.471782    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:08:27.478250 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:27.478218    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz" event={"ID":"18d27223-0935-4a36-90b1-9b4f88615d2b","Type":"ContainerStarted","Data":"695bfb45edfc50703351ac0cf1a21fcfc805270b51dd49267e8c134d10d13153"}
Sep 11 12:08:28.125849 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:28.125808    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:28.126082 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:28.126058    2565 patch_prober.go:28] interesting pod/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 11 12:08:28.126140 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:28.126110    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz" podUID="18d27223-0935-4a36-90b1-9b4f88615d2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 11 12:08:29.125647 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:29.125610    2565 patch_prober.go:28] interesting pod/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 11 12:08:29.126054 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:29.125705    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz" podUID="18d27223-0935-4a36-90b1-9b4f88615d2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 11 12:08:30.130234 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:30.130200    2565 patch_prober.go:28] interesting pod/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 11 12:08:30.130718 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:30.130376    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz" podUID="18d27223-0935-4a36-90b1-9b4f88615d2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 11 12:08:31.126398 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:31.126359    2565 patch_prober.go:28] interesting pod/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 11 12:08:31.126574 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:31.126431    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz" podUID="18d27223-0935-4a36-90b1-9b4f88615d2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 11 12:08:32.125800 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:32.125762    2565 patch_prober.go:28] interesting pod/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 11 12:08:32.126184 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:32.125838    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz" podUID="18d27223-0935-4a36-90b1-9b4f88615d2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 11 12:08:32.748535 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:32.748494    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-176ff0-vfm2t"]
Sep 11 12:08:32.750892 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:32.750870    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-176ff0-vfm2t"]
Sep 11 12:08:32.844082 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:32.844044    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97ff87be-ec7a-475b-924f-c66a1c000ad9" path="/var/lib/kubelet/pods/97ff87be-ec7a-475b-924f-c66a1c000ad9/volumes"
Sep 11 12:08:33.130448 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:33.130359    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:33.130923 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:33.130713    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:33.131452 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:33.131434    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:08:38.449347 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:38.449301    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e9d4e44-8hx9r"]
Sep 11 12:08:38.449938 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:38.449914    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97ff87be-ec7a-475b-924f-c66a1c000ad9" containerName="revoke-keys"
Sep 11 12:08:38.450027 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:38.449940    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="97ff87be-ec7a-475b-924f-c66a1c000ad9" containerName="revoke-keys"
Sep 11 12:08:38.450086 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:38.450072    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="97ff87be-ec7a-475b-924f-c66a1c000ad9" containerName="revoke-keys"
Sep 11 12:08:38.454275 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:38.454251    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e9d4e44-8hx9r"
Sep 11 12:08:38.457412 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:38.457387    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:08:38.457558 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:38.457392    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r95fz\""
Sep 11 12:08:38.463219 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:38.463186    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e9d4e44-8hx9r"]
Sep 11 12:08:38.568814 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:38.568778    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc48ba01-80db-4b22-bf4e-0232cec19992-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5e9d4e44-8hx9r\" (UID: \"cc48ba01-80db-4b22-bf4e-0232cec19992\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e9d4e44-8hx9r"
Sep 11 12:08:38.669633 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:38.669588    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc48ba01-80db-4b22-bf4e-0232cec19992-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5e9d4e44-8hx9r\" (UID: \"cc48ba01-80db-4b22-bf4e-0232cec19992\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e9d4e44-8hx9r"
Sep 11 12:08:38.670284 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:38.670260    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc48ba01-80db-4b22-bf4e-0232cec19992-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5e9d4e44-8hx9r\" (UID: \"cc48ba01-80db-4b22-bf4e-0232cec19992\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e9d4e44-8hx9r"
Sep 11 12:08:38.768023 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:38.767925    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e9d4e44-8hx9r"
Sep 11 12:08:39.047390 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:08:39.047358    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc48ba01_80db_4b22_bf4e_0232cec19992.slice/crio-4dddb6108a85d3ef8b12bdcff621b26839eadf8f1d17ef3cc64d20d3b16607af WatchSource:0}: Error finding container 4dddb6108a85d3ef8b12bdcff621b26839eadf8f1d17ef3cc64d20d3b16607af: Status 404 returned error can't find the container with id 4dddb6108a85d3ef8b12bdcff621b26839eadf8f1d17ef3cc64d20d3b16607af
Sep 11 12:08:39.047390 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:39.047361    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e9d4e44-8hx9r"]
Sep 11 12:08:39.561477 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:39.561442    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e9d4e44-8hx9r" event={"ID":"cc48ba01-80db-4b22-bf4e-0232cec19992","Type":"ContainerStarted","Data":"5203e47433a80e3f94f9b13b9e3e05a961c5277de04172c178aedd29a4c50494"}
Sep 11 12:08:39.561889 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:39.561497    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e9d4e44-8hx9r" event={"ID":"cc48ba01-80db-4b22-bf4e-0232cec19992","Type":"ContainerStarted","Data":"4dddb6108a85d3ef8b12bdcff621b26839eadf8f1d17ef3cc64d20d3b16607af"}
Sep 11 12:08:39.579956 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:39.579908    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e9d4e44-8hx9r" podStartSLOduration=1.5798918450000001 podStartE2EDuration="1.579891845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:08:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:08:39.576992988 +0000 UTC m=+1033.259392487" watchObservedRunningTime="2026-09-11 12:08:39.579891845 +0000 UTC m=+1033.262291342"
Sep 11 12:08:40.425152 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:40.425109    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"]
Sep 11 12:08:40.425387 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:40.425363    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2" podUID="6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c" containerName="istio-proxy" containerID="cri-o://de2c365407c3def5fc08ed0b4f7388f4024d6a2f01b1d551eab52a6f60e7cbbb" gracePeriod=30
Sep 11 12:08:40.569313 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:40.569282    2565 generic.go:356] "Generic (PLEG): container finished" podID="cc48ba01-80db-4b22-bf4e-0232cec19992" containerID="5203e47433a80e3f94f9b13b9e3e05a961c5277de04172c178aedd29a4c50494" exitCode=0
Sep 11 12:08:40.569759 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:40.569372    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e9d4e44-8hx9r" event={"ID":"cc48ba01-80db-4b22-bf4e-0232cec19992","Type":"ContainerDied","Data":"5203e47433a80e3f94f9b13b9e3e05a961c5277de04172c178aedd29a4c50494"}
Sep 11 12:08:41.122058 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.122023    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"]
Sep 11 12:08:41.125721 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.125695    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.128335 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.128309    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-40847e-openshift-default-dockercfg-664sd\""
Sep 11 12:08:41.141892 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.141864    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"]
Sep 11 12:08:41.193522 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.193488    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ad14379-874b-4192-a52d-50157546866e-istiod-ca-cert\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.193751 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.193534    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-workload-certs\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.193751 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.193558    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-credential-socket\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.193751 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.193581    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ad14379-874b-4192-a52d-50157546866e-istio-podinfo\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.193751 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.193623    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpd48\" (UniqueName: \"kubernetes.io/projected/8ad14379-874b-4192-a52d-50157546866e-kube-api-access-jpd48\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.193751 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.193651    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-workload-socket\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.193751 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.193716    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-istio-envoy\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.193751 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.193753    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ad14379-874b-4192-a52d-50157546866e-istio-token\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.194088 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.193817    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-istio-data\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.294454 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.294416    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-istio-data\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.294647 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.294476    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ad14379-874b-4192-a52d-50157546866e-istiod-ca-cert\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.294647 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.294518    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-workload-certs\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.294647 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.294538    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-credential-socket\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.294647 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.294559    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ad14379-874b-4192-a52d-50157546866e-istio-podinfo\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.294909 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.294723    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpd48\" (UniqueName: \"kubernetes.io/projected/8ad14379-874b-4192-a52d-50157546866e-kube-api-access-jpd48\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.294909 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.294775    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-workload-socket\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.294909 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.294830    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-istio-envoy\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.294909 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.294874    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ad14379-874b-4192-a52d-50157546866e-istio-token\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.295126 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.294921    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-istio-data\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.295126 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.294979    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-workload-certs\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.295126 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.295035    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-credential-socket\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.295297 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.295197    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-workload-socket\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.295386 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.295366    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ad14379-874b-4192-a52d-50157546866e-istiod-ca-cert\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.297078 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.297048    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-istio-envoy\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.297194 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.297179    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ad14379-874b-4192-a52d-50157546866e-istio-podinfo\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.303833 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.303806    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ad14379-874b-4192-a52d-50157546866e-istio-token\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.303942 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.303868    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpd48\" (UniqueName: \"kubernetes.io/projected/8ad14379-874b-4192-a52d-50157546866e-kube-api-access-jpd48\") pod \"e2e-noten-40847e-openshift-default-57857fb7f6-gnknw\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") " pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.437375 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.437338    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:41.708410 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.708386    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e9d4e44-8hx9r"
Sep 11 12:08:41.719519 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.719494    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"]
Sep 11 12:08:41.720511 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:08:41.720491    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ad14379_874b_4192_a52d_50157546866e.slice/crio-9f65ff1a1a66f58c077853b019c9e4eae90dac40c2a9b782119dbd0f7a82e6ff WatchSource:0}: Error finding container 9f65ff1a1a66f58c077853b019c9e4eae90dac40c2a9b782119dbd0f7a82e6ff: Status 404 returned error can't find the container with id 9f65ff1a1a66f58c077853b019c9e4eae90dac40c2a9b782119dbd0f7a82e6ff
Sep 11 12:08:41.722775 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.722743    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:08:41.722838 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.722806    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:08:41.722878 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.722837    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:08:41.799378 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.799343    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc48ba01-80db-4b22-bf4e-0232cec19992-maas-api-service-ca\") pod \"cc48ba01-80db-4b22-bf4e-0232cec19992\" (UID: \"cc48ba01-80db-4b22-bf4e-0232cec19992\") "
Sep 11 12:08:41.799779 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.799757    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc48ba01-80db-4b22-bf4e-0232cec19992-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cc48ba01-80db-4b22-bf4e-0232cec19992" (UID: "cc48ba01-80db-4b22-bf4e-0232cec19992"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:08:41.900308 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:41.900271    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc48ba01-80db-4b22-bf4e-0232cec19992-maas-api-service-ca\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:08:42.590083 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:42.590048    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e9d4e44-8hx9r"
Sep 11 12:08:42.590083 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:42.590070    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e9d4e44-8hx9r" event={"ID":"cc48ba01-80db-4b22-bf4e-0232cec19992","Type":"ContainerDied","Data":"4dddb6108a85d3ef8b12bdcff621b26839eadf8f1d17ef3cc64d20d3b16607af"}
Sep 11 12:08:42.590310 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:42.590156    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4dddb6108a85d3ef8b12bdcff621b26839eadf8f1d17ef3cc64d20d3b16607af"
Sep 11 12:08:42.591910 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:42.591882    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw" event={"ID":"8ad14379-874b-4192-a52d-50157546866e","Type":"ContainerStarted","Data":"b435514d4b1eed55f685c6cea019cb10744ee89a38d0ce5aafab014b70f3410d"}
Sep 11 12:08:42.592036 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:42.591928    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw" event={"ID":"8ad14379-874b-4192-a52d-50157546866e","Type":"ContainerStarted","Data":"9f65ff1a1a66f58c077853b019c9e4eae90dac40c2a9b782119dbd0f7a82e6ff"}
Sep 11 12:08:42.617876 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:42.617821    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw" podStartSLOduration=1.617806334 podStartE2EDuration="1.617806334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:08:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:08:42.615646456 +0000 UTC m=+1036.298045953" watchObservedRunningTime="2026-09-11 12:08:42.617806334 +0000 UTC m=+1036.300205831"
Sep 11 12:08:43.438473 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:43.438434    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:43.444390 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:43.444356    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:43.598458 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:43.598425    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:43.599401 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:43.599378    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:08:45.611493 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.611463    2565 generic.go:356] "Generic (PLEG): container finished" podID="6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c" containerID="de2c365407c3def5fc08ed0b4f7388f4024d6a2f01b1d551eab52a6f60e7cbbb" exitCode=0
Sep 11 12:08:45.611877 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.611531    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2" event={"ID":"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c","Type":"ContainerDied","Data":"de2c365407c3def5fc08ed0b4f7388f4024d6a2f01b1d551eab52a6f60e7cbbb"}
Sep 11 12:08:45.611877 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.611598    2565 scope.go:117] "RemoveContainer" containerID="3051ba1c9428b0b95187bb5dd8104f2ba3539bb8ec63d776e602b7a25c7cdcd7"
Sep 11 12:08:45.689839 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.689780    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:08:45.736939 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.736907    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istio-token\") pod \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") "
Sep 11 12:08:45.737102 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.736945    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-workload-certs\") pod \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") "
Sep 11 12:08:45.737102 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.736965    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-credential-socket\") pod \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") "
Sep 11 12:08:45.737102 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.737003    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istio-podinfo\") pod \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") "
Sep 11 12:08:45.737292 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.737126    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istio-data\") pod \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") "
Sep 11 12:08:45.737292 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.737175    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istio-envoy\") pod \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") "
Sep 11 12:08:45.737292 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.737236    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bd4lz\" (UniqueName: \"kubernetes.io/projected/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-kube-api-access-bd4lz\") pod \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") "
Sep 11 12:08:45.737292 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.737239    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c" (UID: "6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:08:45.737292 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.737264    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-workload-socket\") pod \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") "
Sep 11 12:08:45.737565 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.737370    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c" (UID: "6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:08:45.737565 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.737383    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istiod-ca-cert\") pod \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\" (UID: \"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c\") "
Sep 11 12:08:45.737565 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.737393    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istio-data" (OuterVolumeSpecName: "istio-data") pod "6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c" (UID: "6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:08:45.737728 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.737597    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c" (UID: "6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:08:45.737803 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.737767    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c" (UID: "6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:08:45.737881 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.737853    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istio-data\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:08:45.737881 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.737876    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-workload-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:08:45.737992 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.737890    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istiod-ca-cert\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:08:45.737992 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.737916    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-workload-certs\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:08:45.737992 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.737937    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-credential-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:08:45.740083 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.740045    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-kube-api-access-bd4lz" (OuterVolumeSpecName: "kube-api-access-bd4lz") pod "6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c" (UID: "6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c"). InnerVolumeSpecName "kube-api-access-bd4lz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:08:45.740302 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.740275    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c" (UID: "6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:08:45.740379 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.740291    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c" (UID: "6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:08:45.740529 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.740502    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istio-token" (OuterVolumeSpecName: "istio-token") pod "6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c" (UID: "6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:08:45.839279 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.839244    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istio-token\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:08:45.839279 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.839275    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istio-podinfo\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:08:45.839279 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.839286    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-istio-envoy\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:08:45.839511 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:45.839299    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bd4lz\" (UniqueName: \"kubernetes.io/projected/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c-kube-api-access-bd4lz\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:08:46.619476 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:46.619446    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"
Sep 11 12:08:46.619476 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:46.619457    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2" event={"ID":"6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c","Type":"ContainerDied","Data":"2ca73d775aff57d9a287062db30f0a9278a8395eacb38e266c11793dfccde3e8"}
Sep 11 12:08:46.619980 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:46.619521    2565 scope.go:117] "RemoveContainer" containerID="de2c365407c3def5fc08ed0b4f7388f4024d6a2f01b1d551eab52a6f60e7cbbb"
Sep 11 12:08:46.642675 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:46.642642    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"]
Sep 11 12:08:46.647386 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:46.647356    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-176ff0-openshift-default-74cbc7cf5b-vhpf2"]
Sep 11 12:08:46.844887 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:46.844857    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c" path="/var/lib/kubelet/pods/6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c/volumes"
Sep 11 12:08:49.600404 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:49.600367    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e9d4e44-8hx9r"]
Sep 11 12:08:49.603028 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:49.603002    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5e9d4e44-8hx9r"]
Sep 11 12:08:50.843347 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:50.843303    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc48ba01-80db-4b22-bf4e-0232cec19992" path="/var/lib/kubelet/pods/cc48ba01-80db-4b22-bf4e-0232cec19992/volumes"
Sep 11 12:08:56.715964 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:56.715925    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"]
Sep 11 12:08:56.716396 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:56.716172    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz" podUID="18d27223-0935-4a36-90b1-9b4f88615d2b" containerName="istio-proxy" containerID="cri-o://695bfb45edfc50703351ac0cf1a21fcfc805270b51dd49267e8c134d10d13153" gracePeriod=30
Sep 11 12:08:58.355634 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:58.355596    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"]
Sep 11 12:08:58.356106 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:08:58.355912    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg" podUID="8e914ee1-7489-45ce-8a06-4afc671cdc39" containerName="istio-proxy" containerID="cri-o://fa509a1f38d7be1b7857526eced298535267cd92a75569e5cea3507b022b2436" gracePeriod=30
Sep 11 12:09:01.962255 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:01.962228    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:09:02.095528 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.095442    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18d27223-0935-4a36-90b1-9b4f88615d2b-istio-podinfo\") pod \"18d27223-0935-4a36-90b1-9b4f88615d2b\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") "
Sep 11 12:09:02.095528 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.095479    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t97rb\" (UniqueName: \"kubernetes.io/projected/18d27223-0935-4a36-90b1-9b4f88615d2b-kube-api-access-t97rb\") pod \"18d27223-0935-4a36-90b1-9b4f88615d2b\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") "
Sep 11 12:09:02.095528 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.095531    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-istio-envoy\") pod \"18d27223-0935-4a36-90b1-9b4f88615d2b\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") "
Sep 11 12:09:02.095808 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.095633    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-credential-socket\") pod \"18d27223-0935-4a36-90b1-9b4f88615d2b\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") "
Sep 11 12:09:02.095808 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.095730    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-workload-socket\") pod \"18d27223-0935-4a36-90b1-9b4f88615d2b\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") "
Sep 11 12:09:02.095808 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.095776    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18d27223-0935-4a36-90b1-9b4f88615d2b-istio-token\") pod \"18d27223-0935-4a36-90b1-9b4f88615d2b\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") "
Sep 11 12:09:02.095808 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.095802    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-istio-data\") pod \"18d27223-0935-4a36-90b1-9b4f88615d2b\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") "
Sep 11 12:09:02.096011 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.095832    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18d27223-0935-4a36-90b1-9b4f88615d2b-istiod-ca-cert\") pod \"18d27223-0935-4a36-90b1-9b4f88615d2b\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") "
Sep 11 12:09:02.096011 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.095895    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-workload-certs\") pod \"18d27223-0935-4a36-90b1-9b4f88615d2b\" (UID: \"18d27223-0935-4a36-90b1-9b4f88615d2b\") "
Sep 11 12:09:02.096011 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.095948    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "18d27223-0935-4a36-90b1-9b4f88615d2b" (UID: "18d27223-0935-4a36-90b1-9b4f88615d2b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:09:02.096257 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.096110    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-istio-data" (OuterVolumeSpecName: "istio-data") pod "18d27223-0935-4a36-90b1-9b4f88615d2b" (UID: "18d27223-0935-4a36-90b1-9b4f88615d2b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:09:02.096319 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.096272    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18d27223-0935-4a36-90b1-9b4f88615d2b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "18d27223-0935-4a36-90b1-9b4f88615d2b" (UID: "18d27223-0935-4a36-90b1-9b4f88615d2b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:09:02.096319 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.096294    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-istio-data\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:02.096319 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.096313    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-credential-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:02.096481 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.096328    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "18d27223-0935-4a36-90b1-9b4f88615d2b" (UID: "18d27223-0935-4a36-90b1-9b4f88615d2b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:09:02.096481 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.096384    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "18d27223-0935-4a36-90b1-9b4f88615d2b" (UID: "18d27223-0935-4a36-90b1-9b4f88615d2b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:09:02.097842 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.097817    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18d27223-0935-4a36-90b1-9b4f88615d2b-kube-api-access-t97rb" (OuterVolumeSpecName: "kube-api-access-t97rb") pod "18d27223-0935-4a36-90b1-9b4f88615d2b" (UID: "18d27223-0935-4a36-90b1-9b4f88615d2b"). InnerVolumeSpecName "kube-api-access-t97rb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:09:02.097988 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.097962    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18d27223-0935-4a36-90b1-9b4f88615d2b-istio-token" (OuterVolumeSpecName: "istio-token") pod "18d27223-0935-4a36-90b1-9b4f88615d2b" (UID: "18d27223-0935-4a36-90b1-9b4f88615d2b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:09:02.098130 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.098104    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "18d27223-0935-4a36-90b1-9b4f88615d2b" (UID: "18d27223-0935-4a36-90b1-9b4f88615d2b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:09:02.098130 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.098104    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/18d27223-0935-4a36-90b1-9b4f88615d2b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "18d27223-0935-4a36-90b1-9b4f88615d2b" (UID: "18d27223-0935-4a36-90b1-9b4f88615d2b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:09:02.196997 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.196964    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18d27223-0935-4a36-90b1-9b4f88615d2b-istio-podinfo\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:02.196997 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.196992    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t97rb\" (UniqueName: \"kubernetes.io/projected/18d27223-0935-4a36-90b1-9b4f88615d2b-kube-api-access-t97rb\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:02.196997 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.197003    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-istio-envoy\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:02.197228 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.197013    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-workload-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:02.197228 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.197022    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18d27223-0935-4a36-90b1-9b4f88615d2b-istio-token\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:02.197228 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.197030    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18d27223-0935-4a36-90b1-9b4f88615d2b-istiod-ca-cert\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:02.197228 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.197038    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18d27223-0935-4a36-90b1-9b4f88615d2b-workload-certs\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:02.731157 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.731121    2565 generic.go:356] "Generic (PLEG): container finished" podID="18d27223-0935-4a36-90b1-9b4f88615d2b" containerID="695bfb45edfc50703351ac0cf1a21fcfc805270b51dd49267e8c134d10d13153" exitCode=0
Sep 11 12:09:02.731334 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.731168    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"
Sep 11 12:09:02.731334 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.731209    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz" event={"ID":"18d27223-0935-4a36-90b1-9b4f88615d2b","Type":"ContainerDied","Data":"695bfb45edfc50703351ac0cf1a21fcfc805270b51dd49267e8c134d10d13153"}
Sep 11 12:09:02.731334 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.731264    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz" event={"ID":"18d27223-0935-4a36-90b1-9b4f88615d2b","Type":"ContainerDied","Data":"23fe1a8ce74ca9263a6dbccc4f875ede8b41c237d91f2ce7cec2423c025daa75"}
Sep 11 12:09:02.731334 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.731287    2565 scope.go:117] "RemoveContainer" containerID="695bfb45edfc50703351ac0cf1a21fcfc805270b51dd49267e8c134d10d13153"
Sep 11 12:09:02.742658 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.742633    2565 scope.go:117] "RemoveContainer" containerID="07e501656f6a1cf49eaefbe0bb2f19ece988f4ed8da83f4a5ac2c981b9517a13"
Sep 11 12:09:02.751946 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.751924    2565 scope.go:117] "RemoveContainer" containerID="695bfb45edfc50703351ac0cf1a21fcfc805270b51dd49267e8c134d10d13153"
Sep 11 12:09:02.752357 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:09:02.752333    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"695bfb45edfc50703351ac0cf1a21fcfc805270b51dd49267e8c134d10d13153\": container with ID starting with 695bfb45edfc50703351ac0cf1a21fcfc805270b51dd49267e8c134d10d13153 not found: ID does not exist" containerID="695bfb45edfc50703351ac0cf1a21fcfc805270b51dd49267e8c134d10d13153"
Sep 11 12:09:02.752465 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.752377    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"695bfb45edfc50703351ac0cf1a21fcfc805270b51dd49267e8c134d10d13153"} err="failed to get container status \"695bfb45edfc50703351ac0cf1a21fcfc805270b51dd49267e8c134d10d13153\": rpc error: code = NotFound desc = could not find container \"695bfb45edfc50703351ac0cf1a21fcfc805270b51dd49267e8c134d10d13153\": container with ID starting with 695bfb45edfc50703351ac0cf1a21fcfc805270b51dd49267e8c134d10d13153 not found: ID does not exist"
Sep 11 12:09:02.752465 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.752404    2565 scope.go:117] "RemoveContainer" containerID="07e501656f6a1cf49eaefbe0bb2f19ece988f4ed8da83f4a5ac2c981b9517a13"
Sep 11 12:09:02.752822 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:09:02.752798    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07e501656f6a1cf49eaefbe0bb2f19ece988f4ed8da83f4a5ac2c981b9517a13\": container with ID starting with 07e501656f6a1cf49eaefbe0bb2f19ece988f4ed8da83f4a5ac2c981b9517a13 not found: ID does not exist" containerID="07e501656f6a1cf49eaefbe0bb2f19ece988f4ed8da83f4a5ac2c981b9517a13"
Sep 11 12:09:02.752927 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.752832    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07e501656f6a1cf49eaefbe0bb2f19ece988f4ed8da83f4a5ac2c981b9517a13"} err="failed to get container status \"07e501656f6a1cf49eaefbe0bb2f19ece988f4ed8da83f4a5ac2c981b9517a13\": rpc error: code = NotFound desc = could not find container \"07e501656f6a1cf49eaefbe0bb2f19ece988f4ed8da83f4a5ac2c981b9517a13\": container with ID starting with 07e501656f6a1cf49eaefbe0bb2f19ece988f4ed8da83f4a5ac2c981b9517a13 not found: ID does not exist"
Sep 11 12:09:02.755113 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.755092    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"]
Sep 11 12:09:02.758835 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.758810    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5e9d4e44-openshift-default-8445c9957b-6z7dz"]
Sep 11 12:09:02.843859 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:02.843827    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18d27223-0935-4a36-90b1-9b4f88615d2b" path="/var/lib/kubelet/pods/18d27223-0935-4a36-90b1-9b4f88615d2b/volumes"
Sep 11 12:09:03.603501 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.603474    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:09:03.710475 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.710431    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-istio-envoy\") pod \"8e914ee1-7489-45ce-8a06-4afc671cdc39\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") "
Sep 11 12:09:03.710650 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.710494    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e914ee1-7489-45ce-8a06-4afc671cdc39-istio-token\") pod \"8e914ee1-7489-45ce-8a06-4afc671cdc39\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") "
Sep 11 12:09:03.710650 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.710532    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e914ee1-7489-45ce-8a06-4afc671cdc39-istio-podinfo\") pod \"8e914ee1-7489-45ce-8a06-4afc671cdc39\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") "
Sep 11 12:09:03.710650 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.710576    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-istio-data\") pod \"8e914ee1-7489-45ce-8a06-4afc671cdc39\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") "
Sep 11 12:09:03.710823 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.710764    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbwkj\" (UniqueName: \"kubernetes.io/projected/8e914ee1-7489-45ce-8a06-4afc671cdc39-kube-api-access-dbwkj\") pod \"8e914ee1-7489-45ce-8a06-4afc671cdc39\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") "
Sep 11 12:09:03.710913 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.710887    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-istio-data" (OuterVolumeSpecName: "istio-data") pod "8e914ee1-7489-45ce-8a06-4afc671cdc39" (UID: "8e914ee1-7489-45ce-8a06-4afc671cdc39"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:09:03.710982 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.710932    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-workload-socket\") pod \"8e914ee1-7489-45ce-8a06-4afc671cdc39\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") "
Sep 11 12:09:03.711062 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.711039    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-credential-socket\") pod \"8e914ee1-7489-45ce-8a06-4afc671cdc39\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") "
Sep 11 12:09:03.711122 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.711080    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e914ee1-7489-45ce-8a06-4afc671cdc39-istiod-ca-cert\") pod \"8e914ee1-7489-45ce-8a06-4afc671cdc39\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") "
Sep 11 12:09:03.711174 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.711121    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-workload-certs\") pod \"8e914ee1-7489-45ce-8a06-4afc671cdc39\" (UID: \"8e914ee1-7489-45ce-8a06-4afc671cdc39\") "
Sep 11 12:09:03.711225 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.711162    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8e914ee1-7489-45ce-8a06-4afc671cdc39" (UID: "8e914ee1-7489-45ce-8a06-4afc671cdc39"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:09:03.711516 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.711450    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-istio-data\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:03.711516 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.711476    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-workload-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:03.711516 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.711481    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8e914ee1-7489-45ce-8a06-4afc671cdc39" (UID: "8e914ee1-7489-45ce-8a06-4afc671cdc39"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:09:03.711516 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.711503    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e914ee1-7489-45ce-8a06-4afc671cdc39-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8e914ee1-7489-45ce-8a06-4afc671cdc39" (UID: "8e914ee1-7489-45ce-8a06-4afc671cdc39"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:09:03.711516 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.711500    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8e914ee1-7489-45ce-8a06-4afc671cdc39" (UID: "8e914ee1-7489-45ce-8a06-4afc671cdc39"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:09:03.712891 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.712870    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8e914ee1-7489-45ce-8a06-4afc671cdc39-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8e914ee1-7489-45ce-8a06-4afc671cdc39" (UID: "8e914ee1-7489-45ce-8a06-4afc671cdc39"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:09:03.713000 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.712921    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e914ee1-7489-45ce-8a06-4afc671cdc39-kube-api-access-dbwkj" (OuterVolumeSpecName: "kube-api-access-dbwkj") pod "8e914ee1-7489-45ce-8a06-4afc671cdc39" (UID: "8e914ee1-7489-45ce-8a06-4afc671cdc39"). InnerVolumeSpecName "kube-api-access-dbwkj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:09:03.713072 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.713057    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8e914ee1-7489-45ce-8a06-4afc671cdc39" (UID: "8e914ee1-7489-45ce-8a06-4afc671cdc39"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:09:03.713203 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.713184    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e914ee1-7489-45ce-8a06-4afc671cdc39-istio-token" (OuterVolumeSpecName: "istio-token") pod "8e914ee1-7489-45ce-8a06-4afc671cdc39" (UID: "8e914ee1-7489-45ce-8a06-4afc671cdc39"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:09:03.739593 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.739563    2565 generic.go:356] "Generic (PLEG): container finished" podID="8e914ee1-7489-45ce-8a06-4afc671cdc39" containerID="fa509a1f38d7be1b7857526eced298535267cd92a75569e5cea3507b022b2436" exitCode=0
Sep 11 12:09:03.739827 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.739613    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"
Sep 11 12:09:03.739827 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.739644    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg" event={"ID":"8e914ee1-7489-45ce-8a06-4afc671cdc39","Type":"ContainerDied","Data":"fa509a1f38d7be1b7857526eced298535267cd92a75569e5cea3507b022b2436"}
Sep 11 12:09:03.739827 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.739762    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg" event={"ID":"8e914ee1-7489-45ce-8a06-4afc671cdc39","Type":"ContainerDied","Data":"6218f0db2d592927522af64c02d777c79e15b1a61e601acbb42737caa5ff4295"}
Sep 11 12:09:03.739827 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.739795    2565 scope.go:117] "RemoveContainer" containerID="fa509a1f38d7be1b7857526eced298535267cd92a75569e5cea3507b022b2436"
Sep 11 12:09:03.750527 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.750509    2565 scope.go:117] "RemoveContainer" containerID="5168217b24e2774892a4c5e852264afb3ac8e3867ca4c4054c299ec6bdc56e1f"
Sep 11 12:09:03.759463 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.759444    2565 scope.go:117] "RemoveContainer" containerID="fa509a1f38d7be1b7857526eced298535267cd92a75569e5cea3507b022b2436"
Sep 11 12:09:03.759788 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:09:03.759767    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa509a1f38d7be1b7857526eced298535267cd92a75569e5cea3507b022b2436\": container with ID starting with fa509a1f38d7be1b7857526eced298535267cd92a75569e5cea3507b022b2436 not found: ID does not exist" containerID="fa509a1f38d7be1b7857526eced298535267cd92a75569e5cea3507b022b2436"
Sep 11 12:09:03.759849 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.759796    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa509a1f38d7be1b7857526eced298535267cd92a75569e5cea3507b022b2436"} err="failed to get container status \"fa509a1f38d7be1b7857526eced298535267cd92a75569e5cea3507b022b2436\": rpc error: code = NotFound desc = could not find container \"fa509a1f38d7be1b7857526eced298535267cd92a75569e5cea3507b022b2436\": container with ID starting with fa509a1f38d7be1b7857526eced298535267cd92a75569e5cea3507b022b2436 not found: ID does not exist"
Sep 11 12:09:03.759849 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.759815    2565 scope.go:117] "RemoveContainer" containerID="5168217b24e2774892a4c5e852264afb3ac8e3867ca4c4054c299ec6bdc56e1f"
Sep 11 12:09:03.760067 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:09:03.760048    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5168217b24e2774892a4c5e852264afb3ac8e3867ca4c4054c299ec6bdc56e1f\": container with ID starting with 5168217b24e2774892a4c5e852264afb3ac8e3867ca4c4054c299ec6bdc56e1f not found: ID does not exist" containerID="5168217b24e2774892a4c5e852264afb3ac8e3867ca4c4054c299ec6bdc56e1f"
Sep 11 12:09:03.760114 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.760072    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5168217b24e2774892a4c5e852264afb3ac8e3867ca4c4054c299ec6bdc56e1f"} err="failed to get container status \"5168217b24e2774892a4c5e852264afb3ac8e3867ca4c4054c299ec6bdc56e1f\": rpc error: code = NotFound desc = could not find container \"5168217b24e2774892a4c5e852264afb3ac8e3867ca4c4054c299ec6bdc56e1f\": container with ID starting with 5168217b24e2774892a4c5e852264afb3ac8e3867ca4c4054c299ec6bdc56e1f not found: ID does not exist"
Sep 11 12:09:03.768050 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.768028    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"]
Sep 11 12:09:03.773477 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.773451    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-34511f-openshift-default-84cf4d6458-52kwg"]
Sep 11 12:09:03.812163 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.812140    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbwkj\" (UniqueName: \"kubernetes.io/projected/8e914ee1-7489-45ce-8a06-4afc671cdc39-kube-api-access-dbwkj\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:03.812163 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.812160    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-credential-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:03.812320 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.812171    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e914ee1-7489-45ce-8a06-4afc671cdc39-istiod-ca-cert\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:03.812320 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.812180    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-workload-certs\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:03.812320 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.812187    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e914ee1-7489-45ce-8a06-4afc671cdc39-istio-envoy\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:03.812320 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.812196    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e914ee1-7489-45ce-8a06-4afc671cdc39-istio-token\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:03.812320 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:03.812203    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e914ee1-7489-45ce-8a06-4afc671cdc39-istio-podinfo\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:04.843571 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:04.843534    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e914ee1-7489-45ce-8a06-4afc671cdc39" path="/var/lib/kubelet/pods/8e914ee1-7489-45ce-8a06-4afc671cdc39/volumes"
Sep 11 12:09:10.327328 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.327294    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"]
Sep 11 12:09:10.327881 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.327861    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18d27223-0935-4a36-90b1-9b4f88615d2b" containerName="istio-proxy"
Sep 11 12:09:10.327982 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.327884    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="18d27223-0935-4a36-90b1-9b4f88615d2b" containerName="istio-proxy"
Sep 11 12:09:10.327982 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.327898    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c" containerName="istio-proxy"
Sep 11 12:09:10.327982 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.327906    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c" containerName="istio-proxy"
Sep 11 12:09:10.327982 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.327916    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18d27223-0935-4a36-90b1-9b4f88615d2b" containerName="istio-proxy"
Sep 11 12:09:10.327982 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.327924    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="18d27223-0935-4a36-90b1-9b4f88615d2b" containerName="istio-proxy"
Sep 11 12:09:10.327982 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.327943    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e914ee1-7489-45ce-8a06-4afc671cdc39" containerName="istio-proxy"
Sep 11 12:09:10.327982 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.327953    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e914ee1-7489-45ce-8a06-4afc671cdc39" containerName="istio-proxy"
Sep 11 12:09:10.327982 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.327962    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e914ee1-7489-45ce-8a06-4afc671cdc39" containerName="istio-proxy"
Sep 11 12:09:10.327982 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.327970    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e914ee1-7489-45ce-8a06-4afc671cdc39" containerName="istio-proxy"
Sep 11 12:09:10.327982 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.327979    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc48ba01-80db-4b22-bf4e-0232cec19992" containerName="revoke-keys"
Sep 11 12:09:10.328537 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.327987    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc48ba01-80db-4b22-bf4e-0232cec19992" containerName="revoke-keys"
Sep 11 12:09:10.328537 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.328103    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e914ee1-7489-45ce-8a06-4afc671cdc39" containerName="istio-proxy"
Sep 11 12:09:10.328537 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.328116    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c" containerName="istio-proxy"
Sep 11 12:09:10.328537 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.328124    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc48ba01-80db-4b22-bf4e-0232cec19992" containerName="revoke-keys"
Sep 11 12:09:10.328537 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.328135    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="18d27223-0935-4a36-90b1-9b4f88615d2b" containerName="istio-proxy"
Sep 11 12:09:10.328537 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.328143    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="18d27223-0935-4a36-90b1-9b4f88615d2b" containerName="istio-proxy"
Sep 11 12:09:10.332830 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.332808    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.338454 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.338433    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-c000cf-openshift-default-dockercfg-dc442\""
Sep 11 12:09:10.348227 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.348203    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"]
Sep 11 12:09:10.478277 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.478232    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istio-data\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.478452 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.478291    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istiod-ca-cert\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.478452 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.478341    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istio-podinfo\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.478452 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.478411    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istio-token\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.478452 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.478443    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istio-envoy\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.478588 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.478473    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-credential-socket\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.478588 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.478517    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-workload-socket\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.478588 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.478545    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-629t8\" (UniqueName: \"kubernetes.io/projected/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-kube-api-access-629t8\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.478588 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.478578    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-workload-certs\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.580029 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.579941    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istiod-ca-cert\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.580029 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.579993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istio-podinfo\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.580221 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.580033    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istio-token\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.580221 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.580050    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istio-envoy\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.580221 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.580070    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-credential-socket\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.580336 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.580217    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-workload-socket\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.580336 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.580268    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-629t8\" (UniqueName: \"kubernetes.io/projected/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-kube-api-access-629t8\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.580336 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.580325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-workload-certs\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.580477 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.580401    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istio-data\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.580607 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.580573    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-credential-socket\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.580733 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.580622    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-workload-socket\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.580820 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.580746    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istio-data\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.580820 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.580796    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istiod-ca-cert\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.580918 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.580882    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-workload-certs\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.582441 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.582417    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istio-envoy\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.582614 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.582593    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istio-podinfo\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.597077 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.597053    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istio-token\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.601647 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.601629    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-629t8\" (UniqueName: \"kubernetes.io/projected/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-kube-api-access-629t8\") pod \"e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") " pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.646606 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.646577    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:10.925440 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.925409    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"]
Sep 11 12:09:10.927036 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:09:10.927011    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d1bb7c4_9f7a_4b17_bf9b_0c5bc0f28cd5.slice/crio-64835c2d2b16ebdc61f029594b5c94dc20b4ca22663a72d11da9531b9a40ad3e WatchSource:0}: Error finding container 64835c2d2b16ebdc61f029594b5c94dc20b4ca22663a72d11da9531b9a40ad3e: Status 404 returned error can't find the container with id 64835c2d2b16ebdc61f029594b5c94dc20b4ca22663a72d11da9531b9a40ad3e
Sep 11 12:09:10.929130 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.929097    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:09:10.929225 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.929162    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:09:10.929225 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:10.929191    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:09:11.800424 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:11.800379    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm" event={"ID":"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5","Type":"ContainerStarted","Data":"e6ddd9469ea33c0f6c44bf116d6abdb06632898359f90ee5ffb68c48c921f9a0"}
Sep 11 12:09:11.800912 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:11.800439    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm" event={"ID":"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5","Type":"ContainerStarted","Data":"64835c2d2b16ebdc61f029594b5c94dc20b4ca22663a72d11da9531b9a40ad3e"}
Sep 11 12:09:11.823206 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:11.823147    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm" podStartSLOduration=1.823130249 podStartE2EDuration="1.823130249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:09:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:09:11.821068879 +0000 UTC m=+1065.503468374" watchObservedRunningTime="2026-09-11 12:09:11.823130249 +0000 UTC m=+1065.505529746"
Sep 11 12:09:12.647284 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:12.647249    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:12.652258 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:12.652236    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:12.806287 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:12.806245    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:12.807127 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:12.807107    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:16.771998 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:16.771963    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"]
Sep 11 12:09:16.772453 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:16.772243    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4" podUID="a71357a7-4f9a-4315-908f-f74ba755eba4" containerName="istio-proxy" containerID="cri-o://033f9ff0f0aeb4ce6911a230caf4331b1f6d4e5445ca97ed5fae1b3ae75f3bc1" gracePeriod=30
Sep 11 12:09:17.626009 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.625970    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"]
Sep 11 12:09:17.626471 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.626442    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c" containerName="istio-proxy"
Sep 11 12:09:17.626471 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.626465    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c" containerName="istio-proxy"
Sep 11 12:09:17.626676 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.626563    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e914ee1-7489-45ce-8a06-4afc671cdc39" containerName="istio-proxy"
Sep 11 12:09:17.626676 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.626575    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e5d6eeb-3d6f-4f2e-925f-d4774f847d9c" containerName="istio-proxy"
Sep 11 12:09:17.630143 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.630119    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.632872 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.632849    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-88968d-openshift-default-dockercfg-lh9qt\""
Sep 11 12:09:17.643728 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.643672    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istio-envoy\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.643854 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.643741    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf6kx\" (UniqueName: \"kubernetes.io/projected/5be27b9b-c449-4e8b-ba1e-f034046f4b44-kube-api-access-qf6kx\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.643854 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.643770    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istiod-ca-cert\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.643854 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.643801    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istio-token\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.643854 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.643827    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-credential-socket\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.644053 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.643857    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-workload-socket\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.644053 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.643932    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-workload-certs\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.644053 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.643960    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istio-podinfo\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.644235 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.644125    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istio-data\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.647518 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.647493    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"]
Sep 11 12:09:17.745704 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.745648    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istio-data\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.746425 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.746401    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istio-envoy\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.746961 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.746941    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf6kx\" (UniqueName: \"kubernetes.io/projected/5be27b9b-c449-4e8b-ba1e-f034046f4b44-kube-api-access-qf6kx\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.747440 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.747418    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istiod-ca-cert\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.748257 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.748236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istio-token\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.748400 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.748384    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-credential-socket\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.748508 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.748491    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-workload-socket\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.748708 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.748673    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-workload-certs\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.748841 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.748824    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istio-podinfo\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.749364 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.748188    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istiod-ca-cert\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.749486 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.746322    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istio-data\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.749798 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.749756    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-workload-socket\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.750015 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.749994    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-credential-socket\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.750359 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.750336    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-workload-certs\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.753177 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.753149    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istio-podinfo\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.755128 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.755103    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istio-envoy\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.757353 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.757326    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf6kx\" (UniqueName: \"kubernetes.io/projected/5be27b9b-c449-4e8b-ba1e-f034046f4b44-kube-api-access-qf6kx\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.757662 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.757643    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istio-token\") pod \"e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") " pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:17.943545 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:17.943506    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:18.225512 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:18.225482    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"]
Sep 11 12:09:18.226548 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:09:18.226514    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5be27b9b_c449_4e8b_ba1e_f034046f4b44.slice/crio-fec35598da0eca7bc64e5b57ea541c06338a65f034470840c540736c89e2951f WatchSource:0}: Error finding container fec35598da0eca7bc64e5b57ea541c06338a65f034470840c540736c89e2951f: Status 404 returned error can't find the container with id fec35598da0eca7bc64e5b57ea541c06338a65f034470840c540736c89e2951f
Sep 11 12:09:18.228869 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:18.228837    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:09:18.228943 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:18.228900    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:09:18.228943 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:18.228929    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:09:18.845379 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:18.845329    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt" event={"ID":"5be27b9b-c449-4e8b-ba1e-f034046f4b44","Type":"ContainerStarted","Data":"c2fd29e5bda739c67d823e5a1c7b6cccf06ba5f518f27edca370a2d3ef2d2f76"}
Sep 11 12:09:18.845379 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:18.845395    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt" event={"ID":"5be27b9b-c449-4e8b-ba1e-f034046f4b44","Type":"ContainerStarted","Data":"fec35598da0eca7bc64e5b57ea541c06338a65f034470840c540736c89e2951f"}
Sep 11 12:09:18.867386 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:18.867330    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt" podStartSLOduration=1.867315098 podStartE2EDuration="1.867315098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:09:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:09:18.865557659 +0000 UTC m=+1072.547957155" watchObservedRunningTime="2026-09-11 12:09:18.867315098 +0000 UTC m=+1072.549714596"
Sep 11 12:09:18.944241 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:18.944198    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:19.949508 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:19.949477    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:20.856381 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:20.856351    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:20.857277 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:20.857258    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:20.925505 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:20.925466    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"]
Sep 11 12:09:20.926022 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:20.925988    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw" podUID="8ad14379-874b-4192-a52d-50157546866e" containerName="istio-proxy" containerID="cri-o://b435514d4b1eed55f685c6cea019cb10744ee89a38d0ce5aafab014b70f3410d" gracePeriod=30
Sep 11 12:09:22.089954 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.089918    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:09:22.198407 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.198373    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-workload-socket\") pod \"a71357a7-4f9a-4315-908f-f74ba755eba4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") "
Sep 11 12:09:22.198407 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.198417    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-credential-socket\") pod \"a71357a7-4f9a-4315-908f-f74ba755eba4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") "
Sep 11 12:09:22.198642 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.198443    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a71357a7-4f9a-4315-908f-f74ba755eba4-istiod-ca-cert\") pod \"a71357a7-4f9a-4315-908f-f74ba755eba4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") "
Sep 11 12:09:22.198642 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.198514    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-istio-envoy\") pod \"a71357a7-4f9a-4315-908f-f74ba755eba4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") "
Sep 11 12:09:22.198642 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.198572    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-istio-data\") pod \"a71357a7-4f9a-4315-908f-f74ba755eba4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") "
Sep 11 12:09:22.198642 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.198610    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-workload-certs\") pod \"a71357a7-4f9a-4315-908f-f74ba755eba4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") "
Sep 11 12:09:22.198896 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.198647    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a71357a7-4f9a-4315-908f-f74ba755eba4-istio-token\") pod \"a71357a7-4f9a-4315-908f-f74ba755eba4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") "
Sep 11 12:09:22.198896 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.198722    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a71357a7-4f9a-4315-908f-f74ba755eba4" (UID: "a71357a7-4f9a-4315-908f-f74ba755eba4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:09:22.198896 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.198738    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f26bx\" (UniqueName: \"kubernetes.io/projected/a71357a7-4f9a-4315-908f-f74ba755eba4-kube-api-access-f26bx\") pod \"a71357a7-4f9a-4315-908f-f74ba755eba4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") "
Sep 11 12:09:22.198896 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.198784    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a71357a7-4f9a-4315-908f-f74ba755eba4" (UID: "a71357a7-4f9a-4315-908f-f74ba755eba4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:09:22.198896 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.198816    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a71357a7-4f9a-4315-908f-f74ba755eba4-istio-podinfo\") pod \"a71357a7-4f9a-4315-908f-f74ba755eba4\" (UID: \"a71357a7-4f9a-4315-908f-f74ba755eba4\") "
Sep 11 12:09:22.198896 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.198860    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-istio-data" (OuterVolumeSpecName: "istio-data") pod "a71357a7-4f9a-4315-908f-f74ba755eba4" (UID: "a71357a7-4f9a-4315-908f-f74ba755eba4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:09:22.199199 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.198934    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a71357a7-4f9a-4315-908f-f74ba755eba4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a71357a7-4f9a-4315-908f-f74ba755eba4" (UID: "a71357a7-4f9a-4315-908f-f74ba755eba4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:09:22.199199 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.198994    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a71357a7-4f9a-4315-908f-f74ba755eba4" (UID: "a71357a7-4f9a-4315-908f-f74ba755eba4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:09:22.199199 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.199168    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-workload-certs\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:22.199199 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.199189    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-workload-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:22.199399 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.199205    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-credential-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:22.199399 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.199220    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a71357a7-4f9a-4315-908f-f74ba755eba4-istiod-ca-cert\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:22.199399 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.199234    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-istio-data\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:22.201054 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.201014    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a71357a7-4f9a-4315-908f-f74ba755eba4" (UID: "a71357a7-4f9a-4315-908f-f74ba755eba4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:09:22.201383 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.201357    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a71357a7-4f9a-4315-908f-f74ba755eba4-istio-token" (OuterVolumeSpecName: "istio-token") pod "a71357a7-4f9a-4315-908f-f74ba755eba4" (UID: "a71357a7-4f9a-4315-908f-f74ba755eba4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:09:22.201498 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.201408    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a71357a7-4f9a-4315-908f-f74ba755eba4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a71357a7-4f9a-4315-908f-f74ba755eba4" (UID: "a71357a7-4f9a-4315-908f-f74ba755eba4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:09:22.201498 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.201431    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a71357a7-4f9a-4315-908f-f74ba755eba4-kube-api-access-f26bx" (OuterVolumeSpecName: "kube-api-access-f26bx") pod "a71357a7-4f9a-4315-908f-f74ba755eba4" (UID: "a71357a7-4f9a-4315-908f-f74ba755eba4"). InnerVolumeSpecName "kube-api-access-f26bx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:09:22.300256 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.300216    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a71357a7-4f9a-4315-908f-f74ba755eba4-istio-token\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:22.300256 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.300250    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f26bx\" (UniqueName: \"kubernetes.io/projected/a71357a7-4f9a-4315-908f-f74ba755eba4-kube-api-access-f26bx\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:22.300256 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.300263    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a71357a7-4f9a-4315-908f-f74ba755eba4-istio-podinfo\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:22.300496 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.300275    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a71357a7-4f9a-4315-908f-f74ba755eba4-istio-envoy\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:22.877038 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.877006    2565 generic.go:356] "Generic (PLEG): container finished" podID="a71357a7-4f9a-4315-908f-f74ba755eba4" containerID="033f9ff0f0aeb4ce6911a230caf4331b1f6d4e5445ca97ed5fae1b3ae75f3bc1" exitCode=0
Sep 11 12:09:22.877187 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.877096    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4" event={"ID":"a71357a7-4f9a-4315-908f-f74ba755eba4","Type":"ContainerDied","Data":"033f9ff0f0aeb4ce6911a230caf4331b1f6d4e5445ca97ed5fae1b3ae75f3bc1"}
Sep 11 12:09:22.877187 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.877133    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"
Sep 11 12:09:22.877187 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.877158    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4" event={"ID":"a71357a7-4f9a-4315-908f-f74ba755eba4","Type":"ContainerDied","Data":"f78f584cd178bf78a0f518e7d45132e20be8f0d6c42ad835c5c95b20a494a344"}
Sep 11 12:09:22.877187 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.877183    2565 scope.go:117] "RemoveContainer" containerID="033f9ff0f0aeb4ce6911a230caf4331b1f6d4e5445ca97ed5fae1b3ae75f3bc1"
Sep 11 12:09:22.889037 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.889017    2565 scope.go:117] "RemoveContainer" containerID="3500f8c56ff5538b19e4a4190c85faf98d2f9d396ed172b14ee970069ad8ee8f"
Sep 11 12:09:22.899652 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.899557    2565 scope.go:117] "RemoveContainer" containerID="033f9ff0f0aeb4ce6911a230caf4331b1f6d4e5445ca97ed5fae1b3ae75f3bc1"
Sep 11 12:09:22.899931 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:09:22.899910    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"033f9ff0f0aeb4ce6911a230caf4331b1f6d4e5445ca97ed5fae1b3ae75f3bc1\": container with ID starting with 033f9ff0f0aeb4ce6911a230caf4331b1f6d4e5445ca97ed5fae1b3ae75f3bc1 not found: ID does not exist" containerID="033f9ff0f0aeb4ce6911a230caf4331b1f6d4e5445ca97ed5fae1b3ae75f3bc1"
Sep 11 12:09:22.900000 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.899942    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"033f9ff0f0aeb4ce6911a230caf4331b1f6d4e5445ca97ed5fae1b3ae75f3bc1"} err="failed to get container status \"033f9ff0f0aeb4ce6911a230caf4331b1f6d4e5445ca97ed5fae1b3ae75f3bc1\": rpc error: code = NotFound desc = could not find container \"033f9ff0f0aeb4ce6911a230caf4331b1f6d4e5445ca97ed5fae1b3ae75f3bc1\": container with ID starting with 033f9ff0f0aeb4ce6911a230caf4331b1f6d4e5445ca97ed5fae1b3ae75f3bc1 not found: ID does not exist"
Sep 11 12:09:22.900000 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.899960    2565 scope.go:117] "RemoveContainer" containerID="3500f8c56ff5538b19e4a4190c85faf98d2f9d396ed172b14ee970069ad8ee8f"
Sep 11 12:09:22.900240 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:09:22.900224    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3500f8c56ff5538b19e4a4190c85faf98d2f9d396ed172b14ee970069ad8ee8f\": container with ID starting with 3500f8c56ff5538b19e4a4190c85faf98d2f9d396ed172b14ee970069ad8ee8f not found: ID does not exist" containerID="3500f8c56ff5538b19e4a4190c85faf98d2f9d396ed172b14ee970069ad8ee8f"
Sep 11 12:09:22.900283 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.900245    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3500f8c56ff5538b19e4a4190c85faf98d2f9d396ed172b14ee970069ad8ee8f"} err="failed to get container status \"3500f8c56ff5538b19e4a4190c85faf98d2f9d396ed172b14ee970069ad8ee8f\": rpc error: code = NotFound desc = could not find container \"3500f8c56ff5538b19e4a4190c85faf98d2f9d396ed172b14ee970069ad8ee8f\": container with ID starting with 3500f8c56ff5538b19e4a4190c85faf98d2f9d396ed172b14ee970069ad8ee8f not found: ID does not exist"
Sep 11 12:09:22.915185 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.915160    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"]
Sep 11 12:09:22.921916 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:22.921887    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-e42660-openshift-default-6d9f45dbb6-6j5q4"]
Sep 11 12:09:24.845463 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:24.845418    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a71357a7-4f9a-4315-908f-f74ba755eba4" path="/var/lib/kubelet/pods/a71357a7-4f9a-4315-908f-f74ba755eba4/volumes"
Sep 11 12:09:26.216472 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.216443    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:09:26.338322 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.338283    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-workload-socket\") pod \"8ad14379-874b-4192-a52d-50157546866e\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") "
Sep 11 12:09:26.338527 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.338349    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-istio-data\") pod \"8ad14379-874b-4192-a52d-50157546866e\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") "
Sep 11 12:09:26.338527 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.338394    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-workload-certs\") pod \"8ad14379-874b-4192-a52d-50157546866e\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") "
Sep 11 12:09:26.338527 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.338415    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ad14379-874b-4192-a52d-50157546866e-istio-token\") pod \"8ad14379-874b-4192-a52d-50157546866e\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") "
Sep 11 12:09:26.338527 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.338432    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpd48\" (UniqueName: \"kubernetes.io/projected/8ad14379-874b-4192-a52d-50157546866e-kube-api-access-jpd48\") pod \"8ad14379-874b-4192-a52d-50157546866e\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") "
Sep 11 12:09:26.338527 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.338459    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-credential-socket\") pod \"8ad14379-874b-4192-a52d-50157546866e\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") "
Sep 11 12:09:26.338527 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.338478    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-istio-envoy\") pod \"8ad14379-874b-4192-a52d-50157546866e\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") "
Sep 11 12:09:26.338527 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.338506    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ad14379-874b-4192-a52d-50157546866e-istio-podinfo\") pod \"8ad14379-874b-4192-a52d-50157546866e\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") "
Sep 11 12:09:26.338960 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.338559    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ad14379-874b-4192-a52d-50157546866e-istiod-ca-cert\") pod \"8ad14379-874b-4192-a52d-50157546866e\" (UID: \"8ad14379-874b-4192-a52d-50157546866e\") "
Sep 11 12:09:26.338960 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.338597    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8ad14379-874b-4192-a52d-50157546866e" (UID: "8ad14379-874b-4192-a52d-50157546866e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:09:26.338960 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.338631    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-istio-data" (OuterVolumeSpecName: "istio-data") pod "8ad14379-874b-4192-a52d-50157546866e" (UID: "8ad14379-874b-4192-a52d-50157546866e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:09:26.338960 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.338941    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-workload-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:26.339182 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.338963    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-istio-data\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:26.339182 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.338938    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8ad14379-874b-4192-a52d-50157546866e" (UID: "8ad14379-874b-4192-a52d-50157546866e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:09:26.339182 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.339125    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8ad14379-874b-4192-a52d-50157546866e" (UID: "8ad14379-874b-4192-a52d-50157546866e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:09:26.339342 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.339290    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ad14379-874b-4192-a52d-50157546866e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8ad14379-874b-4192-a52d-50157546866e" (UID: "8ad14379-874b-4192-a52d-50157546866e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:09:26.343705 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.342297    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ad14379-874b-4192-a52d-50157546866e-istio-token" (OuterVolumeSpecName: "istio-token") pod "8ad14379-874b-4192-a52d-50157546866e" (UID: "8ad14379-874b-4192-a52d-50157546866e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:09:26.366708 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.362858    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8ad14379-874b-4192-a52d-50157546866e" (UID: "8ad14379-874b-4192-a52d-50157546866e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:09:26.366708 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.362993    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8ad14379-874b-4192-a52d-50157546866e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8ad14379-874b-4192-a52d-50157546866e" (UID: "8ad14379-874b-4192-a52d-50157546866e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:09:26.366967 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.366822    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ad14379-874b-4192-a52d-50157546866e-kube-api-access-jpd48" (OuterVolumeSpecName: "kube-api-access-jpd48") pod "8ad14379-874b-4192-a52d-50157546866e" (UID: "8ad14379-874b-4192-a52d-50157546866e"). InnerVolumeSpecName "kube-api-access-jpd48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:09:26.439778 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.439727    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpd48\" (UniqueName: \"kubernetes.io/projected/8ad14379-874b-4192-a52d-50157546866e-kube-api-access-jpd48\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:26.439778 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.439779    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-credential-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:26.440118 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.439796    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-istio-envoy\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:26.440118 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.439812    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ad14379-874b-4192-a52d-50157546866e-istio-podinfo\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:26.440118 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.439826    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ad14379-874b-4192-a52d-50157546866e-istiod-ca-cert\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:26.440118 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.439839    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ad14379-874b-4192-a52d-50157546866e-workload-certs\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:26.440118 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.439852    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ad14379-874b-4192-a52d-50157546866e-istio-token\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:09:26.904960 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.904919    2565 generic.go:356] "Generic (PLEG): container finished" podID="8ad14379-874b-4192-a52d-50157546866e" containerID="b435514d4b1eed55f685c6cea019cb10744ee89a38d0ce5aafab014b70f3410d" exitCode=0
Sep 11 12:09:26.905135 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.904972    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"
Sep 11 12:09:26.905135 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.905002    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw" event={"ID":"8ad14379-874b-4192-a52d-50157546866e","Type":"ContainerDied","Data":"b435514d4b1eed55f685c6cea019cb10744ee89a38d0ce5aafab014b70f3410d"}
Sep 11 12:09:26.905135 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.905076    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw" event={"ID":"8ad14379-874b-4192-a52d-50157546866e","Type":"ContainerDied","Data":"9f65ff1a1a66f58c077853b019c9e4eae90dac40c2a9b782119dbd0f7a82e6ff"}
Sep 11 12:09:26.905135 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.905101    2565 scope.go:117] "RemoveContainer" containerID="b435514d4b1eed55f685c6cea019cb10744ee89a38d0ce5aafab014b70f3410d"
Sep 11 12:09:26.917407 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.917326    2565 scope.go:117] "RemoveContainer" containerID="b435514d4b1eed55f685c6cea019cb10744ee89a38d0ce5aafab014b70f3410d"
Sep 11 12:09:26.917985 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:09:26.917956    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b435514d4b1eed55f685c6cea019cb10744ee89a38d0ce5aafab014b70f3410d\": container with ID starting with b435514d4b1eed55f685c6cea019cb10744ee89a38d0ce5aafab014b70f3410d not found: ID does not exist" containerID="b435514d4b1eed55f685c6cea019cb10744ee89a38d0ce5aafab014b70f3410d"
Sep 11 12:09:26.918114 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.917995    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b435514d4b1eed55f685c6cea019cb10744ee89a38d0ce5aafab014b70f3410d"} err="failed to get container status \"b435514d4b1eed55f685c6cea019cb10744ee89a38d0ce5aafab014b70f3410d\": rpc error: code = NotFound desc = could not find container \"b435514d4b1eed55f685c6cea019cb10744ee89a38d0ce5aafab014b70f3410d\": container with ID starting with b435514d4b1eed55f685c6cea019cb10744ee89a38d0ce5aafab014b70f3410d not found: ID does not exist"
Sep 11 12:09:26.929307 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.929279    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"]
Sep 11 12:09:26.934607 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:26.934579    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-40847e-openshift-default-57857fb7f6-gnknw"]
Sep 11 12:09:28.845286 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:28.845240    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ad14379-874b-4192-a52d-50157546866e" path="/var/lib/kubelet/pods/8ad14379-874b-4192-a52d-50157546866e/volumes"
Sep 11 12:09:28.848909 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:28.848858    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 12:09:28.849243 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:28.849213    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm" podUID="4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 12:09:30.942594 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:30.942537    2565 generic.go:356] "Generic (PLEG): container finished" podID="4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5" containerID="e6ddd9469ea33c0f6c44bf116d6abdb06632898359f90ee5ffb68c48c921f9a0" exitCode=0
Sep 11 12:09:30.943171 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:30.942728    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm" event={"ID":"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5","Type":"ContainerDied","Data":"e6ddd9469ea33c0f6c44bf116d6abdb06632898359f90ee5ffb68c48c921f9a0"}
Sep 11 12:09:30.943348 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:30.943327    2565 scope.go:117] "RemoveContainer" containerID="e6ddd9469ea33c0f6c44bf116d6abdb06632898359f90ee5ffb68c48c921f9a0"
Sep 11 12:09:30.945238 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:30.945201    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:09:30.945464 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:30.945441    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:09:30.945615 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:30.945596    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:09:31.954850 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:31.954805    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm" event={"ID":"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5","Type":"ContainerStarted","Data":"e80f61e622fb7acad121fea26f0b09ebbc64e7bc228e860328b17b546e3c0dbb"}
Sep 11 12:09:32.647778 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:32.647739    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:32.648217 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:32.648124    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 11 12:09:32.648394 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:32.648373    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm" podUID="4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 11 12:09:33.647202 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:33.647159    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 11 12:09:33.648285 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:33.647854    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm" podUID="4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 11 12:09:34.648061 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:34.647469    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 11 12:09:34.648061 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:34.647549    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm" podUID="4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 11 12:09:35.647419 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:35.647372    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 11 12:09:35.647758 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:35.647719    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm" podUID="4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 11 12:09:36.647331 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:36.647290    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 11 12:09:36.648030 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:36.647991    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm" podUID="4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 11 12:09:36.897935 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:36.897849    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 12:09:36.898092 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:36.897929    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt" podUID="5be27b9b-c449-4e8b-ba1e-f034046f4b44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 12:09:37.650617 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:37.650581    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:37.651025 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:37.650878    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:37.651510 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:37.651490    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:09:38.003449 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:38.003340    2565 generic.go:356] "Generic (PLEG): container finished" podID="5be27b9b-c449-4e8b-ba1e-f034046f4b44" containerID="c2fd29e5bda739c67d823e5a1c7b6cccf06ba5f518f27edca370a2d3ef2d2f76" exitCode=0
Sep 11 12:09:38.003449 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:38.003418    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt" event={"ID":"5be27b9b-c449-4e8b-ba1e-f034046f4b44","Type":"ContainerDied","Data":"c2fd29e5bda739c67d823e5a1c7b6cccf06ba5f518f27edca370a2d3ef2d2f76"}
Sep 11 12:09:38.003971 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:38.003955    2565 scope.go:117] "RemoveContainer" containerID="c2fd29e5bda739c67d823e5a1c7b6cccf06ba5f518f27edca370a2d3ef2d2f76"
Sep 11 12:09:38.005021 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:38.004990    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:09:38.005096 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:38.005082    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:09:38.005139 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:38.005122    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:09:39.011887 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.011850    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt" event={"ID":"5be27b9b-c449-4e8b-ba1e-f034046f4b44","Type":"ContainerStarted","Data":"9c29bf678adcb71d3cd8ce8b2db185f60cc2ad5f5d08509a3cc13a4547d59738"}
Sep 11 12:09:39.229495 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.229461    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"]
Sep 11 12:09:39.229885 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.229869    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a71357a7-4f9a-4315-908f-f74ba755eba4" containerName="istio-proxy"
Sep 11 12:09:39.229885 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.229885    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a71357a7-4f9a-4315-908f-f74ba755eba4" containerName="istio-proxy"
Sep 11 12:09:39.230040 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.229893    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ad14379-874b-4192-a52d-50157546866e" containerName="istio-proxy"
Sep 11 12:09:39.230040 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.229900    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ad14379-874b-4192-a52d-50157546866e" containerName="istio-proxy"
Sep 11 12:09:39.230040 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.229909    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a71357a7-4f9a-4315-908f-f74ba755eba4" containerName="istio-proxy"
Sep 11 12:09:39.230040 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.229914    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a71357a7-4f9a-4315-908f-f74ba755eba4" containerName="istio-proxy"
Sep 11 12:09:39.230040 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.229998    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ad14379-874b-4192-a52d-50157546866e" containerName="istio-proxy"
Sep 11 12:09:39.230040 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.230007    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a71357a7-4f9a-4315-908f-f74ba755eba4" containerName="istio-proxy"
Sep 11 12:09:39.230040 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.230013    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a71357a7-4f9a-4315-908f-f74ba755eba4" containerName="istio-proxy"
Sep 11 12:09:39.233625 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.233453    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.237022 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.236993    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-50e434-openshift-default-dockercfg-5rvj4\""
Sep 11 12:09:39.258208 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.258158    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"]
Sep 11 12:09:39.381013 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.380908    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istio-token\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.381203 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.381050    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istio-podinfo\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.381203 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.381088    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istio-envoy\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.381203 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.381136    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istio-data\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.381203 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.381151    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istiod-ca-cert\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.381434 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.381271    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-credential-socket\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.381434 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.381309    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcxws\" (UniqueName: \"kubernetes.io/projected/667c45dc-ea68-41d7-ae69-ee3bac592ca5-kube-api-access-jcxws\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.381434 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.381345    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-workload-socket\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.381434 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.381385    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-workload-certs\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.482865 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.482823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istio-podinfo\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.482865 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.482870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istio-envoy\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.483143 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.482906    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istio-data\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.483143 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.482927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istiod-ca-cert\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.483143 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.482987    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-credential-socket\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.483143 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.483010    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcxws\" (UniqueName: \"kubernetes.io/projected/667c45dc-ea68-41d7-ae69-ee3bac592ca5-kube-api-access-jcxws\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.483143 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.483039    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-workload-socket\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.483143 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.483074    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-workload-certs\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.483143 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.483110    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istio-token\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.483629 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.483597    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-workload-socket\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.483629 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.483612    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-workload-certs\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.483838 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.483746    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istiod-ca-cert\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.483946 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.483920    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-credential-socket\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.484016 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.483964    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istio-data\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.485386 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.485359    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istio-envoy\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.485604 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.485584    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istio-podinfo\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.491791 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.491761    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istio-token\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.491909 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.491853    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcxws\" (UniqueName: \"kubernetes.io/projected/667c45dc-ea68-41d7-ae69-ee3bac592ca5-kube-api-access-jcxws\") pod \"e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") " pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.554998 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.554953    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:39.857416 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:09:39.856438    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod667c45dc_ea68_41d7_ae69_ee3bac592ca5.slice/crio-9f780e5282ee8956a6db3cf7b5826c9d561b490b6a0b9f4b560262383fb70214 WatchSource:0}: Error finding container 9f780e5282ee8956a6db3cf7b5826c9d561b490b6a0b9f4b560262383fb70214: Status 404 returned error can't find the container with id 9f780e5282ee8956a6db3cf7b5826c9d561b490b6a0b9f4b560262383fb70214
Sep 11 12:09:39.857416 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.856578    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"]
Sep 11 12:09:39.859518 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.859472    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:09:39.859625 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.859569    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:09:39.859625 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.859614    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:09:39.943951 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.943915    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:39.944150 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.944045    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 11 12:09:39.944150 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:39.944094    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt" podUID="5be27b9b-c449-4e8b-ba1e-f034046f4b44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 11 12:09:40.021556 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:40.021519    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq" event={"ID":"667c45dc-ea68-41d7-ae69-ee3bac592ca5","Type":"ContainerStarted","Data":"c105c53a2529001f1aee66ddfe26bdffb66149501ebce47f5683bf466ae3a98e"}
Sep 11 12:09:40.022075 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:40.021587    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq" event={"ID":"667c45dc-ea68-41d7-ae69-ee3bac592ca5","Type":"ContainerStarted","Data":"9f780e5282ee8956a6db3cf7b5826c9d561b490b6a0b9f4b560262383fb70214"}
Sep 11 12:09:40.050144 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:40.050068    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq" podStartSLOduration=1.050046989 podStartE2EDuration="1.050046989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:09:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:09:40.04481752 +0000 UTC m=+1093.727217030" watchObservedRunningTime="2026-09-11 12:09:40.050046989 +0000 UTC m=+1093.732446489"
Sep 11 12:09:40.556739 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:40.556699    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:40.558345 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:40.558303    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 11 12:09:40.558567 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:40.558543    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq" podUID="667c45dc-ea68-41d7-ae69-ee3bac592ca5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 11 12:09:40.944016 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:40.943971    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 11 12:09:40.944243 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:40.944047    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt" podUID="5be27b9b-c449-4e8b-ba1e-f034046f4b44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 11 12:09:41.566108 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:41.566065    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:41.944577 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:41.944535    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 11 12:09:41.944797 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:41.944604    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt" podUID="5be27b9b-c449-4e8b-ba1e-f034046f4b44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 11 12:09:42.034086 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:42.034051    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:42.034977 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:42.034956    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:09:42.944446 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:42.944401    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 11 12:09:42.944948 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:42.944474    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt" podUID="5be27b9b-c449-4e8b-ba1e-f034046f4b44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 11 12:09:43.944570 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:43.944096    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 11 12:09:43.944570 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:43.944171    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt" podUID="5be27b9b-c449-4e8b-ba1e-f034046f4b44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 11 12:09:44.948644 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:44.948608    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:44.949070 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:44.949036    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:44.949710 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:44.949673    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:09:51.401997 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.401958    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"]
Sep 11 12:09:51.406896 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.406868    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.409608 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.409582    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-4d3f83-openshift-default-dockercfg-cg4gz\""
Sep 11 12:09:51.417392 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.417360    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"]
Sep 11 12:09:51.508906 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.508870    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-workload-socket\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.508906 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.508911    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-istio-envoy\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.509132 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.508933    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-istio-data\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.509132 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.508988    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-credential-socket\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.509132 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.509054    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b166e30-25f5-431e-a293-ab21003166ae-istiod-ca-cert\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.509132 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.509097    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-workload-certs\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.509273 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.509195    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snf4h\" (UniqueName: \"kubernetes.io/projected/4b166e30-25f5-431e-a293-ab21003166ae-kube-api-access-snf4h\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.509273 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.509231    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b166e30-25f5-431e-a293-ab21003166ae-istio-podinfo\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.509352 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.509289    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b166e30-25f5-431e-a293-ab21003166ae-istio-token\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.610463 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.610421    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snf4h\" (UniqueName: \"kubernetes.io/projected/4b166e30-25f5-431e-a293-ab21003166ae-kube-api-access-snf4h\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.610750 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.610717    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b166e30-25f5-431e-a293-ab21003166ae-istio-podinfo\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.610893 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.610794    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b166e30-25f5-431e-a293-ab21003166ae-istio-token\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.610893 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.610858    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-workload-socket\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.611057 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.611025    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-istio-envoy\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.611134 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.611072    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-istio-data\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.611134 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.611101    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-credential-socket\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.611251 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.611141    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b166e30-25f5-431e-a293-ab21003166ae-istiod-ca-cert\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.611251 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.611180    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-workload-certs\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.611582 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.611559    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-istio-data\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.611759 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.611597    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-workload-certs\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.611930 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.611906    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-credential-socket\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.612337 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.612308    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b166e30-25f5-431e-a293-ab21003166ae-istiod-ca-cert\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.612437 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.612382    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-workload-socket\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.614204 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.614180    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b166e30-25f5-431e-a293-ab21003166ae-istio-podinfo\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.614826 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.614797    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-istio-envoy\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.618556 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.618534    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b166e30-25f5-431e-a293-ab21003166ae-istio-token\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.618637 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.618562    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snf4h\" (UniqueName: \"kubernetes.io/projected/4b166e30-25f5-431e-a293-ab21003166ae-kube-api-access-snf4h\") pod \"e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") " pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:51.721407 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:51.721321    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:52.033953 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:52.033920    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"]
Sep 11 12:09:52.035174 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:09:52.035145    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b166e30_25f5_431e_a293_ab21003166ae.slice/crio-034485374a1f63f5d30b5a4817281f1e077905b29dfb34ed72f38005bc4c6455 WatchSource:0}: Error finding container 034485374a1f63f5d30b5a4817281f1e077905b29dfb34ed72f38005bc4c6455: Status 404 returned error can't find the container with id 034485374a1f63f5d30b5a4817281f1e077905b29dfb34ed72f38005bc4c6455
Sep 11 12:09:52.037780 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:52.037751    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:09:52.037831 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:52.037815    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:09:52.037863 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:52.037844    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:09:52.103507 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:52.103471    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw" event={"ID":"4b166e30-25f5-431e-a293-ab21003166ae","Type":"ContainerStarted","Data":"034485374a1f63f5d30b5a4817281f1e077905b29dfb34ed72f38005bc4c6455"}
Sep 11 12:09:53.110298 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:53.110257    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw" event={"ID":"4b166e30-25f5-431e-a293-ab21003166ae","Type":"ContainerStarted","Data":"1dba8040831a07d25afbcadbe44f647bfab199b0c9e9fe490fff1e0d9b9801c3"}
Sep 11 12:09:53.131917 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:53.131858    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw" podStartSLOduration=2.131840117 podStartE2EDuration="2.131840117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:09:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:09:53.131156703 +0000 UTC m=+1106.813556201" watchObservedRunningTime="2026-09-11 12:09:53.131840117 +0000 UTC m=+1106.814239615"
Sep 11 12:09:53.721881 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:53.721842    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:53.726753 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:53.726718    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:54.116393 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:54.116313    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:54.117410 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:54.117391    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:09:58.075902 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:58.075856    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 12:09:58.076284 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:58.075926    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq" podUID="667c45dc-ea68-41d7-ae69-ee3bac592ca5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 12:09:59.149477 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:59.149444    2565 generic.go:356] "Generic (PLEG): container finished" podID="667c45dc-ea68-41d7-ae69-ee3bac592ca5" containerID="c105c53a2529001f1aee66ddfe26bdffb66149501ebce47f5683bf466ae3a98e" exitCode=0
Sep 11 12:09:59.149921 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:59.149513    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq" event={"ID":"667c45dc-ea68-41d7-ae69-ee3bac592ca5","Type":"ContainerDied","Data":"c105c53a2529001f1aee66ddfe26bdffb66149501ebce47f5683bf466ae3a98e"}
Sep 11 12:09:59.150020 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:59.150003    2565 scope.go:117] "RemoveContainer" containerID="c105c53a2529001f1aee66ddfe26bdffb66149501ebce47f5683bf466ae3a98e"
Sep 11 12:09:59.151235 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:59.151204    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:09:59.151347 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:59.151291    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:09:59.151347 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:09:59.151341    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:10:00.163743 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:00.163672    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq" event={"ID":"667c45dc-ea68-41d7-ae69-ee3bac592ca5","Type":"ContainerStarted","Data":"b49a14579ca9303c4c3cb0df841723633c55a0f2661e471eec605abfb1d5f45f"}
Sep 11 12:10:00.556360 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:00.556153    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:10:00.556808 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:00.556712    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 11 12:10:00.557003 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:00.556977    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq" podUID="667c45dc-ea68-41d7-ae69-ee3bac592ca5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 11 12:10:01.556354 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:01.556311    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 11 12:10:01.556964 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:01.556928    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq" podUID="667c45dc-ea68-41d7-ae69-ee3bac592ca5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 11 12:10:02.556046 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:02.556002    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 11 12:10:02.556367 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:02.556333    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq" podUID="667c45dc-ea68-41d7-ae69-ee3bac592ca5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 11 12:10:03.557790 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:03.557742    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 11 12:10:03.558376 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:03.558337    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq" podUID="667c45dc-ea68-41d7-ae69-ee3bac592ca5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 11 12:10:04.556560 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:04.556513    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 11 12:10:04.556800 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:04.556584    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq" podUID="667c45dc-ea68-41d7-ae69-ee3bac592ca5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 11 12:10:05.566594 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:05.566563    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:10:05.567057 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:05.567008    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:10:05.567646 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:05.567626    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:10:15.263804 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:15.263769    2565 generic.go:356] "Generic (PLEG): container finished" podID="4b166e30-25f5-431e-a293-ab21003166ae" containerID="1dba8040831a07d25afbcadbe44f647bfab199b0c9e9fe490fff1e0d9b9801c3" exitCode=0
Sep 11 12:10:15.264331 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:15.263844    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw" event={"ID":"4b166e30-25f5-431e-a293-ab21003166ae","Type":"ContainerDied","Data":"1dba8040831a07d25afbcadbe44f647bfab199b0c9e9fe490fff1e0d9b9801c3"}
Sep 11 12:10:15.264406 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:15.264353    2565 scope.go:117] "RemoveContainer" containerID="1dba8040831a07d25afbcadbe44f647bfab199b0c9e9fe490fff1e0d9b9801c3"
Sep 11 12:10:15.265523 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:15.265494    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:10:15.265631 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:15.265576    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:10:15.265631 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:15.265621    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:10:16.280195 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.280152    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw" event={"ID":"4b166e30-25f5-431e-a293-ab21003166ae","Type":"ContainerStarted","Data":"d7095908b4cf01153dcdf489a604930116a140779bd13713fcfed291a1343038"}
Sep 11 12:10:16.662696 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.662637    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"]
Sep 11 12:10:16.681076 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.681032    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.681422 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.681392    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"]
Sep 11 12:10:16.684522 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.684496    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-fde9d154-openshift-default-dockercfg-7bhf4\""
Sep 11 12:10:16.721822 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.721783    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:10:16.722012 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.721993    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 11 12:10:16.722075 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.722035    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw" podUID="4b166e30-25f5-431e-a293-ab21003166ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 11 12:10:16.763273 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.763229    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-istio-data\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.763592 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.763565    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a20a0eb-26ad-4571-8c30-612ddb925d63-istio-podinfo\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.763772 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.763753    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-workload-socket\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.763905 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.763889    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-workload-certs\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.764020 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.764004    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-istio-envoy\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.764136 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.764123    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a20a0eb-26ad-4571-8c30-612ddb925d63-istiod-ca-cert\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.764240 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.764227    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-credential-socket\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.764368 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.764355    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a20a0eb-26ad-4571-8c30-612ddb925d63-istio-token\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.764499 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.764484    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tpp8\" (UniqueName: \"kubernetes.io/projected/3a20a0eb-26ad-4571-8c30-612ddb925d63-kube-api-access-5tpp8\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.866209 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.866163    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-istio-data\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.866523 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.866496    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a20a0eb-26ad-4571-8c30-612ddb925d63-istio-podinfo\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.866671 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.866655    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-workload-socket\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.866827 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.866810    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-workload-certs\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.866945 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.866909    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-istio-data\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.867126 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.866931    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-istio-envoy\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.867291 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.867272    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a20a0eb-26ad-4571-8c30-612ddb925d63-istiod-ca-cert\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.868492 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.868465    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-credential-socket\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.869074 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.869047    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a20a0eb-26ad-4571-8c30-612ddb925d63-istio-token\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.869707 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.868402    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-workload-certs\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.869862 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.867487    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-workload-socket\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.869987 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.868946    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-credential-socket\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.870109 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.868075    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a20a0eb-26ad-4571-8c30-612ddb925d63-istiod-ca-cert\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.870338 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.870320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tpp8\" (UniqueName: \"kubernetes.io/projected/3a20a0eb-26ad-4571-8c30-612ddb925d63-kube-api-access-5tpp8\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.871730 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.870950    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-istio-envoy\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.873845 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.873824    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a20a0eb-26ad-4571-8c30-612ddb925d63-istio-podinfo\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.878969 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.878942    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a20a0eb-26ad-4571-8c30-612ddb925d63-istio-token\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.879182 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.879162    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tpp8\" (UniqueName: \"kubernetes.io/projected/3a20a0eb-26ad-4571-8c30-612ddb925d63-kube-api-access-5tpp8\") pod \"e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") " pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:16.993445 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:16.993345    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:17.305247 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:17.305218    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"]
Sep 11 12:10:17.305613 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:10:17.305544    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a20a0eb_26ad_4571_8c30_612ddb925d63.slice/crio-a4430559d8071f4c51db6a744cf2e09dc5bc787b3ab9cac8a346c02755072650 WatchSource:0}: Error finding container a4430559d8071f4c51db6a744cf2e09dc5bc787b3ab9cac8a346c02755072650: Status 404 returned error can't find the container with id a4430559d8071f4c51db6a744cf2e09dc5bc787b3ab9cac8a346c02755072650
Sep 11 12:10:17.307938 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:17.307906    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:10:17.308024 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:17.307974    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:10:17.308024 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:17.308001    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:10:17.721916 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:17.721877    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 11 12:10:17.722125 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:17.721935    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw" podUID="4b166e30-25f5-431e-a293-ab21003166ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 11 12:10:18.294760 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:18.294719    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5" event={"ID":"3a20a0eb-26ad-4571-8c30-612ddb925d63","Type":"ContainerStarted","Data":"66aead6735ac1c88f082d594953d0e1b0d17176a8cbd31380ed50d9c0637153a"}
Sep 11 12:10:18.294921 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:18.294777    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5" event={"ID":"3a20a0eb-26ad-4571-8c30-612ddb925d63","Type":"ContainerStarted","Data":"a4430559d8071f4c51db6a744cf2e09dc5bc787b3ab9cac8a346c02755072650"}
Sep 11 12:10:18.315060 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:18.315004    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5" podStartSLOduration=2.314987939 podStartE2EDuration="2.314987939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:10:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:10:18.313120699 +0000 UTC m=+1131.995520198" watchObservedRunningTime="2026-09-11 12:10:18.314987939 +0000 UTC m=+1131.997387457"
Sep 11 12:10:18.721899 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:18.721855    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 11 12:10:18.722087 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:18.721924    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw" podUID="4b166e30-25f5-431e-a293-ab21003166ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 11 12:10:18.993722 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:18.993620    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:18.999181 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:18.999152    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:19.300946 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:19.300857    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:19.301859 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:19.301840    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:19.722523 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:19.722482    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 11 12:10:19.722973 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:19.722544    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw" podUID="4b166e30-25f5-431e-a293-ab21003166ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 11 12:10:20.722200 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:20.722152    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 11 12:10:20.722391 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:20.722216    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw" podUID="4b166e30-25f5-431e-a293-ab21003166ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 11 12:10:21.726165 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:21.726130    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:10:21.726598 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:21.726424    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:10:21.727064 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:21.727045    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:10:27.026827 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:27.026793    2565 scope.go:117] "RemoveContainer" containerID="e3bfe68313b0f2dcce9efedb3267bf267cf1ecb8949ef07b970413be58816377"
Sep 11 12:10:35.342875 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:35.342830    2565 patch_prober.go:28] interesting pod/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 12:10:35.343316 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:35.342933    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5" podUID="3a20a0eb-26ad-4571-8c30-612ddb925d63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 12:10:36.418030 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:36.417991    2565 generic.go:356] "Generic (PLEG): container finished" podID="3a20a0eb-26ad-4571-8c30-612ddb925d63" containerID="66aead6735ac1c88f082d594953d0e1b0d17176a8cbd31380ed50d9c0637153a" exitCode=0
Sep 11 12:10:36.418451 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:36.418045    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5" event={"ID":"3a20a0eb-26ad-4571-8c30-612ddb925d63","Type":"ContainerDied","Data":"66aead6735ac1c88f082d594953d0e1b0d17176a8cbd31380ed50d9c0637153a"}
Sep 11 12:10:36.418499 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:36.418461    2565 scope.go:117] "RemoveContainer" containerID="66aead6735ac1c88f082d594953d0e1b0d17176a8cbd31380ed50d9c0637153a"
Sep 11 12:10:36.419560 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:36.419531    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:10:36.419612 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:36.419599    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:10:36.419647 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:36.419631    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:10:37.426628 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:37.426583    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5" event={"ID":"3a20a0eb-26ad-4571-8c30-612ddb925d63","Type":"ContainerStarted","Data":"9c1aa0ef8a40a30518a658d23f9fdc79c61bbc2dc4ada8bda7d1052fdfdfbe48"}
Sep 11 12:10:37.994174 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:37.994141    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:37.994364 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:37.994311    2565 patch_prober.go:28] interesting pod/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 11 12:10:37.994425 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:37.994359    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5" podUID="3a20a0eb-26ad-4571-8c30-612ddb925d63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 11 12:10:38.993963 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:38.993929    2565 patch_prober.go:28] interesting pod/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 11 12:10:38.994369 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:38.993992    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5" podUID="3a20a0eb-26ad-4571-8c30-612ddb925d63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 11 12:10:39.994582 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:39.994541    2565 patch_prober.go:28] interesting pod/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 11 12:10:39.995012 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:39.994629    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5" podUID="3a20a0eb-26ad-4571-8c30-612ddb925d63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 11 12:10:40.994008 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:40.993966    2565 patch_prober.go:28] interesting pod/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 11 12:10:40.994199 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:40.994033    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5" podUID="3a20a0eb-26ad-4571-8c30-612ddb925d63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 11 12:10:41.993885 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:41.993840    2565 patch_prober.go:28] interesting pod/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 11 12:10:41.994298 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:41.993907    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5" podUID="3a20a0eb-26ad-4571-8c30-612ddb925d63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 11 12:10:43.187216 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:43.187178    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:43.187995 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:43.187580    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:10:43.188388 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:10:43.188370    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:11:26.901712 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:26.901657    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5pnqx_2233f21d-d3f8-44fc-92bf-03a86f7456ce/console-operator/1.log"
Sep 11 12:11:26.902261 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:26.902067    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5pnqx_2233f21d-d3f8-44fc-92bf-03a86f7456ce/console-operator/1.log"
Sep 11 12:11:26.908726 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:26.908707    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wzvlx_2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b/ovn-acl-logging/0.log"
Sep 11 12:11:26.908834 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:26.908707    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wzvlx_2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b/ovn-acl-logging/0.log"
Sep 11 12:11:27.052742 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:27.052705    2565 scope.go:117] "RemoveContainer" containerID="9799447f304e1d03dcfddac34109a07bc19bb551171afd8b66b7e6bf5f890ecb"
Sep 11 12:11:44.795101 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:44.795063    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fde9d154-mzzhf"]
Sep 11 12:11:44.800084 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:44.800063    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fde9d154-mzzhf"
Sep 11 12:11:44.803205 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:44.803182    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:11:44.803292 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:44.803210    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r95fz\""
Sep 11 12:11:44.808575 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:44.808552    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fde9d154-mzzhf"]
Sep 11 12:11:44.860577 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:44.860543    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1976342-76dc-4bb2-9404-944a1398b5c4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fde9d154-mzzhf\" (UID: \"f1976342-76dc-4bb2-9404-944a1398b5c4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fde9d154-mzzhf"
Sep 11 12:11:44.961940 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:44.961904    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1976342-76dc-4bb2-9404-944a1398b5c4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fde9d154-mzzhf\" (UID: \"f1976342-76dc-4bb2-9404-944a1398b5c4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fde9d154-mzzhf"
Sep 11 12:11:44.962640 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:44.962617    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1976342-76dc-4bb2-9404-944a1398b5c4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fde9d154-mzzhf\" (UID: \"f1976342-76dc-4bb2-9404-944a1398b5c4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fde9d154-mzzhf"
Sep 11 12:11:45.112114 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:45.112017    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fde9d154-mzzhf"
Sep 11 12:11:45.389723 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:45.389665    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fde9d154-mzzhf"]
Sep 11 12:11:45.390877 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:11:45.390846    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1976342_76dc_4bb2_9404_944a1398b5c4.slice/crio-a05b2b7865602aeca70d66bf12157595c96b72f200878c3171347509394979d9 WatchSource:0}: Error finding container a05b2b7865602aeca70d66bf12157595c96b72f200878c3171347509394979d9: Status 404 returned error can't find the container with id a05b2b7865602aeca70d66bf12157595c96b72f200878c3171347509394979d9
Sep 11 12:11:45.870290 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:45.870251    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fde9d154-mzzhf" event={"ID":"f1976342-76dc-4bb2-9404-944a1398b5c4","Type":"ContainerStarted","Data":"8dc515865248393c3c50fc4b6163614e9659dbd216a7469eb90ebf5e960c5188"}
Sep 11 12:11:45.870731 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:45.870303    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fde9d154-mzzhf" event={"ID":"f1976342-76dc-4bb2-9404-944a1398b5c4","Type":"ContainerStarted","Data":"a05b2b7865602aeca70d66bf12157595c96b72f200878c3171347509394979d9"}
Sep 11 12:11:45.884843 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:45.884796    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fde9d154-mzzhf" podStartSLOduration=1.884783048 podStartE2EDuration="1.884783048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:11:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:11:45.884419483 +0000 UTC m=+1219.566818980" watchObservedRunningTime="2026-09-11 12:11:45.884783048 +0000 UTC m=+1219.567182545"
Sep 11 12:11:46.877259 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:46.877224    2565 generic.go:356] "Generic (PLEG): container finished" podID="f1976342-76dc-4bb2-9404-944a1398b5c4" containerID="8dc515865248393c3c50fc4b6163614e9659dbd216a7469eb90ebf5e960c5188" exitCode=0
Sep 11 12:11:46.877630 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:46.877271    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fde9d154-mzzhf" event={"ID":"f1976342-76dc-4bb2-9404-944a1398b5c4","Type":"ContainerDied","Data":"8dc515865248393c3c50fc4b6163614e9659dbd216a7469eb90ebf5e960c5188"}
Sep 11 12:11:48.011504 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:48.011475    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fde9d154-mzzhf"
Sep 11 12:11:48.087747 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:48.087721    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1976342-76dc-4bb2-9404-944a1398b5c4-maas-api-service-ca\") pod \"f1976342-76dc-4bb2-9404-944a1398b5c4\" (UID: \"f1976342-76dc-4bb2-9404-944a1398b5c4\") "
Sep 11 12:11:48.088058 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:48.088033    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1976342-76dc-4bb2-9404-944a1398b5c4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f1976342-76dc-4bb2-9404-944a1398b5c4" (UID: "f1976342-76dc-4bb2-9404-944a1398b5c4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:11:48.188504 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:48.188471    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1976342-76dc-4bb2-9404-944a1398b5c4-maas-api-service-ca\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:11:48.891261 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:48.891232    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fde9d154-mzzhf"
Sep 11 12:11:48.891426 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:48.891230    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fde9d154-mzzhf" event={"ID":"f1976342-76dc-4bb2-9404-944a1398b5c4","Type":"ContainerDied","Data":"a05b2b7865602aeca70d66bf12157595c96b72f200878c3171347509394979d9"}
Sep 11 12:11:48.891426 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:11:48.891360    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a05b2b7865602aeca70d66bf12157595c96b72f200878c3171347509394979d9"
Sep 11 12:12:00.773838 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:00.773791    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fde9d154-mzzhf"]
Sep 11 12:12:00.776208 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:00.776186    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fde9d154-mzzhf"]
Sep 11 12:12:00.846695 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:00.846639    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1976342-76dc-4bb2-9404-944a1398b5c4" path="/var/lib/kubelet/pods/f1976342-76dc-4bb2-9404-944a1398b5c4/volumes"
Sep 11 12:12:27.075973 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:27.075937    2565 scope.go:117] "RemoveContainer" containerID="324f863a6580f616eab80ed5b5928aeac162f1c30886bb88deaba1d44f2487b5"
Sep 11 12:12:27.084835 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:27.084815    2565 scope.go:117] "RemoveContainer" containerID="485dd2969282ad22ae8b1f28e3c9925cfaed9aa7f2a615e8f50d1780029e674d"
Sep 11 12:12:51.860232 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:51.860198    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"]
Sep 11 12:12:51.860789 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:51.860441    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5" podUID="3a20a0eb-26ad-4571-8c30-612ddb925d63" containerName="istio-proxy" containerID="cri-o://9c1aa0ef8a40a30518a658d23f9fdc79c61bbc2dc4ada8bda7d1052fdfdfbe48" gracePeriod=30
Sep 11 12:12:57.123451 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.123381    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:12:57.243759 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.243717    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-istio-data\") pod \"3a20a0eb-26ad-4571-8c30-612ddb925d63\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") "
Sep 11 12:12:57.243759 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.243762    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-credential-socket\") pod \"3a20a0eb-26ad-4571-8c30-612ddb925d63\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") "
Sep 11 12:12:57.244012 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.243871    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a20a0eb-26ad-4571-8c30-612ddb925d63-istiod-ca-cert\") pod \"3a20a0eb-26ad-4571-8c30-612ddb925d63\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") "
Sep 11 12:12:57.244012 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.243903    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-istio-envoy\") pod \"3a20a0eb-26ad-4571-8c30-612ddb925d63\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") "
Sep 11 12:12:57.244012 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.243938    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a20a0eb-26ad-4571-8c30-612ddb925d63-istio-podinfo\") pod \"3a20a0eb-26ad-4571-8c30-612ddb925d63\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") "
Sep 11 12:12:57.244012 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.243987    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tpp8\" (UniqueName: \"kubernetes.io/projected/3a20a0eb-26ad-4571-8c30-612ddb925d63-kube-api-access-5tpp8\") pod \"3a20a0eb-26ad-4571-8c30-612ddb925d63\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") "
Sep 11 12:12:57.244226 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.244011    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a20a0eb-26ad-4571-8c30-612ddb925d63-istio-token\") pod \"3a20a0eb-26ad-4571-8c30-612ddb925d63\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") "
Sep 11 12:12:57.244226 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.244049    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-workload-certs\") pod \"3a20a0eb-26ad-4571-8c30-612ddb925d63\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") "
Sep 11 12:12:57.244226 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.244051    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-istio-data" (OuterVolumeSpecName: "istio-data") pod "3a20a0eb-26ad-4571-8c30-612ddb925d63" (UID: "3a20a0eb-26ad-4571-8c30-612ddb925d63"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:12:57.244226 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.244063    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3a20a0eb-26ad-4571-8c30-612ddb925d63" (UID: "3a20a0eb-26ad-4571-8c30-612ddb925d63"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:12:57.244226 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.244079    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-workload-socket\") pod \"3a20a0eb-26ad-4571-8c30-612ddb925d63\" (UID: \"3a20a0eb-26ad-4571-8c30-612ddb925d63\") "
Sep 11 12:12:57.244482 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.244376    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3a20a0eb-26ad-4571-8c30-612ddb925d63" (UID: "3a20a0eb-26ad-4571-8c30-612ddb925d63"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:12:57.244562 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.244519    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3a20a0eb-26ad-4571-8c30-612ddb925d63" (UID: "3a20a0eb-26ad-4571-8c30-612ddb925d63"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:12:57.244622 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.244559    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-istio-data\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:12:57.244622 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.244579    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-credential-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:12:57.244622 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.244593    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-workload-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:12:57.244815 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.244792    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a20a0eb-26ad-4571-8c30-612ddb925d63-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3a20a0eb-26ad-4571-8c30-612ddb925d63" (UID: "3a20a0eb-26ad-4571-8c30-612ddb925d63"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:12:57.246445 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.246394    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a20a0eb-26ad-4571-8c30-612ddb925d63-kube-api-access-5tpp8" (OuterVolumeSpecName: "kube-api-access-5tpp8") pod "3a20a0eb-26ad-4571-8c30-612ddb925d63" (UID: "3a20a0eb-26ad-4571-8c30-612ddb925d63"). InnerVolumeSpecName "kube-api-access-5tpp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:12:57.246570 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.246460    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3a20a0eb-26ad-4571-8c30-612ddb925d63" (UID: "3a20a0eb-26ad-4571-8c30-612ddb925d63"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:12:57.246673 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.246655    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a20a0eb-26ad-4571-8c30-612ddb925d63-istio-token" (OuterVolumeSpecName: "istio-token") pod "3a20a0eb-26ad-4571-8c30-612ddb925d63" (UID: "3a20a0eb-26ad-4571-8c30-612ddb925d63"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:12:57.246871 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.246848    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3a20a0eb-26ad-4571-8c30-612ddb925d63-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3a20a0eb-26ad-4571-8c30-612ddb925d63" (UID: "3a20a0eb-26ad-4571-8c30-612ddb925d63"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:12:57.321336 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.321298    2565 generic.go:356] "Generic (PLEG): container finished" podID="3a20a0eb-26ad-4571-8c30-612ddb925d63" containerID="9c1aa0ef8a40a30518a658d23f9fdc79c61bbc2dc4ada8bda7d1052fdfdfbe48" exitCode=0
Sep 11 12:12:57.321511 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.321357    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"
Sep 11 12:12:57.321511 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.321387    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5" event={"ID":"3a20a0eb-26ad-4571-8c30-612ddb925d63","Type":"ContainerDied","Data":"9c1aa0ef8a40a30518a658d23f9fdc79c61bbc2dc4ada8bda7d1052fdfdfbe48"}
Sep 11 12:12:57.321511 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.321445    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5" event={"ID":"3a20a0eb-26ad-4571-8c30-612ddb925d63","Type":"ContainerDied","Data":"a4430559d8071f4c51db6a744cf2e09dc5bc787b3ab9cac8a346c02755072650"}
Sep 11 12:12:57.321511 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.321466    2565 scope.go:117] "RemoveContainer" containerID="9c1aa0ef8a40a30518a658d23f9fdc79c61bbc2dc4ada8bda7d1052fdfdfbe48"
Sep 11 12:12:57.331390 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.331370    2565 scope.go:117] "RemoveContainer" containerID="66aead6735ac1c88f082d594953d0e1b0d17176a8cbd31380ed50d9c0637153a"
Sep 11 12:12:57.340119 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.340095    2565 scope.go:117] "RemoveContainer" containerID="9c1aa0ef8a40a30518a658d23f9fdc79c61bbc2dc4ada8bda7d1052fdfdfbe48"
Sep 11 12:12:57.340676 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:12:57.340654    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c1aa0ef8a40a30518a658d23f9fdc79c61bbc2dc4ada8bda7d1052fdfdfbe48\": container with ID starting with 9c1aa0ef8a40a30518a658d23f9fdc79c61bbc2dc4ada8bda7d1052fdfdfbe48 not found: ID does not exist" containerID="9c1aa0ef8a40a30518a658d23f9fdc79c61bbc2dc4ada8bda7d1052fdfdfbe48"
Sep 11 12:12:57.340892 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.340849    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c1aa0ef8a40a30518a658d23f9fdc79c61bbc2dc4ada8bda7d1052fdfdfbe48"} err="failed to get container status \"9c1aa0ef8a40a30518a658d23f9fdc79c61bbc2dc4ada8bda7d1052fdfdfbe48\": rpc error: code = NotFound desc = could not find container \"9c1aa0ef8a40a30518a658d23f9fdc79c61bbc2dc4ada8bda7d1052fdfdfbe48\": container with ID starting with 9c1aa0ef8a40a30518a658d23f9fdc79c61bbc2dc4ada8bda7d1052fdfdfbe48 not found: ID does not exist"
Sep 11 12:12:57.341042 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.341013    2565 scope.go:117] "RemoveContainer" containerID="66aead6735ac1c88f082d594953d0e1b0d17176a8cbd31380ed50d9c0637153a"
Sep 11 12:12:57.341488 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:12:57.341469    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66aead6735ac1c88f082d594953d0e1b0d17176a8cbd31380ed50d9c0637153a\": container with ID starting with 66aead6735ac1c88f082d594953d0e1b0d17176a8cbd31380ed50d9c0637153a not found: ID does not exist" containerID="66aead6735ac1c88f082d594953d0e1b0d17176a8cbd31380ed50d9c0637153a"
Sep 11 12:12:57.341577 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.341492    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66aead6735ac1c88f082d594953d0e1b0d17176a8cbd31380ed50d9c0637153a"} err="failed to get container status \"66aead6735ac1c88f082d594953d0e1b0d17176a8cbd31380ed50d9c0637153a\": rpc error: code = NotFound desc = could not find container \"66aead6735ac1c88f082d594953d0e1b0d17176a8cbd31380ed50d9c0637153a\": container with ID starting with 66aead6735ac1c88f082d594953d0e1b0d17176a8cbd31380ed50d9c0637153a not found: ID does not exist"
Sep 11 12:12:57.344837 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.344812    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"]
Sep 11 12:12:57.345228 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.345205    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-istio-envoy\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:12:57.345336 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.345235    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a20a0eb-26ad-4571-8c30-612ddb925d63-istio-podinfo\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:12:57.345336 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.345249    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tpp8\" (UniqueName: \"kubernetes.io/projected/3a20a0eb-26ad-4571-8c30-612ddb925d63-kube-api-access-5tpp8\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:12:57.345336 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.345264    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a20a0eb-26ad-4571-8c30-612ddb925d63-istio-token\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:12:57.345336 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.345277    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a20a0eb-26ad-4571-8c30-612ddb925d63-workload-certs\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:12:57.345336 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.345289    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a20a0eb-26ad-4571-8c30-612ddb925d63-istiod-ca-cert\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:12:57.347887 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:57.347861    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-fde9d154-openshift-default-79596f8d56-tbjb5"]
Sep 11 12:12:58.843344 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:12:58.843306    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a20a0eb-26ad-4571-8c30-612ddb925d63" path="/var/lib/kubelet/pods/3a20a0eb-26ad-4571-8c30-612ddb925d63/volumes"
Sep 11 12:13:24.987777 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:24.987748    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7779-bc7491"]
Sep 11 12:13:24.988150 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:24.988120    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a20a0eb-26ad-4571-8c30-612ddb925d63" containerName="istio-proxy"
Sep 11 12:13:24.988150 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:24.988131    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a20a0eb-26ad-4571-8c30-612ddb925d63" containerName="istio-proxy"
Sep 11 12:13:24.988150 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:24.988143    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1976342-76dc-4bb2-9404-944a1398b5c4" containerName="revoke-keys"
Sep 11 12:13:24.988150 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:24.988148    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1976342-76dc-4bb2-9404-944a1398b5c4" containerName="revoke-keys"
Sep 11 12:13:24.988291 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:24.988215    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a20a0eb-26ad-4571-8c30-612ddb925d63" containerName="istio-proxy"
Sep 11 12:13:24.988291 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:24.988223    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1976342-76dc-4bb2-9404-944a1398b5c4" containerName="revoke-keys"
Sep 11 12:13:24.992622 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:24.992601    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7779-bc7491"
Sep 11 12:13:24.995665 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:24.995641    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-sw5w8\""
Sep 11 12:13:24.997802 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:24.997778    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7779-bc7491"]
Sep 11 12:13:25.105364 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:25.105334    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvjqx\" (UniqueName: \"kubernetes.io/projected/e60ba70e-bdb2-4e21-91e7-aa301165822c-kube-api-access-nvjqx\") pod \"test-curl-7779-bc7491\" (UID: \"e60ba70e-bdb2-4e21-91e7-aa301165822c\") " pod="opendatahub/test-curl-7779-bc7491"
Sep 11 12:13:25.206951 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:25.206908    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvjqx\" (UniqueName: \"kubernetes.io/projected/e60ba70e-bdb2-4e21-91e7-aa301165822c-kube-api-access-nvjqx\") pod \"test-curl-7779-bc7491\" (UID: \"e60ba70e-bdb2-4e21-91e7-aa301165822c\") " pod="opendatahub/test-curl-7779-bc7491"
Sep 11 12:13:25.216840 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:25.216807    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvjqx\" (UniqueName: \"kubernetes.io/projected/e60ba70e-bdb2-4e21-91e7-aa301165822c-kube-api-access-nvjqx\") pod \"test-curl-7779-bc7491\" (UID: \"e60ba70e-bdb2-4e21-91e7-aa301165822c\") " pod="opendatahub/test-curl-7779-bc7491"
Sep 11 12:13:25.302972 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:25.302894    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7779-bc7491"
Sep 11 12:13:25.572693 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:25.572650    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7779-bc7491"]
Sep 11 12:13:25.574051 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:13:25.574022    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode60ba70e_bdb2_4e21_91e7_aa301165822c.slice/crio-76f5ae1094b2ccc6448eb7989dc282c7bcaa16b0d6166813d8452ae2c0d9dc78 WatchSource:0}: Error finding container 76f5ae1094b2ccc6448eb7989dc282c7bcaa16b0d6166813d8452ae2c0d9dc78: Status 404 returned error can't find the container with id 76f5ae1094b2ccc6448eb7989dc282c7bcaa16b0d6166813d8452ae2c0d9dc78
Sep 11 12:13:26.504412 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:26.504374    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7779-bc7491" event={"ID":"e60ba70e-bdb2-4e21-91e7-aa301165822c","Type":"ContainerStarted","Data":"fc1eedc162338f8176720c0b3153587e54f4123c68617e072ba46c3dde7090aa"}
Sep 11 12:13:26.504805 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:26.504421    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7779-bc7491" event={"ID":"e60ba70e-bdb2-4e21-91e7-aa301165822c","Type":"ContainerStarted","Data":"76f5ae1094b2ccc6448eb7989dc282c7bcaa16b0d6166813d8452ae2c0d9dc78"}
Sep 11 12:13:26.522377 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:26.522325    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7779-bc7491" podStartSLOduration=2.5223083969999998 podStartE2EDuration="2.522308397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:13:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:13:26.51928228 +0000 UTC m=+1320.201681779" watchObservedRunningTime="2026-09-11 12:13:26.522308397 +0000 UTC m=+1320.204707969"
Sep 11 12:13:27.102418 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:27.102381    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7779-bc7491"]
Sep 11 12:13:27.106635 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:27.106607    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7779-bc7491"]
Sep 11 12:13:27.112441 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:27.112409    2565 scope.go:117] "RemoveContainer" containerID="a64cf8a7d8ef7c959c4d6380d58d029b034340787e2eb6096affcc780c441f42"
Sep 11 12:13:27.510364 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:13:27.510332    2565 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7779-bc7491" container="test-curl-7779-bc7491"
Sep 11 12:13:28.518085 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:28.518044    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7779-bc7491" podUID="e60ba70e-bdb2-4e21-91e7-aa301165822c" containerName="test-curl-7779-bc7491" containerID="cri-o://fc1eedc162338f8176720c0b3153587e54f4123c68617e072ba46c3dde7090aa" gracePeriod=2
Sep 11 12:13:28.520583 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:13:28.520542    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7779-bc7491\" is forbidden: User \"system:node:ip-10-0-138-111.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-111.ec2.internal' and this object" podUID="e60ba70e-bdb2-4e21-91e7-aa301165822c" pod="opendatahub/test-curl-7779-bc7491"
Sep 11 12:13:30.700177 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:30.700150    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7779-bc7491"
Sep 11 12:13:30.762731 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:30.762676    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvjqx\" (UniqueName: \"kubernetes.io/projected/e60ba70e-bdb2-4e21-91e7-aa301165822c-kube-api-access-nvjqx\") pod \"e60ba70e-bdb2-4e21-91e7-aa301165822c\" (UID: \"e60ba70e-bdb2-4e21-91e7-aa301165822c\") "
Sep 11 12:13:30.764873 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:30.764837    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e60ba70e-bdb2-4e21-91e7-aa301165822c-kube-api-access-nvjqx" (OuterVolumeSpecName: "kube-api-access-nvjqx") pod "e60ba70e-bdb2-4e21-91e7-aa301165822c" (UID: "e60ba70e-bdb2-4e21-91e7-aa301165822c"). InnerVolumeSpecName "kube-api-access-nvjqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:13:30.842808 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:30.842718    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e60ba70e-bdb2-4e21-91e7-aa301165822c" path="/var/lib/kubelet/pods/e60ba70e-bdb2-4e21-91e7-aa301165822c/volumes"
Sep 11 12:13:30.864130 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:30.864101    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvjqx\" (UniqueName: \"kubernetes.io/projected/e60ba70e-bdb2-4e21-91e7-aa301165822c-kube-api-access-nvjqx\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:13:31.538711 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:31.538641    2565 generic.go:356] "Generic (PLEG): container finished" podID="e60ba70e-bdb2-4e21-91e7-aa301165822c" containerID="fc1eedc162338f8176720c0b3153587e54f4123c68617e072ba46c3dde7090aa" exitCode=137
Sep 11 12:13:31.538711 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:31.538709    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7779-bc7491"
Sep 11 12:13:31.538978 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:31.538743    2565 scope.go:117] "RemoveContainer" containerID="fc1eedc162338f8176720c0b3153587e54f4123c68617e072ba46c3dde7090aa"
Sep 11 12:13:31.549611 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:31.549588    2565 scope.go:117] "RemoveContainer" containerID="fc1eedc162338f8176720c0b3153587e54f4123c68617e072ba46c3dde7090aa"
Sep 11 12:13:31.549926 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:13:31.549906    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc1eedc162338f8176720c0b3153587e54f4123c68617e072ba46c3dde7090aa\": container with ID starting with fc1eedc162338f8176720c0b3153587e54f4123c68617e072ba46c3dde7090aa not found: ID does not exist" containerID="fc1eedc162338f8176720c0b3153587e54f4123c68617e072ba46c3dde7090aa"
Sep 11 12:13:31.549993 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:31.549933    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc1eedc162338f8176720c0b3153587e54f4123c68617e072ba46c3dde7090aa"} err="failed to get container status \"fc1eedc162338f8176720c0b3153587e54f4123c68617e072ba46c3dde7090aa\": rpc error: code = NotFound desc = could not find container \"fc1eedc162338f8176720c0b3153587e54f4123c68617e072ba46c3dde7090aa\": container with ID starting with fc1eedc162338f8176720c0b3153587e54f4123c68617e072ba46c3dde7090aa not found: ID does not exist"
Sep 11 12:13:45.716610 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.716571    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"]
Sep 11 12:13:45.717219 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.717201    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e60ba70e-bdb2-4e21-91e7-aa301165822c" containerName="test-curl-7779-bc7491"
Sep 11 12:13:45.717267 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.717222    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e60ba70e-bdb2-4e21-91e7-aa301165822c" containerName="test-curl-7779-bc7491"
Sep 11 12:13:45.717303 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.717267    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a20a0eb-26ad-4571-8c30-612ddb925d63" containerName="istio-proxy"
Sep 11 12:13:45.717303 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.717276    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a20a0eb-26ad-4571-8c30-612ddb925d63" containerName="istio-proxy"
Sep 11 12:13:45.717371 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.717360    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a20a0eb-26ad-4571-8c30-612ddb925d63" containerName="istio-proxy"
Sep 11 12:13:45.717405 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.717377    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e60ba70e-bdb2-4e21-91e7-aa301165822c" containerName="test-curl-7779-bc7491"
Sep 11 12:13:45.722104 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.722079    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.726249 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.726226    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-482cb0-openshift-default-dockercfg-wqbbb\""
Sep 11 12:13:45.734615 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.734585    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"]
Sep 11 12:13:45.801382 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.801335    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-workload-certs\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.801728 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.801698    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-workload-socket\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.801883 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.801865    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-istio-data\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.802004 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.801990    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/129c9dae-98ef-4901-8161-8e3dd8cf5474-istio-token\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.802141 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.802126    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/129c9dae-98ef-4901-8161-8e3dd8cf5474-istio-podinfo\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.802274 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.802257    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/129c9dae-98ef-4901-8161-8e3dd8cf5474-istiod-ca-cert\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.802511 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.802387    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6pp2\" (UniqueName: \"kubernetes.io/projected/129c9dae-98ef-4901-8161-8e3dd8cf5474-kube-api-access-r6pp2\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.802511 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.802433    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-istio-envoy\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.802511 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.802456    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-credential-socket\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.903255 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.903213    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/129c9dae-98ef-4901-8161-8e3dd8cf5474-istio-token\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.903460 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.903272    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/129c9dae-98ef-4901-8161-8e3dd8cf5474-istio-podinfo\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.903460 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.903320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/129c9dae-98ef-4901-8161-8e3dd8cf5474-istiod-ca-cert\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.903460 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.903362    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6pp2\" (UniqueName: \"kubernetes.io/projected/129c9dae-98ef-4901-8161-8e3dd8cf5474-kube-api-access-r6pp2\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.903460 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.903396    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-istio-envoy\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.903460 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.903420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-credential-socket\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.903778 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.903534    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-workload-certs\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.903778 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.903579    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-workload-socket\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.903778 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.903601    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-istio-data\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.903991 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.903965    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-workload-certs\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.904071 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.903984    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-workload-socket\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.904071 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.904037    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-credential-socket\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.904183 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.904148    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-istio-data\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.904183 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.904175    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/129c9dae-98ef-4901-8161-8e3dd8cf5474-istiod-ca-cert\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.905729 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.905706    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-istio-envoy\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.905851 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.905834    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/129c9dae-98ef-4901-8161-8e3dd8cf5474-istio-podinfo\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.912290 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.912261    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/129c9dae-98ef-4901-8161-8e3dd8cf5474-istio-token\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:45.913093 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:45.913034    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6pp2\" (UniqueName: \"kubernetes.io/projected/129c9dae-98ef-4901-8161-8e3dd8cf5474-kube-api-access-r6pp2\") pod \"e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") " pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:46.034603 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:46.034512    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:46.313886 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:46.313859    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"]
Sep 11 12:13:46.316221 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:13:46.316191    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod129c9dae_98ef_4901_8161_8e3dd8cf5474.slice/crio-52f9bf988437173006980934a88a21b6f3c09ca451bdf20b8e20d11ec241e6dd WatchSource:0}: Error finding container 52f9bf988437173006980934a88a21b6f3c09ca451bdf20b8e20d11ec241e6dd: Status 404 returned error can't find the container with id 52f9bf988437173006980934a88a21b6f3c09ca451bdf20b8e20d11ec241e6dd
Sep 11 12:13:46.318572 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:46.318536    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:13:46.318678 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:46.318605    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:13:46.318678 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:46.318634    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:13:46.638021 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:46.637981    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk" event={"ID":"129c9dae-98ef-4901-8161-8e3dd8cf5474","Type":"ContainerStarted","Data":"2254fa256007185c6f02d7f0e99f806f8ee789fdc7575cb38956a74b196aaa77"}
Sep 11 12:13:46.638196 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:46.638084    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk" event={"ID":"129c9dae-98ef-4901-8161-8e3dd8cf5474","Type":"ContainerStarted","Data":"52f9bf988437173006980934a88a21b6f3c09ca451bdf20b8e20d11ec241e6dd"}
Sep 11 12:13:46.657990 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:46.657932    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk" podStartSLOduration=1.657915474 podStartE2EDuration="1.657915474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:13:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:13:46.656330636 +0000 UTC m=+1340.338730134" watchObservedRunningTime="2026-09-11 12:13:46.657915474 +0000 UTC m=+1340.340314972"
Sep 11 12:13:47.034930 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:47.034829    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:47.040799 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:47.040770    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:47.645501 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:47.645469    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:13:47.646541 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:13:47.646510    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:14:03.688846 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:03.688800    2565 patch_prober.go:28] interesting pod/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 12:14:03.689290 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:03.688873    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk" podUID="129c9dae-98ef-4901-8161-8e3dd8cf5474" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 12:14:04.766396 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:04.766362    2565 generic.go:356] "Generic (PLEG): container finished" podID="129c9dae-98ef-4901-8161-8e3dd8cf5474" containerID="2254fa256007185c6f02d7f0e99f806f8ee789fdc7575cb38956a74b196aaa77" exitCode=0
Sep 11 12:14:04.766896 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:04.766403    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk" event={"ID":"129c9dae-98ef-4901-8161-8e3dd8cf5474","Type":"ContainerDied","Data":"2254fa256007185c6f02d7f0e99f806f8ee789fdc7575cb38956a74b196aaa77"}
Sep 11 12:14:04.766896 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:04.766801    2565 scope.go:117] "RemoveContainer" containerID="2254fa256007185c6f02d7f0e99f806f8ee789fdc7575cb38956a74b196aaa77"
Sep 11 12:14:04.767834 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:04.767805    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:14:04.767903 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:04.767872    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:14:04.767903 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:04.767901    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:14:05.774270 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:05.774228    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk" event={"ID":"129c9dae-98ef-4901-8161-8e3dd8cf5474","Type":"ContainerStarted","Data":"8920e9832cc36bba244bef2ecbccf734735bd116f7c02600d6aedb5bbf86f627"}
Sep 11 12:14:06.034942 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:06.034839    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:14:06.035097 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:06.035058    2565 patch_prober.go:28] interesting pod/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 11 12:14:06.035144 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:06.035108    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk" podUID="129c9dae-98ef-4901-8161-8e3dd8cf5474" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 11 12:14:07.035360 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:07.035320    2565 patch_prober.go:28] interesting pod/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 11 12:14:07.035775 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:07.035378    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk" podUID="129c9dae-98ef-4901-8161-8e3dd8cf5474" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 11 12:14:08.034890 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:08.034850    2565 patch_prober.go:28] interesting pod/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 11 12:14:08.035072 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:08.034908    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk" podUID="129c9dae-98ef-4901-8161-8e3dd8cf5474" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 11 12:14:09.035806 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:09.035771    2565 patch_prober.go:28] interesting pod/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 11 12:14:09.036244 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:09.035824    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk" podUID="129c9dae-98ef-4901-8161-8e3dd8cf5474" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 11 12:14:10.035124 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:10.035085    2565 patch_prober.go:28] interesting pod/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 11 12:14:10.035290 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:10.035149    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk" podUID="129c9dae-98ef-4901-8161-8e3dd8cf5474" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 11 12:14:11.035994 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:11.035949    2565 patch_prober.go:28] interesting pod/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 11 12:14:11.036487 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:11.036023    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk" podUID="129c9dae-98ef-4901-8161-8e3dd8cf5474" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 11 12:14:12.038374 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:12.038338    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:14:12.038850 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:12.038630    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:14:12.039432 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:12.039409    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:14:14.174543 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.174506    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"]
Sep 11 12:14:14.178733 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.178710    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.181644 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.181622    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-571fee-openshift-default-dockercfg-fxx42\""
Sep 11 12:14:14.193165 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.193141    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"]
Sep 11 12:14:14.308981 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.308939    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istiod-ca-cert\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.309284 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.309260    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istio-data\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.309518 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.309499    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-credential-socket\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.309695 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.309663    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istio-token\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.309871 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.309854    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-workload-certs\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.310010 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.309996    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-workload-socket\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.310128 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.310115    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istio-podinfo\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.310291 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.310268    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wc4x\" (UniqueName: \"kubernetes.io/projected/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-kube-api-access-6wc4x\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.310509 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.310482    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istio-envoy\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.411406 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.411373    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istio-envoy\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.411599 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.411428    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istiod-ca-cert\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.411599 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.411458    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istio-data\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.411599 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.411531    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-credential-socket\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.411599 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.411570    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istio-token\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.411599 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.411596    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-workload-certs\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.411912 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.411624    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-workload-socket\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.411912 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.411649    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istio-podinfo\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.411912 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.411706    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wc4x\" (UniqueName: \"kubernetes.io/projected/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-kube-api-access-6wc4x\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.412064 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.411908    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istio-data\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.412153 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.412126    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-credential-socket\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.412225 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.412168    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-workload-socket\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.412305 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.412282    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istiod-ca-cert\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.412376 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.412353    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-workload-certs\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.413840 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.413819    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istio-envoy\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.414253 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.414237    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istio-podinfo\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.419788 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.419763    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istio-token\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.419872 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.419856    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wc4x\" (UniqueName: \"kubernetes.io/projected/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-kube-api-access-6wc4x\") pod \"e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") " pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.491031 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.490947    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:14.771337 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.771303    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"]
Sep 11 12:14:14.771828 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:14:14.771804    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dbd4ad7_0a57_4430_bbd5_b5ea712e2e7b.slice/crio-1af44fb4752829c4daf94b430d618c1896345761206aaf75f45fe63e492f1226 WatchSource:0}: Error finding container 1af44fb4752829c4daf94b430d618c1896345761206aaf75f45fe63e492f1226: Status 404 returned error can't find the container with id 1af44fb4752829c4daf94b430d618c1896345761206aaf75f45fe63e492f1226
Sep 11 12:14:14.774420 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.774387    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:14:14.774496 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.774451    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:14:14.774496 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.774477    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:14:14.833287 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:14.833261    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl" event={"ID":"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b","Type":"ContainerStarted","Data":"1af44fb4752829c4daf94b430d618c1896345761206aaf75f45fe63e492f1226"}
Sep 11 12:14:15.841501 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:15.841463    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl" event={"ID":"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b","Type":"ContainerStarted","Data":"9b7f53463487bf54ba45143ae3d4de1262be93beb13fa13f6a053fa61d8c3ea0"}
Sep 11 12:14:15.862552 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:15.862499    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl" podStartSLOduration=1.8624844459999998 podStartE2EDuration="1.862484446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:14:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:14:15.861480251 +0000 UTC m=+1369.543879754" watchObservedRunningTime="2026-09-11 12:14:15.862484446 +0000 UTC m=+1369.544883943"
Sep 11 12:14:16.491877 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:16.491839    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:16.496605 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:16.496580    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:16.848480 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:16.848389    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:16.849497 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:16.849476    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:27.145441 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:27.145403    2565 scope.go:117] "RemoveContainer" containerID="9569d2edb06b551d952d8768f0b4fc4423ac096664c707fcfcd2334eeb6a4ed1"
Sep 11 12:14:37.995055 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:37.994974    2565 generic.go:356] "Generic (PLEG): container finished" podID="8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b" containerID="9b7f53463487bf54ba45143ae3d4de1262be93beb13fa13f6a053fa61d8c3ea0" exitCode=0
Sep 11 12:14:37.995055 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:37.995013    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl" event={"ID":"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b","Type":"ContainerDied","Data":"9b7f53463487bf54ba45143ae3d4de1262be93beb13fa13f6a053fa61d8c3ea0"}
Sep 11 12:14:37.995491 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:37.995414    2565 scope.go:117] "RemoveContainer" containerID="9b7f53463487bf54ba45143ae3d4de1262be93beb13fa13f6a053fa61d8c3ea0"
Sep 11 12:14:37.996505 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:37.996472    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:14:37.996599 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:37.996542    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:14:37.996599 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:37.996573    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:14:39.003427 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:39.003392    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl" event={"ID":"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b","Type":"ContainerStarted","Data":"55324d0955a6024085375660389e474bc770d602a7161bb27c7704c9d1a21828"}
Sep 11 12:14:39.491307 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:39.491271    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:39.491530 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:39.491512    2565 patch_prober.go:28] interesting pod/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 11 12:14:39.491589 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:39.491556    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl" podUID="8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 11 12:14:40.491377 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:40.491333    2565 patch_prober.go:28] interesting pod/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 11 12:14:40.491820 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:40.491395    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl" podUID="8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 11 12:14:41.491608 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:41.491567    2565 patch_prober.go:28] interesting pod/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 11 12:14:41.492052 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:41.491624    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl" podUID="8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 11 12:14:42.491792 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:42.491750    2565 patch_prober.go:28] interesting pod/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 11 12:14:42.492203 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:42.491817    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl" podUID="8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 11 12:14:43.491933 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:43.491893    2565 patch_prober.go:28] interesting pod/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 11 12:14:43.492326 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:43.491955    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl" podUID="8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 11 12:14:44.495819 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:44.495787    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:44.496224 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:44.496162    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:44.496896 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:44.496875    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:14:45.432504 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:45.432461    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-482cb0-kv66d"]
Sep 11 12:14:45.435880 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:45.435856    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-482cb0-kv66d"
Sep 11 12:14:45.438548 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:45.438526    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:14:45.438677 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:45.438563    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r95fz\""
Sep 11 12:14:45.445197 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:45.445169    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-482cb0-kv66d"]
Sep 11 12:14:45.531375 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:45.531337    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8e2821a-e016-48b5-8a70-2246bf4b066b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-482cb0-kv66d\" (UID: \"b8e2821a-e016-48b5-8a70-2246bf4b066b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-482cb0-kv66d"
Sep 11 12:14:45.632041 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:45.632004    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8e2821a-e016-48b5-8a70-2246bf4b066b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-482cb0-kv66d\" (UID: \"b8e2821a-e016-48b5-8a70-2246bf4b066b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-482cb0-kv66d"
Sep 11 12:14:45.632641 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:45.632615    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8e2821a-e016-48b5-8a70-2246bf4b066b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-482cb0-kv66d\" (UID: \"b8e2821a-e016-48b5-8a70-2246bf4b066b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-482cb0-kv66d"
Sep 11 12:14:45.748735 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:45.748620    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-482cb0-kv66d"
Sep 11 12:14:46.023802 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:46.023774    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-482cb0-kv66d"]
Sep 11 12:14:46.025942 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:14:46.025912    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8e2821a_e016_48b5_8a70_2246bf4b066b.slice/crio-d129e9df7902b4bee3ef71228ae3fe846c4b009605244c690db9498d27699de7 WatchSource:0}: Error finding container d129e9df7902b4bee3ef71228ae3fe846c4b009605244c690db9498d27699de7: Status 404 returned error can't find the container with id d129e9df7902b4bee3ef71228ae3fe846c4b009605244c690db9498d27699de7
Sep 11 12:14:46.051163 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:46.051133    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-482cb0-kv66d" event={"ID":"b8e2821a-e016-48b5-8a70-2246bf4b066b","Type":"ContainerStarted","Data":"d129e9df7902b4bee3ef71228ae3fe846c4b009605244c690db9498d27699de7"}
Sep 11 12:14:47.058933 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:47.058889    2565 generic.go:356] "Generic (PLEG): container finished" podID="b8e2821a-e016-48b5-8a70-2246bf4b066b" containerID="15d7b3c45af014f3276faa1f0d7f33f424c2eaa60c31d5939705fbc9a28a2e77" exitCode=0
Sep 11 12:14:47.059315 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:47.058974    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-482cb0-kv66d" event={"ID":"b8e2821a-e016-48b5-8a70-2246bf4b066b","Type":"ContainerDied","Data":"15d7b3c45af014f3276faa1f0d7f33f424c2eaa60c31d5939705fbc9a28a2e77"}
Sep 11 12:14:48.210600 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:48.210575    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-482cb0-kv66d"
Sep 11 12:14:48.259976 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:48.259936    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8e2821a-e016-48b5-8a70-2246bf4b066b-maas-api-service-ca\") pod \"b8e2821a-e016-48b5-8a70-2246bf4b066b\" (UID: \"b8e2821a-e016-48b5-8a70-2246bf4b066b\") "
Sep 11 12:14:48.260291 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:48.260264    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8e2821a-e016-48b5-8a70-2246bf4b066b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b8e2821a-e016-48b5-8a70-2246bf4b066b" (UID: "b8e2821a-e016-48b5-8a70-2246bf4b066b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:14:48.361611 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:48.361532    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8e2821a-e016-48b5-8a70-2246bf4b066b-maas-api-service-ca\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:14:49.072277 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:49.072244    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-482cb0-kv66d" event={"ID":"b8e2821a-e016-48b5-8a70-2246bf4b066b","Type":"ContainerDied","Data":"d129e9df7902b4bee3ef71228ae3fe846c4b009605244c690db9498d27699de7"}
Sep 11 12:14:49.072277 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:49.072279    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-482cb0-kv66d"
Sep 11 12:14:49.072481 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:49.072291    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d129e9df7902b4bee3ef71228ae3fe846c4b009605244c690db9498d27699de7"
Sep 11 12:14:59.253316 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:59.253281    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7779-6f6208"]
Sep 11 12:14:59.253784 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:59.253768    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8e2821a-e016-48b5-8a70-2246bf4b066b" containerName="revoke-keys"
Sep 11 12:14:59.253784 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:59.253785    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8e2821a-e016-48b5-8a70-2246bf4b066b" containerName="revoke-keys"
Sep 11 12:14:59.253871 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:59.253846    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8e2821a-e016-48b5-8a70-2246bf4b066b" containerName="revoke-keys"
Sep 11 12:14:59.256771 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:59.256755    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7779-6f6208"
Sep 11 12:14:59.259602 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:59.259582    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-sw5w8\""
Sep 11 12:14:59.266368 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:59.266347    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7779-6f6208"]
Sep 11 12:14:59.367949 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:59.367912    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwqh4\" (UniqueName: \"kubernetes.io/projected/22875264-5a51-43b4-b670-62fcf3fb3004-kube-api-access-rwqh4\") pod \"test-curl-7779-6f6208\" (UID: \"22875264-5a51-43b4-b670-62fcf3fb3004\") " pod="opendatahub/test-curl-7779-6f6208"
Sep 11 12:14:59.468854 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:59.468815    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwqh4\" (UniqueName: \"kubernetes.io/projected/22875264-5a51-43b4-b670-62fcf3fb3004-kube-api-access-rwqh4\") pod \"test-curl-7779-6f6208\" (UID: \"22875264-5a51-43b4-b670-62fcf3fb3004\") " pod="opendatahub/test-curl-7779-6f6208"
Sep 11 12:14:59.477595 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:59.477561    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwqh4\" (UniqueName: \"kubernetes.io/projected/22875264-5a51-43b4-b670-62fcf3fb3004-kube-api-access-rwqh4\") pod \"test-curl-7779-6f6208\" (UID: \"22875264-5a51-43b4-b670-62fcf3fb3004\") " pod="opendatahub/test-curl-7779-6f6208"
Sep 11 12:14:59.566629 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:59.566547    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7779-6f6208"
Sep 11 12:14:59.843278 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:14:59.843251    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22875264_5a51_43b4_b670_62fcf3fb3004.slice/crio-56cb54c8f65508b3d67af0a3b20117e5e7ea1094c866d65686212f850730c228 WatchSource:0}: Error finding container 56cb54c8f65508b3d67af0a3b20117e5e7ea1094c866d65686212f850730c228: Status 404 returned error can't find the container with id 56cb54c8f65508b3d67af0a3b20117e5e7ea1094c866d65686212f850730c228
Sep 11 12:14:59.843859 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:14:59.843826    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7779-6f6208"]
Sep 11 12:15:00.137632 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.137595    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7779-6f6208" event={"ID":"22875264-5a51-43b4-b670-62fcf3fb3004","Type":"ContainerStarted","Data":"cba6c2b6721a84c5f5a89e1b0a3b06ba0505fdfe6a70e626a02cb9e29baf50ee"}
Sep 11 12:15:00.137821 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.137642    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7779-6f6208" event={"ID":"22875264-5a51-43b4-b670-62fcf3fb3004","Type":"ContainerStarted","Data":"56cb54c8f65508b3d67af0a3b20117e5e7ea1094c866d65686212f850730c228"}
Sep 11 12:15:00.148585 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.148172    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c000cf-29818815-4sp5k"]
Sep 11 12:15:00.151982 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.151962    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c000cf-29818815-4sp5k"
Sep 11 12:15:00.152630 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.152605    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-88968d-29818815-m4kl2"]
Sep 11 12:15:00.154890 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.154868    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r95fz\""
Sep 11 12:15:00.156172 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.156152    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-88968d-29818815-m4kl2"
Sep 11 12:15:00.156318 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.156299    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4d3f83-29818815-dq7dk"]
Sep 11 12:15:00.159795 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.159773    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4d3f83-29818815-dq7dk"
Sep 11 12:15:00.161997 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.161967    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c000cf-29818815-4sp5k"]
Sep 11 12:15:00.165653 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.165632    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4d3f83-29818815-dq7dk"]
Sep 11 12:15:00.166942 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.166891    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7779-6f6208" podStartSLOduration=1.166872973 podStartE2EDuration="1.166872973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:14:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:15:00.164359846 +0000 UTC m=+1413.846759345" watchObservedRunningTime="2026-09-11 12:15:00.166872973 +0000 UTC m=+1413.849272472"
Sep 11 12:15:00.167284 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.167266    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c000cf-29818815-4sp5k"
Sep 11 12:15:00.177733 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.175693    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-88968d-29818815-m4kl2"]
Sep 11 12:15:00.178181 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.178160    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-88968d-29818815-m4kl2"
Sep 11 12:15:00.180589 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.180564    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818815-nkz4v"]
Sep 11 12:15:00.184870 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.184848    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818815-nkz4v"
Sep 11 12:15:00.186962 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.186939    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4d3f83-29818815-dq7dk"
Sep 11 12:15:00.194490 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.194470    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818815-nkz4v"]
Sep 11 12:15:00.201529 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.201510    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818815-nkz4v"
Sep 11 12:15:00.475253 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.475116    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c000cf-29818815-4sp5k"]
Sep 11 12:15:00.476667 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:15:00.476633    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac6e3a8b_3982_44d6_8af7_121c2406cb8d.slice/crio-99239767d4b022530b74eb1000bdb422d600c9599b1a754e9e6e55377eac8ca7 WatchSource:0}: Error finding container 99239767d4b022530b74eb1000bdb422d600c9599b1a754e9e6e55377eac8ca7: Status 404 returned error can't find the container with id 99239767d4b022530b74eb1000bdb422d600c9599b1a754e9e6e55377eac8ca7
Sep 11 12:15:00.502461 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.502436    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-88968d-29818815-m4kl2"]
Sep 11 12:15:00.504808 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:15:00.504737    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbea006f3_8c20_4441_bd97_67fbb6b22d21.slice/crio-244ce011d5cd75ef10850bd37148350151b8ce8e58e198b73801fbed12e2db81 WatchSource:0}: Error finding container 244ce011d5cd75ef10850bd37148350151b8ce8e58e198b73801fbed12e2db81: Status 404 returned error can't find the container with id 244ce011d5cd75ef10850bd37148350151b8ce8e58e198b73801fbed12e2db81
Sep 11 12:15:00.512822 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.512802    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818815-nkz4v"]
Sep 11 12:15:00.513069 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.513029    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4d3f83-29818815-dq7dk"]
Sep 11 12:15:00.749487 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.749384    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7779-6f6208"]
Sep 11 12:15:00.753122 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.753092    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7779-6f6208"]
Sep 11 12:15:00.861960 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.861936    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7779-3ad128"]
Sep 11 12:15:00.862382 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.862370    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22875264-5a51-43b4-b670-62fcf3fb3004" containerName="test-curl-7779-6f6208"
Sep 11 12:15:00.862421 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.862384    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="22875264-5a51-43b4-b670-62fcf3fb3004" containerName="test-curl-7779-6f6208"
Sep 11 12:15:00.862472 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.862463    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="22875264-5a51-43b4-b670-62fcf3fb3004" containerName="test-curl-7779-6f6208"
Sep 11 12:15:00.865520 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.865502    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7779-3ad128"
Sep 11 12:15:00.871758 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.871735    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7779-3ad128"]
Sep 11 12:15:00.984840 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:00.984801    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlxft\" (UniqueName: \"kubernetes.io/projected/1410fc14-2221-46f6-b235-0f79f9e83bd9-kube-api-access-qlxft\") pod \"test-curl-7779-3ad128\" (UID: \"1410fc14-2221-46f6-b235-0f79f9e83bd9\") " pod="opendatahub/test-curl-7779-3ad128"
Sep 11 12:15:01.085886 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:01.085802    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlxft\" (UniqueName: \"kubernetes.io/projected/1410fc14-2221-46f6-b235-0f79f9e83bd9-kube-api-access-qlxft\") pod \"test-curl-7779-3ad128\" (UID: \"1410fc14-2221-46f6-b235-0f79f9e83bd9\") " pod="opendatahub/test-curl-7779-3ad128"
Sep 11 12:15:01.093763 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:01.093740    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlxft\" (UniqueName: \"kubernetes.io/projected/1410fc14-2221-46f6-b235-0f79f9e83bd9-kube-api-access-qlxft\") pod \"test-curl-7779-3ad128\" (UID: \"1410fc14-2221-46f6-b235-0f79f9e83bd9\") " pod="opendatahub/test-curl-7779-3ad128"
Sep 11 12:15:01.148006 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:01.147970    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-88968d-29818815-m4kl2" event={"ID":"bea006f3-8c20-4441-bd97-67fbb6b22d21","Type":"ContainerStarted","Data":"66c654b70aed81a1544281f69cc06f5e8354768a58eacfd8079ce5a0d18448e9"}
Sep 11 12:15:01.148545 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:01.148041    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-88968d-29818815-m4kl2" event={"ID":"bea006f3-8c20-4441-bd97-67fbb6b22d21","Type":"ContainerStarted","Data":"244ce011d5cd75ef10850bd37148350151b8ce8e58e198b73801fbed12e2db81"}
Sep 11 12:15:01.150472 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:01.150296    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818815-nkz4v" event={"ID":"666575eb-b229-488e-bcc2-5dda53e512cd","Type":"ContainerStarted","Data":"974347f358850ecb66e95fe189178a26625f24c309525022308073747e614756"}
Sep 11 12:15:01.150472 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:01.150345    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818815-nkz4v" event={"ID":"666575eb-b229-488e-bcc2-5dda53e512cd","Type":"ContainerStarted","Data":"e9780f1c616e932f80a85bf33f516e6a6534b63bb1f1276d1e9845bfc8539277"}
Sep 11 12:15:01.152259 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:01.152196    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c000cf-29818815-4sp5k" event={"ID":"ac6e3a8b-3982-44d6-8af7-121c2406cb8d","Type":"ContainerStarted","Data":"99239767d4b022530b74eb1000bdb422d600c9599b1a754e9e6e55377eac8ca7"}
Sep 11 12:15:01.154458 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:01.154431    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4d3f83-29818815-dq7dk" event={"ID":"d4fe5db6-bba5-40c0-b226-04a173d2093c","Type":"ContainerStarted","Data":"2ff1d5c5a2580b572177f24215e8f021d4bede8c8b9af729d723cf2040bf8c97"}
Sep 11 12:15:01.154594 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:01.154484    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-482cb0-kv66d"]
Sep 11 12:15:01.154594 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:01.154505    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4d3f83-29818815-dq7dk" event={"ID":"d4fe5db6-bba5-40c0-b226-04a173d2093c","Type":"ContainerStarted","Data":"66c79ae1770a128bb5dec9d4224a971d52bf48193a93489ed86d31bec45e046c"}
Sep 11 12:15:01.154730 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:15:01.154621    2565 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7779-6f6208" container="test-curl-7779-6f6208"
Sep 11 12:15:01.157724 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:01.157702    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-482cb0-kv66d"]
Sep 11 12:15:01.167479 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:01.167440    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-88968d-29818815-m4kl2" podStartSLOduration=1.167427337 podStartE2EDuration="1.167427337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:15:01.165070889 +0000 UTC m=+1414.847470377" watchObservedRunningTime="2026-09-11 12:15:01.167427337 +0000 UTC m=+1414.849826834"
Sep 11 12:15:01.175392 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:01.175368    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7779-3ad128"
Sep 11 12:15:01.181920 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:01.181882    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818815-nkz4v" podStartSLOduration=1.181869426 podStartE2EDuration="1.181869426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:15:01.180570853 +0000 UTC m=+1414.862970353" watchObservedRunningTime="2026-09-11 12:15:01.181869426 +0000 UTC m=+1414.864268923"
Sep 11 12:15:01.196507 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:01.196465    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4d3f83-29818815-dq7dk" podStartSLOduration=1.1964526229999999 podStartE2EDuration="1.196452623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:15:01.193890117 +0000 UTC m=+1414.876289615" watchObservedRunningTime="2026-09-11 12:15:01.196452623 +0000 UTC m=+1414.878852121"
Sep 11 12:15:01.456556 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:01.456531    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7779-3ad128"]
Sep 11 12:15:01.457460 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:15:01.457429    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1410fc14_2221_46f6_b235_0f79f9e83bd9.slice/crio-f9f1b8f13397ea0941a331dcd0d0dceb183031797a0837067d23409de1a85686 WatchSource:0}: Error finding container f9f1b8f13397ea0941a331dcd0d0dceb183031797a0837067d23409de1a85686: Status 404 returned error can't find the container with id f9f1b8f13397ea0941a331dcd0d0dceb183031797a0837067d23409de1a85686
Sep 11 12:15:02.163127 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:02.163091    2565 generic.go:356] "Generic (PLEG): container finished" podID="bea006f3-8c20-4441-bd97-67fbb6b22d21" containerID="66c654b70aed81a1544281f69cc06f5e8354768a58eacfd8079ce5a0d18448e9" exitCode=0
Sep 11 12:15:02.163577 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:02.163188    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-88968d-29818815-m4kl2" event={"ID":"bea006f3-8c20-4441-bd97-67fbb6b22d21","Type":"ContainerDied","Data":"66c654b70aed81a1544281f69cc06f5e8354768a58eacfd8079ce5a0d18448e9"}
Sep 11 12:15:02.164800 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:02.164779    2565 generic.go:356] "Generic (PLEG): container finished" podID="666575eb-b229-488e-bcc2-5dda53e512cd" containerID="974347f358850ecb66e95fe189178a26625f24c309525022308073747e614756" exitCode=0
Sep 11 12:15:02.164923 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:02.164843    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818815-nkz4v" event={"ID":"666575eb-b229-488e-bcc2-5dda53e512cd","Type":"ContainerDied","Data":"974347f358850ecb66e95fe189178a26625f24c309525022308073747e614756"}
Sep 11 12:15:02.166390 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:02.166371    2565 generic.go:356] "Generic (PLEG): container finished" podID="ac6e3a8b-3982-44d6-8af7-121c2406cb8d" containerID="68e78891504744af6d663e1cc7204838f2da0df3128e89862e7e71ba6decdbc3" exitCode=0
Sep 11 12:15:02.166496 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:02.166442    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c000cf-29818815-4sp5k" event={"ID":"ac6e3a8b-3982-44d6-8af7-121c2406cb8d","Type":"ContainerDied","Data":"68e78891504744af6d663e1cc7204838f2da0df3128e89862e7e71ba6decdbc3"}
Sep 11 12:15:02.167987 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:02.167970    2565 generic.go:356] "Generic (PLEG): container finished" podID="d4fe5db6-bba5-40c0-b226-04a173d2093c" containerID="2ff1d5c5a2580b572177f24215e8f021d4bede8c8b9af729d723cf2040bf8c97" exitCode=0
Sep 11 12:15:02.168072 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:02.168043    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4d3f83-29818815-dq7dk" event={"ID":"d4fe5db6-bba5-40c0-b226-04a173d2093c","Type":"ContainerDied","Data":"2ff1d5c5a2580b572177f24215e8f021d4bede8c8b9af729d723cf2040bf8c97"}
Sep 11 12:15:02.169486 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:02.169465    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7779-3ad128" event={"ID":"1410fc14-2221-46f6-b235-0f79f9e83bd9","Type":"ContainerStarted","Data":"5fb871b469a3b61b9237670160be3132cc3306cffba4ce5c0b2962ecac9fd826"}
Sep 11 12:15:02.169593 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:02.169500    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7779-3ad128" event={"ID":"1410fc14-2221-46f6-b235-0f79f9e83bd9","Type":"ContainerStarted","Data":"f9f1b8f13397ea0941a331dcd0d0dceb183031797a0837067d23409de1a85686"}
Sep 11 12:15:02.169593 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:02.169582    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7779-6f6208" podUID="22875264-5a51-43b4-b670-62fcf3fb3004" containerName="test-curl-7779-6f6208" containerID="cri-o://cba6c2b6721a84c5f5a89e1b0a3b06ba0505fdfe6a70e626a02cb9e29baf50ee" gracePeriod=2
Sep 11 12:15:02.194287 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:02.194223    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7779-3ad128" podStartSLOduration=2.194204414 podStartE2EDuration="2.194204414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:15:02.193609328 +0000 UTC m=+1415.876008827" watchObservedRunningTime="2026-09-11 12:15:02.194204414 +0000 UTC m=+1415.876603913"
Sep 11 12:15:02.782065 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:02.782026    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7779-3ad128"]
Sep 11 12:15:02.788277 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:02.788245    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7779-3ad128"]
Sep 11 12:15:02.843496 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:02.843414    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8e2821a-e016-48b5-8a70-2246bf4b066b" path="/var/lib/kubelet/pods/b8e2821a-e016-48b5-8a70-2246bf4b066b/volumes"
Sep 11 12:15:03.178100 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:15:03.177452    2565 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7779-3ad128" container="test-curl-7779-3ad128"
Sep 11 12:15:03.327784 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:03.327752    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818815-nkz4v"
Sep 11 12:15:03.396694 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:03.396645    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-88968d-29818815-m4kl2"
Sep 11 12:15:03.399671 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:03.399648    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4d3f83-29818815-dq7dk"
Sep 11 12:15:03.403135 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:03.403117    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c000cf-29818815-4sp5k"
Sep 11 12:15:04.185623 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:04.185599    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4d3f83-29818815-dq7dk"
Sep 11 12:15:04.185623 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:04.185603    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4d3f83-29818815-dq7dk" event={"ID":"d4fe5db6-bba5-40c0-b226-04a173d2093c","Type":"ContainerDied","Data":"66c79ae1770a128bb5dec9d4224a971d52bf48193a93489ed86d31bec45e046c"}
Sep 11 12:15:04.186022 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:04.185666    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66c79ae1770a128bb5dec9d4224a971d52bf48193a93489ed86d31bec45e046c"
Sep 11 12:15:04.187081 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:04.187054    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-88968d-29818815-m4kl2"
Sep 11 12:15:04.187186 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:04.187075    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-88968d-29818815-m4kl2" event={"ID":"bea006f3-8c20-4441-bd97-67fbb6b22d21","Type":"ContainerDied","Data":"244ce011d5cd75ef10850bd37148350151b8ce8e58e198b73801fbed12e2db81"}
Sep 11 12:15:04.187186 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:04.187116    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="244ce011d5cd75ef10850bd37148350151b8ce8e58e198b73801fbed12e2db81"
Sep 11 12:15:04.188622 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:04.188597    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818815-nkz4v"
Sep 11 12:15:04.188742 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:04.188601    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818815-nkz4v" event={"ID":"666575eb-b229-488e-bcc2-5dda53e512cd","Type":"ContainerDied","Data":"e9780f1c616e932f80a85bf33f516e6a6534b63bb1f1276d1e9845bfc8539277"}
Sep 11 12:15:04.188802 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:04.188744    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9780f1c616e932f80a85bf33f516e6a6534b63bb1f1276d1e9845bfc8539277"
Sep 11 12:15:04.190151 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:04.190126    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c000cf-29818815-4sp5k" event={"ID":"ac6e3a8b-3982-44d6-8af7-121c2406cb8d","Type":"ContainerDied","Data":"99239767d4b022530b74eb1000bdb422d600c9599b1a754e9e6e55377eac8ca7"}
Sep 11 12:15:04.190241 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:04.190156    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c000cf-29818815-4sp5k"
Sep 11 12:15:04.190241 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:04.190173    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99239767d4b022530b74eb1000bdb422d600c9599b1a754e9e6e55377eac8ca7"
Sep 11 12:15:04.190350 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:04.190238    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7779-3ad128" podUID="1410fc14-2221-46f6-b235-0f79f9e83bd9" containerName="test-curl-7779-3ad128" containerID="cri-o://5fb871b469a3b61b9237670160be3132cc3306cffba4ce5c0b2962ecac9fd826" gracePeriod=2
Sep 11 12:15:04.351543 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:04.351518    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7779-6f6208"
Sep 11 12:15:04.526005 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:04.525904    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwqh4\" (UniqueName: \"kubernetes.io/projected/22875264-5a51-43b4-b670-62fcf3fb3004-kube-api-access-rwqh4\") pod \"22875264-5a51-43b4-b670-62fcf3fb3004\" (UID: \"22875264-5a51-43b4-b670-62fcf3fb3004\") "
Sep 11 12:15:04.528116 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:04.528082    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22875264-5a51-43b4-b670-62fcf3fb3004-kube-api-access-rwqh4" (OuterVolumeSpecName: "kube-api-access-rwqh4") pod "22875264-5a51-43b4-b670-62fcf3fb3004" (UID: "22875264-5a51-43b4-b670-62fcf3fb3004"). InnerVolumeSpecName "kube-api-access-rwqh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:15:04.627280 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:04.627241    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwqh4\" (UniqueName: \"kubernetes.io/projected/22875264-5a51-43b4-b670-62fcf3fb3004-kube-api-access-rwqh4\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:04.844620 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:04.844526    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22875264-5a51-43b4-b670-62fcf3fb3004" path="/var/lib/kubelet/pods/22875264-5a51-43b4-b670-62fcf3fb3004/volumes"
Sep 11 12:15:05.197874 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:05.197836    2565 generic.go:356] "Generic (PLEG): container finished" podID="22875264-5a51-43b4-b670-62fcf3fb3004" containerID="cba6c2b6721a84c5f5a89e1b0a3b06ba0505fdfe6a70e626a02cb9e29baf50ee" exitCode=137
Sep 11 12:15:05.197874 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:05.197879    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7779-6f6208"
Sep 11 12:15:05.198328 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:05.197935    2565 scope.go:117] "RemoveContainer" containerID="cba6c2b6721a84c5f5a89e1b0a3b06ba0505fdfe6a70e626a02cb9e29baf50ee"
Sep 11 12:15:05.206990 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:05.206969    2565 scope.go:117] "RemoveContainer" containerID="cba6c2b6721a84c5f5a89e1b0a3b06ba0505fdfe6a70e626a02cb9e29baf50ee"
Sep 11 12:15:05.207248 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:15:05.207233    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cba6c2b6721a84c5f5a89e1b0a3b06ba0505fdfe6a70e626a02cb9e29baf50ee\": container with ID starting with cba6c2b6721a84c5f5a89e1b0a3b06ba0505fdfe6a70e626a02cb9e29baf50ee not found: ID does not exist" containerID="cba6c2b6721a84c5f5a89e1b0a3b06ba0505fdfe6a70e626a02cb9e29baf50ee"
Sep 11 12:15:05.207295 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:05.207256    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cba6c2b6721a84c5f5a89e1b0a3b06ba0505fdfe6a70e626a02cb9e29baf50ee"} err="failed to get container status \"cba6c2b6721a84c5f5a89e1b0a3b06ba0505fdfe6a70e626a02cb9e29baf50ee\": rpc error: code = NotFound desc = could not find container \"cba6c2b6721a84c5f5a89e1b0a3b06ba0505fdfe6a70e626a02cb9e29baf50ee\": container with ID starting with cba6c2b6721a84c5f5a89e1b0a3b06ba0505fdfe6a70e626a02cb9e29baf50ee not found: ID does not exist"
Sep 11 12:15:06.368591 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:06.368559    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7779-3ad128"
Sep 11 12:15:06.546098 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:06.545982    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlxft\" (UniqueName: \"kubernetes.io/projected/1410fc14-2221-46f6-b235-0f79f9e83bd9-kube-api-access-qlxft\") pod \"1410fc14-2221-46f6-b235-0f79f9e83bd9\" (UID: \"1410fc14-2221-46f6-b235-0f79f9e83bd9\") "
Sep 11 12:15:06.548317 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:06.548280    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1410fc14-2221-46f6-b235-0f79f9e83bd9-kube-api-access-qlxft" (OuterVolumeSpecName: "kube-api-access-qlxft") pod "1410fc14-2221-46f6-b235-0f79f9e83bd9" (UID: "1410fc14-2221-46f6-b235-0f79f9e83bd9"). InnerVolumeSpecName "kube-api-access-qlxft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:15:06.646994 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:06.646953    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlxft\" (UniqueName: \"kubernetes.io/projected/1410fc14-2221-46f6-b235-0f79f9e83bd9-kube-api-access-qlxft\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:06.844487 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:06.844405    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1410fc14-2221-46f6-b235-0f79f9e83bd9" path="/var/lib/kubelet/pods/1410fc14-2221-46f6-b235-0f79f9e83bd9/volumes"
Sep 11 12:15:07.222661 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:07.222620    2565 generic.go:356] "Generic (PLEG): container finished" podID="1410fc14-2221-46f6-b235-0f79f9e83bd9" containerID="5fb871b469a3b61b9237670160be3132cc3306cffba4ce5c0b2962ecac9fd826" exitCode=137
Sep 11 12:15:07.222896 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:07.222712    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7779-3ad128"
Sep 11 12:15:07.222896 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:07.222742    2565 scope.go:117] "RemoveContainer" containerID="5fb871b469a3b61b9237670160be3132cc3306cffba4ce5c0b2962ecac9fd826"
Sep 11 12:15:07.232005 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:07.231984    2565 scope.go:117] "RemoveContainer" containerID="5fb871b469a3b61b9237670160be3132cc3306cffba4ce5c0b2962ecac9fd826"
Sep 11 12:15:07.232295 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:15:07.232274    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fb871b469a3b61b9237670160be3132cc3306cffba4ce5c0b2962ecac9fd826\": container with ID starting with 5fb871b469a3b61b9237670160be3132cc3306cffba4ce5c0b2962ecac9fd826 not found: ID does not exist" containerID="5fb871b469a3b61b9237670160be3132cc3306cffba4ce5c0b2962ecac9fd826"
Sep 11 12:15:07.232355 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:07.232302    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fb871b469a3b61b9237670160be3132cc3306cffba4ce5c0b2962ecac9fd826"} err="failed to get container status \"5fb871b469a3b61b9237670160be3132cc3306cffba4ce5c0b2962ecac9fd826\": rpc error: code = NotFound desc = could not find container \"5fb871b469a3b61b9237670160be3132cc3306cffba4ce5c0b2962ecac9fd826\": container with ID starting with 5fb871b469a3b61b9237670160be3132cc3306cffba4ce5c0b2962ecac9fd826 not found: ID does not exist"
Sep 11 12:15:07.554205 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:07.554120    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"]
Sep 11 12:15:07.554580 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:07.554389    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk" podUID="129c9dae-98ef-4901-8161-8e3dd8cf5474" containerName="istio-proxy" containerID="cri-o://8920e9832cc36bba244bef2ecbccf734735bd116f7c02600d6aedb5bbf86f627" gracePeriod=30
Sep 11 12:15:12.041617 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:12.041571    2565 patch_prober.go:28] interesting pod/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 12:15:12.042083 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:12.041649    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk" podUID="129c9dae-98ef-4901-8161-8e3dd8cf5474" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 12:15:12.809167 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:12.809143    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:15:12.906129 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:12.906095    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-workload-socket\") pod \"129c9dae-98ef-4901-8161-8e3dd8cf5474\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") "
Sep 11 12:15:12.906316 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:12.906138    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-istio-envoy\") pod \"129c9dae-98ef-4901-8161-8e3dd8cf5474\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") "
Sep 11 12:15:12.906316 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:12.906165    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/129c9dae-98ef-4901-8161-8e3dd8cf5474-istio-token\") pod \"129c9dae-98ef-4901-8161-8e3dd8cf5474\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") "
Sep 11 12:15:12.906316 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:12.906201    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6pp2\" (UniqueName: \"kubernetes.io/projected/129c9dae-98ef-4901-8161-8e3dd8cf5474-kube-api-access-r6pp2\") pod \"129c9dae-98ef-4901-8161-8e3dd8cf5474\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") "
Sep 11 12:15:12.906316 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:12.906260    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-istio-data\") pod \"129c9dae-98ef-4901-8161-8e3dd8cf5474\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") "
Sep 11 12:15:12.906316 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:12.906304    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-credential-socket\") pod \"129c9dae-98ef-4901-8161-8e3dd8cf5474\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") "
Sep 11 12:15:12.906601 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:12.906354    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/129c9dae-98ef-4901-8161-8e3dd8cf5474-istio-podinfo\") pod \"129c9dae-98ef-4901-8161-8e3dd8cf5474\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") "
Sep 11 12:15:12.906601 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:12.906386    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/129c9dae-98ef-4901-8161-8e3dd8cf5474-istiod-ca-cert\") pod \"129c9dae-98ef-4901-8161-8e3dd8cf5474\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") "
Sep 11 12:15:12.906601 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:12.906405    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "129c9dae-98ef-4901-8161-8e3dd8cf5474" (UID: "129c9dae-98ef-4901-8161-8e3dd8cf5474"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:15:12.906601 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:12.906462    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-workload-certs\") pod \"129c9dae-98ef-4901-8161-8e3dd8cf5474\" (UID: \"129c9dae-98ef-4901-8161-8e3dd8cf5474\") "
Sep 11 12:15:12.906601 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:12.906581    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-istio-data" (OuterVolumeSpecName: "istio-data") pod "129c9dae-98ef-4901-8161-8e3dd8cf5474" (UID: "129c9dae-98ef-4901-8161-8e3dd8cf5474"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:15:12.906984 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:12.906876    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "129c9dae-98ef-4901-8161-8e3dd8cf5474" (UID: "129c9dae-98ef-4901-8161-8e3dd8cf5474"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:15:12.906984 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:12.906887    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-workload-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:12.906984 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:12.906912    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-istio-data\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:12.906984 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:12.906905    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/129c9dae-98ef-4901-8161-8e3dd8cf5474-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "129c9dae-98ef-4901-8161-8e3dd8cf5474" (UID: "129c9dae-98ef-4901-8161-8e3dd8cf5474"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:15:12.906984 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:12.906964    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "129c9dae-98ef-4901-8161-8e3dd8cf5474" (UID: "129c9dae-98ef-4901-8161-8e3dd8cf5474"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:15:12.908511 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:12.908483    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/129c9dae-98ef-4901-8161-8e3dd8cf5474-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "129c9dae-98ef-4901-8161-8e3dd8cf5474" (UID: "129c9dae-98ef-4901-8161-8e3dd8cf5474"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:15:12.908511 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:12.908495    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "129c9dae-98ef-4901-8161-8e3dd8cf5474" (UID: "129c9dae-98ef-4901-8161-8e3dd8cf5474"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:15:12.908648 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:12.908510    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/129c9dae-98ef-4901-8161-8e3dd8cf5474-istio-token" (OuterVolumeSpecName: "istio-token") pod "129c9dae-98ef-4901-8161-8e3dd8cf5474" (UID: "129c9dae-98ef-4901-8161-8e3dd8cf5474"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:15:12.908648 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:12.908490    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/129c9dae-98ef-4901-8161-8e3dd8cf5474-kube-api-access-r6pp2" (OuterVolumeSpecName: "kube-api-access-r6pp2") pod "129c9dae-98ef-4901-8161-8e3dd8cf5474" (UID: "129c9dae-98ef-4901-8161-8e3dd8cf5474"). InnerVolumeSpecName "kube-api-access-r6pp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:15:13.008229 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:13.008195    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-credential-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:13.008229 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:13.008220    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/129c9dae-98ef-4901-8161-8e3dd8cf5474-istio-podinfo\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:13.008229 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:13.008229    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/129c9dae-98ef-4901-8161-8e3dd8cf5474-istiod-ca-cert\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:13.008229 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:13.008238    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-workload-certs\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:13.008496 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:13.008246    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/129c9dae-98ef-4901-8161-8e3dd8cf5474-istio-envoy\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:13.008496 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:13.008253    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/129c9dae-98ef-4901-8161-8e3dd8cf5474-istio-token\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:13.008496 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:13.008261    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6pp2\" (UniqueName: \"kubernetes.io/projected/129c9dae-98ef-4901-8161-8e3dd8cf5474-kube-api-access-r6pp2\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:13.264628 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:13.264542    2565 generic.go:356] "Generic (PLEG): container finished" podID="129c9dae-98ef-4901-8161-8e3dd8cf5474" containerID="8920e9832cc36bba244bef2ecbccf734735bd116f7c02600d6aedb5bbf86f627" exitCode=0
Sep 11 12:15:13.264628 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:13.264602    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"
Sep 11 12:15:13.265141 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:13.264603    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk" event={"ID":"129c9dae-98ef-4901-8161-8e3dd8cf5474","Type":"ContainerDied","Data":"8920e9832cc36bba244bef2ecbccf734735bd116f7c02600d6aedb5bbf86f627"}
Sep 11 12:15:13.265141 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:13.264764    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk" event={"ID":"129c9dae-98ef-4901-8161-8e3dd8cf5474","Type":"ContainerDied","Data":"52f9bf988437173006980934a88a21b6f3c09ca451bdf20b8e20d11ec241e6dd"}
Sep 11 12:15:13.265141 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:13.264790    2565 scope.go:117] "RemoveContainer" containerID="8920e9832cc36bba244bef2ecbccf734735bd116f7c02600d6aedb5bbf86f627"
Sep 11 12:15:13.275175 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:13.275157    2565 scope.go:117] "RemoveContainer" containerID="2254fa256007185c6f02d7f0e99f806f8ee789fdc7575cb38956a74b196aaa77"
Sep 11 12:15:13.283707 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:13.283674    2565 scope.go:117] "RemoveContainer" containerID="8920e9832cc36bba244bef2ecbccf734735bd116f7c02600d6aedb5bbf86f627"
Sep 11 12:15:13.283976 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:15:13.283955    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8920e9832cc36bba244bef2ecbccf734735bd116f7c02600d6aedb5bbf86f627\": container with ID starting with 8920e9832cc36bba244bef2ecbccf734735bd116f7c02600d6aedb5bbf86f627 not found: ID does not exist" containerID="8920e9832cc36bba244bef2ecbccf734735bd116f7c02600d6aedb5bbf86f627"
Sep 11 12:15:13.284026 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:13.283985    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8920e9832cc36bba244bef2ecbccf734735bd116f7c02600d6aedb5bbf86f627"} err="failed to get container status \"8920e9832cc36bba244bef2ecbccf734735bd116f7c02600d6aedb5bbf86f627\": rpc error: code = NotFound desc = could not find container \"8920e9832cc36bba244bef2ecbccf734735bd116f7c02600d6aedb5bbf86f627\": container with ID starting with 8920e9832cc36bba244bef2ecbccf734735bd116f7c02600d6aedb5bbf86f627 not found: ID does not exist"
Sep 11 12:15:13.284026 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:13.284002    2565 scope.go:117] "RemoveContainer" containerID="2254fa256007185c6f02d7f0e99f806f8ee789fdc7575cb38956a74b196aaa77"
Sep 11 12:15:13.284274 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:15:13.284252    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2254fa256007185c6f02d7f0e99f806f8ee789fdc7575cb38956a74b196aaa77\": container with ID starting with 2254fa256007185c6f02d7f0e99f806f8ee789fdc7575cb38956a74b196aaa77 not found: ID does not exist" containerID="2254fa256007185c6f02d7f0e99f806f8ee789fdc7575cb38956a74b196aaa77"
Sep 11 12:15:13.284327 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:13.284280    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2254fa256007185c6f02d7f0e99f806f8ee789fdc7575cb38956a74b196aaa77"} err="failed to get container status \"2254fa256007185c6f02d7f0e99f806f8ee789fdc7575cb38956a74b196aaa77\": rpc error: code = NotFound desc = could not find container \"2254fa256007185c6f02d7f0e99f806f8ee789fdc7575cb38956a74b196aaa77\": container with ID starting with 2254fa256007185c6f02d7f0e99f806f8ee789fdc7575cb38956a74b196aaa77 not found: ID does not exist"
Sep 11 12:15:13.289991 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:13.289968    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"]
Sep 11 12:15:13.293350 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:13.293329    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-482cb0-openshift-default-75d64647fd-k4qdk"]
Sep 11 12:15:14.843446 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:14.843412    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="129c9dae-98ef-4901-8161-8e3dd8cf5474" path="/var/lib/kubelet/pods/129c9dae-98ef-4901-8161-8e3dd8cf5474/volumes"
Sep 11 12:15:27.174770 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:27.174734    2565 scope.go:117] "RemoveContainer" containerID="5203e47433a80e3f94f9b13b9e3e05a961c5277de04172c178aedd29a4c50494"
Sep 11 12:15:30.084198 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:30.084162    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"]
Sep 11 12:15:30.084570 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:30.084418    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl" podUID="8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b" containerName="istio-proxy" containerID="cri-o://55324d0955a6024085375660389e474bc770d602a7161bb27c7704c9d1a21828" gracePeriod=30
Sep 11 12:15:35.335439 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.335409    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:15:35.410624 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.410589    2565 generic.go:356] "Generic (PLEG): container finished" podID="8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b" containerID="55324d0955a6024085375660389e474bc770d602a7161bb27c7704c9d1a21828" exitCode=0
Sep 11 12:15:35.410860 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.410646    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"
Sep 11 12:15:35.410860 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.410677    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl" event={"ID":"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b","Type":"ContainerDied","Data":"55324d0955a6024085375660389e474bc770d602a7161bb27c7704c9d1a21828"}
Sep 11 12:15:35.410860 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.410769    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl" event={"ID":"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b","Type":"ContainerDied","Data":"1af44fb4752829c4daf94b430d618c1896345761206aaf75f45fe63e492f1226"}
Sep 11 12:15:35.410860 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.410794    2565 scope.go:117] "RemoveContainer" containerID="55324d0955a6024085375660389e474bc770d602a7161bb27c7704c9d1a21828"
Sep 11 12:15:35.420316 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.420297    2565 scope.go:117] "RemoveContainer" containerID="9b7f53463487bf54ba45143ae3d4de1262be93beb13fa13f6a053fa61d8c3ea0"
Sep 11 12:15:35.428644 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.428627    2565 scope.go:117] "RemoveContainer" containerID="55324d0955a6024085375660389e474bc770d602a7161bb27c7704c9d1a21828"
Sep 11 12:15:35.428928 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:15:35.428909    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55324d0955a6024085375660389e474bc770d602a7161bb27c7704c9d1a21828\": container with ID starting with 55324d0955a6024085375660389e474bc770d602a7161bb27c7704c9d1a21828 not found: ID does not exist" containerID="55324d0955a6024085375660389e474bc770d602a7161bb27c7704c9d1a21828"
Sep 11 12:15:35.428994 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.428938    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55324d0955a6024085375660389e474bc770d602a7161bb27c7704c9d1a21828"} err="failed to get container status \"55324d0955a6024085375660389e474bc770d602a7161bb27c7704c9d1a21828\": rpc error: code = NotFound desc = could not find container \"55324d0955a6024085375660389e474bc770d602a7161bb27c7704c9d1a21828\": container with ID starting with 55324d0955a6024085375660389e474bc770d602a7161bb27c7704c9d1a21828 not found: ID does not exist"
Sep 11 12:15:35.428994 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.428956    2565 scope.go:117] "RemoveContainer" containerID="9b7f53463487bf54ba45143ae3d4de1262be93beb13fa13f6a053fa61d8c3ea0"
Sep 11 12:15:35.429207 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:15:35.429189    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b7f53463487bf54ba45143ae3d4de1262be93beb13fa13f6a053fa61d8c3ea0\": container with ID starting with 9b7f53463487bf54ba45143ae3d4de1262be93beb13fa13f6a053fa61d8c3ea0 not found: ID does not exist" containerID="9b7f53463487bf54ba45143ae3d4de1262be93beb13fa13f6a053fa61d8c3ea0"
Sep 11 12:15:35.429250 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.429214    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b7f53463487bf54ba45143ae3d4de1262be93beb13fa13f6a053fa61d8c3ea0"} err="failed to get container status \"9b7f53463487bf54ba45143ae3d4de1262be93beb13fa13f6a053fa61d8c3ea0\": rpc error: code = NotFound desc = could not find container \"9b7f53463487bf54ba45143ae3d4de1262be93beb13fa13f6a053fa61d8c3ea0\": container with ID starting with 9b7f53463487bf54ba45143ae3d4de1262be93beb13fa13f6a053fa61d8c3ea0 not found: ID does not exist"
Sep 11 12:15:35.434533 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.434512    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istio-data\") pod \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") "
Sep 11 12:15:35.434630 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.434545    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istio-envoy\") pod \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") "
Sep 11 12:15:35.434630 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.434571    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-workload-certs\") pod \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") "
Sep 11 12:15:35.434630 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.434611    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wc4x\" (UniqueName: \"kubernetes.io/projected/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-kube-api-access-6wc4x\") pod \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") "
Sep 11 12:15:35.434809 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.434676    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-workload-socket\") pod \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") "
Sep 11 12:15:35.434809 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.434744    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istiod-ca-cert\") pod \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") "
Sep 11 12:15:35.434809 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.434768    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istio-token\") pod \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") "
Sep 11 12:15:35.434947 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.434822    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istio-data" (OuterVolumeSpecName: "istio-data") pod "8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b" (UID: "8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:15:35.434947 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.434894    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istio-podinfo\") pod \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") "
Sep 11 12:15:35.434947 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.434922    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-credential-socket\") pod \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\" (UID: \"8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b\") "
Sep 11 12:15:35.434947 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.434931    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b" (UID: "8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:15:35.435143 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.434978    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b" (UID: "8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:15:35.435143 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.435090    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b" (UID: "8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:15:35.435235 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.435191    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b" (UID: "8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:15:35.435344 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.435327    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-credential-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:35.435407 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.435349    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istio-data\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:35.435407 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.435365    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-workload-certs\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:35.435407 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.435376    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-workload-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:35.435407 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.435385    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istiod-ca-cert\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:35.436663 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.436638    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b" (UID: "8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:15:35.436894 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.436872    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-kube-api-access-6wc4x" (OuterVolumeSpecName: "kube-api-access-6wc4x") pod "8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b" (UID: "8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b"). InnerVolumeSpecName "kube-api-access-6wc4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:15:35.436966 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.436944    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b" (UID: "8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:15:35.437130 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.437113    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istio-token" (OuterVolumeSpecName: "istio-token") pod "8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b" (UID: "8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:15:35.535952 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.535915    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istio-podinfo\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:35.535952 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.535947    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istio-envoy\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:35.535952 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.535957    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wc4x\" (UniqueName: \"kubernetes.io/projected/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-kube-api-access-6wc4x\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:35.536186 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.535968    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b-istio-token\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:35.734098 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.734060    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"]
Sep 11 12:15:35.737250 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:35.737224    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-571fee-openshift-default-795c68dc76-w5cvl"]
Sep 11 12:15:36.843339 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:36.843303    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b" path="/var/lib/kubelet/pods/8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b/volumes"
Sep 11 12:15:40.945391 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:40.945357    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c000cf-29818815-4sp5k"]
Sep 11 12:15:40.950562 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:40.950535    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c000cf-29818815-4sp5k"]
Sep 11 12:15:42.844825 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:42.844782    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac6e3a8b-3982-44d6-8af7-121c2406cb8d" path="/var/lib/kubelet/pods/ac6e3a8b-3982-44d6-8af7-121c2406cb8d/volumes"
Sep 11 12:15:47.615757 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:47.615724    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"]
Sep 11 12:15:47.616204 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:47.615949    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm" podUID="4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5" containerName="istio-proxy" containerID="cri-o://e80f61e622fb7acad121fea26f0b09ebbc64e7bc228e860328b17b546e3c0dbb" gracePeriod=30
Sep 11 12:15:52.653056 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:52.653014    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 11 12:15:52.653411 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:52.653097    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm" podUID="4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 11 12:15:52.888929 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:52.888904    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:15:52.902625 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:52.902595    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-credential-socket\") pod \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") "
Sep 11 12:15:52.902763 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:52.902654    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istiod-ca-cert\") pod \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") "
Sep 11 12:15:52.902763 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:52.902703    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-workload-certs\") pod \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") "
Sep 11 12:15:52.902763 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:52.902758    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istio-podinfo\") pod \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") "
Sep 11 12:15:52.902912 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:52.902780    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istio-token\") pod \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") "
Sep 11 12:15:52.902912 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:52.902809    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-629t8\" (UniqueName: \"kubernetes.io/projected/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-kube-api-access-629t8\") pod \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") "
Sep 11 12:15:52.902912 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:52.902846    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istio-envoy\") pod \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") "
Sep 11 12:15:52.902912 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:52.902865    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5" (UID: "4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:15:52.902912 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:52.902905    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istio-data\") pod \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") "
Sep 11 12:15:52.903178 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:52.902956    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-workload-socket\") pod \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\" (UID: \"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5\") "
Sep 11 12:15:52.903178 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:52.902985    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5" (UID: "4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:15:52.903178 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:52.903103    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5" (UID: "4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:15:52.903345 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:52.903185    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istio-data" (OuterVolumeSpecName: "istio-data") pod "4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5" (UID: "4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:15:52.903345 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:52.903303    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istio-data\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:52.903345 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:52.903317    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-credential-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:52.903345 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:52.903327    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istiod-ca-cert\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:52.903345 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:52.903336    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-workload-certs\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:52.903601 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:52.903358    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5" (UID: "4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:15:52.904998 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:52.904967    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5" (UID: "4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:15:52.905414 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:52.905383    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5" (UID: "4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:15:52.905414 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:52.905383    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istio-token" (OuterVolumeSpecName: "istio-token") pod "4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5" (UID: "4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:15:52.905556 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:52.905505    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-kube-api-access-629t8" (OuterVolumeSpecName: "kube-api-access-629t8") pod "4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5" (UID: "4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5"). InnerVolumeSpecName "kube-api-access-629t8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:15:53.004008 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:53.003976    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istio-podinfo\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:53.004008 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:53.004004    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istio-token\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:53.004008 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:53.004014    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-629t8\" (UniqueName: \"kubernetes.io/projected/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-kube-api-access-629t8\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:53.004265 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:53.004025    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-istio-envoy\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:53.004265 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:53.004034    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5-workload-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:15:53.530026 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:53.529992    2565 generic.go:356] "Generic (PLEG): container finished" podID="4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5" containerID="e80f61e622fb7acad121fea26f0b09ebbc64e7bc228e860328b17b546e3c0dbb" exitCode=0
Sep 11 12:15:53.530218 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:53.530047    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"
Sep 11 12:15:53.530218 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:53.530063    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm" event={"ID":"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5","Type":"ContainerDied","Data":"e80f61e622fb7acad121fea26f0b09ebbc64e7bc228e860328b17b546e3c0dbb"}
Sep 11 12:15:53.530218 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:53.530107    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm" event={"ID":"4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5","Type":"ContainerDied","Data":"64835c2d2b16ebdc61f029594b5c94dc20b4ca22663a72d11da9531b9a40ad3e"}
Sep 11 12:15:53.530218 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:53.530130    2565 scope.go:117] "RemoveContainer" containerID="e80f61e622fb7acad121fea26f0b09ebbc64e7bc228e860328b17b546e3c0dbb"
Sep 11 12:15:53.540376 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:53.540351    2565 scope.go:117] "RemoveContainer" containerID="e6ddd9469ea33c0f6c44bf116d6abdb06632898359f90ee5ffb68c48c921f9a0"
Sep 11 12:15:53.552354 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:53.552331    2565 scope.go:117] "RemoveContainer" containerID="e80f61e622fb7acad121fea26f0b09ebbc64e7bc228e860328b17b546e3c0dbb"
Sep 11 12:15:53.552706 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:15:53.552656    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e80f61e622fb7acad121fea26f0b09ebbc64e7bc228e860328b17b546e3c0dbb\": container with ID starting with e80f61e622fb7acad121fea26f0b09ebbc64e7bc228e860328b17b546e3c0dbb not found: ID does not exist" containerID="e80f61e622fb7acad121fea26f0b09ebbc64e7bc228e860328b17b546e3c0dbb"
Sep 11 12:15:53.552802 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:53.552775    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e80f61e622fb7acad121fea26f0b09ebbc64e7bc228e860328b17b546e3c0dbb"} err="failed to get container status \"e80f61e622fb7acad121fea26f0b09ebbc64e7bc228e860328b17b546e3c0dbb\": rpc error: code = NotFound desc = could not find container \"e80f61e622fb7acad121fea26f0b09ebbc64e7bc228e860328b17b546e3c0dbb\": container with ID starting with e80f61e622fb7acad121fea26f0b09ebbc64e7bc228e860328b17b546e3c0dbb not found: ID does not exist"
Sep 11 12:15:53.552847 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:53.552806    2565 scope.go:117] "RemoveContainer" containerID="e6ddd9469ea33c0f6c44bf116d6abdb06632898359f90ee5ffb68c48c921f9a0"
Sep 11 12:15:53.553131 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:15:53.553106    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6ddd9469ea33c0f6c44bf116d6abdb06632898359f90ee5ffb68c48c921f9a0\": container with ID starting with e6ddd9469ea33c0f6c44bf116d6abdb06632898359f90ee5ffb68c48c921f9a0 not found: ID does not exist" containerID="e6ddd9469ea33c0f6c44bf116d6abdb06632898359f90ee5ffb68c48c921f9a0"
Sep 11 12:15:53.553227 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:53.553133    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6ddd9469ea33c0f6c44bf116d6abdb06632898359f90ee5ffb68c48c921f9a0"} err="failed to get container status \"e6ddd9469ea33c0f6c44bf116d6abdb06632898359f90ee5ffb68c48c921f9a0\": rpc error: code = NotFound desc = could not find container \"e6ddd9469ea33c0f6c44bf116d6abdb06632898359f90ee5ffb68c48c921f9a0\": container with ID starting with e6ddd9469ea33c0f6c44bf116d6abdb06632898359f90ee5ffb68c48c921f9a0 not found: ID does not exist"
Sep 11 12:15:53.554425 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:53.554405    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"]
Sep 11 12:15:53.559350 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:53.559329    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c000cf-openshift-default-59d675c5f4-z2vlm"]
Sep 11 12:15:54.845886 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:15:54.845845    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5" path="/var/lib/kubelet/pods/4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5/volumes"
Sep 11 12:16:05.164710 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:05.164642    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"]
Sep 11 12:16:05.165214 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:05.164895    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq" podUID="667c45dc-ea68-41d7-ae69-ee3bac592ca5" containerName="istio-proxy" containerID="cri-o://b49a14579ca9303c4c3cb0df841723633c55a0f2661e471eec605abfb1d5f45f" gracePeriod=30
Sep 11 12:16:05.569859 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:05.569772    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 12:16:05.569859 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:05.569841    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq" podUID="667c45dc-ea68-41d7-ae69-ee3bac592ca5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 12:16:10.414756 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.414727    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:16:10.476019 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.475933    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcxws\" (UniqueName: \"kubernetes.io/projected/667c45dc-ea68-41d7-ae69-ee3bac592ca5-kube-api-access-jcxws\") pod \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") "
Sep 11 12:16:10.476019 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.475980    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istio-podinfo\") pod \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") "
Sep 11 12:16:10.476239 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.476033    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istiod-ca-cert\") pod \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") "
Sep 11 12:16:10.476239 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.476095    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-workload-socket\") pod \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") "
Sep 11 12:16:10.476239 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.476120    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-workload-certs\") pod \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") "
Sep 11 12:16:10.476239 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.476144    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istio-token\") pod \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") "
Sep 11 12:16:10.476239 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.476179    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-credential-socket\") pod \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") "
Sep 11 12:16:10.476239 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.476235    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istio-data\") pod \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") "
Sep 11 12:16:10.476560 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.476276    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istio-envoy\") pod \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\" (UID: \"667c45dc-ea68-41d7-ae69-ee3bac592ca5\") "
Sep 11 12:16:10.476560 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.476431    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "667c45dc-ea68-41d7-ae69-ee3bac592ca5" (UID: "667c45dc-ea68-41d7-ae69-ee3bac592ca5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:16:10.476717 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.476670    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istiod-ca-cert\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:16:10.477076 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.476771    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "667c45dc-ea68-41d7-ae69-ee3bac592ca5" (UID: "667c45dc-ea68-41d7-ae69-ee3bac592ca5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:16:10.477076 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.476865    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istio-data" (OuterVolumeSpecName: "istio-data") pod "667c45dc-ea68-41d7-ae69-ee3bac592ca5" (UID: "667c45dc-ea68-41d7-ae69-ee3bac592ca5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:16:10.477076 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.477017    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "667c45dc-ea68-41d7-ae69-ee3bac592ca5" (UID: "667c45dc-ea68-41d7-ae69-ee3bac592ca5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:16:10.477351 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.477085    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "667c45dc-ea68-41d7-ae69-ee3bac592ca5" (UID: "667c45dc-ea68-41d7-ae69-ee3bac592ca5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:16:10.478815 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.478772    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/667c45dc-ea68-41d7-ae69-ee3bac592ca5-kube-api-access-jcxws" (OuterVolumeSpecName: "kube-api-access-jcxws") pod "667c45dc-ea68-41d7-ae69-ee3bac592ca5" (UID: "667c45dc-ea68-41d7-ae69-ee3bac592ca5"). InnerVolumeSpecName "kube-api-access-jcxws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:16:10.479188 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.479164    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istio-token" (OuterVolumeSpecName: "istio-token") pod "667c45dc-ea68-41d7-ae69-ee3bac592ca5" (UID: "667c45dc-ea68-41d7-ae69-ee3bac592ca5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:16:10.479286 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.479260    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "667c45dc-ea68-41d7-ae69-ee3bac592ca5" (UID: "667c45dc-ea68-41d7-ae69-ee3bac592ca5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:16:10.479525 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.479499    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "667c45dc-ea68-41d7-ae69-ee3bac592ca5" (UID: "667c45dc-ea68-41d7-ae69-ee3bac592ca5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:16:10.577739 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.577703    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istio-data\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:16:10.577739 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.577735    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istio-envoy\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:16:10.577739 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.577745    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcxws\" (UniqueName: \"kubernetes.io/projected/667c45dc-ea68-41d7-ae69-ee3bac592ca5-kube-api-access-jcxws\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:16:10.577988 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.577754    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istio-podinfo\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:16:10.577988 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.577763    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-workload-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:16:10.577988 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.577776    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-workload-certs\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:16:10.577988 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.577784    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/667c45dc-ea68-41d7-ae69-ee3bac592ca5-istio-token\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:16:10.577988 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.577792    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/667c45dc-ea68-41d7-ae69-ee3bac592ca5-credential-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:16:10.647388 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.647349    2565 generic.go:356] "Generic (PLEG): container finished" podID="667c45dc-ea68-41d7-ae69-ee3bac592ca5" containerID="b49a14579ca9303c4c3cb0df841723633c55a0f2661e471eec605abfb1d5f45f" exitCode=0
Sep 11 12:16:10.647388 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.647394    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"
Sep 11 12:16:10.647615 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.647434    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq" event={"ID":"667c45dc-ea68-41d7-ae69-ee3bac592ca5","Type":"ContainerDied","Data":"b49a14579ca9303c4c3cb0df841723633c55a0f2661e471eec605abfb1d5f45f"}
Sep 11 12:16:10.647615 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.647495    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq" event={"ID":"667c45dc-ea68-41d7-ae69-ee3bac592ca5","Type":"ContainerDied","Data":"9f780e5282ee8956a6db3cf7b5826c9d561b490b6a0b9f4b560262383fb70214"}
Sep 11 12:16:10.647615 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.647525    2565 scope.go:117] "RemoveContainer" containerID="b49a14579ca9303c4c3cb0df841723633c55a0f2661e471eec605abfb1d5f45f"
Sep 11 12:16:10.663251 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.663144    2565 scope.go:117] "RemoveContainer" containerID="c105c53a2529001f1aee66ddfe26bdffb66149501ebce47f5683bf466ae3a98e"
Sep 11 12:16:10.675225 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.675198    2565 scope.go:117] "RemoveContainer" containerID="b49a14579ca9303c4c3cb0df841723633c55a0f2661e471eec605abfb1d5f45f"
Sep 11 12:16:10.675600 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:16:10.675565    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b49a14579ca9303c4c3cb0df841723633c55a0f2661e471eec605abfb1d5f45f\": container with ID starting with b49a14579ca9303c4c3cb0df841723633c55a0f2661e471eec605abfb1d5f45f not found: ID does not exist" containerID="b49a14579ca9303c4c3cb0df841723633c55a0f2661e471eec605abfb1d5f45f"
Sep 11 12:16:10.675717 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.675613    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b49a14579ca9303c4c3cb0df841723633c55a0f2661e471eec605abfb1d5f45f"} err="failed to get container status \"b49a14579ca9303c4c3cb0df841723633c55a0f2661e471eec605abfb1d5f45f\": rpc error: code = NotFound desc = could not find container \"b49a14579ca9303c4c3cb0df841723633c55a0f2661e471eec605abfb1d5f45f\": container with ID starting with b49a14579ca9303c4c3cb0df841723633c55a0f2661e471eec605abfb1d5f45f not found: ID does not exist"
Sep 11 12:16:10.675717 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.675640    2565 scope.go:117] "RemoveContainer" containerID="c105c53a2529001f1aee66ddfe26bdffb66149501ebce47f5683bf466ae3a98e"
Sep 11 12:16:10.675995 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:16:10.675976    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c105c53a2529001f1aee66ddfe26bdffb66149501ebce47f5683bf466ae3a98e\": container with ID starting with c105c53a2529001f1aee66ddfe26bdffb66149501ebce47f5683bf466ae3a98e not found: ID does not exist" containerID="c105c53a2529001f1aee66ddfe26bdffb66149501ebce47f5683bf466ae3a98e"
Sep 11 12:16:10.676050 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.676010    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c105c53a2529001f1aee66ddfe26bdffb66149501ebce47f5683bf466ae3a98e"} err="failed to get container status \"c105c53a2529001f1aee66ddfe26bdffb66149501ebce47f5683bf466ae3a98e\": rpc error: code = NotFound desc = could not find container \"c105c53a2529001f1aee66ddfe26bdffb66149501ebce47f5683bf466ae3a98e\": container with ID starting with c105c53a2529001f1aee66ddfe26bdffb66149501ebce47f5683bf466ae3a98e not found: ID does not exist"
Sep 11 12:16:10.678193 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.678169    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"]
Sep 11 12:16:10.682284 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.682260    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-50e434-openshift-default-6966dcc98b-9mdxq"]
Sep 11 12:16:10.848926 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:10.845795    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="667c45dc-ea68-41d7-ae69-ee3bac592ca5" path="/var/lib/kubelet/pods/667c45dc-ea68-41d7-ae69-ee3bac592ca5/volumes"
Sep 11 12:16:26.941219 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:26.941189    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5pnqx_2233f21d-d3f8-44fc-92bf-03a86f7456ce/console-operator/1.log"
Sep 11 12:16:26.942494 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:26.942469    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5pnqx_2233f21d-d3f8-44fc-92bf-03a86f7456ce/console-operator/1.log"
Sep 11 12:16:26.948367 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:26.948344    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wzvlx_2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b/ovn-acl-logging/0.log"
Sep 11 12:16:26.949292 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:26.949272    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wzvlx_2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b/ovn-acl-logging/0.log"
Sep 11 12:16:53.297560 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.297467    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"]
Sep 11 12:16:53.298042 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.297892    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac6e3a8b-3982-44d6-8af7-121c2406cb8d" containerName="cleanup"
Sep 11 12:16:53.298042 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.297907    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac6e3a8b-3982-44d6-8af7-121c2406cb8d" containerName="cleanup"
Sep 11 12:16:53.298042 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.297919    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5" containerName="istio-proxy"
Sep 11 12:16:53.298042 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.297925    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5" containerName="istio-proxy"
Sep 11 12:16:53.298042 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.297936    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="666575eb-b229-488e-bcc2-5dda53e512cd" containerName="cleanup"
Sep 11 12:16:53.298042 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.297941    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="666575eb-b229-488e-bcc2-5dda53e512cd" containerName="cleanup"
Sep 11 12:16:53.298042 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.297948    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b" containerName="istio-proxy"
Sep 11 12:16:53.298042 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.297958    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b" containerName="istio-proxy"
Sep 11 12:16:53.298042 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.297968    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="129c9dae-98ef-4901-8161-8e3dd8cf5474" containerName="istio-proxy"
Sep 11 12:16:53.298042 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.297973    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="129c9dae-98ef-4901-8161-8e3dd8cf5474" containerName="istio-proxy"
Sep 11 12:16:53.298042 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.297981    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4fe5db6-bba5-40c0-b226-04a173d2093c" containerName="cleanup"
Sep 11 12:16:53.298042 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.297986    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4fe5db6-bba5-40c0-b226-04a173d2093c" containerName="cleanup"
Sep 11 12:16:53.298042 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.297992    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bea006f3-8c20-4441-bd97-67fbb6b22d21" containerName="cleanup"
Sep 11 12:16:53.298042 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.297997    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bea006f3-8c20-4441-bd97-67fbb6b22d21" containerName="cleanup"
Sep 11 12:16:53.298042 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.298006    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b" containerName="istio-proxy"
Sep 11 12:16:53.298042 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.298011    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b" containerName="istio-proxy"
Sep 11 12:16:53.298042 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.298018    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="667c45dc-ea68-41d7-ae69-ee3bac592ca5" containerName="istio-proxy"
Sep 11 12:16:53.298042 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.298023    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="667c45dc-ea68-41d7-ae69-ee3bac592ca5" containerName="istio-proxy"
Sep 11 12:16:53.298042 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.298029    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="129c9dae-98ef-4901-8161-8e3dd8cf5474" containerName="istio-proxy"
Sep 11 12:16:53.298042 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.298037    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="129c9dae-98ef-4901-8161-8e3dd8cf5474" containerName="istio-proxy"
Sep 11 12:16:53.298042 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.298045    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1410fc14-2221-46f6-b235-0f79f9e83bd9" containerName="test-curl-7779-3ad128"
Sep 11 12:16:53.298042 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.298052    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1410fc14-2221-46f6-b235-0f79f9e83bd9" containerName="test-curl-7779-3ad128"
Sep 11 12:16:53.298841 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.298124    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5" containerName="istio-proxy"
Sep 11 12:16:53.298841 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.298132    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="666575eb-b229-488e-bcc2-5dda53e512cd" containerName="cleanup"
Sep 11 12:16:53.298841 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.298138    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="129c9dae-98ef-4901-8161-8e3dd8cf5474" containerName="istio-proxy"
Sep 11 12:16:53.298841 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.298147    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b" containerName="istio-proxy"
Sep 11 12:16:53.298841 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.298153    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bea006f3-8c20-4441-bd97-67fbb6b22d21" containerName="cleanup"
Sep 11 12:16:53.298841 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.298158    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac6e3a8b-3982-44d6-8af7-121c2406cb8d" containerName="cleanup"
Sep 11 12:16:53.298841 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.298164    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dbd4ad7-0a57-4430-bbd5-b5ea712e2e7b" containerName="istio-proxy"
Sep 11 12:16:53.298841 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.298168    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1410fc14-2221-46f6-b235-0f79f9e83bd9" containerName="test-curl-7779-3ad128"
Sep 11 12:16:53.298841 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.298173    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4fe5db6-bba5-40c0-b226-04a173d2093c" containerName="cleanup"
Sep 11 12:16:53.298841 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.298179    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5" containerName="istio-proxy"
Sep 11 12:16:53.298841 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.298184    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="667c45dc-ea68-41d7-ae69-ee3bac592ca5" containerName="istio-proxy"
Sep 11 12:16:53.298841 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.298190    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="129c9dae-98ef-4901-8161-8e3dd8cf5474" containerName="istio-proxy"
Sep 11 12:16:53.298841 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.298199    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="667c45dc-ea68-41d7-ae69-ee3bac592ca5" containerName="istio-proxy"
Sep 11 12:16:53.302778 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.302758    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.305591 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.305564    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-9c3012-openshift-default-dockercfg-j9zfj\""
Sep 11 12:16:53.313507 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.313474    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"]
Sep 11 12:16:53.365573 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.365531    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da27961f-7767-4f09-b92e-744aae2b5ca7-istio-podinfo\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.365573 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.365568    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da27961f-7767-4f09-b92e-744aae2b5ca7-istio-token\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.365849 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.365588    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-workload-socket\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.365849 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.365716    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-credential-socket\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.365849 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.365782    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-workload-certs\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.366030 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.365848    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8jts\" (UniqueName: \"kubernetes.io/projected/da27961f-7767-4f09-b92e-744aae2b5ca7-kube-api-access-q8jts\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.366030 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.365920    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-istio-data\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.366030 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.365981    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da27961f-7767-4f09-b92e-744aae2b5ca7-istiod-ca-cert\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.366030 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.366005    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-istio-envoy\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.467088 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.467046    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8jts\" (UniqueName: \"kubernetes.io/projected/da27961f-7767-4f09-b92e-744aae2b5ca7-kube-api-access-q8jts\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.467270 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.467119    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-istio-data\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.467270 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.467172    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da27961f-7767-4f09-b92e-744aae2b5ca7-istiod-ca-cert\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.467270 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.467196    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-istio-envoy\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.467270 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.467222    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da27961f-7767-4f09-b92e-744aae2b5ca7-istio-podinfo\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.467270 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.467243    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da27961f-7767-4f09-b92e-744aae2b5ca7-istio-token\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.467270 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.467267    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-workload-socket\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.467585 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.467453    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-credential-socket\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.467585 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.467515    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-workload-certs\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.467734 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.467598    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-istio-data\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.467734 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.467705    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-workload-socket\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.467875 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.467850    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-credential-socket\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.467929 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.467855    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-workload-certs\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.467992 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.467956    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da27961f-7767-4f09-b92e-744aae2b5ca7-istiod-ca-cert\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.469670 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.469648    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-istio-envoy\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.469968 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.469947    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da27961f-7767-4f09-b92e-744aae2b5ca7-istio-podinfo\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.475193 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.475169    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da27961f-7767-4f09-b92e-744aae2b5ca7-istio-token\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.475958 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.475940    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8jts\" (UniqueName: \"kubernetes.io/projected/da27961f-7767-4f09-b92e-744aae2b5ca7-kube-api-access-q8jts\") pod \"e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") " pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.615257 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.615165    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:53.894604 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.894574    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"]
Sep 11 12:16:53.895512 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:16:53.895483    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda27961f_7767_4f09_b92e_744aae2b5ca7.slice/crio-badfeafaaba172d801505fe9ccff353e893ec1c752dac16da6bd776bc8351f6d WatchSource:0}: Error finding container badfeafaaba172d801505fe9ccff353e893ec1c752dac16da6bd776bc8351f6d: Status 404 returned error can't find the container with id badfeafaaba172d801505fe9ccff353e893ec1c752dac16da6bd776bc8351f6d
Sep 11 12:16:53.897761 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.897729    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:16:53.897826 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.897800    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:16:53.897868 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.897832    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:16:53.909244 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:53.909214    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m" event={"ID":"da27961f-7767-4f09-b92e-744aae2b5ca7","Type":"ContainerStarted","Data":"badfeafaaba172d801505fe9ccff353e893ec1c752dac16da6bd776bc8351f6d"}
Sep 11 12:16:54.917033 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:54.916988    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m" event={"ID":"da27961f-7767-4f09-b92e-744aae2b5ca7","Type":"ContainerStarted","Data":"c7f730467eb18de86a1168247b0a46543aa4de1b6dbbb221914e40f8c0b88d2f"}
Sep 11 12:16:54.939183 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:54.939131    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m" podStartSLOduration=1.939115684 podStartE2EDuration="1.939115684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:16:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:16:54.935997128 +0000 UTC m=+1528.618396653" watchObservedRunningTime="2026-09-11 12:16:54.939115684 +0000 UTC m=+1528.621515178"
Sep 11 12:16:55.615378 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:55.615336    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:55.620699 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:55.620661    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:55.922573 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:55.922533    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:16:55.923675 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:16:55.923654    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:17:11.963860 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:11.963821    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 12:17:11.964297 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:11.963900    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m" podUID="da27961f-7767-4f09-b92e-744aae2b5ca7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 12:17:13.028254 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:13.028162    2565 generic.go:356] "Generic (PLEG): container finished" podID="da27961f-7767-4f09-b92e-744aae2b5ca7" containerID="c7f730467eb18de86a1168247b0a46543aa4de1b6dbbb221914e40f8c0b88d2f" exitCode=0
Sep 11 12:17:13.028254 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:13.028235    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m" event={"ID":"da27961f-7767-4f09-b92e-744aae2b5ca7","Type":"ContainerDied","Data":"c7f730467eb18de86a1168247b0a46543aa4de1b6dbbb221914e40f8c0b88d2f"}
Sep 11 12:17:13.028779 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:13.028629    2565 scope.go:117] "RemoveContainer" containerID="c7f730467eb18de86a1168247b0a46543aa4de1b6dbbb221914e40f8c0b88d2f"
Sep 11 12:17:13.029731 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:13.029705    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:17:13.029802 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:13.029780    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:17:13.029839 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:13.029814    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:17:14.036003 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:14.035965    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m" event={"ID":"da27961f-7767-4f09-b92e-744aae2b5ca7","Type":"ContainerStarted","Data":"41df22aa4c60ea6a6ea8cabb68ad39e9071339fb13ecc95eb6aa25b9fff3242f"}
Sep 11 12:17:14.616082 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:14.616044    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:17:14.616277 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:14.616219    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 11 12:17:14.616330 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:14.616297    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m" podUID="da27961f-7767-4f09-b92e-744aae2b5ca7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 11 12:17:15.615777 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:15.615734    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 11 12:17:15.616247 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:15.615800    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m" podUID="da27961f-7767-4f09-b92e-744aae2b5ca7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 11 12:17:16.615922 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:16.615882    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 11 12:17:16.616307 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:16.615940    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m" podUID="da27961f-7767-4f09-b92e-744aae2b5ca7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 11 12:17:17.616039 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:17.616000    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 11 12:17:17.616450 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:17.616060    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m" podUID="da27961f-7767-4f09-b92e-744aae2b5ca7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 11 12:17:18.616143 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:18.616100    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 11 12:17:18.616549 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:18.616162    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m" podUID="da27961f-7767-4f09-b92e-744aae2b5ca7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 11 12:17:19.619407 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:19.619372    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:17:19.619813 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:19.619713    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:17:19.620344 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:19.620324    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:17:22.654557 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.654516    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"]
Sep 11 12:17:22.655060 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.655016    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="667c45dc-ea68-41d7-ae69-ee3bac592ca5" containerName="istio-proxy"
Sep 11 12:17:22.655060 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.655037    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="667c45dc-ea68-41d7-ae69-ee3bac592ca5" containerName="istio-proxy"
Sep 11 12:17:22.655060 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.655059    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5" containerName="istio-proxy"
Sep 11 12:17:22.655267 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.655069    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d1bb7c4-9f7a-4b17-bf9b-0c5bc0f28cd5" containerName="istio-proxy"
Sep 11 12:17:22.658325 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.658305    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.661310 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.661283    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-6d324e-openshift-default-dockercfg-c25kx\""
Sep 11 12:17:22.671831 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.671803    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"]
Sep 11 12:17:22.742785 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.742745    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-workload-certs\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.742952 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.742799    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2eee8bf-2273-40fc-b102-de9006439cac-istiod-ca-cert\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.742952 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.742856    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-workload-socket\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.742952 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.742915    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-istio-envoy\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.743150 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.743068    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2eee8bf-2273-40fc-b102-de9006439cac-istio-token\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.743150 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.743123    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-istio-data\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.743264 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.743158    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-credential-socket\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.743264 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.743215    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpxwj\" (UniqueName: \"kubernetes.io/projected/c2eee8bf-2273-40fc-b102-de9006439cac-kube-api-access-hpxwj\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.743264 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.743256    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2eee8bf-2273-40fc-b102-de9006439cac-istio-podinfo\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.844593 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.844559    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2eee8bf-2273-40fc-b102-de9006439cac-istio-podinfo\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.844795 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.844611    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-workload-certs\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.844795 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.844642    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2eee8bf-2273-40fc-b102-de9006439cac-istiod-ca-cert\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.844795 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.844721    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-workload-socket\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.844795 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.844759    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-istio-envoy\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.845029 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.844822    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2eee8bf-2273-40fc-b102-de9006439cac-istio-token\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.845029 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.844864    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-istio-data\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.845029 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.844895    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-credential-socket\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.845029 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.844926    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpxwj\" (UniqueName: \"kubernetes.io/projected/c2eee8bf-2273-40fc-b102-de9006439cac-kube-api-access-hpxwj\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.845236 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.845074    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-workload-certs\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.845365 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.845342    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-credential-socket\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.845438 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.845401    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-istio-data\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.845543 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.845500    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2eee8bf-2273-40fc-b102-de9006439cac-istiod-ca-cert\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.845768 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.845743    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-workload-socket\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.847289 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.847264    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-istio-envoy\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.847569 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.847548    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2eee8bf-2273-40fc-b102-de9006439cac-istio-podinfo\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.853349 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.853318    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2eee8bf-2273-40fc-b102-de9006439cac-istio-token\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.853468 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.853421    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpxwj\" (UniqueName: \"kubernetes.io/projected/c2eee8bf-2273-40fc-b102-de9006439cac-kube-api-access-hpxwj\") pod \"e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") " pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:22.971325 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:22.971241    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:23.254830 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:23.254798    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"]
Sep 11 12:17:23.256794 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:17:23.256758    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2eee8bf_2273_40fc_b102_de9006439cac.slice/crio-ef6ebb1c2d0c7c6bf4db4b6dc2160227afa74b767771555182c71d6d5eca8d05 WatchSource:0}: Error finding container ef6ebb1c2d0c7c6bf4db4b6dc2160227afa74b767771555182c71d6d5eca8d05: Status 404 returned error can't find the container with id ef6ebb1c2d0c7c6bf4db4b6dc2160227afa74b767771555182c71d6d5eca8d05
Sep 11 12:17:23.259064 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:23.259031    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:17:23.259148 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:23.259100    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:17:23.259148 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:23.259126    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:17:24.108421 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:24.108385    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9" event={"ID":"c2eee8bf-2273-40fc-b102-de9006439cac","Type":"ContainerStarted","Data":"bd09dc48ce6dd83cdeb28947179df0be6d972d0cd37d852302eac0b57a2239c1"}
Sep 11 12:17:24.108808 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:24.108474    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9" event={"ID":"c2eee8bf-2273-40fc-b102-de9006439cac","Type":"ContainerStarted","Data":"ef6ebb1c2d0c7c6bf4db4b6dc2160227afa74b767771555182c71d6d5eca8d05"}
Sep 11 12:17:24.132326 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:24.132273    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9" podStartSLOduration=2.132257624 podStartE2EDuration="2.132257624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:17:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:17:24.128399415 +0000 UTC m=+1557.810798913" watchObservedRunningTime="2026-09-11 12:17:24.132257624 +0000 UTC m=+1557.814657122"
Sep 11 12:17:24.972322 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:24.972287    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:24.977334 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:24.977308    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:25.114364 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:25.114333    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:25.115451 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:25.115433    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:44.236728 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:44.236673    2565 generic.go:356] "Generic (PLEG): container finished" podID="c2eee8bf-2273-40fc-b102-de9006439cac" containerID="bd09dc48ce6dd83cdeb28947179df0be6d972d0cd37d852302eac0b57a2239c1" exitCode=0
Sep 11 12:17:44.237211 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:44.236742    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9" event={"ID":"c2eee8bf-2273-40fc-b102-de9006439cac","Type":"ContainerDied","Data":"bd09dc48ce6dd83cdeb28947179df0be6d972d0cd37d852302eac0b57a2239c1"}
Sep 11 12:17:44.237211 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:44.237194    2565 scope.go:117] "RemoveContainer" containerID="bd09dc48ce6dd83cdeb28947179df0be6d972d0cd37d852302eac0b57a2239c1"
Sep 11 12:17:44.238329 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:44.238287    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:17:44.238389 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:44.238361    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:17:44.238434 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:44.238394    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:17:45.248029 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:45.247983    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9" event={"ID":"c2eee8bf-2273-40fc-b102-de9006439cac","Type":"ContainerStarted","Data":"95aff0832432e7e13e68adbcebaf6431ebe0dfd427fc7cfde99b641c94d20c6b"}
Sep 11 12:17:45.971496 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:45.971458    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:45.971697 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:45.971662    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 11 12:17:45.971760 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:45.971736    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9" podUID="c2eee8bf-2273-40fc-b102-de9006439cac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 11 12:17:46.972424 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:46.972386    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 11 12:17:46.972912 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:46.972449    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9" podUID="c2eee8bf-2273-40fc-b102-de9006439cac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 11 12:17:47.972441 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:47.972399    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 11 12:17:47.972923 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:47.972474    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9" podUID="c2eee8bf-2273-40fc-b102-de9006439cac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 11 12:17:48.971895 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:48.971860    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 11 12:17:48.972140 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:48.972116    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9" podUID="c2eee8bf-2273-40fc-b102-de9006439cac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 11 12:17:49.972596 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:49.972556    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 11 12:17:49.973004 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:49.972617    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9" podUID="c2eee8bf-2273-40fc-b102-de9006439cac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 11 12:17:50.975983 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:50.975947    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:50.976443 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:50.976425    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:17:50.977229 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:17:50.977208    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:18:27.160486 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.160446    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"]
Sep 11 12:18:27.164726 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.164674    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.167463 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.167437    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-49995f-openshift-default-dockercfg-jbkqd\""
Sep 11 12:18:27.177290 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.177263    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"]
Sep 11 12:18:27.247051 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.247015    2565 scope.go:117] "RemoveContainer" containerID="8dc515865248393c3c50fc4b6163614e9659dbd216a7469eb90ebf5e960c5188"
Sep 11 12:18:27.271704 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.260776    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/106a88b8-308c-4457-a865-dd85dd40e334-istio-podinfo\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.271704 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.260852    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-workload-certs\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.271704 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.260926    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/106a88b8-308c-4457-a865-dd85dd40e334-istiod-ca-cert\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.271704 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.260960    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-credential-socket\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.271704 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.260997    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4dst\" (UniqueName: \"kubernetes.io/projected/106a88b8-308c-4457-a865-dd85dd40e334-kube-api-access-j4dst\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.271704 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.261033    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-workload-socket\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.271704 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.261075    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/106a88b8-308c-4457-a865-dd85dd40e334-istio-token\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.271704 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.261138    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-istio-data\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.271704 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.261172    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-istio-envoy\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.362365 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.362326    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-istio-data\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.362567 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.362369    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-istio-envoy\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.362567 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.362429    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/106a88b8-308c-4457-a865-dd85dd40e334-istio-podinfo\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.362567 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.362468    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-workload-certs\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.362567 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.362523    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/106a88b8-308c-4457-a865-dd85dd40e334-istiod-ca-cert\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.362567 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.362548    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-credential-socket\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.362874 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.362583    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4dst\" (UniqueName: \"kubernetes.io/projected/106a88b8-308c-4457-a865-dd85dd40e334-kube-api-access-j4dst\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.362874 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.362641    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-workload-socket\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.362874 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.362809    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-istio-data\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.363035 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.362900    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-workload-certs\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.363091 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.363038    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/106a88b8-308c-4457-a865-dd85dd40e334-istio-token\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.363091 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.363055    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-credential-socket\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.363091 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.363074    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-workload-socket\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.363961 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.363936    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/106a88b8-308c-4457-a865-dd85dd40e334-istiod-ca-cert\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.364808 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.364780    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-istio-envoy\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.365174 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.365153    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/106a88b8-308c-4457-a865-dd85dd40e334-istio-podinfo\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.371184 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.371160    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/106a88b8-308c-4457-a865-dd85dd40e334-istio-token\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.371333 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.371239    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4dst\" (UniqueName: \"kubernetes.io/projected/106a88b8-308c-4457-a865-dd85dd40e334-kube-api-access-j4dst\") pod \"e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") " pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.477638 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.477550    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:27.757081 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.757033    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"]
Sep 11 12:18:27.757850 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:18:27.757826    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod106a88b8_308c_4457_a865_dd85dd40e334.slice/crio-fe9b6fc61c8c5dbd90af3b33e416ff8ca4bfb69bdf1b3151c0cde7b163425373 WatchSource:0}: Error finding container fe9b6fc61c8c5dbd90af3b33e416ff8ca4bfb69bdf1b3151c0cde7b163425373: Status 404 returned error can't find the container with id fe9b6fc61c8c5dbd90af3b33e416ff8ca4bfb69bdf1b3151c0cde7b163425373
Sep 11 12:18:27.760288 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.760253    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:18:27.760391 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.760327    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:18:27.760391 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:27.760357    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:18:28.517221 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:28.517185    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw" event={"ID":"106a88b8-308c-4457-a865-dd85dd40e334","Type":"ContainerStarted","Data":"679ef7c316f644df501efa547659a0b83cccced704a461f88656e1e203a5c133"}
Sep 11 12:18:28.517596 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:28.517238    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw" event={"ID":"106a88b8-308c-4457-a865-dd85dd40e334","Type":"ContainerStarted","Data":"fe9b6fc61c8c5dbd90af3b33e416ff8ca4bfb69bdf1b3151c0cde7b163425373"}
Sep 11 12:18:28.537566 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:28.537503    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw" podStartSLOduration=1.537486183 podStartE2EDuration="1.537486183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:18:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:18:28.53582107 +0000 UTC m=+1622.218220579" watchObservedRunningTime="2026-09-11 12:18:28.537486183 +0000 UTC m=+1622.219885681"
Sep 11 12:18:29.477918 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:29.477879    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:29.483299 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:29.483272    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:29.522787 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:29.522757    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:29.523671 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:29.523653    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:50.659585 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:50.659551    2565 generic.go:356] "Generic (PLEG): container finished" podID="106a88b8-308c-4457-a865-dd85dd40e334" containerID="679ef7c316f644df501efa547659a0b83cccced704a461f88656e1e203a5c133" exitCode=0
Sep 11 12:18:50.660047 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:50.659617    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw" event={"ID":"106a88b8-308c-4457-a865-dd85dd40e334","Type":"ContainerDied","Data":"679ef7c316f644df501efa547659a0b83cccced704a461f88656e1e203a5c133"}
Sep 11 12:18:50.660125 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:50.660108    2565 scope.go:117] "RemoveContainer" containerID="679ef7c316f644df501efa547659a0b83cccced704a461f88656e1e203a5c133"
Sep 11 12:18:50.661301 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:50.661268    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:18:50.661409 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:50.661339    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:18:50.661409 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:50.661369    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 12:18:51.671598 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:51.671564    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw" event={"ID":"106a88b8-308c-4457-a865-dd85dd40e334","Type":"ContainerStarted","Data":"1f4979cd15c398dc6e8a8c74da9a314a6817963216b9d0ffa3030cc534bdc5e1"}
Sep 11 12:18:52.478001 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:52.477964    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:52.478222 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:52.478198    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Sep 11 12:18:52.478271 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:52.478251    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw" podUID="106a88b8-308c-4457-a865-dd85dd40e334" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Sep 11 12:18:53.478849 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:53.478802    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Sep 11 12:18:53.479237 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:53.478869    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw" podUID="106a88b8-308c-4457-a865-dd85dd40e334" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Sep 11 12:18:54.478104 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:54.478066    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Sep 11 12:18:54.478283 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:54.478139    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw" podUID="106a88b8-308c-4457-a865-dd85dd40e334" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Sep 11 12:18:55.478660 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:55.478626    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Sep 11 12:18:55.479083 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:55.478718    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw" podUID="106a88b8-308c-4457-a865-dd85dd40e334" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Sep 11 12:18:56.027138 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:56.027096    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-49995f-mkhzc"]
Sep 11 12:18:56.030712 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:56.030669    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-49995f-mkhzc"
Sep 11 12:18:56.033502 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:56.033479    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r95fz\""
Sep 11 12:18:56.033618 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:56.033553    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:18:56.039039 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:56.039007    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-49995f-mkhzc"]
Sep 11 12:18:56.162413 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:56.162361    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12c96980-8b70-4b81-ad69-aabd182ad463-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-49995f-mkhzc\" (UID: \"12c96980-8b70-4b81-ad69-aabd182ad463\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-49995f-mkhzc"
Sep 11 12:18:56.263889 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:56.263849    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12c96980-8b70-4b81-ad69-aabd182ad463-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-49995f-mkhzc\" (UID: \"12c96980-8b70-4b81-ad69-aabd182ad463\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-49995f-mkhzc"
Sep 11 12:18:56.264509 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:56.264488    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12c96980-8b70-4b81-ad69-aabd182ad463-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-49995f-mkhzc\" (UID: \"12c96980-8b70-4b81-ad69-aabd182ad463\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-49995f-mkhzc"
Sep 11 12:18:56.354881 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:56.354779    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-49995f-mkhzc"
Sep 11 12:18:56.478227 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:56.478183    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Sep 11 12:18:56.478422 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:56.478248    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw" podUID="106a88b8-308c-4457-a865-dd85dd40e334" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Sep 11 12:18:56.632430 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:56.632404    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-49995f-mkhzc"]
Sep 11 12:18:56.634823 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:18:56.634797    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12c96980_8b70_4b81_ad69_aabd182ad463.slice/crio-daef7ed2544ed8467265a84f9daf9b056938b74993779a8ee07786727582e075 WatchSource:0}: Error finding container daef7ed2544ed8467265a84f9daf9b056938b74993779a8ee07786727582e075: Status 404 returned error can't find the container with id daef7ed2544ed8467265a84f9daf9b056938b74993779a8ee07786727582e075
Sep 11 12:18:56.705533 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:56.705494    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-49995f-mkhzc" event={"ID":"12c96980-8b70-4b81-ad69-aabd182ad463","Type":"ContainerStarted","Data":"daef7ed2544ed8467265a84f9daf9b056938b74993779a8ee07786727582e075"}
Sep 11 12:18:57.482027 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:57.481993    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:57.482301 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:57.482279    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:57.482906 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:57.482888    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:18:57.713307 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:57.713273    2565 generic.go:356] "Generic (PLEG): container finished" podID="12c96980-8b70-4b81-ad69-aabd182ad463" containerID="0a6aee8cecdb53fc83b039d5c14b021cb99808b2efd2f1aa51275315052d7843" exitCode=0
Sep 11 12:18:57.713655 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:57.713363    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-49995f-mkhzc" event={"ID":"12c96980-8b70-4b81-ad69-aabd182ad463","Type":"ContainerDied","Data":"0a6aee8cecdb53fc83b039d5c14b021cb99808b2efd2f1aa51275315052d7843"}
Sep 11 12:18:58.852724 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:58.852696    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-49995f-mkhzc"
Sep 11 12:18:58.995868 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:58.995774    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12c96980-8b70-4b81-ad69-aabd182ad463-maas-api-service-ca\") pod \"12c96980-8b70-4b81-ad69-aabd182ad463\" (UID: \"12c96980-8b70-4b81-ad69-aabd182ad463\") "
Sep 11 12:18:58.996197 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:58.996173    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12c96980-8b70-4b81-ad69-aabd182ad463-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "12c96980-8b70-4b81-ad69-aabd182ad463" (UID: "12c96980-8b70-4b81-ad69-aabd182ad463"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:18:59.097311 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:59.097278    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12c96980-8b70-4b81-ad69-aabd182ad463-maas-api-service-ca\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:18:59.726726 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:59.726664    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-49995f-mkhzc" event={"ID":"12c96980-8b70-4b81-ad69-aabd182ad463","Type":"ContainerDied","Data":"daef7ed2544ed8467265a84f9daf9b056938b74993779a8ee07786727582e075"}
Sep 11 12:18:59.726928 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:59.726752    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="daef7ed2544ed8467265a84f9daf9b056938b74993779a8ee07786727582e075"
Sep 11 12:18:59.726928 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:18:59.726699    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-49995f-mkhzc"
Sep 11 12:19:02.308254 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:02.308215    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-49995f-mkhzc"]
Sep 11 12:19:02.311417 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:02.311393    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-49995f-mkhzc"]
Sep 11 12:19:02.850710 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:02.850645    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12c96980-8b70-4b81-ad69-aabd182ad463" path="/var/lib/kubelet/pods/12c96980-8b70-4b81-ad69-aabd182ad463/volumes"
Sep 11 12:19:08.867417 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:08.867380    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"]
Sep 11 12:19:08.867876 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:08.867615    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw" podUID="106a88b8-308c-4457-a865-dd85dd40e334" containerName="istio-proxy" containerID="cri-o://1f4979cd15c398dc6e8a8c74da9a314a6817963216b9d0ffa3030cc534bdc5e1" gracePeriod=30
Sep 11 12:19:12.484978 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:12.484936    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 12:19:12.485368 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:12.485000    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw" podUID="106a88b8-308c-4457-a865-dd85dd40e334" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 12:19:14.122068 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.122043    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:19:14.242521 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.242490    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/106a88b8-308c-4457-a865-dd85dd40e334-istio-token\") pod \"106a88b8-308c-4457-a865-dd85dd40e334\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") "
Sep 11 12:19:14.242734 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.242527    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4dst\" (UniqueName: \"kubernetes.io/projected/106a88b8-308c-4457-a865-dd85dd40e334-kube-api-access-j4dst\") pod \"106a88b8-308c-4457-a865-dd85dd40e334\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") "
Sep 11 12:19:14.242734 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.242561    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-workload-certs\") pod \"106a88b8-308c-4457-a865-dd85dd40e334\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") "
Sep 11 12:19:14.242734 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.242678    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/106a88b8-308c-4457-a865-dd85dd40e334-istiod-ca-cert\") pod \"106a88b8-308c-4457-a865-dd85dd40e334\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") "
Sep 11 12:19:14.242929 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.242797    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/106a88b8-308c-4457-a865-dd85dd40e334-istio-podinfo\") pod \"106a88b8-308c-4457-a865-dd85dd40e334\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") "
Sep 11 12:19:14.242929 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.242843    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "106a88b8-308c-4457-a865-dd85dd40e334" (UID: "106a88b8-308c-4457-a865-dd85dd40e334"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:19:14.242929 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.242907    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-istio-envoy\") pod \"106a88b8-308c-4457-a865-dd85dd40e334\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") "
Sep 11 12:19:14.243089 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.242938    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-credential-socket\") pod \"106a88b8-308c-4457-a865-dd85dd40e334\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") "
Sep 11 12:19:14.243089 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.242964    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-workload-socket\") pod \"106a88b8-308c-4457-a865-dd85dd40e334\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") "
Sep 11 12:19:14.243089 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.243009    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-istio-data\") pod \"106a88b8-308c-4457-a865-dd85dd40e334\" (UID: \"106a88b8-308c-4457-a865-dd85dd40e334\") "
Sep 11 12:19:14.243251 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.243097    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/106a88b8-308c-4457-a865-dd85dd40e334-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "106a88b8-308c-4457-a865-dd85dd40e334" (UID: "106a88b8-308c-4457-a865-dd85dd40e334"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:19:14.243396 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.243373    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-istio-data" (OuterVolumeSpecName: "istio-data") pod "106a88b8-308c-4457-a865-dd85dd40e334" (UID: "106a88b8-308c-4457-a865-dd85dd40e334"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:19:14.243533 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.243506    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-workload-certs\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:19:14.243533 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.243530    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/106a88b8-308c-4457-a865-dd85dd40e334-istiod-ca-cert\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:19:14.243708 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.243484    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "106a88b8-308c-4457-a865-dd85dd40e334" (UID: "106a88b8-308c-4457-a865-dd85dd40e334"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:19:14.243776 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.243712    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "106a88b8-308c-4457-a865-dd85dd40e334" (UID: "106a88b8-308c-4457-a865-dd85dd40e334"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:19:14.245373 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.245346    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/106a88b8-308c-4457-a865-dd85dd40e334-istio-token" (OuterVolumeSpecName: "istio-token") pod "106a88b8-308c-4457-a865-dd85dd40e334" (UID: "106a88b8-308c-4457-a865-dd85dd40e334"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:19:14.245373 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.245361    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/106a88b8-308c-4457-a865-dd85dd40e334-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "106a88b8-308c-4457-a865-dd85dd40e334" (UID: "106a88b8-308c-4457-a865-dd85dd40e334"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:19:14.245652 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.245628    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "106a88b8-308c-4457-a865-dd85dd40e334" (UID: "106a88b8-308c-4457-a865-dd85dd40e334"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:19:14.245761 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.245721    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/106a88b8-308c-4457-a865-dd85dd40e334-kube-api-access-j4dst" (OuterVolumeSpecName: "kube-api-access-j4dst") pod "106a88b8-308c-4457-a865-dd85dd40e334" (UID: "106a88b8-308c-4457-a865-dd85dd40e334"). InnerVolumeSpecName "kube-api-access-j4dst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:19:14.344120 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.344080    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-istio-data\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:19:14.344120 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.344108    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/106a88b8-308c-4457-a865-dd85dd40e334-istio-token\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:19:14.344120 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.344119    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4dst\" (UniqueName: \"kubernetes.io/projected/106a88b8-308c-4457-a865-dd85dd40e334-kube-api-access-j4dst\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:19:14.344120 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.344130    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/106a88b8-308c-4457-a865-dd85dd40e334-istio-podinfo\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:19:14.344416 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.344139    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-istio-envoy\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:19:14.344416 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.344147    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-credential-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:19:14.344416 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.344155    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/106a88b8-308c-4457-a865-dd85dd40e334-workload-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:19:14.824625 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.824583    2565 generic.go:356] "Generic (PLEG): container finished" podID="106a88b8-308c-4457-a865-dd85dd40e334" containerID="1f4979cd15c398dc6e8a8c74da9a314a6817963216b9d0ffa3030cc534bdc5e1" exitCode=0
Sep 11 12:19:14.824815 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.824650    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"
Sep 11 12:19:14.824815 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.824662    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw" event={"ID":"106a88b8-308c-4457-a865-dd85dd40e334","Type":"ContainerDied","Data":"1f4979cd15c398dc6e8a8c74da9a314a6817963216b9d0ffa3030cc534bdc5e1"}
Sep 11 12:19:14.824815 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.824763    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw" event={"ID":"106a88b8-308c-4457-a865-dd85dd40e334","Type":"ContainerDied","Data":"fe9b6fc61c8c5dbd90af3b33e416ff8ca4bfb69bdf1b3151c0cde7b163425373"}
Sep 11 12:19:14.824815 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.824794    2565 scope.go:117] "RemoveContainer" containerID="1f4979cd15c398dc6e8a8c74da9a314a6817963216b9d0ffa3030cc534bdc5e1"
Sep 11 12:19:14.834922 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.834902    2565 scope.go:117] "RemoveContainer" containerID="679ef7c316f644df501efa547659a0b83cccced704a461f88656e1e203a5c133"
Sep 11 12:19:14.845859 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.845834    2565 scope.go:117] "RemoveContainer" containerID="1f4979cd15c398dc6e8a8c74da9a314a6817963216b9d0ffa3030cc534bdc5e1"
Sep 11 12:19:14.846178 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:19:14.846154    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f4979cd15c398dc6e8a8c74da9a314a6817963216b9d0ffa3030cc534bdc5e1\": container with ID starting with 1f4979cd15c398dc6e8a8c74da9a314a6817963216b9d0ffa3030cc534bdc5e1 not found: ID does not exist" containerID="1f4979cd15c398dc6e8a8c74da9a314a6817963216b9d0ffa3030cc534bdc5e1"
Sep 11 12:19:14.846276 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.846186    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f4979cd15c398dc6e8a8c74da9a314a6817963216b9d0ffa3030cc534bdc5e1"} err="failed to get container status \"1f4979cd15c398dc6e8a8c74da9a314a6817963216b9d0ffa3030cc534bdc5e1\": rpc error: code = NotFound desc = could not find container \"1f4979cd15c398dc6e8a8c74da9a314a6817963216b9d0ffa3030cc534bdc5e1\": container with ID starting with 1f4979cd15c398dc6e8a8c74da9a314a6817963216b9d0ffa3030cc534bdc5e1 not found: ID does not exist"
Sep 11 12:19:14.846276 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.846204    2565 scope.go:117] "RemoveContainer" containerID="679ef7c316f644df501efa547659a0b83cccced704a461f88656e1e203a5c133"
Sep 11 12:19:14.846524 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:19:14.846502    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"679ef7c316f644df501efa547659a0b83cccced704a461f88656e1e203a5c133\": container with ID starting with 679ef7c316f644df501efa547659a0b83cccced704a461f88656e1e203a5c133 not found: ID does not exist" containerID="679ef7c316f644df501efa547659a0b83cccced704a461f88656e1e203a5c133"
Sep 11 12:19:14.846616 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.846535    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"679ef7c316f644df501efa547659a0b83cccced704a461f88656e1e203a5c133"} err="failed to get container status \"679ef7c316f644df501efa547659a0b83cccced704a461f88656e1e203a5c133\": rpc error: code = NotFound desc = could not find container \"679ef7c316f644df501efa547659a0b83cccced704a461f88656e1e203a5c133\": container with ID starting with 679ef7c316f644df501efa547659a0b83cccced704a461f88656e1e203a5c133 not found: ID does not exist"
Sep 11 12:19:14.848299 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.848277    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"]
Sep 11 12:19:14.852861 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:14.852836    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-49995f-openshift-default-59846986d8-lc7vw"]
Sep 11 12:19:16.843334 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:19:16.843296    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="106a88b8-308c-4457-a865-dd85dd40e334" path="/var/lib/kubelet/pods/106a88b8-308c-4457-a865-dd85dd40e334/volumes"
Sep 11 12:20:21.894734 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:21.894699    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"]
Sep 11 12:20:21.895279 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:21.894975    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m" podUID="da27961f-7767-4f09-b92e-744aae2b5ca7" containerName="istio-proxy" containerID="cri-o://41df22aa4c60ea6a6ea8cabb68ad39e9071339fb13ecc95eb6aa25b9fff3242f" gracePeriod=30
Sep 11 12:20:27.154901 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.154873    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:20:27.232080 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.231997    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8jts\" (UniqueName: \"kubernetes.io/projected/da27961f-7767-4f09-b92e-744aae2b5ca7-kube-api-access-q8jts\") pod \"da27961f-7767-4f09-b92e-744aae2b5ca7\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") "
Sep 11 12:20:27.232080 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.232041    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-credential-socket\") pod \"da27961f-7767-4f09-b92e-744aae2b5ca7\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") "
Sep 11 12:20:27.232080 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.232073    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da27961f-7767-4f09-b92e-744aae2b5ca7-istiod-ca-cert\") pod \"da27961f-7767-4f09-b92e-744aae2b5ca7\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") "
Sep 11 12:20:27.232344 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.232096    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da27961f-7767-4f09-b92e-744aae2b5ca7-istio-token\") pod \"da27961f-7767-4f09-b92e-744aae2b5ca7\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") "
Sep 11 12:20:27.232344 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.232112    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-workload-socket\") pod \"da27961f-7767-4f09-b92e-744aae2b5ca7\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") "
Sep 11 12:20:27.232344 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.232132    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-istio-data\") pod \"da27961f-7767-4f09-b92e-744aae2b5ca7\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") "
Sep 11 12:20:27.232344 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.232187    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da27961f-7767-4f09-b92e-744aae2b5ca7-istio-podinfo\") pod \"da27961f-7767-4f09-b92e-744aae2b5ca7\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") "
Sep 11 12:20:27.232344 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.232242    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-workload-certs\") pod \"da27961f-7767-4f09-b92e-744aae2b5ca7\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") "
Sep 11 12:20:27.232344 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.232285    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-istio-envoy\") pod \"da27961f-7767-4f09-b92e-744aae2b5ca7\" (UID: \"da27961f-7767-4f09-b92e-744aae2b5ca7\") "
Sep 11 12:20:27.232344 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.232308    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "da27961f-7767-4f09-b92e-744aae2b5ca7" (UID: "da27961f-7767-4f09-b92e-744aae2b5ca7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:20:27.232719 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.232446    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-istio-data" (OuterVolumeSpecName: "istio-data") pod "da27961f-7767-4f09-b92e-744aae2b5ca7" (UID: "da27961f-7767-4f09-b92e-744aae2b5ca7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:20:27.232719 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.232478    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "da27961f-7767-4f09-b92e-744aae2b5ca7" (UID: "da27961f-7767-4f09-b92e-744aae2b5ca7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:20:27.232719 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.232490    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "da27961f-7767-4f09-b92e-744aae2b5ca7" (UID: "da27961f-7767-4f09-b92e-744aae2b5ca7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:20:27.232719 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.232558    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da27961f-7767-4f09-b92e-744aae2b5ca7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "da27961f-7767-4f09-b92e-744aae2b5ca7" (UID: "da27961f-7767-4f09-b92e-744aae2b5ca7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:20:27.232719 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.232715    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-credential-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:20:27.232932 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.232738    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da27961f-7767-4f09-b92e-744aae2b5ca7-istiod-ca-cert\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:20:27.232932 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.232753    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-workload-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:20:27.232932 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.232766    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-istio-data\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:20:27.232932 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.232779    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-workload-certs\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:20:27.234458 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.234426    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/da27961f-7767-4f09-b92e-744aae2b5ca7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "da27961f-7767-4f09-b92e-744aae2b5ca7" (UID: "da27961f-7767-4f09-b92e-744aae2b5ca7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:20:27.234458 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.234442    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da27961f-7767-4f09-b92e-744aae2b5ca7-kube-api-access-q8jts" (OuterVolumeSpecName: "kube-api-access-q8jts") pod "da27961f-7767-4f09-b92e-744aae2b5ca7" (UID: "da27961f-7767-4f09-b92e-744aae2b5ca7"). InnerVolumeSpecName "kube-api-access-q8jts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:20:27.234639 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.234611    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da27961f-7767-4f09-b92e-744aae2b5ca7-istio-token" (OuterVolumeSpecName: "istio-token") pod "da27961f-7767-4f09-b92e-744aae2b5ca7" (UID: "da27961f-7767-4f09-b92e-744aae2b5ca7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:20:27.234741 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.234722    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "da27961f-7767-4f09-b92e-744aae2b5ca7" (UID: "da27961f-7767-4f09-b92e-744aae2b5ca7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:20:27.279875 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.279844    2565 generic.go:356] "Generic (PLEG): container finished" podID="da27961f-7767-4f09-b92e-744aae2b5ca7" containerID="41df22aa4c60ea6a6ea8cabb68ad39e9071339fb13ecc95eb6aa25b9fff3242f" exitCode=0
Sep 11 12:20:27.280024 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.279887    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"
Sep 11 12:20:27.280024 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.279893    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m" event={"ID":"da27961f-7767-4f09-b92e-744aae2b5ca7","Type":"ContainerDied","Data":"41df22aa4c60ea6a6ea8cabb68ad39e9071339fb13ecc95eb6aa25b9fff3242f"}
Sep 11 12:20:27.280024 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.279934    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m" event={"ID":"da27961f-7767-4f09-b92e-744aae2b5ca7","Type":"ContainerDied","Data":"badfeafaaba172d801505fe9ccff353e893ec1c752dac16da6bd776bc8351f6d"}
Sep 11 12:20:27.280024 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.279956    2565 scope.go:117] "RemoveContainer" containerID="41df22aa4c60ea6a6ea8cabb68ad39e9071339fb13ecc95eb6aa25b9fff3242f"
Sep 11 12:20:27.289533 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.289517    2565 scope.go:117] "RemoveContainer" containerID="c7f730467eb18de86a1168247b0a46543aa4de1b6dbbb221914e40f8c0b88d2f"
Sep 11 12:20:27.298377 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.298358    2565 scope.go:117] "RemoveContainer" containerID="41df22aa4c60ea6a6ea8cabb68ad39e9071339fb13ecc95eb6aa25b9fff3242f"
Sep 11 12:20:27.298644 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:20:27.298625    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41df22aa4c60ea6a6ea8cabb68ad39e9071339fb13ecc95eb6aa25b9fff3242f\": container with ID starting with 41df22aa4c60ea6a6ea8cabb68ad39e9071339fb13ecc95eb6aa25b9fff3242f not found: ID does not exist" containerID="41df22aa4c60ea6a6ea8cabb68ad39e9071339fb13ecc95eb6aa25b9fff3242f"
Sep 11 12:20:27.298710 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.298653    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41df22aa4c60ea6a6ea8cabb68ad39e9071339fb13ecc95eb6aa25b9fff3242f"} err="failed to get container status \"41df22aa4c60ea6a6ea8cabb68ad39e9071339fb13ecc95eb6aa25b9fff3242f\": rpc error: code = NotFound desc = could not find container \"41df22aa4c60ea6a6ea8cabb68ad39e9071339fb13ecc95eb6aa25b9fff3242f\": container with ID starting with 41df22aa4c60ea6a6ea8cabb68ad39e9071339fb13ecc95eb6aa25b9fff3242f not found: ID does not exist"
Sep 11 12:20:27.298710 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.298670    2565 scope.go:117] "RemoveContainer" containerID="c7f730467eb18de86a1168247b0a46543aa4de1b6dbbb221914e40f8c0b88d2f"
Sep 11 12:20:27.298922 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:20:27.298907    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7f730467eb18de86a1168247b0a46543aa4de1b6dbbb221914e40f8c0b88d2f\": container with ID starting with c7f730467eb18de86a1168247b0a46543aa4de1b6dbbb221914e40f8c0b88d2f not found: ID does not exist" containerID="c7f730467eb18de86a1168247b0a46543aa4de1b6dbbb221914e40f8c0b88d2f"
Sep 11 12:20:27.298964 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.298926    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7f730467eb18de86a1168247b0a46543aa4de1b6dbbb221914e40f8c0b88d2f"} err="failed to get container status \"c7f730467eb18de86a1168247b0a46543aa4de1b6dbbb221914e40f8c0b88d2f\": rpc error: code = NotFound desc = could not find container \"c7f730467eb18de86a1168247b0a46543aa4de1b6dbbb221914e40f8c0b88d2f\": container with ID starting with c7f730467eb18de86a1168247b0a46543aa4de1b6dbbb221914e40f8c0b88d2f not found: ID does not exist"
Sep 11 12:20:27.303560 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.303535    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"]
Sep 11 12:20:27.307256 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.307235    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-9c3012-openshift-default-866c7766b-6rq8m"]
Sep 11 12:20:27.333313 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.333292    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da27961f-7767-4f09-b92e-744aae2b5ca7-istio-podinfo\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:20:27.333410 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.333318    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da27961f-7767-4f09-b92e-744aae2b5ca7-istio-envoy\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:20:27.333410 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.333332    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8jts\" (UniqueName: \"kubernetes.io/projected/da27961f-7767-4f09-b92e-744aae2b5ca7-kube-api-access-q8jts\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:20:27.333410 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:27.333345    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da27961f-7767-4f09-b92e-744aae2b5ca7-istio-token\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:20:28.842311 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:28.842276    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da27961f-7767-4f09-b92e-744aae2b5ca7" path="/var/lib/kubelet/pods/da27961f-7767-4f09-b92e-744aae2b5ca7/volumes"
Sep 11 12:20:39.457489 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:39.457442    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"]
Sep 11 12:20:39.458055 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:39.457752    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9" podUID="c2eee8bf-2273-40fc-b102-de9006439cac" containerName="istio-proxy" containerID="cri-o://95aff0832432e7e13e68adbcebaf6431ebe0dfd427fc7cfde99b641c94d20c6b" gracePeriod=30
Sep 11 12:20:44.720504 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:44.720478    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:20:44.899136 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:44.899105    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2eee8bf-2273-40fc-b102-de9006439cac-istiod-ca-cert\") pod \"c2eee8bf-2273-40fc-b102-de9006439cac\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") "
Sep 11 12:20:44.899303 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:44.899147    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-istio-data\") pod \"c2eee8bf-2273-40fc-b102-de9006439cac\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") "
Sep 11 12:20:44.899303 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:44.899198    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-credential-socket\") pod \"c2eee8bf-2273-40fc-b102-de9006439cac\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") "
Sep 11 12:20:44.899303 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:44.899229    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpxwj\" (UniqueName: \"kubernetes.io/projected/c2eee8bf-2273-40fc-b102-de9006439cac-kube-api-access-hpxwj\") pod \"c2eee8bf-2273-40fc-b102-de9006439cac\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") "
Sep 11 12:20:44.899303 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:44.899298    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-istio-envoy\") pod \"c2eee8bf-2273-40fc-b102-de9006439cac\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") "
Sep 11 12:20:44.899489 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:44.899323    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-workload-socket\") pod \"c2eee8bf-2273-40fc-b102-de9006439cac\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") "
Sep 11 12:20:44.899489 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:44.899342    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-workload-certs\") pod \"c2eee8bf-2273-40fc-b102-de9006439cac\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") "
Sep 11 12:20:44.899489 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:44.899371    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2eee8bf-2273-40fc-b102-de9006439cac-istio-token\") pod \"c2eee8bf-2273-40fc-b102-de9006439cac\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") "
Sep 11 12:20:44.899489 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:44.899413    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2eee8bf-2273-40fc-b102-de9006439cac-istio-podinfo\") pod \"c2eee8bf-2273-40fc-b102-de9006439cac\" (UID: \"c2eee8bf-2273-40fc-b102-de9006439cac\") "
Sep 11 12:20:44.899725 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:44.899508    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-istio-data" (OuterVolumeSpecName: "istio-data") pod "c2eee8bf-2273-40fc-b102-de9006439cac" (UID: "c2eee8bf-2273-40fc-b102-de9006439cac"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:20:44.899725 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:44.899524    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c2eee8bf-2273-40fc-b102-de9006439cac" (UID: "c2eee8bf-2273-40fc-b102-de9006439cac"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:20:44.899725 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:44.899546    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2eee8bf-2273-40fc-b102-de9006439cac-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c2eee8bf-2273-40fc-b102-de9006439cac" (UID: "c2eee8bf-2273-40fc-b102-de9006439cac"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:20:44.899913 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:44.899718    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c2eee8bf-2273-40fc-b102-de9006439cac" (UID: "c2eee8bf-2273-40fc-b102-de9006439cac"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:20:44.899913 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:44.899755    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c2eee8bf-2273-40fc-b102-de9006439cac" (UID: "c2eee8bf-2273-40fc-b102-de9006439cac"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:20:44.899913 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:44.899823    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-workload-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:20:44.899913 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:44.899841    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-workload-certs\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:20:44.899913 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:44.899859    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2eee8bf-2273-40fc-b102-de9006439cac-istiod-ca-cert\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:20:44.899913 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:44.899874    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-istio-data\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:20:44.899913 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:44.899889    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-credential-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:20:44.901624 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:44.901597    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c2eee8bf-2273-40fc-b102-de9006439cac-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c2eee8bf-2273-40fc-b102-de9006439cac" (UID: "c2eee8bf-2273-40fc-b102-de9006439cac"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:20:44.901624 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:44.901604    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c2eee8bf-2273-40fc-b102-de9006439cac" (UID: "c2eee8bf-2273-40fc-b102-de9006439cac"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:20:44.901624 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:44.901606    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2eee8bf-2273-40fc-b102-de9006439cac-kube-api-access-hpxwj" (OuterVolumeSpecName: "kube-api-access-hpxwj") pod "c2eee8bf-2273-40fc-b102-de9006439cac" (UID: "c2eee8bf-2273-40fc-b102-de9006439cac"). InnerVolumeSpecName "kube-api-access-hpxwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:20:44.901846 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:44.901630    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2eee8bf-2273-40fc-b102-de9006439cac-istio-token" (OuterVolumeSpecName: "istio-token") pod "c2eee8bf-2273-40fc-b102-de9006439cac" (UID: "c2eee8bf-2273-40fc-b102-de9006439cac"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:20:45.001022 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:45.000981    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2eee8bf-2273-40fc-b102-de9006439cac-istio-envoy\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:20:45.001022 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:45.001013    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2eee8bf-2273-40fc-b102-de9006439cac-istio-token\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:20:45.001022 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:45.001027    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2eee8bf-2273-40fc-b102-de9006439cac-istio-podinfo\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:20:45.001263 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:45.001039    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpxwj\" (UniqueName: \"kubernetes.io/projected/c2eee8bf-2273-40fc-b102-de9006439cac-kube-api-access-hpxwj\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:20:45.391874 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:45.391843    2565 generic.go:356] "Generic (PLEG): container finished" podID="c2eee8bf-2273-40fc-b102-de9006439cac" containerID="95aff0832432e7e13e68adbcebaf6431ebe0dfd427fc7cfde99b641c94d20c6b" exitCode=0
Sep 11 12:20:45.392079 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:45.391904    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"
Sep 11 12:20:45.392079 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:45.391932    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9" event={"ID":"c2eee8bf-2273-40fc-b102-de9006439cac","Type":"ContainerDied","Data":"95aff0832432e7e13e68adbcebaf6431ebe0dfd427fc7cfde99b641c94d20c6b"}
Sep 11 12:20:45.392079 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:45.391986    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9" event={"ID":"c2eee8bf-2273-40fc-b102-de9006439cac","Type":"ContainerDied","Data":"ef6ebb1c2d0c7c6bf4db4b6dc2160227afa74b767771555182c71d6d5eca8d05"}
Sep 11 12:20:45.392079 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:45.392009    2565 scope.go:117] "RemoveContainer" containerID="95aff0832432e7e13e68adbcebaf6431ebe0dfd427fc7cfde99b641c94d20c6b"
Sep 11 12:20:45.401498 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:45.401480    2565 scope.go:117] "RemoveContainer" containerID="bd09dc48ce6dd83cdeb28947179df0be6d972d0cd37d852302eac0b57a2239c1"
Sep 11 12:20:45.410430 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:45.410411    2565 scope.go:117] "RemoveContainer" containerID="95aff0832432e7e13e68adbcebaf6431ebe0dfd427fc7cfde99b641c94d20c6b"
Sep 11 12:20:45.410727 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:20:45.410705    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95aff0832432e7e13e68adbcebaf6431ebe0dfd427fc7cfde99b641c94d20c6b\": container with ID starting with 95aff0832432e7e13e68adbcebaf6431ebe0dfd427fc7cfde99b641c94d20c6b not found: ID does not exist" containerID="95aff0832432e7e13e68adbcebaf6431ebe0dfd427fc7cfde99b641c94d20c6b"
Sep 11 12:20:45.410815 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:45.410739    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95aff0832432e7e13e68adbcebaf6431ebe0dfd427fc7cfde99b641c94d20c6b"} err="failed to get container status \"95aff0832432e7e13e68adbcebaf6431ebe0dfd427fc7cfde99b641c94d20c6b\": rpc error: code = NotFound desc = could not find container \"95aff0832432e7e13e68adbcebaf6431ebe0dfd427fc7cfde99b641c94d20c6b\": container with ID starting with 95aff0832432e7e13e68adbcebaf6431ebe0dfd427fc7cfde99b641c94d20c6b not found: ID does not exist"
Sep 11 12:20:45.410815 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:45.410764    2565 scope.go:117] "RemoveContainer" containerID="bd09dc48ce6dd83cdeb28947179df0be6d972d0cd37d852302eac0b57a2239c1"
Sep 11 12:20:45.411025 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:20:45.411005    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd09dc48ce6dd83cdeb28947179df0be6d972d0cd37d852302eac0b57a2239c1\": container with ID starting with bd09dc48ce6dd83cdeb28947179df0be6d972d0cd37d852302eac0b57a2239c1 not found: ID does not exist" containerID="bd09dc48ce6dd83cdeb28947179df0be6d972d0cd37d852302eac0b57a2239c1"
Sep 11 12:20:45.411066 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:45.411032    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd09dc48ce6dd83cdeb28947179df0be6d972d0cd37d852302eac0b57a2239c1"} err="failed to get container status \"bd09dc48ce6dd83cdeb28947179df0be6d972d0cd37d852302eac0b57a2239c1\": rpc error: code = NotFound desc = could not find container \"bd09dc48ce6dd83cdeb28947179df0be6d972d0cd37d852302eac0b57a2239c1\": container with ID starting with bd09dc48ce6dd83cdeb28947179df0be6d972d0cd37d852302eac0b57a2239c1 not found: ID does not exist"
Sep 11 12:20:45.414929 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:45.414910    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"]
Sep 11 12:20:45.418400 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:45.418375    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-6d324e-openshift-default-78b66594b4-r76p9"]
Sep 11 12:20:46.842280 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:46.842247    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2eee8bf-2273-40fc-b102-de9006439cac" path="/var/lib/kubelet/pods/c2eee8bf-2273-40fc-b102-de9006439cac/volumes"
Sep 11 12:20:50.385875 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:50.385841    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-88968d-29818815-m4kl2"]
Sep 11 12:20:50.389849 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:50.389816    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-88968d-29818815-m4kl2"]
Sep 11 12:20:50.843415 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:50.843327    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bea006f3-8c20-4441-bd97-67fbb6b22d21" path="/var/lib/kubelet/pods/bea006f3-8c20-4441-bd97-67fbb6b22d21/volumes"
Sep 11 12:20:57.207829 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:57.207787    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"]
Sep 11 12:20:57.208251 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:57.208037    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt" podUID="5be27b9b-c449-4e8b-ba1e-f034046f4b44" containerName="istio-proxy" containerID="cri-o://9c29bf678adcb71d3cd8ce8b2db185f60cc2ad5f5d08509a3cc13a4547d59738" gracePeriod=30
Sep 11 12:20:59.951474 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:59.951432    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 12:20:59.951848 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:20:59.951497    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt" podUID="5be27b9b-c449-4e8b-ba1e-f034046f4b44" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 12:21:02.469473 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.469442    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:21:02.496334 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.496249    2565 generic.go:356] "Generic (PLEG): container finished" podID="5be27b9b-c449-4e8b-ba1e-f034046f4b44" containerID="9c29bf678adcb71d3cd8ce8b2db185f60cc2ad5f5d08509a3cc13a4547d59738" exitCode=0
Sep 11 12:21:02.496334 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.496299    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt" event={"ID":"5be27b9b-c449-4e8b-ba1e-f034046f4b44","Type":"ContainerDied","Data":"9c29bf678adcb71d3cd8ce8b2db185f60cc2ad5f5d08509a3cc13a4547d59738"}
Sep 11 12:21:02.496533 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.496352    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt" event={"ID":"5be27b9b-c449-4e8b-ba1e-f034046f4b44","Type":"ContainerDied","Data":"fec35598da0eca7bc64e5b57ea541c06338a65f034470840c540736c89e2951f"}
Sep 11 12:21:02.496533 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.496382    2565 scope.go:117] "RemoveContainer" containerID="9c29bf678adcb71d3cd8ce8b2db185f60cc2ad5f5d08509a3cc13a4547d59738"
Sep 11 12:21:02.496533 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.496389    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"
Sep 11 12:21:02.509587 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.509561    2565 scope.go:117] "RemoveContainer" containerID="c2fd29e5bda739c67d823e5a1c7b6cccf06ba5f518f27edca370a2d3ef2d2f76"
Sep 11 12:21:02.518318 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.518299    2565 scope.go:117] "RemoveContainer" containerID="9c29bf678adcb71d3cd8ce8b2db185f60cc2ad5f5d08509a3cc13a4547d59738"
Sep 11 12:21:02.518574 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:21:02.518556    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c29bf678adcb71d3cd8ce8b2db185f60cc2ad5f5d08509a3cc13a4547d59738\": container with ID starting with 9c29bf678adcb71d3cd8ce8b2db185f60cc2ad5f5d08509a3cc13a4547d59738 not found: ID does not exist" containerID="9c29bf678adcb71d3cd8ce8b2db185f60cc2ad5f5d08509a3cc13a4547d59738"
Sep 11 12:21:02.518626 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.518587    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c29bf678adcb71d3cd8ce8b2db185f60cc2ad5f5d08509a3cc13a4547d59738"} err="failed to get container status \"9c29bf678adcb71d3cd8ce8b2db185f60cc2ad5f5d08509a3cc13a4547d59738\": rpc error: code = NotFound desc = could not find container \"9c29bf678adcb71d3cd8ce8b2db185f60cc2ad5f5d08509a3cc13a4547d59738\": container with ID starting with 9c29bf678adcb71d3cd8ce8b2db185f60cc2ad5f5d08509a3cc13a4547d59738 not found: ID does not exist"
Sep 11 12:21:02.518626 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.518605    2565 scope.go:117] "RemoveContainer" containerID="c2fd29e5bda739c67d823e5a1c7b6cccf06ba5f518f27edca370a2d3ef2d2f76"
Sep 11 12:21:02.518857 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:21:02.518838    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2fd29e5bda739c67d823e5a1c7b6cccf06ba5f518f27edca370a2d3ef2d2f76\": container with ID starting with c2fd29e5bda739c67d823e5a1c7b6cccf06ba5f518f27edca370a2d3ef2d2f76 not found: ID does not exist" containerID="c2fd29e5bda739c67d823e5a1c7b6cccf06ba5f518f27edca370a2d3ef2d2f76"
Sep 11 12:21:02.518899 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.518862    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2fd29e5bda739c67d823e5a1c7b6cccf06ba5f518f27edca370a2d3ef2d2f76"} err="failed to get container status \"c2fd29e5bda739c67d823e5a1c7b6cccf06ba5f518f27edca370a2d3ef2d2f76\": rpc error: code = NotFound desc = could not find container \"c2fd29e5bda739c67d823e5a1c7b6cccf06ba5f518f27edca370a2d3ef2d2f76\": container with ID starting with c2fd29e5bda739c67d823e5a1c7b6cccf06ba5f518f27edca370a2d3ef2d2f76 not found: ID does not exist"
Sep 11 12:21:02.558866 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.558831    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istiod-ca-cert\") pod \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") "
Sep 11 12:21:02.559031 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.558878    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qf6kx\" (UniqueName: \"kubernetes.io/projected/5be27b9b-c449-4e8b-ba1e-f034046f4b44-kube-api-access-qf6kx\") pod \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") "
Sep 11 12:21:02.559031 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.558931    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istio-envoy\") pod \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") "
Sep 11 12:21:02.559031 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.558976    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-workload-certs\") pod \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") "
Sep 11 12:21:02.559031 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.559008    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istio-data\") pod \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") "
Sep 11 12:21:02.559249 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.559048    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-workload-socket\") pod \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") "
Sep 11 12:21:02.559249 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.559075    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istio-token\") pod \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") "
Sep 11 12:21:02.559249 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.559123    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istio-podinfo\") pod \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") "
Sep 11 12:21:02.559249 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.559165    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-credential-socket\") pod \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\" (UID: \"5be27b9b-c449-4e8b-ba1e-f034046f4b44\") "
Sep 11 12:21:02.559433 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.559204    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5be27b9b-c449-4e8b-ba1e-f034046f4b44" (UID: "5be27b9b-c449-4e8b-ba1e-f034046f4b44"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:21:02.559433 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.559286    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5be27b9b-c449-4e8b-ba1e-f034046f4b44" (UID: "5be27b9b-c449-4e8b-ba1e-f034046f4b44"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:21:02.559548 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.559488    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5be27b9b-c449-4e8b-ba1e-f034046f4b44" (UID: "5be27b9b-c449-4e8b-ba1e-f034046f4b44"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:21:02.559548 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.559497    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5be27b9b-c449-4e8b-ba1e-f034046f4b44" (UID: "5be27b9b-c449-4e8b-ba1e-f034046f4b44"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:21:02.559548 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.559509    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istiod-ca-cert\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:21:02.559548 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.559527    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-workload-certs\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:21:02.559747 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.559599    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istio-data" (OuterVolumeSpecName: "istio-data") pod "5be27b9b-c449-4e8b-ba1e-f034046f4b44" (UID: "5be27b9b-c449-4e8b-ba1e-f034046f4b44"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:21:02.561227 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.561198    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5be27b9b-c449-4e8b-ba1e-f034046f4b44" (UID: "5be27b9b-c449-4e8b-ba1e-f034046f4b44"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:21:02.561347 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.561254    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5be27b9b-c449-4e8b-ba1e-f034046f4b44" (UID: "5be27b9b-c449-4e8b-ba1e-f034046f4b44"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:21:02.561459 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.561439    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5be27b9b-c449-4e8b-ba1e-f034046f4b44-kube-api-access-qf6kx" (OuterVolumeSpecName: "kube-api-access-qf6kx") pod "5be27b9b-c449-4e8b-ba1e-f034046f4b44" (UID: "5be27b9b-c449-4e8b-ba1e-f034046f4b44"). InnerVolumeSpecName "kube-api-access-qf6kx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:21:02.561510 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.561478    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istio-token" (OuterVolumeSpecName: "istio-token") pod "5be27b9b-c449-4e8b-ba1e-f034046f4b44" (UID: "5be27b9b-c449-4e8b-ba1e-f034046f4b44"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:21:02.660141 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.660102    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qf6kx\" (UniqueName: \"kubernetes.io/projected/5be27b9b-c449-4e8b-ba1e-f034046f4b44-kube-api-access-qf6kx\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:21:02.660141 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.660136    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istio-envoy\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:21:02.660141 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.660146    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istio-data\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:21:02.660141 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.660154    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-workload-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:21:02.660423 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.660163    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istio-token\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:21:02.660423 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.660171    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5be27b9b-c449-4e8b-ba1e-f034046f4b44-istio-podinfo\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:21:02.660423 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.660179    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5be27b9b-c449-4e8b-ba1e-f034046f4b44-credential-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:21:02.820457 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.820425    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"]
Sep 11 12:21:02.823768 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.823740    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-88968d-openshift-default-6fbdbcbf78-q7gtt"]
Sep 11 12:21:02.843863 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:02.843826    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5be27b9b-c449-4e8b-ba1e-f034046f4b44" path="/var/lib/kubelet/pods/5be27b9b-c449-4e8b-ba1e-f034046f4b44/volumes"
Sep 11 12:21:08.277164 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:08.277126    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4d3f83-29818815-dq7dk"]
Sep 11 12:21:08.279418 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:08.279393    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-4d3f83-29818815-dq7dk"]
Sep 11 12:21:08.849408 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:08.849372    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4fe5db6-bba5-40c0-b226-04a173d2093c" path="/var/lib/kubelet/pods/d4fe5db6-bba5-40c0-b226-04a173d2093c/volumes"
Sep 11 12:21:14.962885 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:14.962850    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"]
Sep 11 12:21:14.963462 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:14.963107    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw" podUID="4b166e30-25f5-431e-a293-ab21003166ae" containerName="istio-proxy" containerID="cri-o://d7095908b4cf01153dcdf489a604930116a140779bd13713fcfed291a1343038" gracePeriod=30
Sep 11 12:21:20.210997 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.210970    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:21:20.331588 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.331503    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-credential-socket\") pod \"4b166e30-25f5-431e-a293-ab21003166ae\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") "
Sep 11 12:21:20.331588 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.331542    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b166e30-25f5-431e-a293-ab21003166ae-istio-token\") pod \"4b166e30-25f5-431e-a293-ab21003166ae\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") "
Sep 11 12:21:20.331588 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.331581    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-istio-envoy\") pod \"4b166e30-25f5-431e-a293-ab21003166ae\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") "
Sep 11 12:21:20.331899 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.331633    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b166e30-25f5-431e-a293-ab21003166ae-istio-podinfo\") pod \"4b166e30-25f5-431e-a293-ab21003166ae\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") "
Sep 11 12:21:20.331899 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.331664    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-istio-data\") pod \"4b166e30-25f5-431e-a293-ab21003166ae\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") "
Sep 11 12:21:20.331899 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.331749    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snf4h\" (UniqueName: \"kubernetes.io/projected/4b166e30-25f5-431e-a293-ab21003166ae-kube-api-access-snf4h\") pod \"4b166e30-25f5-431e-a293-ab21003166ae\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") "
Sep 11 12:21:20.331899 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.331794    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b166e30-25f5-431e-a293-ab21003166ae-istiod-ca-cert\") pod \"4b166e30-25f5-431e-a293-ab21003166ae\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") "
Sep 11 12:21:20.331899 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.331818    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-workload-certs\") pod \"4b166e30-25f5-431e-a293-ab21003166ae\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") "
Sep 11 12:21:20.331899 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.331873    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-workload-socket\") pod \"4b166e30-25f5-431e-a293-ab21003166ae\" (UID: \"4b166e30-25f5-431e-a293-ab21003166ae\") "
Sep 11 12:21:20.332217 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.331869    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4b166e30-25f5-431e-a293-ab21003166ae" (UID: "4b166e30-25f5-431e-a293-ab21003166ae"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:21:20.332217 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.332138    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-istio-data" (OuterVolumeSpecName: "istio-data") pod "4b166e30-25f5-431e-a293-ab21003166ae" (UID: "4b166e30-25f5-431e-a293-ab21003166ae"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:21:20.332340 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.332244    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b166e30-25f5-431e-a293-ab21003166ae-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4b166e30-25f5-431e-a293-ab21003166ae" (UID: "4b166e30-25f5-431e-a293-ab21003166ae"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:21:20.332402 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.332346    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4b166e30-25f5-431e-a293-ab21003166ae" (UID: "4b166e30-25f5-431e-a293-ab21003166ae"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:21:20.332402 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.332356    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4b166e30-25f5-431e-a293-ab21003166ae" (UID: "4b166e30-25f5-431e-a293-ab21003166ae"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:21:20.334121 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.334089    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b166e30-25f5-431e-a293-ab21003166ae-istio-token" (OuterVolumeSpecName: "istio-token") pod "4b166e30-25f5-431e-a293-ab21003166ae" (UID: "4b166e30-25f5-431e-a293-ab21003166ae"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:21:20.334121 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.334114    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4b166e30-25f5-431e-a293-ab21003166ae-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4b166e30-25f5-431e-a293-ab21003166ae" (UID: "4b166e30-25f5-431e-a293-ab21003166ae"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 12:21:20.334276 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.334116    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b166e30-25f5-431e-a293-ab21003166ae-kube-api-access-snf4h" (OuterVolumeSpecName: "kube-api-access-snf4h") pod "4b166e30-25f5-431e-a293-ab21003166ae" (UID: "4b166e30-25f5-431e-a293-ab21003166ae"). InnerVolumeSpecName "kube-api-access-snf4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:21:20.334276 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.334099    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4b166e30-25f5-431e-a293-ab21003166ae" (UID: "4b166e30-25f5-431e-a293-ab21003166ae"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:21:20.433029 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.432989    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snf4h\" (UniqueName: \"kubernetes.io/projected/4b166e30-25f5-431e-a293-ab21003166ae-kube-api-access-snf4h\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:21:20.433029 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.433024    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b166e30-25f5-431e-a293-ab21003166ae-istiod-ca-cert\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:21:20.433251 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.433039    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-workload-certs\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:21:20.433251 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.433050    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-workload-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:21:20.433251 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.433068    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-credential-socket\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:21:20.433251 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.433080    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b166e30-25f5-431e-a293-ab21003166ae-istio-token\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:21:20.433251 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.433090    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-istio-envoy\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:21:20.433251 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.433102    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b166e30-25f5-431e-a293-ab21003166ae-istio-podinfo\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:21:20.433251 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.433112    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b166e30-25f5-431e-a293-ab21003166ae-istio-data\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:21:20.602676 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.602583    2565 generic.go:356] "Generic (PLEG): container finished" podID="4b166e30-25f5-431e-a293-ab21003166ae" containerID="d7095908b4cf01153dcdf489a604930116a140779bd13713fcfed291a1343038" exitCode=0
Sep 11 12:21:20.602676 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.602641    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"
Sep 11 12:21:20.602919 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.602691    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw" event={"ID":"4b166e30-25f5-431e-a293-ab21003166ae","Type":"ContainerDied","Data":"d7095908b4cf01153dcdf489a604930116a140779bd13713fcfed291a1343038"}
Sep 11 12:21:20.602919 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.602761    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw" event={"ID":"4b166e30-25f5-431e-a293-ab21003166ae","Type":"ContainerDied","Data":"034485374a1f63f5d30b5a4817281f1e077905b29dfb34ed72f38005bc4c6455"}
Sep 11 12:21:20.602919 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.602785    2565 scope.go:117] "RemoveContainer" containerID="d7095908b4cf01153dcdf489a604930116a140779bd13713fcfed291a1343038"
Sep 11 12:21:20.612446 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.612426    2565 scope.go:117] "RemoveContainer" containerID="1dba8040831a07d25afbcadbe44f647bfab199b0c9e9fe490fff1e0d9b9801c3"
Sep 11 12:21:20.620813 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.620796    2565 scope.go:117] "RemoveContainer" containerID="d7095908b4cf01153dcdf489a604930116a140779bd13713fcfed291a1343038"
Sep 11 12:21:20.621090 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:21:20.621069    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7095908b4cf01153dcdf489a604930116a140779bd13713fcfed291a1343038\": container with ID starting with d7095908b4cf01153dcdf489a604930116a140779bd13713fcfed291a1343038 not found: ID does not exist" containerID="d7095908b4cf01153dcdf489a604930116a140779bd13713fcfed291a1343038"
Sep 11 12:21:20.621153 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.621098    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7095908b4cf01153dcdf489a604930116a140779bd13713fcfed291a1343038"} err="failed to get container status \"d7095908b4cf01153dcdf489a604930116a140779bd13713fcfed291a1343038\": rpc error: code = NotFound desc = could not find container \"d7095908b4cf01153dcdf489a604930116a140779bd13713fcfed291a1343038\": container with ID starting with d7095908b4cf01153dcdf489a604930116a140779bd13713fcfed291a1343038 not found: ID does not exist"
Sep 11 12:21:20.621153 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.621115    2565 scope.go:117] "RemoveContainer" containerID="1dba8040831a07d25afbcadbe44f647bfab199b0c9e9fe490fff1e0d9b9801c3"
Sep 11 12:21:20.621347 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:21:20.621333    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dba8040831a07d25afbcadbe44f647bfab199b0c9e9fe490fff1e0d9b9801c3\": container with ID starting with 1dba8040831a07d25afbcadbe44f647bfab199b0c9e9fe490fff1e0d9b9801c3 not found: ID does not exist" containerID="1dba8040831a07d25afbcadbe44f647bfab199b0c9e9fe490fff1e0d9b9801c3"
Sep 11 12:21:20.621390 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.621349    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dba8040831a07d25afbcadbe44f647bfab199b0c9e9fe490fff1e0d9b9801c3"} err="failed to get container status \"1dba8040831a07d25afbcadbe44f647bfab199b0c9e9fe490fff1e0d9b9801c3\": rpc error: code = NotFound desc = could not find container \"1dba8040831a07d25afbcadbe44f647bfab199b0c9e9fe490fff1e0d9b9801c3\": container with ID starting with 1dba8040831a07d25afbcadbe44f647bfab199b0c9e9fe490fff1e0d9b9801c3 not found: ID does not exist"
Sep 11 12:21:20.628286 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.628262    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"]
Sep 11 12:21:20.631442 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.631421    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-4d3f83-openshift-default-659987cd86-hrshw"]
Sep 11 12:21:20.843253 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:20.843216    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b166e30-25f5-431e-a293-ab21003166ae" path="/var/lib/kubelet/pods/4b166e30-25f5-431e-a293-ab21003166ae/volumes"
Sep 11 12:21:26.977989 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:26.977957    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5pnqx_2233f21d-d3f8-44fc-92bf-03a86f7456ce/console-operator/1.log"
Sep 11 12:21:26.981760 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:26.981731    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5pnqx_2233f21d-d3f8-44fc-92bf-03a86f7456ce/console-operator/1.log"
Sep 11 12:21:26.985230 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:26.985209    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wzvlx_2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b/ovn-acl-logging/0.log"
Sep 11 12:21:26.988797 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:26.988778    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wzvlx_2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b/ovn-acl-logging/0.log"
Sep 11 12:21:27.337021 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:27.336938    2565 scope.go:117] "RemoveContainer" containerID="66c654b70aed81a1544281f69cc06f5e8354768a58eacfd8079ce5a0d18448e9"
Sep 11 12:21:27.347220 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:27.347187    2565 scope.go:117] "RemoveContainer" containerID="15d7b3c45af014f3276faa1f0d7f33f424c2eaa60c31d5939705fbc9a28a2e77"
Sep 11 12:21:27.355945 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:27.355928    2565 scope.go:117] "RemoveContainer" containerID="2ff1d5c5a2580b572177f24215e8f021d4bede8c8b9af729d723cf2040bf8c97"
Sep 11 12:21:27.363527 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:21:27.363510    2565 scope.go:117] "RemoveContainer" containerID="68e78891504744af6d663e1cc7204838f2da0df3128e89862e7e71ba6decdbc3"
Sep 11 12:23:59.726823 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:23:59.726789    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cwgfv"]
Sep 11 12:23:59.729328 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:23:59.727053    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cwgfv" podUID="bb26c757-b700-4fa3-b195-f29a520f11ed" containerName="manager" containerID="cri-o://077102f88672ef7859def5ac5e85e9e320c70a95e55b70f962d77460d7e40874" gracePeriod=10
Sep 11 12:23:59.967902 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:23:59.967878    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cwgfv"
Sep 11 12:23:59.968226 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:23:59.968208    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb26c757-b700-4fa3-b195-f29a520f11ed-extensions-socket-volume\") pod \"bb26c757-b700-4fa3-b195-f29a520f11ed\" (UID: \"bb26c757-b700-4fa3-b195-f29a520f11ed\") "
Sep 11 12:23:59.968271 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:23:59.968252    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ghjb\" (UniqueName: \"kubernetes.io/projected/bb26c757-b700-4fa3-b195-f29a520f11ed-kube-api-access-2ghjb\") pod \"bb26c757-b700-4fa3-b195-f29a520f11ed\" (UID: \"bb26c757-b700-4fa3-b195-f29a520f11ed\") "
Sep 11 12:23:59.968573 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:23:59.968549    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb26c757-b700-4fa3-b195-f29a520f11ed-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bb26c757-b700-4fa3-b195-f29a520f11ed" (UID: "bb26c757-b700-4fa3-b195-f29a520f11ed"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:23:59.970366 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:23:59.970345    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb26c757-b700-4fa3-b195-f29a520f11ed-kube-api-access-2ghjb" (OuterVolumeSpecName: "kube-api-access-2ghjb") pod "bb26c757-b700-4fa3-b195-f29a520f11ed" (UID: "bb26c757-b700-4fa3-b195-f29a520f11ed"). InnerVolumeSpecName "kube-api-access-2ghjb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:24:00.069242 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:24:00.069157    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ghjb\" (UniqueName: \"kubernetes.io/projected/bb26c757-b700-4fa3-b195-f29a520f11ed-kube-api-access-2ghjb\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:24:00.069242 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:24:00.069189    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb26c757-b700-4fa3-b195-f29a520f11ed-extensions-socket-volume\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:24:00.519986 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:24:00.519954    2565 generic.go:356] "Generic (PLEG): container finished" podID="bb26c757-b700-4fa3-b195-f29a520f11ed" containerID="077102f88672ef7859def5ac5e85e9e320c70a95e55b70f962d77460d7e40874" exitCode=0
Sep 11 12:24:00.520169 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:24:00.519994    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cwgfv"
Sep 11 12:24:00.520169 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:24:00.520016    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cwgfv" event={"ID":"bb26c757-b700-4fa3-b195-f29a520f11ed","Type":"ContainerDied","Data":"077102f88672ef7859def5ac5e85e9e320c70a95e55b70f962d77460d7e40874"}
Sep 11 12:24:00.520169 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:24:00.520058    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cwgfv" event={"ID":"bb26c757-b700-4fa3-b195-f29a520f11ed","Type":"ContainerDied","Data":"2189322b391ead307bbb12e52bf27a7e4912e152dd18fc21d789e9d5c6607f49"}
Sep 11 12:24:00.520169 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:24:00.520081    2565 scope.go:117] "RemoveContainer" containerID="077102f88672ef7859def5ac5e85e9e320c70a95e55b70f962d77460d7e40874"
Sep 11 12:24:00.530138 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:24:00.530117    2565 scope.go:117] "RemoveContainer" containerID="077102f88672ef7859def5ac5e85e9e320c70a95e55b70f962d77460d7e40874"
Sep 11 12:24:00.530408 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:24:00.530389    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"077102f88672ef7859def5ac5e85e9e320c70a95e55b70f962d77460d7e40874\": container with ID starting with 077102f88672ef7859def5ac5e85e9e320c70a95e55b70f962d77460d7e40874 not found: ID does not exist" containerID="077102f88672ef7859def5ac5e85e9e320c70a95e55b70f962d77460d7e40874"
Sep 11 12:24:00.530455 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:24:00.530417    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"077102f88672ef7859def5ac5e85e9e320c70a95e55b70f962d77460d7e40874"} err="failed to get container status \"077102f88672ef7859def5ac5e85e9e320c70a95e55b70f962d77460d7e40874\": rpc error: code = NotFound desc = could not find container \"077102f88672ef7859def5ac5e85e9e320c70a95e55b70f962d77460d7e40874\": container with ID starting with 077102f88672ef7859def5ac5e85e9e320c70a95e55b70f962d77460d7e40874 not found: ID does not exist"
Sep 11 12:24:00.545980 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:24:00.545951    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cwgfv"]
Sep 11 12:24:00.550147 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:24:00.550119    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-cwgfv"]
Sep 11 12:24:00.841829 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:24:00.841747    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb26c757-b700-4fa3-b195-f29a520f11ed" path="/var/lib/kubelet/pods/bb26c757-b700-4fa3-b195-f29a520f11ed/volumes"
Sep 11 12:25:00.477818 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.477780    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zb7lh"]
Sep 11 12:25:00.478304 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478144    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb26c757-b700-4fa3-b195-f29a520f11ed" containerName="manager"
Sep 11 12:25:00.478304 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478156    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb26c757-b700-4fa3-b195-f29a520f11ed" containerName="manager"
Sep 11 12:25:00.478304 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478164    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da27961f-7767-4f09-b92e-744aae2b5ca7" containerName="istio-proxy"
Sep 11 12:25:00.478304 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478170    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="da27961f-7767-4f09-b92e-744aae2b5ca7" containerName="istio-proxy"
Sep 11 12:25:00.478304 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478178    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da27961f-7767-4f09-b92e-744aae2b5ca7" containerName="istio-proxy"
Sep 11 12:25:00.478304 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478184    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="da27961f-7767-4f09-b92e-744aae2b5ca7" containerName="istio-proxy"
Sep 11 12:25:00.478304 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478190    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12c96980-8b70-4b81-ad69-aabd182ad463" containerName="revoke-keys"
Sep 11 12:25:00.478304 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478195    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="12c96980-8b70-4b81-ad69-aabd182ad463" containerName="revoke-keys"
Sep 11 12:25:00.478304 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478203    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5be27b9b-c449-4e8b-ba1e-f034046f4b44" containerName="istio-proxy"
Sep 11 12:25:00.478304 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478209    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5be27b9b-c449-4e8b-ba1e-f034046f4b44" containerName="istio-proxy"
Sep 11 12:25:00.478304 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478216    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b166e30-25f5-431e-a293-ab21003166ae" containerName="istio-proxy"
Sep 11 12:25:00.478304 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478221    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b166e30-25f5-431e-a293-ab21003166ae" containerName="istio-proxy"
Sep 11 12:25:00.478304 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478227    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2eee8bf-2273-40fc-b102-de9006439cac" containerName="istio-proxy"
Sep 11 12:25:00.478304 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478232    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2eee8bf-2273-40fc-b102-de9006439cac" containerName="istio-proxy"
Sep 11 12:25:00.478304 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478238    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="106a88b8-308c-4457-a865-dd85dd40e334" containerName="istio-proxy"
Sep 11 12:25:00.478304 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478243    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="106a88b8-308c-4457-a865-dd85dd40e334" containerName="istio-proxy"
Sep 11 12:25:00.478304 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478249    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5be27b9b-c449-4e8b-ba1e-f034046f4b44" containerName="istio-proxy"
Sep 11 12:25:00.478304 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478253    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5be27b9b-c449-4e8b-ba1e-f034046f4b44" containerName="istio-proxy"
Sep 11 12:25:00.478304 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478258    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b166e30-25f5-431e-a293-ab21003166ae" containerName="istio-proxy"
Sep 11 12:25:00.478304 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478264    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b166e30-25f5-431e-a293-ab21003166ae" containerName="istio-proxy"
Sep 11 12:25:00.478304 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478270    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="106a88b8-308c-4457-a865-dd85dd40e334" containerName="istio-proxy"
Sep 11 12:25:00.478304 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478275    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="106a88b8-308c-4457-a865-dd85dd40e334" containerName="istio-proxy"
Sep 11 12:25:00.478304 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478284    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2eee8bf-2273-40fc-b102-de9006439cac" containerName="istio-proxy"
Sep 11 12:25:00.478304 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478289    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2eee8bf-2273-40fc-b102-de9006439cac" containerName="istio-proxy"
Sep 11 12:25:00.479083 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478344    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5be27b9b-c449-4e8b-ba1e-f034046f4b44" containerName="istio-proxy"
Sep 11 12:25:00.479083 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478350    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b166e30-25f5-431e-a293-ab21003166ae" containerName="istio-proxy"
Sep 11 12:25:00.479083 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478357    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="da27961f-7767-4f09-b92e-744aae2b5ca7" containerName="istio-proxy"
Sep 11 12:25:00.479083 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478364    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2eee8bf-2273-40fc-b102-de9006439cac" containerName="istio-proxy"
Sep 11 12:25:00.479083 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478369    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="12c96980-8b70-4b81-ad69-aabd182ad463" containerName="revoke-keys"
Sep 11 12:25:00.479083 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478375    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5be27b9b-c449-4e8b-ba1e-f034046f4b44" containerName="istio-proxy"
Sep 11 12:25:00.479083 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478379    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="106a88b8-308c-4457-a865-dd85dd40e334" containerName="istio-proxy"
Sep 11 12:25:00.479083 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.478387    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb26c757-b700-4fa3-b195-f29a520f11ed" containerName="manager"
Sep 11 12:25:00.481496 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.481479    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zb7lh"
Sep 11 12:25:00.484493 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.484477    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xbl99\""
Sep 11 12:25:00.488732 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.488712    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4146faef-8d35-4ab4-b9a0-9ea2dfb1172c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-zb7lh\" (UID: \"4146faef-8d35-4ab4-b9a0-9ea2dfb1172c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zb7lh"
Sep 11 12:25:00.488820 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.488803    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhf85\" (UniqueName: \"kubernetes.io/projected/4146faef-8d35-4ab4-b9a0-9ea2dfb1172c-kube-api-access-rhf85\") pod \"kuadrant-operator-controller-manager-5769f99d9f-zb7lh\" (UID: \"4146faef-8d35-4ab4-b9a0-9ea2dfb1172c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zb7lh"
Sep 11 12:25:00.493265 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.493240    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zb7lh"]
Sep 11 12:25:00.589442 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.589411    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4146faef-8d35-4ab4-b9a0-9ea2dfb1172c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-zb7lh\" (UID: \"4146faef-8d35-4ab4-b9a0-9ea2dfb1172c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zb7lh"
Sep 11 12:25:00.589642 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.589492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhf85\" (UniqueName: \"kubernetes.io/projected/4146faef-8d35-4ab4-b9a0-9ea2dfb1172c-kube-api-access-rhf85\") pod \"kuadrant-operator-controller-manager-5769f99d9f-zb7lh\" (UID: \"4146faef-8d35-4ab4-b9a0-9ea2dfb1172c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zb7lh"
Sep 11 12:25:00.589858 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.589834    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4146faef-8d35-4ab4-b9a0-9ea2dfb1172c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-zb7lh\" (UID: \"4146faef-8d35-4ab4-b9a0-9ea2dfb1172c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zb7lh"
Sep 11 12:25:00.598078 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.598053    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhf85\" (UniqueName: \"kubernetes.io/projected/4146faef-8d35-4ab4-b9a0-9ea2dfb1172c-kube-api-access-rhf85\") pod \"kuadrant-operator-controller-manager-5769f99d9f-zb7lh\" (UID: \"4146faef-8d35-4ab4-b9a0-9ea2dfb1172c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zb7lh"
Sep 11 12:25:00.791821 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:00.791726    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zb7lh"
Sep 11 12:25:01.077708 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:01.076298    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zb7lh"]
Sep 11 12:25:01.860460 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:01.860416    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zb7lh" event={"ID":"4146faef-8d35-4ab4-b9a0-9ea2dfb1172c","Type":"ContainerStarted","Data":"3ea60b5beb1b4118538ca59df7659f1fbca3a1e7a1a4bf8cd9824ccc14855c77"}
Sep 11 12:25:01.860896 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:01.860566    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zb7lh"
Sep 11 12:25:01.860896 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:01.860616    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zb7lh" event={"ID":"4146faef-8d35-4ab4-b9a0-9ea2dfb1172c","Type":"ContainerStarted","Data":"15b907f572bfd62e29e865cf6203e0704e746da1ad4f8e46d9b806ddfb3d37d1"}
Sep 11 12:25:01.885236 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:01.885182    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zb7lh" podStartSLOduration=1.885161938 podStartE2EDuration="1.885161938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:25:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:25:01.881458147 +0000 UTC m=+2015.563857644" watchObservedRunningTime="2026-09-11 12:25:01.885161938 +0000 UTC m=+2015.567561436"
Sep 11 12:25:12.869420 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:12.869388    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zb7lh"
Sep 11 12:25:27.432057 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:25:27.432026    2565 scope.go:117] "RemoveContainer" containerID="0a6aee8cecdb53fc83b039d5c14b021cb99808b2efd2f1aa51275315052d7843"
Sep 11 12:26:27.014863 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:27.014832    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5pnqx_2233f21d-d3f8-44fc-92bf-03a86f7456ce/console-operator/1.log"
Sep 11 12:26:27.019738 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:27.019706    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5pnqx_2233f21d-d3f8-44fc-92bf-03a86f7456ce/console-operator/1.log"
Sep 11 12:26:27.022588 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:27.022568    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wzvlx_2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b/ovn-acl-logging/0.log"
Sep 11 12:26:27.027027 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:27.027012    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wzvlx_2d6b2252-3e4b-4fe6-b8f0-c90c3481f50b/ovn-acl-logging/0.log"
Sep 11 12:26:44.748797 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:44.748758    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw"]
Sep 11 12:26:44.749276 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:44.749238    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="106a88b8-308c-4457-a865-dd85dd40e334" containerName="istio-proxy"
Sep 11 12:26:44.749276 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:44.749258    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b166e30-25f5-431e-a293-ab21003166ae" containerName="istio-proxy"
Sep 11 12:26:44.749276 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:44.749266    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="da27961f-7767-4f09-b92e-744aae2b5ca7" containerName="istio-proxy"
Sep 11 12:26:44.749276 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:44.749273    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2eee8bf-2273-40fc-b102-de9006439cac" containerName="istio-proxy"
Sep 11 12:26:44.752330 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:44.752309    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw"
Sep 11 12:26:44.756150 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:44.756125    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 12:26:44.756377 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:44.756356    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 12:26:44.756377 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:44.756369    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-p9257\""
Sep 11 12:26:44.756548 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:44.756407    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 12:26:44.756548 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:44.756449    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 12:26:44.762137 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:44.762095    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw"]
Sep 11 12:26:44.836490 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:44.836456    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7bde1ff5-b743-414c-9d09-895910593311-maas-api-tls\") pod \"maas-api-75bf587cb6-p7rfw\" (UID: \"7bde1ff5-b743-414c-9d09-895910593311\") " pod="odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw"
Sep 11 12:26:44.836656 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:44.836516    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bde1ff5-b743-414c-9d09-895910593311-openshift-service-ca\") pod \"maas-api-75bf587cb6-p7rfw\" (UID: \"7bde1ff5-b743-414c-9d09-895910593311\") " pod="odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw"
Sep 11 12:26:44.836656 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:44.836613    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bde1ff5-b743-414c-9d09-895910593311-metrics-certs\") pod \"maas-api-75bf587cb6-p7rfw\" (UID: \"7bde1ff5-b743-414c-9d09-895910593311\") " pod="odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw"
Sep 11 12:26:44.836770 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:44.836671    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjh8b\" (UniqueName: \"kubernetes.io/projected/7bde1ff5-b743-414c-9d09-895910593311-kube-api-access-mjh8b\") pod \"maas-api-75bf587cb6-p7rfw\" (UID: \"7bde1ff5-b743-414c-9d09-895910593311\") " pod="odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw"
Sep 11 12:26:44.937368 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:44.937322    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bde1ff5-b743-414c-9d09-895910593311-metrics-certs\") pod \"maas-api-75bf587cb6-p7rfw\" (UID: \"7bde1ff5-b743-414c-9d09-895910593311\") " pod="odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw"
Sep 11 12:26:44.937368 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:44.937378    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjh8b\" (UniqueName: \"kubernetes.io/projected/7bde1ff5-b743-414c-9d09-895910593311-kube-api-access-mjh8b\") pod \"maas-api-75bf587cb6-p7rfw\" (UID: \"7bde1ff5-b743-414c-9d09-895910593311\") " pod="odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw"
Sep 11 12:26:44.937588 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:44.937418    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7bde1ff5-b743-414c-9d09-895910593311-maas-api-tls\") pod \"maas-api-75bf587cb6-p7rfw\" (UID: \"7bde1ff5-b743-414c-9d09-895910593311\") " pod="odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw"
Sep 11 12:26:44.937588 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:44.937456    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bde1ff5-b743-414c-9d09-895910593311-openshift-service-ca\") pod \"maas-api-75bf587cb6-p7rfw\" (UID: \"7bde1ff5-b743-414c-9d09-895910593311\") " pod="odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw"
Sep 11 12:26:44.938127 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:44.938102    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bde1ff5-b743-414c-9d09-895910593311-openshift-service-ca\") pod \"maas-api-75bf587cb6-p7rfw\" (UID: \"7bde1ff5-b743-414c-9d09-895910593311\") " pod="odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw"
Sep 11 12:26:44.939887 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:44.939852    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bde1ff5-b743-414c-9d09-895910593311-metrics-certs\") pod \"maas-api-75bf587cb6-p7rfw\" (UID: \"7bde1ff5-b743-414c-9d09-895910593311\") " pod="odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw"
Sep 11 12:26:44.940050 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:44.940032    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7bde1ff5-b743-414c-9d09-895910593311-maas-api-tls\") pod \"maas-api-75bf587cb6-p7rfw\" (UID: \"7bde1ff5-b743-414c-9d09-895910593311\") " pod="odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw"
Sep 11 12:26:44.946338 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:44.946306    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjh8b\" (UniqueName: \"kubernetes.io/projected/7bde1ff5-b743-414c-9d09-895910593311-kube-api-access-mjh8b\") pod \"maas-api-75bf587cb6-p7rfw\" (UID: \"7bde1ff5-b743-414c-9d09-895910593311\") " pod="odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw"
Sep 11 12:26:45.064384 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:45.064281    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw"
Sep 11 12:26:45.336650 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:45.336623    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw"]
Sep 11 12:26:45.337608 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:26:45.337586    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bde1ff5_b743_414c_9d09_895910593311.slice/crio-9b895e3f0ecef088bd806fb08682c7b084049c2301bf7f0a79ddc498283af3ee WatchSource:0}: Error finding container 9b895e3f0ecef088bd806fb08682c7b084049c2301bf7f0a79ddc498283af3ee: Status 404 returned error can't find the container with id 9b895e3f0ecef088bd806fb08682c7b084049c2301bf7f0a79ddc498283af3ee
Sep 11 12:26:45.338982 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:45.338961    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 12:26:45.433892 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:45.433854    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw" event={"ID":"7bde1ff5-b743-414c-9d09-895910593311","Type":"ContainerStarted","Data":"9b895e3f0ecef088bd806fb08682c7b084049c2301bf7f0a79ddc498283af3ee"}
Sep 11 12:26:49.464039 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:49.463938    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw" event={"ID":"7bde1ff5-b743-414c-9d09-895910593311","Type":"ContainerStarted","Data":"f126f5ef6db0f4631e6ca3ef01260d05d4bfd89d659abaa9b86a009ec4db616f"}
Sep 11 12:26:49.464423 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:49.464136    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw"
Sep 11 12:26:49.481976 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:49.481921    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw" podStartSLOduration=1.6759291269999999 podStartE2EDuration="5.481903413s" totalImagesPullingTime="3.805974286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:26:49.480521075 +0000 UTC m=+2123.162920574" watchObservedRunningTime="2026-09-11 12:26:49.481903413 +0000 UTC m=+2123.164302911"
Sep 11 12:26:52.684656 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:52.684619    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw"]
Sep 11 12:26:52.685165 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:52.684839    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw" podUID="7bde1ff5-b743-414c-9d09-895910593311" containerName="maas-api" containerID="cri-o://f126f5ef6db0f4631e6ca3ef01260d05d4bfd89d659abaa9b86a009ec4db616f" gracePeriod=30
Sep 11 12:26:52.715695 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:52.715640    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6f9765f64b-qj5pl"]
Sep 11 12:26:52.719070 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:52.719048    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6f9765f64b-qj5pl"
Sep 11 12:26:52.730534 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:52.730504    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6f9765f64b-qj5pl"]
Sep 11 12:26:52.811017 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:52.810981    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cfda9aa-1653-4834-9342-0e20686ffa9c-openshift-service-ca\") pod \"maas-api-6f9765f64b-qj5pl\" (UID: \"4cfda9aa-1653-4834-9342-0e20686ffa9c\") " pod="odh-ai-gateway-infra/maas-api-6f9765f64b-qj5pl"
Sep 11 12:26:52.811189 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:52.811072    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cfda9aa-1653-4834-9342-0e20686ffa9c-metrics-certs\") pod \"maas-api-6f9765f64b-qj5pl\" (UID: \"4cfda9aa-1653-4834-9342-0e20686ffa9c\") " pod="odh-ai-gateway-infra/maas-api-6f9765f64b-qj5pl"
Sep 11 12:26:52.811189 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:52.811103    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4w4n\" (UniqueName: \"kubernetes.io/projected/4cfda9aa-1653-4834-9342-0e20686ffa9c-kube-api-access-s4w4n\") pod \"maas-api-6f9765f64b-qj5pl\" (UID: \"4cfda9aa-1653-4834-9342-0e20686ffa9c\") " pod="odh-ai-gateway-infra/maas-api-6f9765f64b-qj5pl"
Sep 11 12:26:52.811189 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:52.811123    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cfda9aa-1653-4834-9342-0e20686ffa9c-maas-api-tls\") pod \"maas-api-6f9765f64b-qj5pl\" (UID: \"4cfda9aa-1653-4834-9342-0e20686ffa9c\") " pod="odh-ai-gateway-infra/maas-api-6f9765f64b-qj5pl"
Sep 11 12:26:52.912218 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:52.912179    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cfda9aa-1653-4834-9342-0e20686ffa9c-openshift-service-ca\") pod \"maas-api-6f9765f64b-qj5pl\" (UID: \"4cfda9aa-1653-4834-9342-0e20686ffa9c\") " pod="odh-ai-gateway-infra/maas-api-6f9765f64b-qj5pl"
Sep 11 12:26:52.912455 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:52.912277    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cfda9aa-1653-4834-9342-0e20686ffa9c-metrics-certs\") pod \"maas-api-6f9765f64b-qj5pl\" (UID: \"4cfda9aa-1653-4834-9342-0e20686ffa9c\") " pod="odh-ai-gateway-infra/maas-api-6f9765f64b-qj5pl"
Sep 11 12:26:52.912455 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:52.912322    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4w4n\" (UniqueName: \"kubernetes.io/projected/4cfda9aa-1653-4834-9342-0e20686ffa9c-kube-api-access-s4w4n\") pod \"maas-api-6f9765f64b-qj5pl\" (UID: \"4cfda9aa-1653-4834-9342-0e20686ffa9c\") " pod="odh-ai-gateway-infra/maas-api-6f9765f64b-qj5pl"
Sep 11 12:26:52.912792 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:52.912698    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cfda9aa-1653-4834-9342-0e20686ffa9c-maas-api-tls\") pod \"maas-api-6f9765f64b-qj5pl\" (UID: \"4cfda9aa-1653-4834-9342-0e20686ffa9c\") " pod="odh-ai-gateway-infra/maas-api-6f9765f64b-qj5pl"
Sep 11 12:26:52.913019 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:52.912992    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cfda9aa-1653-4834-9342-0e20686ffa9c-openshift-service-ca\") pod \"maas-api-6f9765f64b-qj5pl\" (UID: \"4cfda9aa-1653-4834-9342-0e20686ffa9c\") " pod="odh-ai-gateway-infra/maas-api-6f9765f64b-qj5pl"
Sep 11 12:26:52.915404 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:52.915380    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cfda9aa-1653-4834-9342-0e20686ffa9c-maas-api-tls\") pod \"maas-api-6f9765f64b-qj5pl\" (UID: \"4cfda9aa-1653-4834-9342-0e20686ffa9c\") " pod="odh-ai-gateway-infra/maas-api-6f9765f64b-qj5pl"
Sep 11 12:26:52.915802 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:52.915772    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cfda9aa-1653-4834-9342-0e20686ffa9c-metrics-certs\") pod \"maas-api-6f9765f64b-qj5pl\" (UID: \"4cfda9aa-1653-4834-9342-0e20686ffa9c\") " pod="odh-ai-gateway-infra/maas-api-6f9765f64b-qj5pl"
Sep 11 12:26:52.921248 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:52.921224    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4w4n\" (UniqueName: \"kubernetes.io/projected/4cfda9aa-1653-4834-9342-0e20686ffa9c-kube-api-access-s4w4n\") pod \"maas-api-6f9765f64b-qj5pl\" (UID: \"4cfda9aa-1653-4834-9342-0e20686ffa9c\") " pod="odh-ai-gateway-infra/maas-api-6f9765f64b-qj5pl"
Sep 11 12:26:52.970859 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:52.970830    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw"
Sep 11 12:26:53.065178 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:53.065144    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6f9765f64b-qj5pl"
Sep 11 12:26:53.115267 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:53.115228    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7bde1ff5-b743-414c-9d09-895910593311-maas-api-tls\") pod \"7bde1ff5-b743-414c-9d09-895910593311\" (UID: \"7bde1ff5-b743-414c-9d09-895910593311\") "
Sep 11 12:26:53.115501 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:53.115288    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjh8b\" (UniqueName: \"kubernetes.io/projected/7bde1ff5-b743-414c-9d09-895910593311-kube-api-access-mjh8b\") pod \"7bde1ff5-b743-414c-9d09-895910593311\" (UID: \"7bde1ff5-b743-414c-9d09-895910593311\") "
Sep 11 12:26:53.115501 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:53.115407    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bde1ff5-b743-414c-9d09-895910593311-metrics-certs\") pod \"7bde1ff5-b743-414c-9d09-895910593311\" (UID: \"7bde1ff5-b743-414c-9d09-895910593311\") "
Sep 11 12:26:53.115501 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:53.115465    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bde1ff5-b743-414c-9d09-895910593311-openshift-service-ca\") pod \"7bde1ff5-b743-414c-9d09-895910593311\" (UID: \"7bde1ff5-b743-414c-9d09-895910593311\") "
Sep 11 12:26:53.116344 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:53.116113    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bde1ff5-b743-414c-9d09-895910593311-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7bde1ff5-b743-414c-9d09-895910593311" (UID: "7bde1ff5-b743-414c-9d09-895910593311"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:26:53.120019 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:53.119832    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bde1ff5-b743-414c-9d09-895910593311-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7bde1ff5-b743-414c-9d09-895910593311" (UID: "7bde1ff5-b743-414c-9d09-895910593311"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:26:53.120019 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:53.119960    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bde1ff5-b743-414c-9d09-895910593311-kube-api-access-mjh8b" (OuterVolumeSpecName: "kube-api-access-mjh8b") pod "7bde1ff5-b743-414c-9d09-895910593311" (UID: "7bde1ff5-b743-414c-9d09-895910593311"). InnerVolumeSpecName "kube-api-access-mjh8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:26:53.120267 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:53.120221    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bde1ff5-b743-414c-9d09-895910593311-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7bde1ff5-b743-414c-9d09-895910593311" (UID: "7bde1ff5-b743-414c-9d09-895910593311"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:26:53.216904 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:53.216805    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bde1ff5-b743-414c-9d09-895910593311-metrics-certs\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:26:53.216904 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:53.216852    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bde1ff5-b743-414c-9d09-895910593311-openshift-service-ca\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:26:53.216904 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:53.216871    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7bde1ff5-b743-414c-9d09-895910593311-maas-api-tls\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:26:53.216904 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:53.216887    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjh8b\" (UniqueName: \"kubernetes.io/projected/7bde1ff5-b743-414c-9d09-895910593311-kube-api-access-mjh8b\") on node \"ip-10-0-138-111.ec2.internal\" DevicePath \"\""
Sep 11 12:26:53.342511 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:53.342480    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6f9765f64b-qj5pl"]
Sep 11 12:26:53.343557 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:26:53.343524    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cfda9aa_1653_4834_9342_0e20686ffa9c.slice/crio-6123677a322ee333fc3fb0d9d6bd073a797ade4143d9a39153a9b0a4f58827f7 WatchSource:0}: Error finding container 6123677a322ee333fc3fb0d9d6bd073a797ade4143d9a39153a9b0a4f58827f7: Status 404 returned error can't find the container with id 6123677a322ee333fc3fb0d9d6bd073a797ade4143d9a39153a9b0a4f58827f7
Sep 11 12:26:53.488669 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:53.488564    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6f9765f64b-qj5pl" event={"ID":"4cfda9aa-1653-4834-9342-0e20686ffa9c","Type":"ContainerStarted","Data":"6123677a322ee333fc3fb0d9d6bd073a797ade4143d9a39153a9b0a4f58827f7"}
Sep 11 12:26:53.490367 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:53.490328    2565 generic.go:356] "Generic (PLEG): container finished" podID="7bde1ff5-b743-414c-9d09-895910593311" containerID="f126f5ef6db0f4631e6ca3ef01260d05d4bfd89d659abaa9b86a009ec4db616f" exitCode=0
Sep 11 12:26:53.490498 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:53.490389    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw"
Sep 11 12:26:53.490498 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:53.490409    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw" event={"ID":"7bde1ff5-b743-414c-9d09-895910593311","Type":"ContainerDied","Data":"f126f5ef6db0f4631e6ca3ef01260d05d4bfd89d659abaa9b86a009ec4db616f"}
Sep 11 12:26:53.490498 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:53.490480    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw" event={"ID":"7bde1ff5-b743-414c-9d09-895910593311","Type":"ContainerDied","Data":"9b895e3f0ecef088bd806fb08682c7b084049c2301bf7f0a79ddc498283af3ee"}
Sep 11 12:26:53.490620 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:53.490514    2565 scope.go:117] "RemoveContainer" containerID="f126f5ef6db0f4631e6ca3ef01260d05d4bfd89d659abaa9b86a009ec4db616f"
Sep 11 12:26:53.502237 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:53.502213    2565 scope.go:117] "RemoveContainer" containerID="f126f5ef6db0f4631e6ca3ef01260d05d4bfd89d659abaa9b86a009ec4db616f"
Sep 11 12:26:53.502651 ip-10-0-138-111 kubenswrapper[2565]: E0911 12:26:53.502623    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f126f5ef6db0f4631e6ca3ef01260d05d4bfd89d659abaa9b86a009ec4db616f\": container with ID starting with f126f5ef6db0f4631e6ca3ef01260d05d4bfd89d659abaa9b86a009ec4db616f not found: ID does not exist" containerID="f126f5ef6db0f4631e6ca3ef01260d05d4bfd89d659abaa9b86a009ec4db616f"
Sep 11 12:26:53.502787 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:53.502666    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f126f5ef6db0f4631e6ca3ef01260d05d4bfd89d659abaa9b86a009ec4db616f"} err="failed to get container status \"f126f5ef6db0f4631e6ca3ef01260d05d4bfd89d659abaa9b86a009ec4db616f\": rpc error: code = NotFound desc = could not find container \"f126f5ef6db0f4631e6ca3ef01260d05d4bfd89d659abaa9b86a009ec4db616f\": container with ID starting with f126f5ef6db0f4631e6ca3ef01260d05d4bfd89d659abaa9b86a009ec4db616f not found: ID does not exist"
Sep 11 12:26:53.516030 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:53.515998    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw"]
Sep 11 12:26:53.519666 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:53.519636    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-75bf587cb6-p7rfw"]
Sep 11 12:26:54.497808 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:54.497768    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6f9765f64b-qj5pl" event={"ID":"4cfda9aa-1653-4834-9342-0e20686ffa9c","Type":"ContainerStarted","Data":"5c30ac8282da77e2394d5dc9aea18f530bd013d36b946fec126f4d94526aab47"}
Sep 11 12:26:54.498270 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:54.497963    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6f9765f64b-qj5pl"
Sep 11 12:26:54.515569 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:54.515510    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6f9765f64b-qj5pl" podStartSLOduration=2.195039323 podStartE2EDuration="2.51549085s" totalImagesPullingTime="320.451527ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:26:54.514926085 +0000 UTC m=+2128.197325584" watchObservedRunningTime="2026-09-11 12:26:54.51549085 +0000 UTC m=+2128.197890349"
Sep 11 12:26:54.842937 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:26:54.842859    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bde1ff5-b743-414c-9d09-895910593311" path="/var/lib/kubelet/pods/7bde1ff5-b743-414c-9d09-895910593311/volumes"
Sep 11 12:27:00.509649 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:00.509615    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6f9765f64b-qj5pl"
Sep 11 12:27:24.899564 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:24.899534    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-fg7hm_635116a6-736f-4a5b-9f99-c041b6838fe1/manager/0.log"
Sep 11 12:27:25.048812 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:25.048779    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-s878r_39fad017-21bc-46c1-8fea-ff787bf83e53/manager/0.log"
Sep 11 12:27:25.299206 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:25.299111    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gbgb4_4d327ca3-43ad-454f-ab85-4bc69a5270fc/server/0.log"
Sep 11 12:27:25.418015 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:25.417981    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9ggdp_4f0cbcf9-7958-4697-b00f-474179f9c874/manager/0.log"
Sep 11 12:27:25.538402 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:25.538373    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cbb9c7bc-8275q_a900ed8c-4e7a-4655-81e5-3bb6e45bbdce/copy-manifests/0.log"
Sep 11 12:27:25.545907 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:25.545877    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cbb9c7bc-8275q_a900ed8c-4e7a-4655-81e5-3bb6e45bbdce/manager/0.log"
Sep 11 12:27:26.274565 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:26.274532    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6f9765f64b-qj5pl_4cfda9aa-1653-4834-9342-0e20686ffa9c/maas-api/0.log"
Sep 11 12:27:26.382396 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:26.382366    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29818815-nkz4v_666575eb-b229-488e-bcc2-5dda53e512cd/cleanup/0.log"
Sep 11 12:27:27.437779 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:27.437750    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-j7rpx_6e5ab5a7-2173-4591-bad5-9333f082fecb/manager/0.log"
Sep 11 12:27:27.549828 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:27.549797    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-582k7_6e17d76e-d693-4cb6-9306-e1ff79ea6745/manager/0.log"
Sep 11 12:27:27.798309 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:27.798227    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-zb7lh_4146faef-8d35-4ab4-b9a0-9ea2dfb1172c/manager/0.log"
Sep 11 12:27:28.072101 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:28.072024    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-m8pp5_dac8da16-a702-461f-ac08-9e64388e1b68/manager/0.log"
Sep 11 12:27:28.466971 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:28.466942    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm_75217bc8-7b9d-441c-8313-390105642653/istio-proxy/0.log"
Sep 11 12:27:28.714519 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:28.714486    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8478ddd598-t8k7h_8ceab4d9-986f-48c2-a3f3-a4233cc76972/kube-auth-proxy/0.log"
Sep 11 12:27:28.982133 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:28.982066    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-k2frv_626e4a08-50c2-4625-b145-656b540edc43/istio-proxy/1.log"
Sep 11 12:27:29.747869 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:29.747837    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-cshws_2b70a6cc-a620-4d84-97b8-e4c6e325b032/main/0.log"
Sep 11 12:27:30.230600 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:30.230564    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9gdvt_2c6e984f-5325-4e36-bf34-3cc0ec1788bd/main/0.log"
Sep 11 12:27:30.354384 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:30.354352    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-c559w_f41e666a-8097-4d2b-a5e5-4d82c9325eaf/main/0.log"
Sep 11 12:27:39.112777 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:39.112743    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zdjj7_307113f7-a015-4c41-a620-b5c2b90b3828/global-pull-secret-syncer/0.log"
Sep 11 12:27:39.240539 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:39.240509    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lzbk8_947d0f48-7790-4364-acbe-15b44a71f937/konnectivity-agent/0.log"
Sep 11 12:27:39.312295 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:39.312265    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-111.ec2.internal_c78744bb1b8d7ee618cc9c33e60a9eea/haproxy/0.log"
Sep 11 12:27:43.684111 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:43.684071    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-j7rpx_6e5ab5a7-2173-4591-bad5-9333f082fecb/manager/0.log"
Sep 11 12:27:43.708318 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:43.708291    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-582k7_6e17d76e-d693-4cb6-9306-e1ff79ea6745/manager/0.log"
Sep 11 12:27:43.812289 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:43.812256    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-zb7lh_4146faef-8d35-4ab4-b9a0-9ea2dfb1172c/manager/0.log"
Sep 11 12:27:43.951492 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:43.951396    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-m8pp5_dac8da16-a702-461f-ac08-9e64388e1b68/manager/0.log"
Sep 11 12:27:45.669422 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:45.669390    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-lwcvz_4f66e97d-43ad-400a-8b2a-acc93a06e282/cluster-monitoring-operator/0.log"
Sep 11 12:27:45.933714 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:45.933624    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-djqrt_a5f7d4ab-eb5a-4600-b052-2ad1f99cef14/node-exporter/0.log"
Sep 11 12:27:45.957644 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:45.957615    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-djqrt_a5f7d4ab-eb5a-4600-b052-2ad1f99cef14/kube-rbac-proxy/0.log"
Sep 11 12:27:45.977822 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:45.977798    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-djqrt_a5f7d4ab-eb5a-4600-b052-2ad1f99cef14/init-textfile/0.log"
Sep 11 12:27:48.992734 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:48.992702    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5pnqx_2233f21d-d3f8-44fc-92bf-03a86f7456ce/console-operator/1.log"
Sep 11 12:27:49.001939 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:49.001915    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-5pnqx_2233f21d-d3f8-44fc-92bf-03a86f7456ce/console-operator/2.log"
Sep 11 12:27:49.772376 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:49.772339    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rhtnl/perf-node-gather-daemonset-j47fx"]
Sep 11 12:27:49.772732 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:49.772719    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bde1ff5-b743-414c-9d09-895910593311" containerName="maas-api"
Sep 11 12:27:49.772784 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:49.772734    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bde1ff5-b743-414c-9d09-895910593311" containerName="maas-api"
Sep 11 12:27:49.772835 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:49.772826    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bde1ff5-b743-414c-9d09-895910593311" containerName="maas-api"
Sep 11 12:27:49.775855 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:49.775834    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rhtnl/perf-node-gather-daemonset-j47fx"
Sep 11 12:27:49.778589 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:49.778558    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rhtnl\"/\"default-dockercfg-blx5s\""
Sep 11 12:27:49.779845 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:49.779826    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rhtnl\"/\"kube-root-ca.crt\""
Sep 11 12:27:49.779943 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:49.779834    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rhtnl\"/\"openshift-service-ca.crt\""
Sep 11 12:27:49.791243 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:49.791219    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rhtnl/perf-node-gather-daemonset-j47fx"]
Sep 11 12:27:49.926109 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:49.926050    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggkdg\" (UniqueName: \"kubernetes.io/projected/79411648-fad8-4fde-9515-7aafc0f141c5-kube-api-access-ggkdg\") pod \"perf-node-gather-daemonset-j47fx\" (UID: \"79411648-fad8-4fde-9515-7aafc0f141c5\") " pod="openshift-must-gather-rhtnl/perf-node-gather-daemonset-j47fx"
Sep 11 12:27:49.926109 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:49.926116    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/79411648-fad8-4fde-9515-7aafc0f141c5-proc\") pod \"perf-node-gather-daemonset-j47fx\" (UID: \"79411648-fad8-4fde-9515-7aafc0f141c5\") " pod="openshift-must-gather-rhtnl/perf-node-gather-daemonset-j47fx"
Sep 11 12:27:49.926341 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:49.926141    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79411648-fad8-4fde-9515-7aafc0f141c5-sys\") pod \"perf-node-gather-daemonset-j47fx\" (UID: \"79411648-fad8-4fde-9515-7aafc0f141c5\") " pod="openshift-must-gather-rhtnl/perf-node-gather-daemonset-j47fx"
Sep 11 12:27:49.926341 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:49.926185    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/79411648-fad8-4fde-9515-7aafc0f141c5-podres\") pod \"perf-node-gather-daemonset-j47fx\" (UID: \"79411648-fad8-4fde-9515-7aafc0f141c5\") " pod="openshift-must-gather-rhtnl/perf-node-gather-daemonset-j47fx"
Sep 11 12:27:49.926341 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:49.926208    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79411648-fad8-4fde-9515-7aafc0f141c5-lib-modules\") pod \"perf-node-gather-daemonset-j47fx\" (UID: \"79411648-fad8-4fde-9515-7aafc0f141c5\") " pod="openshift-must-gather-rhtnl/perf-node-gather-daemonset-j47fx"
Sep 11 12:27:50.027030 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:50.026927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/79411648-fad8-4fde-9515-7aafc0f141c5-podres\") pod \"perf-node-gather-daemonset-j47fx\" (UID: \"79411648-fad8-4fde-9515-7aafc0f141c5\") " pod="openshift-must-gather-rhtnl/perf-node-gather-daemonset-j47fx"
Sep 11 12:27:50.027030 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:50.026991    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79411648-fad8-4fde-9515-7aafc0f141c5-lib-modules\") pod \"perf-node-gather-daemonset-j47fx\" (UID: \"79411648-fad8-4fde-9515-7aafc0f141c5\") " pod="openshift-must-gather-rhtnl/perf-node-gather-daemonset-j47fx"
Sep 11 12:27:50.027424 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:50.027068    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggkdg\" (UniqueName: \"kubernetes.io/projected/79411648-fad8-4fde-9515-7aafc0f141c5-kube-api-access-ggkdg\") pod \"perf-node-gather-daemonset-j47fx\" (UID: \"79411648-fad8-4fde-9515-7aafc0f141c5\") " pod="openshift-must-gather-rhtnl/perf-node-gather-daemonset-j47fx"
Sep 11 12:27:50.027424 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:50.027114    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/79411648-fad8-4fde-9515-7aafc0f141c5-proc\") pod \"perf-node-gather-daemonset-j47fx\" (UID: \"79411648-fad8-4fde-9515-7aafc0f141c5\") " pod="openshift-must-gather-rhtnl/perf-node-gather-daemonset-j47fx"
Sep 11 12:27:50.027424 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:50.027133    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/79411648-fad8-4fde-9515-7aafc0f141c5-podres\") pod \"perf-node-gather-daemonset-j47fx\" (UID: \"79411648-fad8-4fde-9515-7aafc0f141c5\") " pod="openshift-must-gather-rhtnl/perf-node-gather-daemonset-j47fx"
Sep 11 12:27:50.027424 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:50.027142    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79411648-fad8-4fde-9515-7aafc0f141c5-sys\") pod \"perf-node-gather-daemonset-j47fx\" (UID: \"79411648-fad8-4fde-9515-7aafc0f141c5\") " pod="openshift-must-gather-rhtnl/perf-node-gather-daemonset-j47fx"
Sep 11 12:27:50.027424 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:50.027185    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79411648-fad8-4fde-9515-7aafc0f141c5-lib-modules\") pod \"perf-node-gather-daemonset-j47fx\" (UID: \"79411648-fad8-4fde-9515-7aafc0f141c5\") " pod="openshift-must-gather-rhtnl/perf-node-gather-daemonset-j47fx"
Sep 11 12:27:50.027424 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:50.027215    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79411648-fad8-4fde-9515-7aafc0f141c5-sys\") pod \"perf-node-gather-daemonset-j47fx\" (UID: \"79411648-fad8-4fde-9515-7aafc0f141c5\") " pod="openshift-must-gather-rhtnl/perf-node-gather-daemonset-j47fx"
Sep 11 12:27:50.027424 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:50.027199    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/79411648-fad8-4fde-9515-7aafc0f141c5-proc\") pod \"perf-node-gather-daemonset-j47fx\" (UID: \"79411648-fad8-4fde-9515-7aafc0f141c5\") " pod="openshift-must-gather-rhtnl/perf-node-gather-daemonset-j47fx"
Sep 11 12:27:50.035923 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:50.035899    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggkdg\" (UniqueName: \"kubernetes.io/projected/79411648-fad8-4fde-9515-7aafc0f141c5-kube-api-access-ggkdg\") pod \"perf-node-gather-daemonset-j47fx\" (UID: \"79411648-fad8-4fde-9515-7aafc0f141c5\") " pod="openshift-must-gather-rhtnl/perf-node-gather-daemonset-j47fx"
Sep 11 12:27:50.085715 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:50.085648    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rhtnl/perf-node-gather-daemonset-j47fx"
Sep 11 12:27:50.356298 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:50.356269    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rhtnl/perf-node-gather-daemonset-j47fx"]
Sep 11 12:27:50.356956 ip-10-0-138-111 kubenswrapper[2565]: W0911 12:27:50.356932    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod79411648_fad8_4fde_9515_7aafc0f141c5.slice/crio-d5b99af2bb91b43966c4b88bb4b73736e83a785e8c1f34e4adb59b74b13f3142 WatchSource:0}: Error finding container d5b99af2bb91b43966c4b88bb4b73736e83a785e8c1f34e4adb59b74b13f3142: Status 404 returned error can't find the container with id d5b99af2bb91b43966c4b88bb4b73736e83a785e8c1f34e4adb59b74b13f3142
Sep 11 12:27:50.358995 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:50.358951    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-htsk6_223e97bb-f3c6-4476-bfa0-e8298a46d0cd/volume-data-source-validator/0.log"
Sep 11 12:27:50.825422 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:50.825378    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rhtnl/perf-node-gather-daemonset-j47fx" event={"ID":"79411648-fad8-4fde-9515-7aafc0f141c5","Type":"ContainerStarted","Data":"0880ed1229a598478ae86311ff1f62382b0ef3f93e28c957bc10d7ec677113fb"}
Sep 11 12:27:50.825608 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:50.825435    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rhtnl/perf-node-gather-daemonset-j47fx" event={"ID":"79411648-fad8-4fde-9515-7aafc0f141c5","Type":"ContainerStarted","Data":"d5b99af2bb91b43966c4b88bb4b73736e83a785e8c1f34e4adb59b74b13f3142"}
Sep 11 12:27:50.825608 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:50.825516    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rhtnl/perf-node-gather-daemonset-j47fx"
Sep 11 12:27:50.840852 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:50.840802    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rhtnl/perf-node-gather-daemonset-j47fx" podStartSLOduration=1.8407861410000002 podStartE2EDuration="1.840786141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:27:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:27:50.840195971 +0000 UTC m=+2184.522595471" watchObservedRunningTime="2026-09-11 12:27:50.840786141 +0000 UTC m=+2184.523185638"
Sep 11 12:27:51.537412 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:51.537380    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5csdj_92208eb8-4897-4a87-ab47-b3b7e57ebcec/dns/0.log"
Sep 11 12:27:51.556556 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:51.556521    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5csdj_92208eb8-4897-4a87-ab47-b3b7e57ebcec/kube-rbac-proxy/0.log"
Sep 11 12:27:51.676623 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:51.676590    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kp8l6_dc741275-985d-42ea-b85c-11c3b6af7009/dns-node-resolver/0.log"
Sep 11 12:27:52.310439 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:52.310405    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bc6h9_b2c794da-4296-49a0-a9af-491db5c72a12/node-ca/0.log"
Sep 11 12:27:53.280807 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:53.280769    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm_75217bc8-7b9d-441c-8313-390105642653/istio-proxy/0.log"
Sep 11 12:27:53.731088 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:53.731047    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8478ddd598-t8k7h_8ceab4d9-986f-48c2-a3f3-a4233cc76972/kube-auth-proxy/0.log"
Sep 11 12:27:53.790084 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:53.790050    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-k2frv_626e4a08-50c2-4625-b145-656b540edc43/istio-proxy/0.log"
Sep 11 12:27:53.806042 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:53.806004    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-k2frv_626e4a08-50c2-4625-b145-656b540edc43/istio-proxy/1.log"
Sep 11 12:27:54.796797 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:54.796762    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-96hq7_17b83b0d-839c-4c6c-9ab6-da6827bf62f0/serve-healthcheck-canary/0.log"
Sep 11 12:27:55.314433 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:55.314402    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8qkvp_3affa3aa-fa25-4aa6-9e45-2059f116ea81/kube-rbac-proxy/0.log"
Sep 11 12:27:55.339375 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:55.339348    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8qkvp_3affa3aa-fa25-4aa6-9e45-2059f116ea81/exporter/0.log"
Sep 11 12:27:55.364093 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:55.364066    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8qkvp_3affa3aa-fa25-4aa6-9e45-2059f116ea81/extractor/0.log"
Sep 11 12:27:56.842010 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:56.841985    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rhtnl/perf-node-gather-daemonset-j47fx"
Sep 11 12:27:57.672189 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:57.672159    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-fg7hm_635116a6-736f-4a5b-9f99-c041b6838fe1/manager/0.log"
Sep 11 12:27:57.986825 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:57.986733    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-s878r_39fad017-21bc-46c1-8fea-ff787bf83e53/manager/0.log"
Sep 11 12:27:58.076333 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:58.076297    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gbgb4_4d327ca3-43ad-454f-ab85-4bc69a5270fc/server/0.log"
Sep 11 12:27:58.201477 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:58.201443    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9ggdp_4f0cbcf9-7958-4697-b00f-474179f9c874/manager/0.log"
Sep 11 12:27:58.230743 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:58.230711    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cbb9c7bc-8275q_a900ed8c-4e7a-4655-81e5-3bb6e45bbdce/manager/0.log"
Sep 11 12:27:58.251505 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:58.251438    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cbb9c7bc-8275q_a900ed8c-4e7a-4655-81e5-3bb6e45bbdce/copy-manifests/0.log"
Sep 11 12:27:59.942108 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:27:59.942070    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-q8hx9_2487a775-dcd0-4d8d-b9d4-2c60d8adf78b/openshift-lws-operator/0.log"
Sep 11 12:28:00.204002 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:28:00.203870    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm_75217bc8-7b9d-441c-8313-390105642653/istio-proxy/0.log"
Sep 11 12:28:00.647269 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:28:00.647241    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8478ddd598-t8k7h_8ceab4d9-986f-48c2-a3f3-a4233cc76972/kube-auth-proxy/0.log"
Sep 11 12:28:00.682767 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:28:00.682725    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-k2frv_626e4a08-50c2-4625-b145-656b540edc43/istio-proxy/0.log"
Sep 11 12:28:00.697701 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:28:00.697651    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-k2frv_626e4a08-50c2-4625-b145-656b540edc43/istio-proxy/1.log"
Sep 11 12:28:02.325788 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:28:02.325744    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-l76bm_75217bc8-7b9d-441c-8313-390105642653/istio-proxy/0.log"
Sep 11 12:28:02.786114 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:28:02.786078    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8478ddd598-t8k7h_8ceab4d9-986f-48c2-a3f3-a4233cc76972/kube-auth-proxy/0.log"
Sep 11 12:28:02.839452 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:28:02.839413    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-k2frv_626e4a08-50c2-4625-b145-656b540edc43/istio-proxy/0.log"
Sep 11 12:28:02.856088 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:28:02.856056    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-k2frv_626e4a08-50c2-4625-b145-656b540edc43/istio-proxy/1.log"
Sep 11 12:28:06.151529 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:28:06.151495    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9pk4q_c353d851-ad50-4533-ba4a-af3d820e25d1/kube-multus-additional-cni-plugins/0.log"
Sep 11 12:28:06.172320 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:28:06.172277    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9pk4q_c353d851-ad50-4533-ba4a-af3d820e25d1/egress-router-binary-copy/0.log"
Sep 11 12:28:06.194400 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:28:06.194378    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9pk4q_c353d851-ad50-4533-ba4a-af3d820e25d1/cni-plugins/0.log"
Sep 11 12:28:06.214442 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:28:06.214412    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9pk4q_c353d851-ad50-4533-ba4a-af3d820e25d1/bond-cni-plugin/0.log"
Sep 11 12:28:06.234634 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:28:06.234602    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9pk4q_c353d851-ad50-4533-ba4a-af3d820e25d1/routeoverride-cni/0.log"
Sep 11 12:28:06.256204 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:28:06.256177    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9pk4q_c353d851-ad50-4533-ba4a-af3d820e25d1/whereabouts-cni-bincopy/0.log"
Sep 11 12:28:06.275461 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:28:06.275433    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9pk4q_c353d851-ad50-4533-ba4a-af3d820e25d1/whereabouts-cni/0.log"
Sep 11 12:28:06.749927 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:28:06.749888    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zc9s9_2af1845b-bb2b-4fc9-96f1-c8805e1d1d56/kube-multus/0.log"
Sep 11 12:28:06.777400 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:28:06.777369    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jcs8z_5b7c905b-ecae-4cbe-a5c2-3962ec391672/network-metrics-daemon/0.log"
Sep 11 12:28:06.794102 ip-10-0-138-111 kubenswrapper[2565]: I0911 12:28:06.794078    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jcs8z_5b7c905b-ecae-4cbe-a5c2-3962ec391672/kube-rbac-proxy/0.log"