Sep 10 14:09:36.926267 ip-10-0-137-114 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 10 14:09:36.926276 ip-10-0-137-114 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 10 14:09:36.926283 ip-10-0-137-114 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 10 14:09:36.926433 ip-10-0-137-114 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 10 14:09:47.138283 ip-10-0-137-114 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 10 14:09:47.138299 ip-10-0-137-114 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 9979e9f9ed5d4e689b27d047f65ed56a --
Sep 10 14:11:41.773784 ip-10-0-137-114 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 14:11:42.155646 ip-10-0-137-114 kubenswrapper[2545]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 14:11:42.155646 ip-10-0-137-114 kubenswrapper[2545]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 14:11:42.155646 ip-10-0-137-114 kubenswrapper[2545]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 14:11:42.155646 ip-10-0-137-114 kubenswrapper[2545]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 14:11:42.155646 ip-10-0-137-114 kubenswrapper[2545]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 14:11:42.156284 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.155668    2545 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 14:11:42.159836 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159822    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 14:11:42.159836 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159835    2545 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 14:11:42.159900 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159839    2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 14:11:42.159900 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159842    2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 14:11:42.159900 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159845    2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 14:11:42.159900 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159848    2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 14:11:42.159900 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159850    2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 14:11:42.159900 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159853    2545 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 14:11:42.159900 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159859    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 14:11:42.159900 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159862    2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 14:11:42.159900 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159865    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 14:11:42.159900 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159870    2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 14:11:42.159900 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159875    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 14:11:42.159900 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159878    2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 14:11:42.159900 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159880    2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 14:11:42.159900 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159884    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 14:11:42.159900 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159887    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 14:11:42.159900 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159889    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 14:11:42.159900 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159892    2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 14:11:42.159900 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159894    2545 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 14:11:42.159900 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159897    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 14:11:42.159900 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159899    2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 14:11:42.160366 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159902    2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 14:11:42.160366 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159905    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 14:11:42.160366 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159907    2545 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 14:11:42.160366 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159910    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 14:11:42.160366 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159913    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 14:11:42.160366 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159916    2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 14:11:42.160366 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159918    2545 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 14:11:42.160366 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159921    2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 14:11:42.160366 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159923    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 14:11:42.160366 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159926    2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 14:11:42.160366 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159928    2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 14:11:42.160366 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159932    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 14:11:42.160366 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159934    2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 14:11:42.160366 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159936    2545 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 14:11:42.160366 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159939    2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 14:11:42.160366 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159942    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 14:11:42.160366 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159944    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 14:11:42.160366 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159946    2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 14:11:42.160366 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159948    2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 14:11:42.160366 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159957    2545 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 14:11:42.160835 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159959    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 14:11:42.160835 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159962    2545 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 14:11:42.160835 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159964    2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 14:11:42.160835 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159966    2545 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 14:11:42.160835 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159969    2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 14:11:42.160835 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159971    2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 14:11:42.160835 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159974    2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 14:11:42.160835 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159976    2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 14:11:42.160835 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159978    2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 14:11:42.160835 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159982    2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 14:11:42.160835 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159986    2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 14:11:42.160835 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159988    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 14:11:42.160835 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159991    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 14:11:42.160835 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159995    2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 14:11:42.160835 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.159997    2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 14:11:42.160835 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160000    2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 14:11:42.160835 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160002    2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 14:11:42.160835 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160006    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 14:11:42.160835 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160008    2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 14:11:42.161309 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160011    2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 14:11:42.161309 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160013    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 14:11:42.161309 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160015    2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 14:11:42.161309 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160018    2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 14:11:42.161309 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160020    2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 14:11:42.161309 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160022    2545 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 14:11:42.161309 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160025    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 14:11:42.161309 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160027    2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 14:11:42.161309 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160029    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 14:11:42.161309 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160032    2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 14:11:42.161309 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160034    2545 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 14:11:42.161309 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160036    2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 14:11:42.161309 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160039    2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 14:11:42.161309 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160046    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 14:11:42.161309 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160049    2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 14:11:42.161309 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160051    2545 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 14:11:42.161309 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160053    2545 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 14:11:42.161309 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160056    2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 14:11:42.161309 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160058    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 14:11:42.161309 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160061    2545 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 14:11:42.161785 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160063    2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 14:11:42.161785 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160065    2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 14:11:42.161785 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160068    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 14:11:42.161785 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160070    2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 14:11:42.161785 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160073    2545 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 14:11:42.161785 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160075    2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 14:11:42.161785 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160078    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 14:11:42.161785 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160081    2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 14:11:42.161785 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160083    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 14:11:42.161785 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160086    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 14:11:42.161785 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160090    2545 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 14:11:42.161785 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160093    2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 14:11:42.161785 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160096    2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 14:11:42.161785 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160099    2545 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 14:11:42.161785 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160101    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 14:11:42.161785 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160104    2545 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 14:11:42.161785 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160106    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 14:11:42.161785 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160109    2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 14:11:42.161785 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160799    2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 14:11:42.162218 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160805    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 14:11:42.162218 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160807    2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 14:11:42.162218 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160810    2545 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 14:11:42.162218 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160813    2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 14:11:42.162218 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160816    2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 14:11:42.162218 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160818    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 14:11:42.162218 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160821    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 14:11:42.162218 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160824    2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 14:11:42.162218 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160827    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 14:11:42.162218 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160829    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 14:11:42.162218 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160832    2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 14:11:42.162218 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160835    2545 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 14:11:42.162218 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160838    2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 14:11:42.162218 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160840    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 14:11:42.162218 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160843    2545 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 14:11:42.162218 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160845    2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 14:11:42.162218 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160848    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 14:11:42.162218 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160851    2545 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 14:11:42.162218 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160854    2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 14:11:42.162218 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160856    2545 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 14:11:42.162706 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160859    2545 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 14:11:42.162706 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160861    2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 14:11:42.162706 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160864    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 14:11:42.162706 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160868    2545 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 14:11:42.162706 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160871    2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 14:11:42.162706 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160874    2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 14:11:42.162706 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160877    2545 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 14:11:42.162706 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160880    2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 14:11:42.162706 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160882    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 14:11:42.162706 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160885    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 14:11:42.162706 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160888    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 14:11:42.162706 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160891    2545 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 14:11:42.162706 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160894    2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 14:11:42.162706 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160896    2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 14:11:42.162706 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160899    2545 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 14:11:42.162706 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160901    2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 14:11:42.162706 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160904    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 14:11:42.162706 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160906    2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 14:11:42.162706 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160908    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 14:11:42.162706 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160912    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 14:11:42.163183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160917    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 14:11:42.163183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160919    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 14:11:42.163183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160922    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 14:11:42.163183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160925    2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 14:11:42.163183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160928    2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 14:11:42.163183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160931    2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 14:11:42.163183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160935    2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 14:11:42.163183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160938    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 14:11:42.163183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160941    2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 14:11:42.163183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160944    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 14:11:42.163183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160947    2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 14:11:42.163183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160950    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 14:11:42.163183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160953    2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 14:11:42.163183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160956    2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 14:11:42.163183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160959    2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 14:11:42.163183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160961    2545 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 14:11:42.163183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160964    2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 14:11:42.163183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160966    2545 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 14:11:42.163183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160968    2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 14:11:42.163183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160971    2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 14:11:42.163715 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160973    2545 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 14:11:42.163715 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160975    2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 14:11:42.163715 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160978    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 14:11:42.163715 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160980    2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 14:11:42.163715 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160983    2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 14:11:42.163715 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160986    2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 14:11:42.163715 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160989    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 14:11:42.163715 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160991    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 14:11:42.163715 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160993    2545 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 14:11:42.163715 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160996    2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 14:11:42.163715 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.160998    2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 14:11:42.163715 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161001    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 14:11:42.163715 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161003    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 14:11:42.163715 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161007    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 14:11:42.163715 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161010    2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 14:11:42.163715 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161012    2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 14:11:42.163715 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161015    2545 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 14:11:42.163715 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161018    2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 14:11:42.163715 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161020    2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 14:11:42.163715 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161023    2545 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 14:11:42.164183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161025    2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 14:11:42.164183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161029    2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 14:11:42.164183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161031    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 14:11:42.164183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161034    2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 14:11:42.164183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161036    2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 14:11:42.164183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161039    2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 14:11:42.164183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161041    2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 14:11:42.164183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161043    2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 14:11:42.164183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161046    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 14:11:42.164183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161049    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 14:11:42.164183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161051    2545 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 14:11:42.164183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161054    2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 14:11:42.164183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161056    2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 14:11:42.164183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161058    2545 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 14:11:42.164183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161061    2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 14:11:42.164183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161063    2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 14:11:42.164183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161066    2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 14:11:42.164183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161068    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 14:11:42.164183 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161418    2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 14:11:42.164646 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161422    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 14:11:42.164646 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161425    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 14:11:42.164646 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161428    2545 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 14:11:42.164646 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161430    2545 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 14:11:42.164646 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161433    2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 14:11:42.164646 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161436    2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 14:11:42.164646 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161439    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 14:11:42.164646 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161442    2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 14:11:42.164646 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161445    2545 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 14:11:42.164646 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161447    2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 14:11:42.164646 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161450    2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 14:11:42.164646 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161452    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 14:11:42.164646 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161455    2545 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 14:11:42.164646 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161457    2545 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 14:11:42.164646 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161461    2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 14:11:42.164646 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161464    2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 14:11:42.164646 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161466    2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 14:11:42.164646 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161468    2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 14:11:42.164646 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161471    2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 14:11:42.164646 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161473    2545 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 14:11:42.164646 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161476    2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 14:11:42.165144 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161478    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 14:11:42.165144 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161481    2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 14:11:42.165144 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161483    2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 14:11:42.165144 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161500    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 14:11:42.165144 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161503    2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 14:11:42.165144 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161506    2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 14:11:42.165144 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161508    2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 14:11:42.165144 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161512    2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 14:11:42.165144 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161515    2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 14:11:42.165144 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161519    2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 14:11:42.165144 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161522    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 14:11:42.165144 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161526    2545 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 14:11:42.165144 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161530    2545 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 14:11:42.165144 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161532    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 14:11:42.165144 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161535    2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 14:11:42.165144 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161538    2545 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 14:11:42.165144 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161541    2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 14:11:42.165144 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161543    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 14:11:42.165591 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161547    2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 14:11:42.165591 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161550    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 14:11:42.165591 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161553    2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 14:11:42.165591 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161555    2545 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 14:11:42.165591 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161559    2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 14:11:42.165591 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161562    2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 14:11:42.165591 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161564    2545 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 14:11:42.165591 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161568    2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 14:11:42.165591 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161570    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 14:11:42.165591 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161573    2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 14:11:42.165591 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161575    2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 14:11:42.165591 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161578    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 14:11:42.165591 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161580    2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 14:11:42.165591 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161582    2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 14:11:42.165591 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161585    2545 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 14:11:42.165591 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161587    2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 14:11:42.165591 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161589    2545 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 14:11:42.165591 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161592    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 14:11:42.165591 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161594    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 14:11:42.165591 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161597    2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 14:11:42.166072 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161599    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 14:11:42.166072 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161601    2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 14:11:42.166072 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161604    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 14:11:42.166072 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161606    2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 14:11:42.166072 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161609    2545 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 14:11:42.166072 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161611    2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 14:11:42.166072 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161613    2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 14:11:42.166072 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161616    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 14:11:42.166072 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161619    2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 14:11:42.166072 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161623    2545 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 14:11:42.166072 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161626    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 14:11:42.166072 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161629    2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 14:11:42.166072 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161631    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 14:11:42.166072 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161634    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 14:11:42.166072 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161637    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 14:11:42.166072 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161640    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 14:11:42.166072 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161642    2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 14:11:42.166072 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161644    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 14:11:42.166072 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161647    2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 14:11:42.166072 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161653    2545 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 14:11:42.166560 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161655    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 14:11:42.166560 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161657    2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 14:11:42.166560 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161660    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 14:11:42.166560 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161663    2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 14:11:42.166560 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161665    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 14:11:42.166560 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161668    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 14:11:42.166560 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161670    2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 14:11:42.166560 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161672    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 14:11:42.166560 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161675    2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 14:11:42.166560 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161677    2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 14:11:42.166560 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161679    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 14:11:42.166560 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161682    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 14:11:42.166560 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161684    2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 14:11:42.166560 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161687    2545 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 14:11:42.166560 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161689    2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 14:11:42.166560 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161691    2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 14:11:42.166560 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161694    2545 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 14:11:42.166560 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161696    2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 14:11:42.166560 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.161698    2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 14:11:42.166997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161761    2545 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 14:11:42.166997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161791    2545 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 14:11:42.166997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161801    2545 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 14:11:42.166997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161805    2545 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 14:11:42.166997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161809    2545 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 14:11:42.166997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161812    2545 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 14:11:42.166997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161816    2545 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 14:11:42.166997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161823    2545 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 14:11:42.166997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161826    2545 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 14:11:42.166997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161829    2545 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 14:11:42.166997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161832    2545 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 14:11:42.166997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161835    2545 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 14:11:42.166997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161839    2545 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 14:11:42.166997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161842    2545 flags.go:64] FLAG: --cgroup-root=""
Sep 10 14:11:42.166997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161844    2545 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 14:11:42.166997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161847    2545 flags.go:64] FLAG: --client-ca-file=""
Sep 10 14:11:42.166997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161850    2545 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 14:11:42.166997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161853    2545 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 14:11:42.166997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161856    2545 flags.go:64] FLAG: --cluster-domain=""
Sep 10 14:11:42.166997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161859    2545 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 14:11:42.166997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161861    2545 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 14:11:42.166997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161864    2545 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 14:11:42.166997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161867    2545 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 14:11:42.166997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161871    2545 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 14:11:42.167586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161874    2545 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 14:11:42.167586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161877    2545 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 14:11:42.167586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161880    2545 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 14:11:42.167586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161883    2545 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 14:11:42.167586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161886    2545 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 14:11:42.167586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161889    2545 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 14:11:42.167586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161892    2545 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 14:11:42.167586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161894    2545 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 14:11:42.167586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161898    2545 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 14:11:42.167586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161901    2545 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 14:11:42.167586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161905    2545 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 14:11:42.167586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161907    2545 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 14:11:42.167586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161910    2545 flags.go:64] FLAG: --enable-server="true"
Sep 10 14:11:42.167586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161913    2545 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 14:11:42.167586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161917    2545 flags.go:64] FLAG: --event-burst="100"
Sep 10 14:11:42.167586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161920    2545 flags.go:64] FLAG: --event-qps="50"
Sep 10 14:11:42.167586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161923    2545 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 14:11:42.167586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161926    2545 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 14:11:42.167586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161929    2545 flags.go:64] FLAG: --eviction-hard=""
Sep 10 14:11:42.167586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161932    2545 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 14:11:42.167586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161935    2545 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 14:11:42.167586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161938    2545 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 14:11:42.167586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161941    2545 flags.go:64] FLAG: --eviction-soft=""
Sep 10 14:11:42.167586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161944    2545 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 14:11:42.167586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161946    2545 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 14:11:42.168308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161949    2545 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 14:11:42.168308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161952    2545 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 14:11:42.168308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161955    2545 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 14:11:42.168308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161958    2545 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 14:11:42.168308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161960    2545 flags.go:64] FLAG: --feature-gates=""
Sep 10 14:11:42.168308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161964    2545 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 14:11:42.168308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161967    2545 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 14:11:42.168308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161969    2545 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 14:11:42.168308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161972    2545 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 14:11:42.168308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161975    2545 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 14:11:42.168308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161978    2545 flags.go:64] FLAG: --help="false"
Sep 10 14:11:42.168308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161981    2545 flags.go:64] FLAG: --hostname-override="ip-10-0-137-114.ec2.internal"
Sep 10 14:11:42.168308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161983    2545 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 14:11:42.168308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161986    2545 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 14:11:42.168308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161989    2545 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 14:11:42.168308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161992    2545 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 14:11:42.168308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161995    2545 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 14:11:42.168308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.161999    2545 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 14:11:42.168308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162002    2545 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 14:11:42.168308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162005    2545 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 14:11:42.168308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162007    2545 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 14:11:42.168308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162010    2545 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 14:11:42.168308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162013    2545 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 14:11:42.168308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162015    2545 flags.go:64] FLAG: --kube-reserved=""
Sep 10 14:11:42.168914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162019    2545 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 14:11:42.168914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162021    2545 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 14:11:42.168914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162024    2545 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 14:11:42.168914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162027    2545 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 14:11:42.168914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162030    2545 flags.go:64] FLAG: --lock-file=""
Sep 10 14:11:42.168914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162033    2545 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 14:11:42.168914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162035    2545 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 14:11:42.168914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162038    2545 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 14:11:42.168914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162043    2545 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 14:11:42.168914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162046    2545 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 14:11:42.168914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162049    2545 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 14:11:42.168914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162051    2545 flags.go:64] FLAG: --logging-format="text"
Sep 10 14:11:42.168914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162054    2545 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 14:11:42.168914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162057    2545 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 14:11:42.168914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162060    2545 flags.go:64] FLAG: --manifest-url=""
Sep 10 14:11:42.168914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162062    2545 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 14:11:42.168914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162067    2545 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 14:11:42.168914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162069    2545 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 14:11:42.168914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162073    2545 flags.go:64] FLAG: --max-pods="110"
Sep 10 14:11:42.168914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162076    2545 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 14:11:42.168914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162079    2545 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 14:11:42.168914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162082    2545 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 14:11:42.168914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162084    2545 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 14:11:42.168914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162087    2545 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 14:11:42.168914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162090    2545 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 14:11:42.169561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162094    2545 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 14:11:42.169561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162100    2545 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 14:11:42.169561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162103    2545 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 14:11:42.169561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162106    2545 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 14:11:42.169561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162108    2545 flags.go:64] FLAG: --pod-cidr=""
Sep 10 14:11:42.169561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162112    2545 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 10 14:11:42.169561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162117    2545 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 14:11:42.169561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162119    2545 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 14:11:42.169561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162123    2545 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 14:11:42.169561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162126    2545 flags.go:64] FLAG: --port="10250"
Sep 10 14:11:42.169561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162129    2545 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 14:11:42.169561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162131    2545 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-020e4bf2aec63ea4d"
Sep 10 14:11:42.169561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162134    2545 flags.go:64] FLAG: --qos-reserved=""
Sep 10 14:11:42.169561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162137    2545 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 14:11:42.169561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162140    2545 flags.go:64] FLAG: --register-node="true"
Sep 10 14:11:42.169561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162143    2545 flags.go:64] FLAG: --register-with-taints=""
Sep 10 14:11:42.169561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162146    2545 flags.go:64] FLAG: --registry-burst="10"
Sep 10 14:11:42.169561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162149    2545 flags.go:64] FLAG: --registry-qps="5"
Sep 10 14:11:42.169561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162152    2545 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 14:11:42.169561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162154    2545 flags.go:64] FLAG: --reserved-memory=""
Sep 10 14:11:42.169561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162157    2545 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 14:11:42.169561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162160    2545 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 14:11:42.169561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162163    2545 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 14:11:42.169561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162166    2545 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 14:11:42.169561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162168    2545 flags.go:64] FLAG: --runonce="false"
Sep 10 14:11:42.170481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162171    2545 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 14:11:42.170481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162174    2545 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 14:11:42.170481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162177    2545 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 14:11:42.170481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162180    2545 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 14:11:42.170481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162182    2545 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 14:11:42.170481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162185    2545 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 14:11:42.170481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162188    2545 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 14:11:42.170481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162191    2545 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 14:11:42.170481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162195    2545 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 14:11:42.170481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162198    2545 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 14:11:42.170481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162201    2545 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 14:11:42.170481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162204    2545 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 14:11:42.170481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162206    2545 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 14:11:42.170481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162209    2545 flags.go:64] FLAG: --system-cgroups=""
Sep 10 14:11:42.170481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162212    2545 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 14:11:42.170481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162217    2545 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 14:11:42.170481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162220    2545 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 14:11:42.170481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162224    2545 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 14:11:42.170481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162228    2545 flags.go:64] FLAG: --tls-min-version=""
Sep 10 14:11:42.170481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162231    2545 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 14:11:42.170481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162234    2545 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 14:11:42.170481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162236    2545 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 14:11:42.170481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162239    2545 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 14:11:42.170481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162242    2545 flags.go:64] FLAG: --v="2"
Sep 10 14:11:42.170481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162245    2545 flags.go:64] FLAG: --version="false"
Sep 10 14:11:42.171113 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162249    2545 flags.go:64] FLAG: --vmodule=""
Sep 10 14:11:42.171113 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162252    2545 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 14:11:42.171113 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.162256    2545 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 14:11:42.171113 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162361    2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 14:11:42.171113 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162366    2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 14:11:42.171113 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162371    2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 14:11:42.171113 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162375    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 14:11:42.171113 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162380    2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 14:11:42.171113 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162383    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 14:11:42.171113 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162386    2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 14:11:42.171113 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162389    2545 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 14:11:42.171113 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162392    2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 14:11:42.171113 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162395    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 14:11:42.171113 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162398    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 14:11:42.171113 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162400    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 14:11:42.171113 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162404    2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 14:11:42.171113 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162406    2545 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 14:11:42.171113 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162409    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 14:11:42.171113 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162412    2545 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 14:11:42.171598 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162415    2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 14:11:42.171598 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162417    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 14:11:42.171598 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162420    2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 14:11:42.171598 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162422    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 14:11:42.171598 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162425    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 14:11:42.171598 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162429    2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 14:11:42.171598 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162432    2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 14:11:42.171598 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162435    2545 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 14:11:42.171598 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162439    2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 14:11:42.171598 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162443    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 14:11:42.171598 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162446    2545 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 14:11:42.171598 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162449    2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 14:11:42.171598 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162452    2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 14:11:42.171598 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162455    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 14:11:42.171598 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162457    2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 14:11:42.171598 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162460    2545 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 14:11:42.171598 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162462    2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 14:11:42.171598 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162465    2545 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 14:11:42.171598 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162468    2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 14:11:42.172045 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162471    2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 14:11:42.172045 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162473    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 14:11:42.172045 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162476    2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 14:11:42.172045 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162479    2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 14:11:42.172045 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162481    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 14:11:42.172045 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162496    2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 14:11:42.172045 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162499    2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 14:11:42.172045 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162501    2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 14:11:42.172045 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162504    2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 14:11:42.172045 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162507    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 14:11:42.172045 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162510    2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 14:11:42.172045 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162512    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 14:11:42.172045 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162515    2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 14:11:42.172045 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162517    2545 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 14:11:42.172045 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162520    2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 14:11:42.172045 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162522    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 14:11:42.172045 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162525    2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 14:11:42.172045 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162527    2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 14:11:42.172045 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162531    2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 14:11:42.172045 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162534    2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 14:11:42.172541 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162536    2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 14:11:42.172541 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162539    2545 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 14:11:42.172541 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162542    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 14:11:42.172541 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162544    2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 14:11:42.172541 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162547    2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 14:11:42.172541 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162549    2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 14:11:42.172541 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162551    2545 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 14:11:42.172541 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162554    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 14:11:42.172541 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162557    2545 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 14:11:42.172541 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162559    2545 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 14:11:42.172541 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162561    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 14:11:42.172541 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162564    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 14:11:42.172541 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162566    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 14:11:42.172541 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162569    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 14:11:42.172541 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162571    2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 14:11:42.172541 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162574    2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 14:11:42.172541 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162576    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 14:11:42.172541 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162578    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 14:11:42.172541 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162581    2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 14:11:42.172541 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162584    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 14:11:42.173040 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162586    2545 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 14:11:42.173040 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162589    2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 14:11:42.173040 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162591    2545 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 14:11:42.173040 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162594    2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 14:11:42.173040 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162596    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 14:11:42.173040 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162599    2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 14:11:42.173040 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162601    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 14:11:42.173040 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162604    2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 14:11:42.173040 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162606    2545 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 14:11:42.173040 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162609    2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 14:11:42.173040 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162612    2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 14:11:42.173040 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162615    2545 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 14:11:42.173040 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162618    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 14:11:42.173040 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162620    2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 14:11:42.173040 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162622    2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 14:11:42.173040 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162625    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 14:11:42.173040 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162627    2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 14:11:42.173040 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162630    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 14:11:42.173040 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162632    2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 14:11:42.173040 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162634    2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 14:11:42.173514 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162637    2545 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 14:11:42.173514 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162639    2545 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 14:11:42.173514 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162641    2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 14:11:42.173514 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.162644    2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 14:11:42.173514 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.163343    2545 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 14:11:42.173514 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.171538    2545 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 14:11:42.173514 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.171551    2545 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 14:11:42.173514 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.172846    2545 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 14:11:42.173514 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.172855    2545 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 14:11:42.173514 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172910    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 14:11:42.173514 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172915    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 14:11:42.173514 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172918    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 14:11:42.173514 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172921    2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 14:11:42.173514 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172924    2545 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 14:11:42.173514 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172927    2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 14:11:42.173874 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172930    2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 14:11:42.173874 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172932    2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 14:11:42.173874 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172935    2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 14:11:42.173874 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172938    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 14:11:42.173874 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172941    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 14:11:42.173874 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172943    2545 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 14:11:42.173874 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172946    2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 14:11:42.173874 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172949    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 14:11:42.173874 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172951    2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 14:11:42.173874 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172954    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 14:11:42.173874 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172956    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 14:11:42.173874 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172960    2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 14:11:42.173874 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172964    2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 14:11:42.173874 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172967    2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 14:11:42.173874 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172970    2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 14:11:42.173874 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172973    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 14:11:42.173874 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172975    2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 14:11:42.173874 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172978    2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 14:11:42.173874 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172981    2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 14:11:42.174326 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172984    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 14:11:42.174326 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172987    2545 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 14:11:42.174326 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172990    2545 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 14:11:42.174326 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172992    2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 14:11:42.174326 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172995    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 14:11:42.174326 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.172998    2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 14:11:42.174326 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173001    2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 14:11:42.174326 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173003    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 14:11:42.174326 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173006    2545 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 14:11:42.174326 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173008    2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 14:11:42.174326 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173011    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 14:11:42.174326 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173013    2545 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 14:11:42.174326 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173016    2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 14:11:42.174326 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173019    2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 14:11:42.174326 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173021    2545 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 14:11:42.174326 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173024    2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 14:11:42.174326 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173026    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 14:11:42.174326 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173029    2545 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 14:11:42.174326 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173031    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 14:11:42.174776 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173034    2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 14:11:42.174776 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173036    2545 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 14:11:42.174776 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173040    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 14:11:42.174776 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173042    2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 14:11:42.174776 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173045    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 14:11:42.174776 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173048    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 14:11:42.174776 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173051    2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 14:11:42.174776 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173053    2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 14:11:42.174776 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173056    2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 14:11:42.174776 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173059    2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 14:11:42.174776 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173077    2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 14:11:42.174776 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173081    2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 14:11:42.174776 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173084    2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 14:11:42.174776 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173087    2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 14:11:42.174776 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173090    2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 14:11:42.174776 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173093    2545 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 14:11:42.174776 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173096    2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 14:11:42.174776 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173100    2545 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 14:11:42.174776 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173104    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 14:11:42.174776 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173106    2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 14:11:42.175251 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173109    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 14:11:42.175251 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173112    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 14:11:42.175251 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173114    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 14:11:42.175251 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173117    2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 14:11:42.175251 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173119    2545 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 14:11:42.175251 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173122    2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 14:11:42.175251 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173124    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 14:11:42.175251 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173127    2545 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 14:11:42.175251 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173129    2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 14:11:42.175251 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173132    2545 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 14:11:42.175251 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173134    2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 14:11:42.175251 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173138    2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 14:11:42.175251 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173141    2545 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 14:11:42.175251 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173144    2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 14:11:42.175251 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173147    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 14:11:42.175251 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173150    2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 14:11:42.175251 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173152    2545 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 14:11:42.175251 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173155    2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 14:11:42.175251 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173157    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 14:11:42.175251 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173160    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 14:11:42.175742 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173163    2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 14:11:42.175742 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173166    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 14:11:42.175742 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173168    2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 14:11:42.175742 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173171    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 14:11:42.175742 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173173    2545 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 14:11:42.175742 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173176    2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 14:11:42.175742 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173178    2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 14:11:42.175742 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173181    2545 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 14:11:42.175742 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173184    2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 14:11:42.175742 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173187    2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 14:11:42.175742 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173189    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 14:11:42.175742 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173192    2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 14:11:42.175742 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173194    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 14:11:42.175742 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173197    2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 14:11:42.175742 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173199    2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 14:11:42.176087 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.173204    2545 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 14:11:42.176087 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173311    2545 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 14:11:42.176087 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173316    2545 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 14:11:42.176087 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173319    2545 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 14:11:42.176087 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173321    2545 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 14:11:42.176087 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173324    2545 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 14:11:42.176087 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173326    2545 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 14:11:42.176087 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173329    2545 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 14:11:42.176087 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173332    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 14:11:42.176087 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173334    2545 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 14:11:42.176087 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173336    2545 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 14:11:42.176087 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173339    2545 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 14:11:42.176087 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173341    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 14:11:42.176087 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173344    2545 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 14:11:42.176087 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173347    2545 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 14:11:42.176470 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173349    2545 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 14:11:42.176470 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173351    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 14:11:42.176470 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173354    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 14:11:42.176470 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173356    2545 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 14:11:42.176470 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173359    2545 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 14:11:42.176470 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173361    2545 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 14:11:42.176470 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173364    2545 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 14:11:42.176470 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173366    2545 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 14:11:42.176470 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173368    2545 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 14:11:42.176470 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173371    2545 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 14:11:42.176470 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173373    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 14:11:42.176470 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173377    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 14:11:42.176470 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173379    2545 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 14:11:42.176470 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173381    2545 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 14:11:42.176470 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173384    2545 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 14:11:42.176470 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173386    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 14:11:42.176470 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173389    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 14:11:42.176470 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173391    2545 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 14:11:42.176470 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173394    2545 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 14:11:42.176939 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173396    2545 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 14:11:42.176939 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173400    2545 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 14:11:42.176939 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173404    2545 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 14:11:42.176939 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173406    2545 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 14:11:42.176939 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173409    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 14:11:42.176939 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173412    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 14:11:42.176939 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173414    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 14:11:42.176939 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173417    2545 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 14:11:42.176939 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173419    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 14:11:42.176939 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173422    2545 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 14:11:42.176939 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173424    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 14:11:42.176939 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173427    2545 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 14:11:42.176939 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173430    2545 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 14:11:42.176939 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173433    2545 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 14:11:42.176939 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173435    2545 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 14:11:42.176939 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173437    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 14:11:42.176939 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173439    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 14:11:42.176939 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173442    2545 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 14:11:42.176939 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173444    2545 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 14:11:42.176939 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173447    2545 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 14:11:42.177404 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173449    2545 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 14:11:42.177404 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173452    2545 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 14:11:42.177404 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173454    2545 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 14:11:42.177404 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173457    2545 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 14:11:42.177404 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173459    2545 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 14:11:42.177404 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173462    2545 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 14:11:42.177404 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173464    2545 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 14:11:42.177404 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173466    2545 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 14:11:42.177404 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173469    2545 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 14:11:42.177404 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173471    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 14:11:42.177404 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173473    2545 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 14:11:42.177404 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173476    2545 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 14:11:42.177404 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173479    2545 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 14:11:42.177404 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173483    2545 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 14:11:42.177404 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173499    2545 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 14:11:42.177404 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173502    2545 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 14:11:42.177404 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173505    2545 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 14:11:42.177404 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173507    2545 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 14:11:42.177404 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173510    2545 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 14:11:42.177404 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173512    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 14:11:42.177976 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173515    2545 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 14:11:42.177976 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173517    2545 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 14:11:42.177976 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173521    2545 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 14:11:42.177976 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173523    2545 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 14:11:42.177976 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173526    2545 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 14:11:42.177976 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173529    2545 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 14:11:42.177976 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173532    2545 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 14:11:42.177976 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173534    2545 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 14:11:42.177976 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173537    2545 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 14:11:42.177976 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173539    2545 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 14:11:42.177976 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173543    2545 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 14:11:42.177976 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173546    2545 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 14:11:42.177976 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173549    2545 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 14:11:42.177976 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173552    2545 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 14:11:42.177976 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173555    2545 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 14:11:42.177976 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173557    2545 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 14:11:42.177976 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173560    2545 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 14:11:42.177976 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173562    2545 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 14:11:42.177976 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173564    2545 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 14:11:42.177976 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173567    2545 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 14:11:42.178452 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173569    2545 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 14:11:42.178452 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173572    2545 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 14:11:42.178452 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173574    2545 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 14:11:42.178452 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173576    2545 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 14:11:42.178452 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173579    2545 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 14:11:42.178452 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:42.173581    2545 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 14:11:42.178452 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.173586    2545 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 14:11:42.178452 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.173681    2545 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 14:11:42.178452 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.175535    2545 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 14:11:42.178452 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.176313    2545 server.go:1019] "Starting client certificate rotation"
Sep 10 14:11:42.178452 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.176407    2545 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 14:11:42.178452 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.176437    2545 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 14:11:42.178879 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.178866    2545 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 14:11:42.179975 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.179952    2545 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 14:11:42.195418 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.195394    2545 log.go:25] "Validated CRI v1 runtime API"
Sep 10 14:11:42.197964 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.197951    2545 log.go:25] "Validated CRI v1 image API"
Sep 10 14:11:42.198759 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.198741    2545 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 14:11:42.204810 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.204785    2545 fs.go:135] Filesystem UUIDs: map[4a30ed12-0651-48bc-9b86-b5b424c3196a:/dev/nvme0n1p4 54f52e7f-d40a-49ad-8b35-4128a00b0591:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 10 14:11:42.204890 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.204823    2545 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 14:11:42.207073 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.207053    2545 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 14:11:42.211838 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.211727    2545 manager.go:216] Machine: {Timestamp:2026-09-10 14:11:42.208616211 +0000 UTC m=+0.326157675 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3195245 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d06db90651ff93d0cf82d2becb8f1 SystemUUID:ec2d06db-9065-1ff9-3d0c-f82d2becb8f1 BootID:9979e9f9-ed5d-4e68-9b27-d047f65ed56a Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4f:90:7e:0a:a9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4f:90:7e:0a:a9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:63:de:f6:69:88 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 14:11:42.211838 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.211826    2545 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 14:11:42.211962 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.211900    2545 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 14:11:42.214728 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.214704    2545 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 14:11:42.214851 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.214731    2545 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-114.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 14:11:42.215962 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.215952    2545 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 14:11:42.216000 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.215965    2545 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 14:11:42.216000 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.215974    2545 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 14:11:42.216509 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.216500    2545 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 14:11:42.217649 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.217640    2545 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 14:11:42.220719 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.220709    2545 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 14:11:42.220829 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.220821    2545 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 14:11:42.220857 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.220848    2545 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 14:11:42.220883 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.220858    2545 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 14:11:42.220883 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.220873    2545 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 14:11:42.220883 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.220883    2545 kubelet.go:398] "Adding apiserver pod source"
Sep 10 14:11:42.220962 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.220892    2545 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 14:11:42.221268 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.221257    2545 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 14:11:42.221360 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.221275    2545 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 14:11:42.223102 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.223087    2545 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 14:11:42.225092 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.225076    2545 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 14:11:42.225166 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.225113    2545 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 14:11:42.225910 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.225897    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 14:11:42.225982 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.225919    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 14:11:42.225982 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.225928    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 14:11:42.225982 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.225937    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 14:11:42.225982 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.225949    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 14:11:42.225982 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.225958    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 14:11:42.225982 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.225977    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 14:11:42.225982 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.225985    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 14:11:42.226196 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.225994    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 14:11:42.226196 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.226003    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 14:11:42.226196 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.226022    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 14:11:42.226196 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.226031    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 14:11:42.226692 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.226682    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 14:11:42.226739 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.226695    2545 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 14:11:42.230206 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.230192    2545 server.go:1268] "Started kubelet"
Sep 10 14:11:42.230367 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.230298    2545 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 14:11:42.230427 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.230384    2545 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 14:11:42.230427 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.230367    2545 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 14:11:42.231154 ip-10-0-137-114 systemd[1]: Started Kubernetes Kubelet.
Sep 10 14:11:42.231799 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.231784    2545 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 14:11:42.231963 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:42.231948    2545 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-114.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 14:11:42.232304 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:42.232266    2545 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 14:11:42.232304 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.232327    2545 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-114.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 14:11:42.233056 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.233042    2545 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 14:11:42.235047 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.235034    2545 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 14:11:42.235115 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.235071    2545 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 14:11:42.235244 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:42.235225    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-114.ec2.internal\" not found"
Sep 10 14:11:42.235736 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.235612    2545 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 14:11:42.235736 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.235649    2545 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 14:11:42.235736 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.235661    2545 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 14:11:42.235916 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.235757    2545 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 14:11:42.235995 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.235985    2545 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 14:11:42.236064 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.235769    2545 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2rqj4"
Sep 10 14:11:42.236184 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:42.235081    2545 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-114.ec2.internal.18d3fb0b2204b3f0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-114.ec2.internal,UID:ip-10-0-137-114.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-114.ec2.internal,},FirstTimestamp:2026-09-10 14:11:42.230164464 +0000 UTC m=+0.347705929,LastTimestamp:2026-09-10 14:11:42.230164464 +0000 UTC m=+0.347705929,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-114.ec2.internal,}"
Sep 10 14:11:42.236725 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.236710    2545 factory.go:55] Registering systemd factory
Sep 10 14:11:42.236795 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.236749    2545 factory.go:223] Registration of the systemd container factory successfully
Sep 10 14:11:42.237002 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.236987    2545 factory.go:153] Registering CRI-O factory
Sep 10 14:11:42.237068 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.237004    2545 factory.go:223] Registration of the crio container factory successfully
Sep 10 14:11:42.237068 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.237050    2545 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 14:11:42.237068 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.237064    2545 factory.go:103] Registering Raw factory
Sep 10 14:11:42.237198 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.237075    2545 manager.go:1196] Started watching for new ooms in manager
Sep 10 14:11:42.237439 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.237425    2545 manager.go:349] Starting recovery of all containers
Sep 10 14:11:42.241200 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:42.241173    2545 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 14:11:42.241314 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:42.241291    2545 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-114.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 14:11:42.248404 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.248380    2545 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2rqj4"
Sep 10 14:11:42.251052 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.251035    2545 manager.go:354] Recovery completed
Sep 10 14:11:42.256197 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.256185    2545 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:11:42.258095 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.258080    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-114.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:11:42.258173 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.258111    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-114.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:11:42.258173 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.258125    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-114.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:11:42.258715 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.258692    2545 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 14:11:42.258715 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.258706    2545 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:11:42.258839 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.258707    2545 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 14:11:42.258839 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.258770    2545 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 14:11:42.259520 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.259471    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-114.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:11:42.259583 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.259523    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-114.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:11:42.259583 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.259537    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-114.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:11:42.259802 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.259790    2545 policy_none.go:49] "None policy: Start"
Sep 10 14:11:42.259850 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.259805    2545 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 14:11:42.259850 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.259815    2545 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 14:11:42.260357 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:42.260294    2545 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-114.ec2.internal.18d3fb0b23aee5d2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-114.ec2.internal,UID:ip-10-0-137-114.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-114.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-114.ec2.internal,},FirstTimestamp:2026-09-10 14:11:42.25809557 +0000 UTC m=+0.375637042,LastTimestamp:2026-09-10 14:11:42.25809557 +0000 UTC m=+0.375637042,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-114.ec2.internal,}"
Sep 10 14:11:42.260942 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.260928    2545 policy_none.go:47] "Start"
Sep 10 14:11:42.292109 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.292094    2545 manager.go:337] "Starting Device Plugin manager"
Sep 10 14:11:42.301324 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:42.292132    2545 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 14:11:42.301324 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.292146    2545 server.go:87] "Starting device plugin registration server"
Sep 10 14:11:42.301324 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.292465    2545 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 14:11:42.301324 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.292530    2545 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 14:11:42.301324 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.292623    2545 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 14:11:42.301324 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.292710    2545 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 14:11:42.301324 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.292721    2545 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 14:11:42.301324 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:42.293322    2545 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 14:11:42.301324 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:42.293370    2545 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-114.ec2.internal\" not found"
Sep 10 14:11:42.358242 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.358217    2545 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 14:11:42.359346 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.359317    2545 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 14:11:42.359450 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.359362    2545 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 14:11:42.359450 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.359393    2545 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 14:11:42.359450 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:42.359439    2545 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 14:11:42.361411 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.361389    2545 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 14:11:42.393014 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.392994    2545 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:11:42.393818 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.393802    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-114.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:11:42.393885 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.393832    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-114.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:11:42.393885 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.393848    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-114.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:11:42.393885 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.393879    2545 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-114.ec2.internal"
Sep 10 14:11:42.402920 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.402906    2545 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-114.ec2.internal"
Sep 10 14:11:42.402959 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:42.402926    2545 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-114.ec2.internal\": node \"ip-10-0-137-114.ec2.internal\" not found"
Sep 10 14:11:42.412623 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:42.412545    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-114.ec2.internal\" not found"
Sep 10 14:11:42.459939 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.459914    2545 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-114.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-114.ec2.internal"]
Sep 10 14:11:42.460038 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.459972    2545 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:11:42.461306 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.461286    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-114.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:11:42.461366 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.461314    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-114.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:11:42.461366 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.461325    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-114.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:11:42.462515 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.462501    2545 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:11:42.462584 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.462572    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-114.ec2.internal"
Sep 10 14:11:42.462628 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.462600    2545 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:11:42.463157 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.463142    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-114.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:11:42.463233 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.463168    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-114.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:11:42.463233 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.463177    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-114.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:11:42.463233 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.463144    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-114.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:11:42.463345 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.463244    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-114.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:11:42.463345 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.463254    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-114.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:11:42.464321 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.464306    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-114.ec2.internal"
Sep 10 14:11:42.464392 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.464329    2545 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:11:42.465013 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.464995    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-114.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:11:42.465084 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.465028    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-114.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:11:42.465084 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.465044    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-114.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:11:42.482021 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:42.482000    2545 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-114.ec2.internal\" not found" node="ip-10-0-137-114.ec2.internal"
Sep 10 14:11:42.485241 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:42.485225    2545 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-114.ec2.internal\" not found" node="ip-10-0-137-114.ec2.internal"
Sep 10 14:11:42.512898 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:42.512883    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-114.ec2.internal\" not found"
Sep 10 14:11:42.538155 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.538136    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7537e821eb6ad3512a374bb0ad165c12-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-114.ec2.internal\" (UID: \"7537e821eb6ad3512a374bb0ad165c12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-114.ec2.internal"
Sep 10 14:11:42.538208 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.538188    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7537e821eb6ad3512a374bb0ad165c12-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-114.ec2.internal\" (UID: \"7537e821eb6ad3512a374bb0ad165c12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-114.ec2.internal"
Sep 10 14:11:42.538244 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.538215    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/450be98a163c16e402ad994ce289c366-config\") pod \"kube-apiserver-proxy-ip-10-0-137-114.ec2.internal\" (UID: \"450be98a163c16e402ad994ce289c366\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-114.ec2.internal"
Sep 10 14:11:42.613465 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:42.613438    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-114.ec2.internal\" not found"
Sep 10 14:11:42.638880 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.638850    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7537e821eb6ad3512a374bb0ad165c12-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-114.ec2.internal\" (UID: \"7537e821eb6ad3512a374bb0ad165c12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-114.ec2.internal"
Sep 10 14:11:42.638942 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.638889    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/450be98a163c16e402ad994ce289c366-config\") pod \"kube-apiserver-proxy-ip-10-0-137-114.ec2.internal\" (UID: \"450be98a163c16e402ad994ce289c366\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-114.ec2.internal"
Sep 10 14:11:42.638942 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.638906    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7537e821eb6ad3512a374bb0ad165c12-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-114.ec2.internal\" (UID: \"7537e821eb6ad3512a374bb0ad165c12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-114.ec2.internal"
Sep 10 14:11:42.639006 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.638950    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7537e821eb6ad3512a374bb0ad165c12-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-114.ec2.internal\" (UID: \"7537e821eb6ad3512a374bb0ad165c12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-114.ec2.internal"
Sep 10 14:11:42.639037 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.639005    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7537e821eb6ad3512a374bb0ad165c12-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-114.ec2.internal\" (UID: \"7537e821eb6ad3512a374bb0ad165c12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-114.ec2.internal"
Sep 10 14:11:42.639037 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.639025    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/450be98a163c16e402ad994ce289c366-config\") pod \"kube-apiserver-proxy-ip-10-0-137-114.ec2.internal\" (UID: \"450be98a163c16e402ad994ce289c366\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-114.ec2.internal"
Sep 10 14:11:42.714103 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:42.714044    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-114.ec2.internal\" not found"
Sep 10 14:11:42.784659 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.784637    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-114.ec2.internal"
Sep 10 14:11:42.788455 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:42.788301    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-114.ec2.internal"
Sep 10 14:11:42.814740 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:42.814716    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-114.ec2.internal\" not found"
Sep 10 14:11:42.915213 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:42.915170    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-114.ec2.internal\" not found"
Sep 10 14:11:43.015724 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:43.015632    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-114.ec2.internal\" not found"
Sep 10 14:11:43.116691 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:43.116657    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-114.ec2.internal\" not found"
Sep 10 14:11:43.176995 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:43.176966    2545 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 14:11:43.177415 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:43.177111    2545 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 14:11:43.217709 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:43.217668    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-114.ec2.internal\" not found"
Sep 10 14:11:43.251177 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:43.251144    2545 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 14:06:42 +0000 UTC" deadline="2028-06-17 01:46:34.534200996 +0000 UTC"
Sep 10 14:11:43.251177 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:43.251171    2545 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15491h34m51.283033206s"
Sep 10 14:11:43.319721 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:43.319648    2545 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-114.ec2.internal\" not found"
Sep 10 14:11:43.334877 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:43.334839    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod450be98a163c16e402ad994ce289c366.slice/crio-6c21faf30ef2e103e5ac479e23bc67d3858bb4021563e3c99114418255192a5f WatchSource:0}: Error finding container 6c21faf30ef2e103e5ac479e23bc67d3858bb4021563e3c99114418255192a5f: Status 404 returned error can't find the container with id 6c21faf30ef2e103e5ac479e23bc67d3858bb4021563e3c99114418255192a5f
Sep 10 14:11:43.343685 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:43.343667    2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 14:11:43.362954 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:43.362916    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-114.ec2.internal" event={"ID":"450be98a163c16e402ad994ce289c366","Type":"ContainerStarted","Data":"6c21faf30ef2e103e5ac479e23bc67d3858bb4021563e3c99114418255192a5f"}
Sep 10 14:11:43.376262 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:43.376238    2545 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 14:11:43.435563 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:43.435537    2545 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-114.ec2.internal"
Sep 10 14:11:43.450242 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:43.450220    2545 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 14:11:43.452071 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:43.452057    2545 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-114.ec2.internal"
Sep 10 14:11:43.462925 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:43.462907    2545 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 14:11:43.518283 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:43.518262    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7537e821eb6ad3512a374bb0ad165c12.slice/crio-7fff4003db53ccd9df09ebbfce14e5607988ffcb9a2efc96a1c6ca9a5250212d WatchSource:0}: Error finding container 7fff4003db53ccd9df09ebbfce14e5607988ffcb9a2efc96a1c6ca9a5250212d: Status 404 returned error can't find the container with id 7fff4003db53ccd9df09ebbfce14e5607988ffcb9a2efc96a1c6ca9a5250212d
Sep 10 14:11:43.623484 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:43.623405    2545 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 14:11:43.807143 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:43.807115    2545 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 14:11:44.223216 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.223186    2545 apiserver.go:52] "Watching apiserver"
Sep 10 14:11:44.232847 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.232821    2545 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 14:11:44.233305 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.233273    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-fcvs7","kube-system/global-pull-secret-syncer-6rscd","kube-system/konnectivity-agent-7trgp","kube-system/kube-apiserver-proxy-ip-10-0-137-114.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5","openshift-dns/node-resolver-ff5pl","openshift-image-registry/node-ca-rw64n","openshift-multus/multus-additional-cni-plugins-n6dsj","openshift-multus/network-metrics-daemon-dzrg2","openshift-cluster-node-tuning-operator/tuned-6vk8h","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-114.ec2.internal","openshift-multus/multus-bx255","openshift-network-diagnostics/network-check-target-w6sct","openshift-network-operator/iptables-alerter-dxpkm"]
Sep 10 14:11:44.234827 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.234808    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.235846 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.235822    2545 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 14:11:44.236040 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.236020    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:11:44.236316 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:44.236089    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w6sct" podUID="721760bd-9049-4f00-999a-078410f3cd57"
Sep 10 14:11:44.237135 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.237109    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7trgp"
Sep 10 14:11:44.237638 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.237611    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 14:11:44.237638 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.237632    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fltsx\""
Sep 10 14:11:44.237794 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.237617    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 14:11:44.238412 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.238390    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dxpkm"
Sep 10 14:11:44.240090 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.239552    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5"
Sep 10 14:11:44.240090 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.239667    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 14:11:44.240090 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.239962    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cg8qz\""
Sep 10 14:11:44.240090 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.240025    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 14:11:44.240755 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.240738    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ff5pl"
Sep 10 14:11:44.241319 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.241298    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 14:11:44.241426 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.241357    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 14:11:44.241495 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.241304    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 14:11:44.241638 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.241586    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cm9gk\""
Sep 10 14:11:44.242236 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.242218    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:11:44.242325 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:44.242284    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzrg2" podUID="f60ac0b0-5ece-478d-855b-9ed8c8bff1d2"
Sep 10 14:11:44.242391 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.242369    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 14:11:44.242452 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.242390    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 14:11:44.242452 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.242420    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 14:11:44.242572 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.242480    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-d6wc2\""
Sep 10 14:11:44.243080 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.243061    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 14:11:44.243194 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.243178    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6l56n\""
Sep 10 14:11:44.243319 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.243302    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 14:11:44.244941 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.244922    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rw64n"
Sep 10 14:11:44.246329 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.246313    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:11:44.246456 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:44.246434    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rscd" podUID="c49d3edb-4324-4cce-aeb7-aa73eda47a3b"
Sep 10 14:11:44.248855 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.248020    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 14:11:44.248855 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.248127    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xpdmt\""
Sep 10 14:11:44.248855 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.248151    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 14:11:44.248855 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.248585    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.248855 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.248607    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 14:11:44.249134 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.248897    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-etc-sysctl-d\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.249134 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.248936    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-etc-sysctl-conf\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.249134 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.248971    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn4j7\" (UniqueName: \"kubernetes.io/projected/721760bd-9049-4f00-999a-078410f3cd57-kube-api-access-gn4j7\") pod \"network-check-target-w6sct\" (UID: \"721760bd-9049-4f00-999a-078410f3cd57\") " pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:11:44.249134 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.249026    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-etc-modprobe-d\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.249134 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.249064    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-etc-kubernetes\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.249134 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.249091    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-etc-systemd\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.249134 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.249133    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-host\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.249447 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.249165    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05b08d04-1103-43b7-9e1d-73ca022ac2cf-tmp\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.249447 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.249200    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcwjs\" (UniqueName: \"kubernetes.io/projected/05b08d04-1103-43b7-9e1d-73ca022ac2cf-kube-api-access-hcwjs\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.249447 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.249235    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-run\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.249447 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.249259    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-sys\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.249447 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.249295    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-lib-modules\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.249447 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.249330    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-var-lib-kubelet\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.249447 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.249365    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-etc-sysconfig\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.249447 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.249407    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/05b08d04-1103-43b7-9e1d-73ca022ac2cf-etc-tuned\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.251109 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.251087    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n6dsj"
Sep 10 14:11:44.252732 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.252713    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.254539 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.254520    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 14:11:44.254646 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.254546    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 14:11:44.254813 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.254798    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 14:11:44.255783 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.255767    2545 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 14:11:44.255854 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.255840    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5qvkw\""
Sep 10 14:11:44.255896 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.255878    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 14:11:44.255991 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.255946    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 14:11:44.256137 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.256065    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bjd7k\""
Sep 10 14:11:44.256249 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.256156    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 14:11:44.256249 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.256190    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 14:11:44.256249 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.256156    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 14:11:44.256249 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.256156    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 14:11:44.256249 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.256154    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 14:11:44.256514 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.256487    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 14:11:44.257139 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.257121    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2rfm4\""
Sep 10 14:11:44.257218 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.257189    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 14:11:44.279476 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.279440    2545 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 14:11:44.287001 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.286983    2545 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pkcsf"
Sep 10 14:11:44.296215 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.296195    2545 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pkcsf"
Sep 10 14:11:44.337331 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.337305    2545 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 14:11:44.349926 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.349895    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-var-lib-kubelet\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.350046 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.349937    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7df903b-495c-4ddd-ba58-7761a144535b-host-slash\") pod \"iptables-alerter-dxpkm\" (UID: \"a7df903b-495c-4ddd-ba58-7761a144535b\") " pod="openshift-network-operator/iptables-alerter-dxpkm"
Sep 10 14:11:44.350046 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.349960    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-host-cni-netd\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.350046 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.349983    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a7df903b-495c-4ddd-ba58-7761a144535b-iptables-alerter-script\") pod \"iptables-alerter-dxpkm\" (UID: \"a7df903b-495c-4ddd-ba58-7761a144535b\") " pod="openshift-network-operator/iptables-alerter-dxpkm"
Sep 10 14:11:44.350046 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350010    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-systemd-units\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.350046 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350035    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-run-openvswitch\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.350315 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350059    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-run-ovn\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.350315 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350088    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-host-run-ovn-kubernetes\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.350315 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350126    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c3c3e79-574d-4f59-ab18-d906e6480e94-cni-binary-copy\") pod \"multus-additional-cni-plugins-n6dsj\" (UID: \"8c3c3e79-574d-4f59-ab18-d906e6480e94\") " pod="openshift-multus/multus-additional-cni-plugins-n6dsj"
Sep 10 14:11:44.350315 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350151    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-host-var-lib-cni-multus\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.350315 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350229    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-hostroot\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.350315 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350260    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-var-lib-kubelet\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.350315 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350266    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dafee11e-f7e3-4bf6-a24e-75163cf24ef1-sys-fs\") pod \"aws-ebs-csi-driver-node-4mkq5\" (UID: \"dafee11e-f7e3-4bf6-a24e-75163cf24ef1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5"
Sep 10 14:11:44.350315 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350290    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-system-cni-dir\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.350744 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350315    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-cnibin\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.350744 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350344    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dafee11e-f7e3-4bf6-a24e-75163cf24ef1-etc-selinux\") pod \"aws-ebs-csi-driver-node-4mkq5\" (UID: \"dafee11e-f7e3-4bf6-a24e-75163cf24ef1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5"
Sep 10 14:11:44.350744 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350366    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/70bb7897-ea8f-4d68-adc1-53b35c76b9ae-agent-certs\") pod \"konnectivity-agent-7trgp\" (UID: \"70bb7897-ea8f-4d68-adc1-53b35c76b9ae\") " pod="kube-system/konnectivity-agent-7trgp"
Sep 10 14:11:44.350744 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350383    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/70bb7897-ea8f-4d68-adc1-53b35c76b9ae-konnectivity-ca\") pod \"konnectivity-agent-7trgp\" (UID: \"70bb7897-ea8f-4d68-adc1-53b35c76b9ae\") " pod="kube-system/konnectivity-agent-7trgp"
Sep 10 14:11:44.350744 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350403    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-host-kubelet\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.350744 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350421    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-node-log\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.350744 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350440    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-ovnkube-config\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.350744 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350478    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-var-lib-openvswitch\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.350744 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350524    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-lib-modules\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.350744 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350554    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dafee11e-f7e3-4bf6-a24e-75163cf24ef1-socket-dir\") pod \"aws-ebs-csi-driver-node-4mkq5\" (UID: \"dafee11e-f7e3-4bf6-a24e-75163cf24ef1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5"
Sep 10 14:11:44.350744 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350578    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c993b267-6073-47f0-8c82-3881b57d4bbd-cni-binary-copy\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.350744 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350602    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-host-run-k8s-cni-cncf-io\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.350744 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350628    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-etc-sysconfig\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.350744 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350650    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dafee11e-f7e3-4bf6-a24e-75163cf24ef1-registration-dir\") pod \"aws-ebs-csi-driver-node-4mkq5\" (UID: \"dafee11e-f7e3-4bf6-a24e-75163cf24ef1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5"
Sep 10 14:11:44.350744 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350672    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dafee11e-f7e3-4bf6-a24e-75163cf24ef1-device-dir\") pod \"aws-ebs-csi-driver-node-4mkq5\" (UID: \"dafee11e-f7e3-4bf6-a24e-75163cf24ef1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5"
Sep 10 14:11:44.350744 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350693    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c3c3e79-574d-4f59-ab18-d906e6480e94-cnibin\") pod \"multus-additional-cni-plugins-n6dsj\" (UID: \"8c3c3e79-574d-4f59-ab18-d906e6480e94\") " pod="openshift-multus/multus-additional-cni-plugins-n6dsj"
Sep 10 14:11:44.350744 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350708    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-etc-sysconfig\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.351524 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350713    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c3c3e79-574d-4f59-ab18-d906e6480e94-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n6dsj\" (UID: \"8c3c3e79-574d-4f59-ab18-d906e6480e94\") " pod="openshift-multus/multus-additional-cni-plugins-n6dsj"
Sep 10 14:11:44.351524 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350754    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-multus-cni-dir\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.351524 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350776    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-lib-modules\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.351524 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350780    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-etc-kubernetes\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.351524 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350822    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-etc-sysctl-conf\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.351524 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350858    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn4j7\" (UniqueName: \"kubernetes.io/projected/721760bd-9049-4f00-999a-078410f3cd57-kube-api-access-gn4j7\") pod \"network-check-target-w6sct\" (UID: \"721760bd-9049-4f00-999a-078410f3cd57\") " pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:11:44.351524 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350886    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5m8b\" (UniqueName: \"kubernetes.io/projected/a7df903b-495c-4ddd-ba58-7761a144535b-kube-api-access-z5m8b\") pod \"iptables-alerter-dxpkm\" (UID: \"a7df903b-495c-4ddd-ba58-7761a144535b\") " pod="openshift-network-operator/iptables-alerter-dxpkm"
Sep 10 14:11:44.351524 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350917    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.351524 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350961    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-ovnkube-script-lib\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.351524 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350980    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-multus-socket-dir-parent\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.351524 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.350997    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-host\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.351524 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351001    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-etc-sysctl-conf\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.351524 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351041    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxgdx\" (UniqueName: \"kubernetes.io/projected/370d222e-be9d-42d0-aa73-d9934e17cdfb-kube-api-access-wxgdx\") pod \"node-ca-rw64n\" (UID: \"370d222e-be9d-42d0-aa73-d9934e17cdfb\") " pod="openshift-image-registry/node-ca-rw64n"
Sep 10 14:11:44.351524 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351058    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-host\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.351524 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351072    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ea5e2be-249a-4829-8bad-e978cbdaf6fe-tmp-dir\") pod \"node-resolver-ff5pl\" (UID: \"0ea5e2be-249a-4829-8bad-e978cbdaf6fe\") " pod="openshift-dns/node-resolver-ff5pl"
Sep 10 14:11:44.351524 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351097    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-run-systemd\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.351524 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351131    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8c3c3e79-574d-4f59-ab18-d906e6480e94-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n6dsj\" (UID: \"8c3c3e79-574d-4f59-ab18-d906e6480e94\") " pod="openshift-multus/multus-additional-cni-plugins-n6dsj"
Sep 10 14:11:44.352349 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351157    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-multus-conf-dir\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.352349 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351179    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-env-overrides\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.352349 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351203    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-host-run-multus-certs\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.352349 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351258    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-etc-sysctl-d\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.352349 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351308    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-ovn-node-metrics-cert\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.352349 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351349    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvp4g\" (UniqueName: \"kubernetes.io/projected/8c3c3e79-574d-4f59-ab18-d906e6480e94-kube-api-access-wvp4g\") pod \"multus-additional-cni-plugins-n6dsj\" (UID: \"8c3c3e79-574d-4f59-ab18-d906e6480e94\") " pod="openshift-multus/multus-additional-cni-plugins-n6dsj"
Sep 10 14:11:44.352349 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351378    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-host-run-netns\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.352349 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351387    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-etc-sysctl-d\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.352349 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351406    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-etc-modprobe-d\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.352349 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351441    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-etc-systemd\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.352349 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351469    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05b08d04-1103-43b7-9e1d-73ca022ac2cf-tmp\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.352349 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351491    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-etc-modprobe-d\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.352349 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351520    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcwjs\" (UniqueName: \"kubernetes.io/projected/05b08d04-1103-43b7-9e1d-73ca022ac2cf-kube-api-access-hcwjs\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.352349 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351550    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-original-pull-secret\") pod \"global-pull-secret-syncer-6rscd\" (UID: \"c49d3edb-4324-4cce-aeb7-aa73eda47a3b\") " pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:11:44.352349 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351560    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-etc-systemd\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.352349 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351576    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-etc-openvswitch\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.352349 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351600    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-log-socket\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.353111 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351623    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-host-cni-bin\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.353111 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351648    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-run\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.353111 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351687    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-sys\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.353111 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351712    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl2zj\" (UniqueName: \"kubernetes.io/projected/dafee11e-f7e3-4bf6-a24e-75163cf24ef1-kube-api-access-xl2zj\") pod \"aws-ebs-csi-driver-node-4mkq5\" (UID: \"dafee11e-f7e3-4bf6-a24e-75163cf24ef1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5"
Sep 10 14:11:44.353111 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351738    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/370d222e-be9d-42d0-aa73-d9934e17cdfb-serviceca\") pod \"node-ca-rw64n\" (UID: \"370d222e-be9d-42d0-aa73-d9934e17cdfb\") " pod="openshift-image-registry/node-ca-rw64n"
Sep 10 14:11:44.353111 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351761    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ea5e2be-249a-4829-8bad-e978cbdaf6fe-hosts-file\") pod \"node-resolver-ff5pl\" (UID: \"0ea5e2be-249a-4829-8bad-e978cbdaf6fe\") " pod="openshift-dns/node-resolver-ff5pl"
Sep 10 14:11:44.353111 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351807    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-sys\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.353111 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.351818    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-run\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.353111 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.352236    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/05b08d04-1103-43b7-9e1d-73ca022ac2cf-etc-tuned\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.353111 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.352278    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dafee11e-f7e3-4bf6-a24e-75163cf24ef1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4mkq5\" (UID: \"dafee11e-f7e3-4bf6-a24e-75163cf24ef1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5"
Sep 10 14:11:44.353111 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.352306    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5sf6\" (UniqueName: \"kubernetes.io/projected/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-kube-api-access-z5sf6\") pod \"network-metrics-daemon-dzrg2\" (UID: \"f60ac0b0-5ece-478d-855b-9ed8c8bff1d2\") " pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:11:44.353111 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.352332    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-kubelet-config\") pod \"global-pull-secret-syncer-6rscd\" (UID: \"c49d3edb-4324-4cce-aeb7-aa73eda47a3b\") " pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:11:44.353111 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.352355    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-host-slash\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.353111 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.352384    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qdn9\" (UniqueName: \"kubernetes.io/projected/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-kube-api-access-6qdn9\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.353111 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.352448    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c3c3e79-574d-4f59-ab18-d906e6480e94-system-cni-dir\") pod \"multus-additional-cni-plugins-n6dsj\" (UID: \"8c3c3e79-574d-4f59-ab18-d906e6480e94\") " pod="openshift-multus/multus-additional-cni-plugins-n6dsj"
Sep 10 14:11:44.353111 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.352484    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs\") pod \"network-metrics-daemon-dzrg2\" (UID: \"f60ac0b0-5ece-478d-855b-9ed8c8bff1d2\") " pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:11:44.353111 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.352526    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/370d222e-be9d-42d0-aa73-d9934e17cdfb-host\") pod \"node-ca-rw64n\" (UID: \"370d222e-be9d-42d0-aa73-d9934e17cdfb\") " pod="openshift-image-registry/node-ca-rw64n"
Sep 10 14:11:44.354096 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.352550    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-dbus\") pod \"global-pull-secret-syncer-6rscd\" (UID: \"c49d3edb-4324-4cce-aeb7-aa73eda47a3b\") " pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:11:44.354096 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.352576    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8c3c3e79-574d-4f59-ab18-d906e6480e94-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n6dsj\" (UID: \"8c3c3e79-574d-4f59-ab18-d906e6480e94\") " pod="openshift-multus/multus-additional-cni-plugins-n6dsj"
Sep 10 14:11:44.354096 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.352604    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-host-var-lib-cni-bin\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.354096 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.352635    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-host-var-lib-kubelet\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.354096 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.352633    2545 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 14:11:44.354096 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.352664    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c993b267-6073-47f0-8c82-3881b57d4bbd-multus-daemon-config\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.354096 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.352707    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-etc-kubernetes\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.354096 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.352735    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncsg6\" (UniqueName: \"kubernetes.io/projected/0ea5e2be-249a-4829-8bad-e978cbdaf6fe-kube-api-access-ncsg6\") pod \"node-resolver-ff5pl\" (UID: \"0ea5e2be-249a-4829-8bad-e978cbdaf6fe\") " pod="openshift-dns/node-resolver-ff5pl"
Sep 10 14:11:44.354096 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.352753    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-host-run-netns\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.354096 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.352774    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46h92\" (UniqueName: \"kubernetes.io/projected/c993b267-6073-47f0-8c82-3881b57d4bbd-kube-api-access-46h92\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.354096 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.352871    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05b08d04-1103-43b7-9e1d-73ca022ac2cf-etc-kubernetes\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.356917 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.356894    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/05b08d04-1103-43b7-9e1d-73ca022ac2cf-etc-tuned\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.357079 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.357054    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05b08d04-1103-43b7-9e1d-73ca022ac2cf-tmp\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.357577 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:44.357542    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:11:44.357669 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:44.357583    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:11:44.357669 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:44.357598    2545 projected.go:196] Error preparing data for projected volume kube-api-access-gn4j7 for pod openshift-network-diagnostics/network-check-target-w6sct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:11:44.357669 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:44.357667    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/721760bd-9049-4f00-999a-078410f3cd57-kube-api-access-gn4j7 podName:721760bd-9049-4f00-999a-078410f3cd57 nodeName:}" failed. No retries permitted until 2026-09-10 14:11:44.857645883 +0000 UTC m=+2.975187358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gn4j7" (UniqueName: "kubernetes.io/projected/721760bd-9049-4f00-999a-078410f3cd57-kube-api-access-gn4j7") pod "network-check-target-w6sct" (UID: "721760bd-9049-4f00-999a-078410f3cd57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:11:44.363765 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.363743    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcwjs\" (UniqueName: \"kubernetes.io/projected/05b08d04-1103-43b7-9e1d-73ca022ac2cf-kube-api-access-hcwjs\") pod \"tuned-6vk8h\" (UID: \"05b08d04-1103-43b7-9e1d-73ca022ac2cf\") " pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.368628 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.367023    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-114.ec2.internal" event={"ID":"7537e821eb6ad3512a374bb0ad165c12","Type":"ContainerStarted","Data":"7fff4003db53ccd9df09ebbfce14e5607988ffcb9a2efc96a1c6ca9a5250212d"}
Sep 10 14:11:44.453719 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.453685    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-hostroot\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.453883 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.453729    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dafee11e-f7e3-4bf6-a24e-75163cf24ef1-sys-fs\") pod \"aws-ebs-csi-driver-node-4mkq5\" (UID: \"dafee11e-f7e3-4bf6-a24e-75163cf24ef1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5"
Sep 10 14:11:44.453883 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.453750    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-system-cni-dir\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.453883 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.453766    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-cnibin\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.453883 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.453788    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dafee11e-f7e3-4bf6-a24e-75163cf24ef1-etc-selinux\") pod \"aws-ebs-csi-driver-node-4mkq5\" (UID: \"dafee11e-f7e3-4bf6-a24e-75163cf24ef1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5"
Sep 10 14:11:44.453883 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.453817    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-hostroot\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.453883 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.453834    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/70bb7897-ea8f-4d68-adc1-53b35c76b9ae-agent-certs\") pod \"konnectivity-agent-7trgp\" (UID: \"70bb7897-ea8f-4d68-adc1-53b35c76b9ae\") " pod="kube-system/konnectivity-agent-7trgp"
Sep 10 14:11:44.453883 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.453868    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-cnibin\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.453883 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.453880    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/70bb7897-ea8f-4d68-adc1-53b35c76b9ae-konnectivity-ca\") pod \"konnectivity-agent-7trgp\" (UID: \"70bb7897-ea8f-4d68-adc1-53b35c76b9ae\") " pod="kube-system/konnectivity-agent-7trgp"
Sep 10 14:11:44.453883 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.453889    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dafee11e-f7e3-4bf6-a24e-75163cf24ef1-etc-selinux\") pod \"aws-ebs-csi-driver-node-4mkq5\" (UID: \"dafee11e-f7e3-4bf6-a24e-75163cf24ef1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5"
Sep 10 14:11:44.454365 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.453890    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dafee11e-f7e3-4bf6-a24e-75163cf24ef1-sys-fs\") pod \"aws-ebs-csi-driver-node-4mkq5\" (UID: \"dafee11e-f7e3-4bf6-a24e-75163cf24ef1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5"
Sep 10 14:11:44.454365 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.453919    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-host-kubelet\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.454365 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.453929    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-system-cni-dir\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.454365 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.453939    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-node-log\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.454365 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.453956    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-host-kubelet\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.454365 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.453956    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-ovnkube-config\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.454365 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.453981    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-var-lib-openvswitch\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.454365 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454002    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dafee11e-f7e3-4bf6-a24e-75163cf24ef1-socket-dir\") pod \"aws-ebs-csi-driver-node-4mkq5\" (UID: \"dafee11e-f7e3-4bf6-a24e-75163cf24ef1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5"
Sep 10 14:11:44.454365 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454025    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c993b267-6073-47f0-8c82-3881b57d4bbd-cni-binary-copy\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.454365 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454052    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-host-run-k8s-cni-cncf-io\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.454365 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454042    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-node-log\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.454365 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454057    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-var-lib-openvswitch\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.454365 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454077    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dafee11e-f7e3-4bf6-a24e-75163cf24ef1-registration-dir\") pod \"aws-ebs-csi-driver-node-4mkq5\" (UID: \"dafee11e-f7e3-4bf6-a24e-75163cf24ef1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5"
Sep 10 14:11:44.454365 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454121    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dafee11e-f7e3-4bf6-a24e-75163cf24ef1-registration-dir\") pod \"aws-ebs-csi-driver-node-4mkq5\" (UID: \"dafee11e-f7e3-4bf6-a24e-75163cf24ef1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5"
Sep 10 14:11:44.454365 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454120    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dafee11e-f7e3-4bf6-a24e-75163cf24ef1-device-dir\") pod \"aws-ebs-csi-driver-node-4mkq5\" (UID: \"dafee11e-f7e3-4bf6-a24e-75163cf24ef1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5"
Sep 10 14:11:44.454365 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454162    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c3c3e79-574d-4f59-ab18-d906e6480e94-cnibin\") pod \"multus-additional-cni-plugins-n6dsj\" (UID: \"8c3c3e79-574d-4f59-ab18-d906e6480e94\") " pod="openshift-multus/multus-additional-cni-plugins-n6dsj"
Sep 10 14:11:44.454365 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454172    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dafee11e-f7e3-4bf6-a24e-75163cf24ef1-socket-dir\") pod \"aws-ebs-csi-driver-node-4mkq5\" (UID: \"dafee11e-f7e3-4bf6-a24e-75163cf24ef1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5"
Sep 10 14:11:44.455228 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454163    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dafee11e-f7e3-4bf6-a24e-75163cf24ef1-device-dir\") pod \"aws-ebs-csi-driver-node-4mkq5\" (UID: \"dafee11e-f7e3-4bf6-a24e-75163cf24ef1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5"
Sep 10 14:11:44.455228 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454190    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c3c3e79-574d-4f59-ab18-d906e6480e94-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n6dsj\" (UID: \"8c3c3e79-574d-4f59-ab18-d906e6480e94\") " pod="openshift-multus/multus-additional-cni-plugins-n6dsj"
Sep 10 14:11:44.455228 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454217    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-multus-cni-dir\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.455228 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454221    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c3c3e79-574d-4f59-ab18-d906e6480e94-cnibin\") pod \"multus-additional-cni-plugins-n6dsj\" (UID: \"8c3c3e79-574d-4f59-ab18-d906e6480e94\") " pod="openshift-multus/multus-additional-cni-plugins-n6dsj"
Sep 10 14:11:44.455228 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454223    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-host-run-k8s-cni-cncf-io\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.455228 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454345    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-multus-cni-dir\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.455228 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454384    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-etc-kubernetes\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.455228 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454405    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c3c3e79-574d-4f59-ab18-d906e6480e94-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n6dsj\" (UID: \"8c3c3e79-574d-4f59-ab18-d906e6480e94\") " pod="openshift-multus/multus-additional-cni-plugins-n6dsj"
Sep 10 14:11:44.455228 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454449    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5m8b\" (UniqueName: \"kubernetes.io/projected/a7df903b-495c-4ddd-ba58-7761a144535b-kube-api-access-z5m8b\") pod \"iptables-alerter-dxpkm\" (UID: \"a7df903b-495c-4ddd-ba58-7761a144535b\") " pod="openshift-network-operator/iptables-alerter-dxpkm"
Sep 10 14:11:44.455228 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454466    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-etc-kubernetes\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.455228 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454476    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.455228 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454501    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-ovnkube-script-lib\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.455228 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454526    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-multus-socket-dir-parent\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.455228 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454552    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-ovnkube-config\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.455228 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454574    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/70bb7897-ea8f-4d68-adc1-53b35c76b9ae-konnectivity-ca\") pod \"konnectivity-agent-7trgp\" (UID: \"70bb7897-ea8f-4d68-adc1-53b35c76b9ae\") " pod="kube-system/konnectivity-agent-7trgp"
Sep 10 14:11:44.455228 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454559    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxgdx\" (UniqueName: \"kubernetes.io/projected/370d222e-be9d-42d0-aa73-d9934e17cdfb-kube-api-access-wxgdx\") pod \"node-ca-rw64n\" (UID: \"370d222e-be9d-42d0-aa73-d9934e17cdfb\") " pod="openshift-image-registry/node-ca-rw64n"
Sep 10 14:11:44.455228 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454574    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.456058 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454635    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-multus-socket-dir-parent\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.456058 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454667    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ea5e2be-249a-4829-8bad-e978cbdaf6fe-tmp-dir\") pod \"node-resolver-ff5pl\" (UID: \"0ea5e2be-249a-4829-8bad-e978cbdaf6fe\") " pod="openshift-dns/node-resolver-ff5pl"
Sep 10 14:11:44.456058 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454693    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-run-systemd\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.456058 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454720    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8c3c3e79-574d-4f59-ab18-d906e6480e94-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n6dsj\" (UID: \"8c3c3e79-574d-4f59-ab18-d906e6480e94\") " pod="openshift-multus/multus-additional-cni-plugins-n6dsj"
Sep 10 14:11:44.456058 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454747    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-multus-conf-dir\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.456058 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454770    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-env-overrides\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.456058 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454795    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-host-run-multus-certs\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.456058 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454826    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-ovn-node-metrics-cert\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.456058 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454833    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-multus-conf-dir\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.456058 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454853    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvp4g\" (UniqueName: \"kubernetes.io/projected/8c3c3e79-574d-4f59-ab18-d906e6480e94-kube-api-access-wvp4g\") pod \"multus-additional-cni-plugins-n6dsj\" (UID: \"8c3c3e79-574d-4f59-ab18-d906e6480e94\") " pod="openshift-multus/multus-additional-cni-plugins-n6dsj"
Sep 10 14:11:44.456058 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454880    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-host-run-netns\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.456058 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454909    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-original-pull-secret\") pod \"global-pull-secret-syncer-6rscd\" (UID: \"c49d3edb-4324-4cce-aeb7-aa73eda47a3b\") " pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:11:44.456058 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454933    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-etc-openvswitch\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.456058 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454960    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-log-socket\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.456058 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454957    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-run-systemd\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.456058 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454986    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-host-cni-bin\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.456058 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455042    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-host-cni-bin\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.456058 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455059    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ea5e2be-249a-4829-8bad-e978cbdaf6fe-tmp-dir\") pod \"node-resolver-ff5pl\" (UID: \"0ea5e2be-249a-4829-8bad-e978cbdaf6fe\") " pod="openshift-dns/node-resolver-ff5pl"
Sep 10 14:11:44.457027 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455086    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-host-run-netns\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.457027 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455122    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-host-run-multus-certs\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.457027 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455155    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-ovnkube-script-lib\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.457027 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.454796    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c993b267-6073-47f0-8c82-3881b57d4bbd-cni-binary-copy\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.457027 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:44.455179    2545 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:11:44.457027 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455210    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl2zj\" (UniqueName: \"kubernetes.io/projected/dafee11e-f7e3-4bf6-a24e-75163cf24ef1-kube-api-access-xl2zj\") pod \"aws-ebs-csi-driver-node-4mkq5\" (UID: \"dafee11e-f7e3-4bf6-a24e-75163cf24ef1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5"
Sep 10 14:11:44.457027 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:44.455230    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-original-pull-secret podName:c49d3edb-4324-4cce-aeb7-aa73eda47a3b nodeName:}" failed. No retries permitted until 2026-09-10 14:11:44.955217649 +0000 UTC m=+3.072759107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-original-pull-secret") pod "global-pull-secret-syncer-6rscd" (UID: "c49d3edb-4324-4cce-aeb7-aa73eda47a3b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:11:44.457027 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455247    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/370d222e-be9d-42d0-aa73-d9934e17cdfb-serviceca\") pod \"node-ca-rw64n\" (UID: \"370d222e-be9d-42d0-aa73-d9934e17cdfb\") " pod="openshift-image-registry/node-ca-rw64n"
Sep 10 14:11:44.457027 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455262    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ea5e2be-249a-4829-8bad-e978cbdaf6fe-hosts-file\") pod \"node-resolver-ff5pl\" (UID: \"0ea5e2be-249a-4829-8bad-e978cbdaf6fe\") " pod="openshift-dns/node-resolver-ff5pl"
Sep 10 14:11:44.457027 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455278    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dafee11e-f7e3-4bf6-a24e-75163cf24ef1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4mkq5\" (UID: \"dafee11e-f7e3-4bf6-a24e-75163cf24ef1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5"
Sep 10 14:11:44.457027 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455296    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5sf6\" (UniqueName: \"kubernetes.io/projected/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-kube-api-access-z5sf6\") pod \"network-metrics-daemon-dzrg2\" (UID: \"f60ac0b0-5ece-478d-855b-9ed8c8bff1d2\") " pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:11:44.457027 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455317    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-kubelet-config\") pod \"global-pull-secret-syncer-6rscd\" (UID: \"c49d3edb-4324-4cce-aeb7-aa73eda47a3b\") " pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:11:44.457027 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455331    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-host-slash\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.457027 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455348    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qdn9\" (UniqueName: \"kubernetes.io/projected/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-kube-api-access-6qdn9\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.457027 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455362    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c3c3e79-574d-4f59-ab18-d906e6480e94-system-cni-dir\") pod \"multus-additional-cni-plugins-n6dsj\" (UID: \"8c3c3e79-574d-4f59-ab18-d906e6480e94\") " pod="openshift-multus/multus-additional-cni-plugins-n6dsj"
Sep 10 14:11:44.457027 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455380    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs\") pod \"network-metrics-daemon-dzrg2\" (UID: \"f60ac0b0-5ece-478d-855b-9ed8c8bff1d2\") " pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:11:44.457027 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455380    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ea5e2be-249a-4829-8bad-e978cbdaf6fe-hosts-file\") pod \"node-resolver-ff5pl\" (UID: \"0ea5e2be-249a-4829-8bad-e978cbdaf6fe\") " pod="openshift-dns/node-resolver-ff5pl"
Sep 10 14:11:44.457773 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455404    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-etc-openvswitch\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.457773 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455422    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dafee11e-f7e3-4bf6-a24e-75163cf24ef1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4mkq5\" (UID: \"dafee11e-f7e3-4bf6-a24e-75163cf24ef1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5"
Sep 10 14:11:44.457773 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455428    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/370d222e-be9d-42d0-aa73-d9934e17cdfb-host\") pod \"node-ca-rw64n\" (UID: \"370d222e-be9d-42d0-aa73-d9934e17cdfb\") " pod="openshift-image-registry/node-ca-rw64n"
Sep 10 14:11:44.457773 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455452    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-dbus\") pod \"global-pull-secret-syncer-6rscd\" (UID: \"c49d3edb-4324-4cce-aeb7-aa73eda47a3b\") " pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:11:44.457773 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455465    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-env-overrides\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.457773 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455470    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8c3c3e79-574d-4f59-ab18-d906e6480e94-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n6dsj\" (UID: \"8c3c3e79-574d-4f59-ab18-d906e6480e94\") " pod="openshift-multus/multus-additional-cni-plugins-n6dsj"
Sep 10 14:11:44.457773 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455522    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-host-var-lib-cni-bin\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.457773 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455546    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-host-var-lib-kubelet\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.457773 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455593    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c993b267-6073-47f0-8c82-3881b57d4bbd-multus-daemon-config\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.457773 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455603    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-host-slash\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.457773 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455625    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncsg6\" (UniqueName: \"kubernetes.io/projected/0ea5e2be-249a-4829-8bad-e978cbdaf6fe-kube-api-access-ncsg6\") pod \"node-resolver-ff5pl\" (UID: \"0ea5e2be-249a-4829-8bad-e978cbdaf6fe\") " pod="openshift-dns/node-resolver-ff5pl"
Sep 10 14:11:44.457773 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455646    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-host-run-netns\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.457773 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455677    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46h92\" (UniqueName: \"kubernetes.io/projected/c993b267-6073-47f0-8c82-3881b57d4bbd-kube-api-access-46h92\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.457773 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455707    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7df903b-495c-4ddd-ba58-7761a144535b-host-slash\") pod \"iptables-alerter-dxpkm\" (UID: \"a7df903b-495c-4ddd-ba58-7761a144535b\") " pod="openshift-network-operator/iptables-alerter-dxpkm"
Sep 10 14:11:44.457773 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455732    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-host-cni-netd\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.457773 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455758    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a7df903b-495c-4ddd-ba58-7761a144535b-iptables-alerter-script\") pod \"iptables-alerter-dxpkm\" (UID: \"a7df903b-495c-4ddd-ba58-7761a144535b\") " pod="openshift-network-operator/iptables-alerter-dxpkm"
Sep 10 14:11:44.457773 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455783    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-systemd-units\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.458489 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455807    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-run-openvswitch\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.458489 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455832    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-run-ovn\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.458489 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455857    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-host-run-ovn-kubernetes\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.458489 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455882    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c3c3e79-574d-4f59-ab18-d906e6480e94-cni-binary-copy\") pod \"multus-additional-cni-plugins-n6dsj\" (UID: \"8c3c3e79-574d-4f59-ab18-d906e6480e94\") " pod="openshift-multus/multus-additional-cni-plugins-n6dsj"
Sep 10 14:11:44.458489 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455912    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-host-var-lib-cni-multus\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.458489 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455962    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8c3c3e79-574d-4f59-ab18-d906e6480e94-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n6dsj\" (UID: \"8c3c3e79-574d-4f59-ab18-d906e6480e94\") " pod="openshift-multus/multus-additional-cni-plugins-n6dsj"
Sep 10 14:11:44.458489 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.455986    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-host-var-lib-cni-multus\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.458489 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.456030    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-log-socket\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.458489 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.456056    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c993b267-6073-47f0-8c82-3881b57d4bbd-multus-daemon-config\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.458489 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.456119    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-host-var-lib-cni-bin\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.458489 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.456163    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c993b267-6073-47f0-8c82-3881b57d4bbd-host-var-lib-kubelet\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.458489 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.456220    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-kubelet-config\") pod \"global-pull-secret-syncer-6rscd\" (UID: \"c49d3edb-4324-4cce-aeb7-aa73eda47a3b\") " pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:11:44.458489 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.456274    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c3c3e79-574d-4f59-ab18-d906e6480e94-system-cni-dir\") pod \"multus-additional-cni-plugins-n6dsj\" (UID: \"8c3c3e79-574d-4f59-ab18-d906e6480e94\") " pod="openshift-multus/multus-additional-cni-plugins-n6dsj"
Sep 10 14:11:44.458489 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:44.456315    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:11:44.458489 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.456324    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-host-cni-netd\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.458489 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:44.456380    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs podName:f60ac0b0-5ece-478d-855b-9ed8c8bff1d2 nodeName:}" failed. No retries permitted until 2026-09-10 14:11:44.956360712 +0000 UTC m=+3.073902181 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs") pod "network-metrics-daemon-dzrg2" (UID: "f60ac0b0-5ece-478d-855b-9ed8c8bff1d2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:11:44.458489 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.456408    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8c3c3e79-574d-4f59-ab18-d906e6480e94-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n6dsj\" (UID: \"8c3c3e79-574d-4f59-ab18-d906e6480e94\") " pod="openshift-multus/multus-additional-cni-plugins-n6dsj"
Sep 10 14:11:44.459171 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.456474    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-run-ovn\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.459171 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.456520    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-systemd-units\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.459171 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.456555    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/370d222e-be9d-42d0-aa73-d9934e17cdfb-serviceca\") pod \"node-ca-rw64n\" (UID: \"370d222e-be9d-42d0-aa73-d9934e17cdfb\") " pod="openshift-image-registry/node-ca-rw64n"
Sep 10 14:11:44.459171 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.456585    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-run-openvswitch\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.459171 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.456628    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/370d222e-be9d-42d0-aa73-d9934e17cdfb-host\") pod \"node-ca-rw64n\" (UID: \"370d222e-be9d-42d0-aa73-d9934e17cdfb\") " pod="openshift-image-registry/node-ca-rw64n"
Sep 10 14:11:44.459171 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.456629    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-host-run-netns\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.459171 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.456642    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-dbus\") pod \"global-pull-secret-syncer-6rscd\" (UID: \"c49d3edb-4324-4cce-aeb7-aa73eda47a3b\") " pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:11:44.459171 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.456702    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-host-run-ovn-kubernetes\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.459171 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.456703    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7df903b-495c-4ddd-ba58-7761a144535b-host-slash\") pod \"iptables-alerter-dxpkm\" (UID: \"a7df903b-495c-4ddd-ba58-7761a144535b\") " pod="openshift-network-operator/iptables-alerter-dxpkm"
Sep 10 14:11:44.459171 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.456858    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a7df903b-495c-4ddd-ba58-7761a144535b-iptables-alerter-script\") pod \"iptables-alerter-dxpkm\" (UID: \"a7df903b-495c-4ddd-ba58-7761a144535b\") " pod="openshift-network-operator/iptables-alerter-dxpkm"
Sep 10 14:11:44.459171 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.457186    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c3c3e79-574d-4f59-ab18-d906e6480e94-cni-binary-copy\") pod \"multus-additional-cni-plugins-n6dsj\" (UID: \"8c3c3e79-574d-4f59-ab18-d906e6480e94\") " pod="openshift-multus/multus-additional-cni-plugins-n6dsj"
Sep 10 14:11:44.459171 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.457524    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/70bb7897-ea8f-4d68-adc1-53b35c76b9ae-agent-certs\") pod \"konnectivity-agent-7trgp\" (UID: \"70bb7897-ea8f-4d68-adc1-53b35c76b9ae\") " pod="kube-system/konnectivity-agent-7trgp"
Sep 10 14:11:44.459171 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.458212    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-ovn-node-metrics-cert\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.464086 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.464061    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvp4g\" (UniqueName: \"kubernetes.io/projected/8c3c3e79-574d-4f59-ab18-d906e6480e94-kube-api-access-wvp4g\") pod \"multus-additional-cni-plugins-n6dsj\" (UID: \"8c3c3e79-574d-4f59-ab18-d906e6480e94\") " pod="openshift-multus/multus-additional-cni-plugins-n6dsj"
Sep 10 14:11:44.464421 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.464399    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl2zj\" (UniqueName: \"kubernetes.io/projected/dafee11e-f7e3-4bf6-a24e-75163cf24ef1-kube-api-access-xl2zj\") pod \"aws-ebs-csi-driver-node-4mkq5\" (UID: \"dafee11e-f7e3-4bf6-a24e-75163cf24ef1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5"
Sep 10 14:11:44.464853 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.464830    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxgdx\" (UniqueName: \"kubernetes.io/projected/370d222e-be9d-42d0-aa73-d9934e17cdfb-kube-api-access-wxgdx\") pod \"node-ca-rw64n\" (UID: \"370d222e-be9d-42d0-aa73-d9934e17cdfb\") " pod="openshift-image-registry/node-ca-rw64n"
Sep 10 14:11:44.464986 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.464833    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5m8b\" (UniqueName: \"kubernetes.io/projected/a7df903b-495c-4ddd-ba58-7761a144535b-kube-api-access-z5m8b\") pod \"iptables-alerter-dxpkm\" (UID: \"a7df903b-495c-4ddd-ba58-7761a144535b\") " pod="openshift-network-operator/iptables-alerter-dxpkm"
Sep 10 14:11:44.466209 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.466190    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5sf6\" (UniqueName: \"kubernetes.io/projected/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-kube-api-access-z5sf6\") pod \"network-metrics-daemon-dzrg2\" (UID: \"f60ac0b0-5ece-478d-855b-9ed8c8bff1d2\") " pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:11:44.467530 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.467508    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qdn9\" (UniqueName: \"kubernetes.io/projected/db1cf9fc-221c-4c0e-a26e-6188c2339bd5-kube-api-access-6qdn9\") pod \"ovnkube-node-fcvs7\" (UID: \"db1cf9fc-221c-4c0e-a26e-6188c2339bd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.471674 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.471533    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncsg6\" (UniqueName: \"kubernetes.io/projected/0ea5e2be-249a-4829-8bad-e978cbdaf6fe-kube-api-access-ncsg6\") pod \"node-resolver-ff5pl\" (UID: \"0ea5e2be-249a-4829-8bad-e978cbdaf6fe\") " pod="openshift-dns/node-resolver-ff5pl"
Sep 10 14:11:44.471805 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.471788    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46h92\" (UniqueName: \"kubernetes.io/projected/c993b267-6073-47f0-8c82-3881b57d4bbd-kube-api-access-46h92\") pod \"multus-bx255\" (UID: \"c993b267-6073-47f0-8c82-3881b57d4bbd\") " pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.548225 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.548148    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6vk8h"
Sep 10 14:11:44.554482 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.554454    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7trgp"
Sep 10 14:11:44.560699 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:44.560674    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b08d04_1103_43b7_9e1d_73ca022ac2cf.slice/crio-94ed78576b422ae8ee74e7b0acaca271512d0de33738ad31c1cefb4050b9e678 WatchSource:0}: Error finding container 94ed78576b422ae8ee74e7b0acaca271512d0de33738ad31c1cefb4050b9e678: Status 404 returned error can't find the container with id 94ed78576b422ae8ee74e7b0acaca271512d0de33738ad31c1cefb4050b9e678
Sep 10 14:11:44.562324 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.562299    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dxpkm"
Sep 10 14:11:44.568180 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.568155    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5"
Sep 10 14:11:44.572867 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:44.572843    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7df903b_495c_4ddd_ba58_7761a144535b.slice/crio-b5dc99df297cafe06501f28b10b3672ae8431b19355bf762bc498125465a5842 WatchSource:0}: Error finding container b5dc99df297cafe06501f28b10b3672ae8431b19355bf762bc498125465a5842: Status 404 returned error can't find the container with id b5dc99df297cafe06501f28b10b3672ae8431b19355bf762bc498125465a5842
Sep 10 14:11:44.575660 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.575611    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ff5pl"
Sep 10 14:11:44.582209 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.582191    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rw64n"
Sep 10 14:11:44.585514 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:44.585488    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ea5e2be_249a_4829_8bad_e978cbdaf6fe.slice/crio-f2736587bf77d37f7ed1065d1e9ea088bfb59d50715313a4714e8db5d6f3b76e WatchSource:0}: Error finding container f2736587bf77d37f7ed1065d1e9ea088bfb59d50715313a4714e8db5d6f3b76e: Status 404 returned error can't find the container with id f2736587bf77d37f7ed1065d1e9ea088bfb59d50715313a4714e8db5d6f3b76e
Sep 10 14:11:44.589187 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.589165    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:11:44.590834 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:44.590808    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod370d222e_be9d_42d0_aa73_d9934e17cdfb.slice/crio-965ff42bacf9a81c94d0d786c8bb1ef64ab1583c39062183cd26c28821efec0e WatchSource:0}: Error finding container 965ff42bacf9a81c94d0d786c8bb1ef64ab1583c39062183cd26c28821efec0e: Status 404 returned error can't find the container with id 965ff42bacf9a81c94d0d786c8bb1ef64ab1583c39062183cd26c28821efec0e
Sep 10 14:11:44.597423 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.597374    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n6dsj"
Sep 10 14:11:44.599638 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:44.599619    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1cf9fc_221c_4c0e_a26e_6188c2339bd5.slice/crio-2105eeb467e2fbebbdb073319000e7be26c987af9935816643213552948447fb WatchSource:0}: Error finding container 2105eeb467e2fbebbdb073319000e7be26c987af9935816643213552948447fb: Status 404 returned error can't find the container with id 2105eeb467e2fbebbdb073319000e7be26c987af9935816643213552948447fb
Sep 10 14:11:44.602045 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.602014    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bx255"
Sep 10 14:11:44.610300 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:44.610274    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c3c3e79_574d_4f59_ab18_d906e6480e94.slice/crio-99f143c104f1bb5abb476678ad13fc278701e2fa5a2c11d18c2e85601e2860a4 WatchSource:0}: Error finding container 99f143c104f1bb5abb476678ad13fc278701e2fa5a2c11d18c2e85601e2860a4: Status 404 returned error can't find the container with id 99f143c104f1bb5abb476678ad13fc278701e2fa5a2c11d18c2e85601e2860a4
Sep 10 14:11:44.614270 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:11:44.614249    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc993b267_6073_47f0_8c82_3881b57d4bbd.slice/crio-aea55fed239c2135a10ea1c0ede63b31ee3cc980c786d3d291ec93bc400dc86d WatchSource:0}: Error finding container aea55fed239c2135a10ea1c0ede63b31ee3cc980c786d3d291ec93bc400dc86d: Status 404 returned error can't find the container with id aea55fed239c2135a10ea1c0ede63b31ee3cc980c786d3d291ec93bc400dc86d
Sep 10 14:11:44.859226 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.859143    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn4j7\" (UniqueName: \"kubernetes.io/projected/721760bd-9049-4f00-999a-078410f3cd57-kube-api-access-gn4j7\") pod \"network-check-target-w6sct\" (UID: \"721760bd-9049-4f00-999a-078410f3cd57\") " pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:11:44.859395 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:44.859294    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:11:44.859395 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:44.859315    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:11:44.859395 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:44.859325    2545 projected.go:196] Error preparing data for projected volume kube-api-access-gn4j7 for pod openshift-network-diagnostics/network-check-target-w6sct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:11:44.859395 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:44.859383    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/721760bd-9049-4f00-999a-078410f3cd57-kube-api-access-gn4j7 podName:721760bd-9049-4f00-999a-078410f3cd57 nodeName:}" failed. No retries permitted until 2026-09-10 14:11:45.859362566 +0000 UTC m=+3.976904028 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gn4j7" (UniqueName: "kubernetes.io/projected/721760bd-9049-4f00-999a-078410f3cd57-kube-api-access-gn4j7") pod "network-check-target-w6sct" (UID: "721760bd-9049-4f00-999a-078410f3cd57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:11:44.959936 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.959901    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs\") pod \"network-metrics-daemon-dzrg2\" (UID: \"f60ac0b0-5ece-478d-855b-9ed8c8bff1d2\") " pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:11:44.960118 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:44.959986    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-original-pull-secret\") pod \"global-pull-secret-syncer-6rscd\" (UID: \"c49d3edb-4324-4cce-aeb7-aa73eda47a3b\") " pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:11:44.960118 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:44.960083    2545 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:11:44.960215 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:44.960148    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-original-pull-secret podName:c49d3edb-4324-4cce-aeb7-aa73eda47a3b nodeName:}" failed. No retries permitted until 2026-09-10 14:11:45.960135605 +0000 UTC m=+4.077677064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-original-pull-secret") pod "global-pull-secret-syncer-6rscd" (UID: "c49d3edb-4324-4cce-aeb7-aa73eda47a3b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:11:44.960215 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:44.960083    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:11:44.960370 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:44.960244    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs podName:f60ac0b0-5ece-478d-855b-9ed8c8bff1d2 nodeName:}" failed. No retries permitted until 2026-09-10 14:11:45.960226761 +0000 UTC m=+4.077768215 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs") pod "network-metrics-daemon-dzrg2" (UID: "f60ac0b0-5ece-478d-855b-9ed8c8bff1d2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:11:45.299017 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:45.298896    2545 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 14:06:44 +0000 UTC" deadline="2028-06-27 23:50:35.660114352 +0000 UTC"
Sep 10 14:11:45.299017 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:45.298961    2545 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15753h38m50.361156158s"
Sep 10 14:11:45.359994 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:45.359770    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:11:45.359994 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:45.359908    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzrg2" podUID="f60ac0b0-5ece-478d-855b-9ed8c8bff1d2"
Sep 10 14:11:45.370795 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:45.370732    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bx255" event={"ID":"c993b267-6073-47f0-8c82-3881b57d4bbd","Type":"ContainerStarted","Data":"aea55fed239c2135a10ea1c0ede63b31ee3cc980c786d3d291ec93bc400dc86d"}
Sep 10 14:11:45.372113 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:45.372069    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6dsj" event={"ID":"8c3c3e79-574d-4f59-ab18-d906e6480e94","Type":"ContainerStarted","Data":"99f143c104f1bb5abb476678ad13fc278701e2fa5a2c11d18c2e85601e2860a4"}
Sep 10 14:11:45.373481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:45.373455    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7" event={"ID":"db1cf9fc-221c-4c0e-a26e-6188c2339bd5","Type":"ContainerStarted","Data":"2105eeb467e2fbebbdb073319000e7be26c987af9935816643213552948447fb"}
Sep 10 14:11:45.374858 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:45.374828    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ff5pl" event={"ID":"0ea5e2be-249a-4829-8bad-e978cbdaf6fe","Type":"ContainerStarted","Data":"f2736587bf77d37f7ed1065d1e9ea088bfb59d50715313a4714e8db5d6f3b76e"}
Sep 10 14:11:45.376124 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:45.376100    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5" event={"ID":"dafee11e-f7e3-4bf6-a24e-75163cf24ef1","Type":"ContainerStarted","Data":"30a0f1e33ab252cc23cb995f958149576c6b90b8374c64a6da57b47e2b696004"}
Sep 10 14:11:45.377472 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:45.377437    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dxpkm" event={"ID":"a7df903b-495c-4ddd-ba58-7761a144535b","Type":"ContainerStarted","Data":"b5dc99df297cafe06501f28b10b3672ae8431b19355bf762bc498125465a5842"}
Sep 10 14:11:45.378822 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:45.378791    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rw64n" event={"ID":"370d222e-be9d-42d0-aa73-d9934e17cdfb","Type":"ContainerStarted","Data":"965ff42bacf9a81c94d0d786c8bb1ef64ab1583c39062183cd26c28821efec0e"}
Sep 10 14:11:45.380128 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:45.380104    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7trgp" event={"ID":"70bb7897-ea8f-4d68-adc1-53b35c76b9ae","Type":"ContainerStarted","Data":"dbd9f26b11975b8f8e58934a4a834ac35ab08b68f988c67e2840fd524f00de89"}
Sep 10 14:11:45.381354 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:45.381333    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6vk8h" event={"ID":"05b08d04-1103-43b7-9e1d-73ca022ac2cf","Type":"ContainerStarted","Data":"94ed78576b422ae8ee74e7b0acaca271512d0de33738ad31c1cefb4050b9e678"}
Sep 10 14:11:45.866014 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:45.865966    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn4j7\" (UniqueName: \"kubernetes.io/projected/721760bd-9049-4f00-999a-078410f3cd57-kube-api-access-gn4j7\") pod \"network-check-target-w6sct\" (UID: \"721760bd-9049-4f00-999a-078410f3cd57\") " pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:11:45.866188 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:45.866167    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:11:45.866188 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:45.866187    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:11:45.866324 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:45.866201    2545 projected.go:196] Error preparing data for projected volume kube-api-access-gn4j7 for pod openshift-network-diagnostics/network-check-target-w6sct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:11:45.866324 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:45.866262    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/721760bd-9049-4f00-999a-078410f3cd57-kube-api-access-gn4j7 podName:721760bd-9049-4f00-999a-078410f3cd57 nodeName:}" failed. No retries permitted until 2026-09-10 14:11:47.866242836 +0000 UTC m=+5.983784307 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gn4j7" (UniqueName: "kubernetes.io/projected/721760bd-9049-4f00-999a-078410f3cd57-kube-api-access-gn4j7") pod "network-check-target-w6sct" (UID: "721760bd-9049-4f00-999a-078410f3cd57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:11:45.968544 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:45.967112    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-original-pull-secret\") pod \"global-pull-secret-syncer-6rscd\" (UID: \"c49d3edb-4324-4cce-aeb7-aa73eda47a3b\") " pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:11:45.968544 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:45.967173    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs\") pod \"network-metrics-daemon-dzrg2\" (UID: \"f60ac0b0-5ece-478d-855b-9ed8c8bff1d2\") " pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:11:45.968544 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:45.967327    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:11:45.968544 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:45.967396    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs podName:f60ac0b0-5ece-478d-855b-9ed8c8bff1d2 nodeName:}" failed. No retries permitted until 2026-09-10 14:11:47.967375526 +0000 UTC m=+6.084916994 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs") pod "network-metrics-daemon-dzrg2" (UID: "f60ac0b0-5ece-478d-855b-9ed8c8bff1d2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:11:45.968544 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:45.967472    2545 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:11:45.968544 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:45.967506    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-original-pull-secret podName:c49d3edb-4324-4cce-aeb7-aa73eda47a3b nodeName:}" failed. No retries permitted until 2026-09-10 14:11:47.967494574 +0000 UTC m=+6.085036030 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-original-pull-secret") pod "global-pull-secret-syncer-6rscd" (UID: "c49d3edb-4324-4cce-aeb7-aa73eda47a3b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:11:46.300129 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:46.300039    2545 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 14:06:44 +0000 UTC" deadline="2028-04-05 04:43:10.395051488 +0000 UTC"
Sep 10 14:11:46.300129 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:46.300080    2545 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13742h31m24.094975687s"
Sep 10 14:11:46.359931 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:46.359898    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:11:46.360112 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:46.360032    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w6sct" podUID="721760bd-9049-4f00-999a-078410f3cd57"
Sep 10 14:11:46.362972 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:46.360405    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:11:46.362972 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:46.360513    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rscd" podUID="c49d3edb-4324-4cce-aeb7-aa73eda47a3b"
Sep 10 14:11:46.396870 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:46.396825    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-114.ec2.internal" event={"ID":"450be98a163c16e402ad994ce289c366","Type":"ContainerStarted","Data":"52a25a4a433762847eadc9d6626a472d9df441569de1d259ded72cda5ed0ec78"}
Sep 10 14:11:46.403455 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:46.403421    2545 generic.go:356] "Generic (PLEG): container finished" podID="7537e821eb6ad3512a374bb0ad165c12" containerID="83ab1e5ceb89a2acc23cde4dee0ad2cd2aebb0297ca2ebc6ab09a3ca75d798ff" exitCode=0
Sep 10 14:11:46.403589 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:46.403468    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-114.ec2.internal" event={"ID":"7537e821eb6ad3512a374bb0ad165c12","Type":"ContainerDied","Data":"83ab1e5ceb89a2acc23cde4dee0ad2cd2aebb0297ca2ebc6ab09a3ca75d798ff"}
Sep 10 14:11:46.416663 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:46.416610    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-114.ec2.internal" podStartSLOduration=2.416591768 podStartE2EDuration="2.416591768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:11:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:11:46.416149919 +0000 UTC m=+4.533691397" watchObservedRunningTime="2026-09-10 14:11:46.416591768 +0000 UTC m=+4.534133246"
Sep 10 14:11:47.360455 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:47.360390    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:11:47.360935 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:47.360629    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzrg2" podUID="f60ac0b0-5ece-478d-855b-9ed8c8bff1d2"
Sep 10 14:11:47.436312 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:47.436273    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-114.ec2.internal" event={"ID":"7537e821eb6ad3512a374bb0ad165c12","Type":"ContainerStarted","Data":"557ee92b0714a373fc9df00e07549a0e4459949cd20014f20bc0886d9a091e05"}
Sep 10 14:11:47.456055 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:47.455999    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-114.ec2.internal" podStartSLOduration=3.45597775 podStartE2EDuration="3.45597775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:11:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:11:47.455896934 +0000 UTC m=+5.573438413" watchObservedRunningTime="2026-09-10 14:11:47.45597775 +0000 UTC m=+5.573519228"
Sep 10 14:11:47.888987 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:47.888399    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn4j7\" (UniqueName: \"kubernetes.io/projected/721760bd-9049-4f00-999a-078410f3cd57-kube-api-access-gn4j7\") pod \"network-check-target-w6sct\" (UID: \"721760bd-9049-4f00-999a-078410f3cd57\") " pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:11:47.888987 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:47.888586    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:11:47.888987 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:47.888610    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:11:47.888987 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:47.888625    2545 projected.go:196] Error preparing data for projected volume kube-api-access-gn4j7 for pod openshift-network-diagnostics/network-check-target-w6sct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:11:47.888987 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:47.888683    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/721760bd-9049-4f00-999a-078410f3cd57-kube-api-access-gn4j7 podName:721760bd-9049-4f00-999a-078410f3cd57 nodeName:}" failed. No retries permitted until 2026-09-10 14:11:51.888664351 +0000 UTC m=+10.006205810 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gn4j7" (UniqueName: "kubernetes.io/projected/721760bd-9049-4f00-999a-078410f3cd57-kube-api-access-gn4j7") pod "network-check-target-w6sct" (UID: "721760bd-9049-4f00-999a-078410f3cd57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:11:47.990062 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:47.989493    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-original-pull-secret\") pod \"global-pull-secret-syncer-6rscd\" (UID: \"c49d3edb-4324-4cce-aeb7-aa73eda47a3b\") " pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:11:47.990062 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:47.989563    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs\") pod \"network-metrics-daemon-dzrg2\" (UID: \"f60ac0b0-5ece-478d-855b-9ed8c8bff1d2\") " pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:11:47.990062 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:47.989642    2545 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:11:47.990062 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:47.989706    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:11:47.990062 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:47.989719    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-original-pull-secret podName:c49d3edb-4324-4cce-aeb7-aa73eda47a3b nodeName:}" failed. No retries permitted until 2026-09-10 14:11:51.989698939 +0000 UTC m=+10.107240407 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-original-pull-secret") pod "global-pull-secret-syncer-6rscd" (UID: "c49d3edb-4324-4cce-aeb7-aa73eda47a3b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:11:47.990062 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:47.989763    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs podName:f60ac0b0-5ece-478d-855b-9ed8c8bff1d2 nodeName:}" failed. No retries permitted until 2026-09-10 14:11:51.989745247 +0000 UTC m=+10.107286708 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs") pod "network-metrics-daemon-dzrg2" (UID: "f60ac0b0-5ece-478d-855b-9ed8c8bff1d2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:11:48.365387 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:48.365311    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:11:48.365908 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:48.365444    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rscd" podUID="c49d3edb-4324-4cce-aeb7-aa73eda47a3b"
Sep 10 14:11:48.365908 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:48.365869    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:11:48.366037 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:48.365964    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w6sct" podUID="721760bd-9049-4f00-999a-078410f3cd57"
Sep 10 14:11:49.360584 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:49.360550    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:11:49.360776 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:49.360713    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzrg2" podUID="f60ac0b0-5ece-478d-855b-9ed8c8bff1d2"
Sep 10 14:11:50.360573 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:50.360481    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:11:50.361062 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:50.360605    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w6sct" podUID="721760bd-9049-4f00-999a-078410f3cd57"
Sep 10 14:11:50.361062 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:50.360652    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:11:50.361062 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:50.360695    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rscd" podUID="c49d3edb-4324-4cce-aeb7-aa73eda47a3b"
Sep 10 14:11:51.359731 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:51.359653    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:11:51.359860 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:51.359790    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzrg2" podUID="f60ac0b0-5ece-478d-855b-9ed8c8bff1d2"
Sep 10 14:11:51.923681 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:51.923642    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn4j7\" (UniqueName: \"kubernetes.io/projected/721760bd-9049-4f00-999a-078410f3cd57-kube-api-access-gn4j7\") pod \"network-check-target-w6sct\" (UID: \"721760bd-9049-4f00-999a-078410f3cd57\") " pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:11:51.924144 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:51.923828    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:11:51.924144 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:51.923850    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:11:51.924144 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:51.923860    2545 projected.go:196] Error preparing data for projected volume kube-api-access-gn4j7 for pod openshift-network-diagnostics/network-check-target-w6sct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:11:51.924144 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:51.923913    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/721760bd-9049-4f00-999a-078410f3cd57-kube-api-access-gn4j7 podName:721760bd-9049-4f00-999a-078410f3cd57 nodeName:}" failed. No retries permitted until 2026-09-10 14:11:59.923894544 +0000 UTC m=+18.041436008 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gn4j7" (UniqueName: "kubernetes.io/projected/721760bd-9049-4f00-999a-078410f3cd57-kube-api-access-gn4j7") pod "network-check-target-w6sct" (UID: "721760bd-9049-4f00-999a-078410f3cd57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:11:52.024809 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:52.024740    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-original-pull-secret\") pod \"global-pull-secret-syncer-6rscd\" (UID: \"c49d3edb-4324-4cce-aeb7-aa73eda47a3b\") " pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:11:52.024809 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:52.024792    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs\") pod \"network-metrics-daemon-dzrg2\" (UID: \"f60ac0b0-5ece-478d-855b-9ed8c8bff1d2\") " pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:11:52.025031 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:52.024894    2545 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:11:52.025031 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:52.024965    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-original-pull-secret podName:c49d3edb-4324-4cce-aeb7-aa73eda47a3b nodeName:}" failed. No retries permitted until 2026-09-10 14:12:00.024946602 +0000 UTC m=+18.142488068 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-original-pull-secret") pod "global-pull-secret-syncer-6rscd" (UID: "c49d3edb-4324-4cce-aeb7-aa73eda47a3b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:11:52.025031 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:52.024896    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:11:52.025031 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:52.025017    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs podName:f60ac0b0-5ece-478d-855b-9ed8c8bff1d2 nodeName:}" failed. No retries permitted until 2026-09-10 14:12:00.025006862 +0000 UTC m=+18.142548320 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs") pod "network-metrics-daemon-dzrg2" (UID: "f60ac0b0-5ece-478d-855b-9ed8c8bff1d2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:11:52.361147 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:52.360750    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:11:52.361147 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:52.360870    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w6sct" podUID="721760bd-9049-4f00-999a-078410f3cd57"
Sep 10 14:11:52.361147 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:52.360928    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:11:52.361147 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:52.361045    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rscd" podUID="c49d3edb-4324-4cce-aeb7-aa73eda47a3b"
Sep 10 14:11:53.360213 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:53.360177    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:11:53.360681 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:53.360313    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzrg2" podUID="f60ac0b0-5ece-478d-855b-9ed8c8bff1d2"
Sep 10 14:11:54.365235 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:54.364808    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:11:54.365235 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:54.364937    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rscd" podUID="c49d3edb-4324-4cce-aeb7-aa73eda47a3b"
Sep 10 14:11:54.365235 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:54.364975    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:11:54.365235 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:54.365086    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w6sct" podUID="721760bd-9049-4f00-999a-078410f3cd57"
Sep 10 14:11:55.360444 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:55.360411    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:11:55.360663 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:55.360575    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzrg2" podUID="f60ac0b0-5ece-478d-855b-9ed8c8bff1d2"
Sep 10 14:11:56.360872 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:56.360746    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:11:56.361292 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:56.360866    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w6sct" podUID="721760bd-9049-4f00-999a-078410f3cd57"
Sep 10 14:11:56.361292 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:56.361201    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:11:56.361411 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:56.361307    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rscd" podUID="c49d3edb-4324-4cce-aeb7-aa73eda47a3b"
Sep 10 14:11:57.360252 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:57.360220    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:11:57.360424 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:57.360361    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzrg2" podUID="f60ac0b0-5ece-478d-855b-9ed8c8bff1d2"
Sep 10 14:11:58.360042 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:58.360004    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:11:58.360517 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:58.360136    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w6sct" podUID="721760bd-9049-4f00-999a-078410f3cd57"
Sep 10 14:11:58.360517 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:58.360178    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:11:58.360517 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:58.360280    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rscd" podUID="c49d3edb-4324-4cce-aeb7-aa73eda47a3b"
Sep 10 14:11:59.360043 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:59.360010    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:11:59.360224 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:59.360119    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzrg2" podUID="f60ac0b0-5ece-478d-855b-9ed8c8bff1d2"
Sep 10 14:11:59.981859 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:11:59.981818    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn4j7\" (UniqueName: \"kubernetes.io/projected/721760bd-9049-4f00-999a-078410f3cd57-kube-api-access-gn4j7\") pod \"network-check-target-w6sct\" (UID: \"721760bd-9049-4f00-999a-078410f3cd57\") " pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:11:59.982044 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:59.982000    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:11:59.982112 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:59.982056    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:11:59.982112 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:59.982071    2545 projected.go:196] Error preparing data for projected volume kube-api-access-gn4j7 for pod openshift-network-diagnostics/network-check-target-w6sct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:11:59.982202 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:11:59.982129    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/721760bd-9049-4f00-999a-078410f3cd57-kube-api-access-gn4j7 podName:721760bd-9049-4f00-999a-078410f3cd57 nodeName:}" failed. No retries permitted until 2026-09-10 14:12:15.982115021 +0000 UTC m=+34.099656497 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gn4j7" (UniqueName: "kubernetes.io/projected/721760bd-9049-4f00-999a-078410f3cd57-kube-api-access-gn4j7") pod "network-check-target-w6sct" (UID: "721760bd-9049-4f00-999a-078410f3cd57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:12:00.082792 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:00.082752    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-original-pull-secret\") pod \"global-pull-secret-syncer-6rscd\" (UID: \"c49d3edb-4324-4cce-aeb7-aa73eda47a3b\") " pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:12:00.082953 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:00.082814    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs\") pod \"network-metrics-daemon-dzrg2\" (UID: \"f60ac0b0-5ece-478d-855b-9ed8c8bff1d2\") " pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:12:00.082953 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:00.082890    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:12:00.082953 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:00.082888    2545 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:12:00.082953 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:00.082943    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs podName:f60ac0b0-5ece-478d-855b-9ed8c8bff1d2 nodeName:}" failed. No retries permitted until 2026-09-10 14:12:16.082930558 +0000 UTC m=+34.200472015 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs") pod "network-metrics-daemon-dzrg2" (UID: "f60ac0b0-5ece-478d-855b-9ed8c8bff1d2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:12:00.082953 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:00.082955    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-original-pull-secret podName:c49d3edb-4324-4cce-aeb7-aa73eda47a3b nodeName:}" failed. No retries permitted until 2026-09-10 14:12:16.082949671 +0000 UTC m=+34.200491123 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-original-pull-secret") pod "global-pull-secret-syncer-6rscd" (UID: "c49d3edb-4324-4cce-aeb7-aa73eda47a3b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:12:00.360307 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:00.360229    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:12:00.360703 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:00.360228    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:12:00.360703 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:00.360360    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w6sct" podUID="721760bd-9049-4f00-999a-078410f3cd57"
Sep 10 14:12:00.360703 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:00.360447    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rscd" podUID="c49d3edb-4324-4cce-aeb7-aa73eda47a3b"
Sep 10 14:12:01.360268 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:01.360240    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:12:01.360432 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:01.360372    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzrg2" podUID="f60ac0b0-5ece-478d-855b-9ed8c8bff1d2"
Sep 10 14:12:02.360803 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:02.360762    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:12:02.361213 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:02.360872    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rscd" podUID="c49d3edb-4324-4cce-aeb7-aa73eda47a3b"
Sep 10 14:12:02.361213 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:02.360927    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:12:02.361213 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:02.361029    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w6sct" podUID="721760bd-9049-4f00-999a-078410f3cd57"
Sep 10 14:12:03.360143 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:03.359899    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:12:03.360297 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:03.360272    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzrg2" podUID="f60ac0b0-5ece-478d-855b-9ed8c8bff1d2"
Sep 10 14:12:03.468210 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:03.468179    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bx255" event={"ID":"c993b267-6073-47f0-8c82-3881b57d4bbd","Type":"ContainerStarted","Data":"1597c6e91c6b2aa5db1dd18af3f6c187ff4f1e2ff133574c95a3c5670819a264"}
Sep 10 14:12:03.469689 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:03.469664    2545 generic.go:356] "Generic (PLEG): container finished" podID="8c3c3e79-574d-4f59-ab18-d906e6480e94" containerID="86145b616453a8fc34ebd415f5396c2381b463c7f71ed89063f8205b88f06216" exitCode=0
Sep 10 14:12:03.469813 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:03.469744    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6dsj" event={"ID":"8c3c3e79-574d-4f59-ab18-d906e6480e94","Type":"ContainerDied","Data":"86145b616453a8fc34ebd415f5396c2381b463c7f71ed89063f8205b88f06216"}
Sep 10 14:12:03.472043 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:03.472016    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7" event={"ID":"db1cf9fc-221c-4c0e-a26e-6188c2339bd5","Type":"ContainerStarted","Data":"5f82f34275cb1dd4557fe7a20fcffb8331fa3bf447bccacd272431f188d8988e"}
Sep 10 14:12:03.472113 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:03.472078    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7" event={"ID":"db1cf9fc-221c-4c0e-a26e-6188c2339bd5","Type":"ContainerStarted","Data":"efae163d412f42d4591e9e81c9d073c9aa6342b1816902ecc31fbe272aecf392"}
Sep 10 14:12:03.472158 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:03.472124    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7" event={"ID":"db1cf9fc-221c-4c0e-a26e-6188c2339bd5","Type":"ContainerStarted","Data":"09ea8de3640fe7a880fde004c2829166410dbd60d8b377a91499a4dfab5fd517"}
Sep 10 14:12:03.473477 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:03.473456    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ff5pl" event={"ID":"0ea5e2be-249a-4829-8bad-e978cbdaf6fe","Type":"ContainerStarted","Data":"3b381e1b8c0f08ec66363e33017a03c4e96e74e1fe43f22ec88d3eba7275c362"}
Sep 10 14:12:03.474826 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:03.474806    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5" event={"ID":"dafee11e-f7e3-4bf6-a24e-75163cf24ef1","Type":"ContainerStarted","Data":"a116b9bac0cbfc293e344051c59233a24ca4d95b31cf9bc1bd4bd69c434922a1"}
Sep 10 14:12:03.476318 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:03.476297    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rw64n" event={"ID":"370d222e-be9d-42d0-aa73-d9934e17cdfb","Type":"ContainerStarted","Data":"a1cc7d470019c82d7572dcad131c928db83aa931700114f464ef9165cffe40ac"}
Sep 10 14:12:03.477882 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:03.477858    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7trgp" event={"ID":"70bb7897-ea8f-4d68-adc1-53b35c76b9ae","Type":"ContainerStarted","Data":"00fed9ff5d5e698aa6dc92f38f1d269670ee508957e2493c45955404de171a9e"}
Sep 10 14:12:03.479338 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:03.479317    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6vk8h" event={"ID":"05b08d04-1103-43b7-9e1d-73ca022ac2cf","Type":"ContainerStarted","Data":"fc52bfa705c51368169fd4694d97875a2bd8bfc05fc4633c39bdfa37b5988015"}
Sep 10 14:12:03.513466 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:03.513433    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bx255" podStartSLOduration=2.004990113 podStartE2EDuration="20.513420451s" totalImagesPullingTime="18.508430338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:12:03.494898059 +0000 UTC m=+21.612439533" watchObservedRunningTime="2026-09-10 14:12:03.513420451 +0000 UTC m=+21.630961929"
Sep 10 14:12:03.513878 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:03.513847    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rw64n" podStartSLOduration=2.103958176 podStartE2EDuration="20.513839783s" totalImagesPullingTime="18.409881607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:12:03.513594388 +0000 UTC m=+21.631135862" watchObservedRunningTime="2026-09-10 14:12:03.513839783 +0000 UTC m=+21.631381295"
Sep 10 14:12:03.570442 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:03.570404    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7trgp" podStartSLOduration=2.134836855 podStartE2EDuration="20.57039054s" totalImagesPullingTime="18.435553685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:12:03.552417577 +0000 UTC m=+21.669959051" watchObservedRunningTime="2026-09-10 14:12:03.57039054 +0000 UTC m=+21.687932013"
Sep 10 14:12:03.570573 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:03.570546    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ff5pl" podStartSLOduration=2.154151688 podStartE2EDuration="20.570542634s" totalImagesPullingTime="18.416390946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:12:03.570324076 +0000 UTC m=+21.687865570" watchObservedRunningTime="2026-09-10 14:12:03.570542634 +0000 UTC m=+21.688084108"
Sep 10 14:12:03.595690 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:03.595655    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6vk8h" podStartSLOduration=2.154940315 podStartE2EDuration="20.595642434s" totalImagesPullingTime="18.440702119s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:12:03.594875996 +0000 UTC m=+21.712417469" watchObservedRunningTime="2026-09-10 14:12:03.595642434 +0000 UTC m=+21.713183908"
Sep 10 14:12:03.647892 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:03.647868    2545 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trgp_70bb7897-ea8f-4d68-adc1-53b35c76b9ae/konnectivity-agent/0.log" limit=1024
Sep 10 14:12:03.726987 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:03.726952    2545 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trgp_70bb7897-ea8f-4d68-adc1-53b35c76b9ae/konnectivity-agent/0.log" limit=1024
Sep 10 14:12:04.360002 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:04.359912    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:12:04.360186 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:04.360029    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w6sct" podUID="721760bd-9049-4f00-999a-078410f3cd57"
Sep 10 14:12:04.360186 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:04.359923    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:12:04.360186 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:04.360120    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rscd" podUID="c49d3edb-4324-4cce-aeb7-aa73eda47a3b"
Sep 10 14:12:04.485728 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:04.485685    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7" event={"ID":"db1cf9fc-221c-4c0e-a26e-6188c2339bd5","Type":"ContainerStarted","Data":"ed235c70c004e0f18613c4262e38bb0c1a3908dfa251e973e709cc9653c764ee"}
Sep 10 14:12:04.486188 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:04.485771    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7" event={"ID":"db1cf9fc-221c-4c0e-a26e-6188c2339bd5","Type":"ContainerStarted","Data":"10a8c4c590146155b55fbbed5d5c032f0a1b513e164615a3600aeb3cda275f68"}
Sep 10 14:12:04.486188 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:04.485818    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7" event={"ID":"db1cf9fc-221c-4c0e-a26e-6188c2339bd5","Type":"ContainerStarted","Data":"9c147fe7a3a85a6d18d0f38c2c1b5d9efe84129e018f9f53395a120c506f3b93"}
Sep 10 14:12:04.487328 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:04.487300    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dxpkm" event={"ID":"a7df903b-495c-4ddd-ba58-7761a144535b","Type":"ContainerStarted","Data":"1e9fa82e114e09cad3cbef6ea468aee4316edd0178c3bf8fafcb43dd67cb6251"}
Sep 10 14:12:04.504366 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:04.504319    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dxpkm" podStartSLOduration=3.076348666 podStartE2EDuration="21.504305678s" totalImagesPullingTime="18.427957012s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:12:04.503983411 +0000 UTC m=+22.621524885" watchObservedRunningTime="2026-09-10 14:12:04.504305678 +0000 UTC m=+22.621847166"
Sep 10 14:12:04.653849 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:04.653778    2545 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trgp_70bb7897-ea8f-4d68-adc1-53b35c76b9ae/konnectivity-agent/0.log" limit=1024
Sep 10 14:12:04.721367 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:04.721337    2545 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trgp_70bb7897-ea8f-4d68-adc1-53b35c76b9ae/konnectivity-agent/0.log" limit=1024
Sep 10 14:12:05.064622 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:05.064588    2545 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 14:12:05.307627 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:05.307543    2545 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T14:12:05.064617954Z","UUID":"eddaa530-b571-4dee-b1e5-5e1a6f7e32eb","Handler":null,"Name":"","Endpoint":""}
Sep 10 14:12:05.308698 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:05.308682    2545 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 14:12:05.308797 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:05.308707    2545 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 14:12:05.360551 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:05.360530    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:12:05.360649 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:05.360626    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzrg2" podUID="f60ac0b0-5ece-478d-855b-9ed8c8bff1d2"
Sep 10 14:12:05.492554 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:05.492515    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5" event={"ID":"dafee11e-f7e3-4bf6-a24e-75163cf24ef1","Type":"ContainerStarted","Data":"cf64f055f6018e81a433c7ac0fc8bfe0b976518c24320c1a23d83fef9ef05305"}
Sep 10 14:12:06.360614 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:06.360579    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:12:06.360614 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:06.360604    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:12:06.360835 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:06.360678    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rscd" podUID="c49d3edb-4324-4cce-aeb7-aa73eda47a3b"
Sep 10 14:12:06.360835 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:06.360736    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w6sct" podUID="721760bd-9049-4f00-999a-078410f3cd57"
Sep 10 14:12:06.497500 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:06.497449    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7" event={"ID":"db1cf9fc-221c-4c0e-a26e-6188c2339bd5","Type":"ContainerStarted","Data":"321dda56dec454748f09961d23d7f58d0c25eb9e02fdcc58da5470aa01eac7e1"}
Sep 10 14:12:06.844412 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:06.844377    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7trgp"
Sep 10 14:12:06.845259 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:06.845239    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7trgp"
Sep 10 14:12:06.853670 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:06.853608    2545 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trgp_70bb7897-ea8f-4d68-adc1-53b35c76b9ae/konnectivity-agent/0.log" limit=1024
Sep 10 14:12:07.083362 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:07.083258    2545 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trgp_70bb7897-ea8f-4d68-adc1-53b35c76b9ae/konnectivity-agent/0.log" limit=1024
Sep 10 14:12:07.314883 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:07.314818    2545 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trgp_70bb7897-ea8f-4d68-adc1-53b35c76b9ae/konnectivity-agent/0.log" limit=1024
Sep 10 14:12:07.359674 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:07.359658    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:12:07.359783 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:07.359766    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzrg2" podUID="f60ac0b0-5ece-478d-855b-9ed8c8bff1d2"
Sep 10 14:12:07.415125 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:07.415096    2545 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trgp_70bb7897-ea8f-4d68-adc1-53b35c76b9ae/konnectivity-agent/0.log" limit=1024
Sep 10 14:12:07.502046 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:07.502007    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5" event={"ID":"dafee11e-f7e3-4bf6-a24e-75163cf24ef1","Type":"ContainerStarted","Data":"12239e0537e7d98ea19a3fdca240aadd7e09b798bce3f9108fadf1de174230b3"}
Sep 10 14:12:07.502461 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:07.502313    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7trgp"
Sep 10 14:12:07.502672 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:07.502654    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7trgp"
Sep 10 14:12:07.557392 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:07.557300    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4mkq5" podStartSLOduration=2.2849752 podStartE2EDuration="24.557280341s" totalImagesPullingTime="22.272305141s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:11:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:12:07.537820702 +0000 UTC m=+25.655362176" watchObservedRunningTime="2026-09-10 14:12:07.557280341 +0000 UTC m=+25.674821817"
Sep 10 14:12:07.575301 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:07.575273    2545 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trgp_70bb7897-ea8f-4d68-adc1-53b35c76b9ae/konnectivity-agent/0.log" limit=1024
Sep 10 14:12:07.863236 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:07.863158    2545 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trgp_70bb7897-ea8f-4d68-adc1-53b35c76b9ae/konnectivity-agent/0.log" limit=1024
Sep 10 14:12:08.360229 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:08.360033    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:12:08.360392 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:08.360062    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:12:08.360392 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:08.360327    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rscd" podUID="c49d3edb-4324-4cce-aeb7-aa73eda47a3b"
Sep 10 14:12:08.360584 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:08.360382    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w6sct" podUID="721760bd-9049-4f00-999a-078410f3cd57"
Sep 10 14:12:08.509648 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:08.509604    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7" event={"ID":"db1cf9fc-221c-4c0e-a26e-6188c2339bd5","Type":"ContainerStarted","Data":"105ec30f65659dbbb00b2500d16bff1bee49f41fb4fad5c80ef89ab5137f4c86"}
Sep 10 14:12:08.538961 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:08.538912    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7" podStartSLOduration=7.104238499 podStartE2EDuration="25.538898361s" totalImagesPullingTime="18.434659862s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:12:08.538513161 +0000 UTC m=+26.656054635" watchObservedRunningTime="2026-09-10 14:12:08.538898361 +0000 UTC m=+26.656439836"
Sep 10 14:12:09.359757 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:09.359729    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:12:09.359924 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:09.359851    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzrg2" podUID="f60ac0b0-5ece-478d-855b-9ed8c8bff1d2"
Sep 10 14:12:09.512361 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:09.512328    2545 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 10 14:12:09.512870 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:09.512852    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:12:09.512931 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:09.512916    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:12:09.529512 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:09.529467    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:12:09.530150 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:09.530135    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:12:09.862384 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:09.862258    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6rscd"]
Sep 10 14:12:09.862384 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:09.862360    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:12:09.862608 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:09.862469    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rscd" podUID="c49d3edb-4324-4cce-aeb7-aa73eda47a3b"
Sep 10 14:12:09.869310 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:09.869240    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dzrg2"]
Sep 10 14:12:09.869870 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:09.869342    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w6sct"]
Sep 10 14:12:09.869870 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:09.869424    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:12:09.869870 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:09.869549    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w6sct" podUID="721760bd-9049-4f00-999a-078410f3cd57"
Sep 10 14:12:09.869870 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:09.869629    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:12:09.869870 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:09.869737    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzrg2" podUID="f60ac0b0-5ece-478d-855b-9ed8c8bff1d2"
Sep 10 14:12:09.959883 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:09.959842    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:12:10.516866 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:10.516636    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6dsj" event={"ID":"8c3c3e79-574d-4f59-ab18-d906e6480e94","Type":"ContainerStarted","Data":"09a95a609156b79a3bc8d9dfd473cce99b99f3b959cef5105ecb95d5f811b071"}
Sep 10 14:12:11.360177 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:11.360138    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:12:11.360350 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:11.360181    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:12:11.360350 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:11.360181    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:12:11.360350 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:11.360293    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzrg2" podUID="f60ac0b0-5ece-478d-855b-9ed8c8bff1d2"
Sep 10 14:12:11.360350 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:11.360309    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rscd" podUID="c49d3edb-4324-4cce-aeb7-aa73eda47a3b"
Sep 10 14:12:11.360563 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:11.360380    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w6sct" podUID="721760bd-9049-4f00-999a-078410f3cd57"
Sep 10 14:12:11.520404 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:11.520375    2545 generic.go:356] "Generic (PLEG): container finished" podID="8c3c3e79-574d-4f59-ab18-d906e6480e94" containerID="09a95a609156b79a3bc8d9dfd473cce99b99f3b959cef5105ecb95d5f811b071" exitCode=0
Sep 10 14:12:11.520772 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:11.520461    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6dsj" event={"ID":"8c3c3e79-574d-4f59-ab18-d906e6480e94","Type":"ContainerDied","Data":"09a95a609156b79a3bc8d9dfd473cce99b99f3b959cef5105ecb95d5f811b071"}
Sep 10 14:12:13.360625 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:13.360590    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:12:13.360998 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:13.360590    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:12:13.360998 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:13.360696    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzrg2" podUID="f60ac0b0-5ece-478d-855b-9ed8c8bff1d2"
Sep 10 14:12:13.360998 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:13.360590    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:12:13.360998 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:13.360766    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rscd" podUID="c49d3edb-4324-4cce-aeb7-aa73eda47a3b"
Sep 10 14:12:13.360998 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:13.360822    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w6sct" podUID="721760bd-9049-4f00-999a-078410f3cd57"
Sep 10 14:12:13.526418 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:13.526385    2545 generic.go:356] "Generic (PLEG): container finished" podID="8c3c3e79-574d-4f59-ab18-d906e6480e94" containerID="470de857717830363b501d6ad5437c210f0523c8610a2e88ae9db7063cbfef42" exitCode=0
Sep 10 14:12:13.526585 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:13.526447    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6dsj" event={"ID":"8c3c3e79-574d-4f59-ab18-d906e6480e94","Type":"ContainerDied","Data":"470de857717830363b501d6ad5437c210f0523c8610a2e88ae9db7063cbfef42"}
Sep 10 14:12:15.360108 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.359948    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:12:15.360586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.359993    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:12:15.360586 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:15.360195    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6rscd" podUID="c49d3edb-4324-4cce-aeb7-aa73eda47a3b"
Sep 10 14:12:15.360586 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:15.360243    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w6sct" podUID="721760bd-9049-4f00-999a-078410f3cd57"
Sep 10 14:12:15.360586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.360003    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:12:15.360586 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:15.360307    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dzrg2" podUID="f60ac0b0-5ece-478d-855b-9ed8c8bff1d2"
Sep 10 14:12:15.533413 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.533374    2545 generic.go:356] "Generic (PLEG): container finished" podID="8c3c3e79-574d-4f59-ab18-d906e6480e94" containerID="e609cdfdf4d0fb11ab143ff656e97413e361dd14f8b497f25d8118a112edd41a" exitCode=0
Sep 10 14:12:15.533638 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.533436    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6dsj" event={"ID":"8c3c3e79-574d-4f59-ab18-d906e6480e94","Type":"ContainerDied","Data":"e609cdfdf4d0fb11ab143ff656e97413e361dd14f8b497f25d8118a112edd41a"}
Sep 10 14:12:15.657339 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.657279    2545 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-114.ec2.internal" event="NodeReady"
Sep 10 14:12:15.657448 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.657400    2545 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 14:12:15.704177 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.704147    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-whqv6"]
Sep 10 14:12:15.722581 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.722553    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hhnkw"]
Sep 10 14:12:15.722734 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.722661    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-whqv6"
Sep 10 14:12:15.725117 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.725098    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xwswr\""
Sep 10 14:12:15.725325 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.725312    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 14:12:15.725379 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.725313    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 14:12:15.738741 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.738712    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-whqv6"]
Sep 10 14:12:15.738858 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.738755    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hhnkw"]
Sep 10 14:12:15.738858 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.738791    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hhnkw"
Sep 10 14:12:15.741536 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.741517    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 14:12:15.741652 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.741621    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 14:12:15.741722 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.741671    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 14:12:15.741779 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.741737    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4qtdq\""
Sep 10 14:12:15.805442 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.805412    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls\") pod \"dns-default-whqv6\" (UID: \"b803a53c-a904-436c-9d1b-4956ef29b1e7\") " pod="openshift-dns/dns-default-whqv6"
Sep 10 14:12:15.805620 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.805481    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b803a53c-a904-436c-9d1b-4956ef29b1e7-config-volume\") pod \"dns-default-whqv6\" (UID: \"b803a53c-a904-436c-9d1b-4956ef29b1e7\") " pod="openshift-dns/dns-default-whqv6"
Sep 10 14:12:15.805620 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.805530    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b803a53c-a904-436c-9d1b-4956ef29b1e7-tmp-dir\") pod \"dns-default-whqv6\" (UID: \"b803a53c-a904-436c-9d1b-4956ef29b1e7\") " pod="openshift-dns/dns-default-whqv6"
Sep 10 14:12:15.805620 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.805556    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8ldl\" (UniqueName: \"kubernetes.io/projected/b803a53c-a904-436c-9d1b-4956ef29b1e7-kube-api-access-m8ldl\") pod \"dns-default-whqv6\" (UID: \"b803a53c-a904-436c-9d1b-4956ef29b1e7\") " pod="openshift-dns/dns-default-whqv6"
Sep 10 14:12:15.828832 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.828800    2545 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trgp_70bb7897-ea8f-4d68-adc1-53b35c76b9ae/konnectivity-agent/0.log" limit=1024
Sep 10 14:12:15.906851 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.906817    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b803a53c-a904-436c-9d1b-4956ef29b1e7-tmp-dir\") pod \"dns-default-whqv6\" (UID: \"b803a53c-a904-436c-9d1b-4956ef29b1e7\") " pod="openshift-dns/dns-default-whqv6"
Sep 10 14:12:15.907019 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.906863    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8ldl\" (UniqueName: \"kubernetes.io/projected/b803a53c-a904-436c-9d1b-4956ef29b1e7-kube-api-access-m8ldl\") pod \"dns-default-whqv6\" (UID: \"b803a53c-a904-436c-9d1b-4956ef29b1e7\") " pod="openshift-dns/dns-default-whqv6"
Sep 10 14:12:15.907019 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.906888    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50606e5c-a872-4b2f-9437-a490b24bcda9-cert\") pod \"ingress-canary-hhnkw\" (UID: \"50606e5c-a872-4b2f-9437-a490b24bcda9\") " pod="openshift-ingress-canary/ingress-canary-hhnkw"
Sep 10 14:12:15.907019 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.906915    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls\") pod \"dns-default-whqv6\" (UID: \"b803a53c-a904-436c-9d1b-4956ef29b1e7\") " pod="openshift-dns/dns-default-whqv6"
Sep 10 14:12:15.907019 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:15.906986    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 14:12:15.907209 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:15.907053    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls podName:b803a53c-a904-436c-9d1b-4956ef29b1e7 nodeName:}" failed. No retries permitted until 2026-09-10 14:12:16.407033015 +0000 UTC m=+34.524574467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls") pod "dns-default-whqv6" (UID: "b803a53c-a904-436c-9d1b-4956ef29b1e7") : secret "dns-default-metrics-tls" not found
Sep 10 14:12:15.907209 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.907082    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm947\" (UniqueName: \"kubernetes.io/projected/50606e5c-a872-4b2f-9437-a490b24bcda9-kube-api-access-pm947\") pod \"ingress-canary-hhnkw\" (UID: \"50606e5c-a872-4b2f-9437-a490b24bcda9\") " pod="openshift-ingress-canary/ingress-canary-hhnkw"
Sep 10 14:12:15.907209 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.907133    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b803a53c-a904-436c-9d1b-4956ef29b1e7-tmp-dir\") pod \"dns-default-whqv6\" (UID: \"b803a53c-a904-436c-9d1b-4956ef29b1e7\") " pod="openshift-dns/dns-default-whqv6"
Sep 10 14:12:15.907209 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.907200    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b803a53c-a904-436c-9d1b-4956ef29b1e7-config-volume\") pod \"dns-default-whqv6\" (UID: \"b803a53c-a904-436c-9d1b-4956ef29b1e7\") " pod="openshift-dns/dns-default-whqv6"
Sep 10 14:12:15.907713 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.907663    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b803a53c-a904-436c-9d1b-4956ef29b1e7-config-volume\") pod \"dns-default-whqv6\" (UID: \"b803a53c-a904-436c-9d1b-4956ef29b1e7\") " pod="openshift-dns/dns-default-whqv6"
Sep 10 14:12:15.917871 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:15.917850    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8ldl\" (UniqueName: \"kubernetes.io/projected/b803a53c-a904-436c-9d1b-4956ef29b1e7-kube-api-access-m8ldl\") pod \"dns-default-whqv6\" (UID: \"b803a53c-a904-436c-9d1b-4956ef29b1e7\") " pod="openshift-dns/dns-default-whqv6"
Sep 10 14:12:16.008040 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:16.008007    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn4j7\" (UniqueName: \"kubernetes.io/projected/721760bd-9049-4f00-999a-078410f3cd57-kube-api-access-gn4j7\") pod \"network-check-target-w6sct\" (UID: \"721760bd-9049-4f00-999a-078410f3cd57\") " pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:12:16.008040 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:16.008045    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50606e5c-a872-4b2f-9437-a490b24bcda9-cert\") pod \"ingress-canary-hhnkw\" (UID: \"50606e5c-a872-4b2f-9437-a490b24bcda9\") " pod="openshift-ingress-canary/ingress-canary-hhnkw"
Sep 10 14:12:16.008247 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:16.008069    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm947\" (UniqueName: \"kubernetes.io/projected/50606e5c-a872-4b2f-9437-a490b24bcda9-kube-api-access-pm947\") pod \"ingress-canary-hhnkw\" (UID: \"50606e5c-a872-4b2f-9437-a490b24bcda9\") " pod="openshift-ingress-canary/ingress-canary-hhnkw"
Sep 10 14:12:16.008299 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:16.008241    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:12:16.008299 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:16.008264    2545 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:12:16.008299 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:16.008276    2545 projected.go:196] Error preparing data for projected volume kube-api-access-gn4j7 for pod openshift-network-diagnostics/network-check-target-w6sct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:12:16.008431 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:16.008359    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/721760bd-9049-4f00-999a-078410f3cd57-kube-api-access-gn4j7 podName:721760bd-9049-4f00-999a-078410f3cd57 nodeName:}" failed. No retries permitted until 2026-09-10 14:12:48.008342796 +0000 UTC m=+66.125884257 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gn4j7" (UniqueName: "kubernetes.io/projected/721760bd-9049-4f00-999a-078410f3cd57-kube-api-access-gn4j7") pod "network-check-target-w6sct" (UID: "721760bd-9049-4f00-999a-078410f3cd57") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:12:16.010565 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:16.010544    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50606e5c-a872-4b2f-9437-a490b24bcda9-cert\") pod \"ingress-canary-hhnkw\" (UID: \"50606e5c-a872-4b2f-9437-a490b24bcda9\") " pod="openshift-ingress-canary/ingress-canary-hhnkw"
Sep 10 14:12:16.015914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:16.015893    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm947\" (UniqueName: \"kubernetes.io/projected/50606e5c-a872-4b2f-9437-a490b24bcda9-kube-api-access-pm947\") pod \"ingress-canary-hhnkw\" (UID: \"50606e5c-a872-4b2f-9437-a490b24bcda9\") " pod="openshift-ingress-canary/ingress-canary-hhnkw"
Sep 10 14:12:16.046869 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:16.046843    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hhnkw"
Sep 10 14:12:16.108989 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:16.108958    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-original-pull-secret\") pod \"global-pull-secret-syncer-6rscd\" (UID: \"c49d3edb-4324-4cce-aeb7-aa73eda47a3b\") " pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:12:16.108989 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:16.108995    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs\") pod \"network-metrics-daemon-dzrg2\" (UID: \"f60ac0b0-5ece-478d-855b-9ed8c8bff1d2\") " pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:12:16.109228 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:16.109100    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:12:16.109228 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:16.109104    2545 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:12:16.109228 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:16.109156    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs podName:f60ac0b0-5ece-478d-855b-9ed8c8bff1d2 nodeName:}" failed. No retries permitted until 2026-09-10 14:12:48.109143246 +0000 UTC m=+66.226684702 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs") pod "network-metrics-daemon-dzrg2" (UID: "f60ac0b0-5ece-478d-855b-9ed8c8bff1d2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:12:16.109228 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:16.109168    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-original-pull-secret podName:c49d3edb-4324-4cce-aeb7-aa73eda47a3b nodeName:}" failed. No retries permitted until 2026-09-10 14:12:48.109162939 +0000 UTC m=+66.226704391 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-original-pull-secret") pod "global-pull-secret-syncer-6rscd" (UID: "c49d3edb-4324-4cce-aeb7-aa73eda47a3b") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:12:16.198962 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:16.198881    2545 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7trgp_70bb7897-ea8f-4d68-adc1-53b35c76b9ae/konnectivity-agent/0.log" limit=1024
Sep 10 14:12:16.350749 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:16.350719    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hhnkw"]
Sep 10 14:12:16.358000 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:12:16.357973    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50606e5c_a872_4b2f_9437_a490b24bcda9.slice/crio-efb1dcc8c2fd19711c0667844310d4f8cfbbad8df687d14fbd197340822bd1ab WatchSource:0}: Error finding container efb1dcc8c2fd19711c0667844310d4f8cfbbad8df687d14fbd197340822bd1ab: Status 404 returned error can't find the container with id efb1dcc8c2fd19711c0667844310d4f8cfbbad8df687d14fbd197340822bd1ab
Sep 10 14:12:16.411812 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:16.411777    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls\") pod \"dns-default-whqv6\" (UID: \"b803a53c-a904-436c-9d1b-4956ef29b1e7\") " pod="openshift-dns/dns-default-whqv6"
Sep 10 14:12:16.412598 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:16.411938    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 14:12:16.412598 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:16.412008    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls podName:b803a53c-a904-436c-9d1b-4956ef29b1e7 nodeName:}" failed. No retries permitted until 2026-09-10 14:12:17.411987112 +0000 UTC m=+35.529528575 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls") pod "dns-default-whqv6" (UID: "b803a53c-a904-436c-9d1b-4956ef29b1e7") : secret "dns-default-metrics-tls" not found
Sep 10 14:12:16.536578 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:16.536547    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hhnkw" event={"ID":"50606e5c-a872-4b2f-9437-a490b24bcda9","Type":"ContainerStarted","Data":"efb1dcc8c2fd19711c0667844310d4f8cfbbad8df687d14fbd197340822bd1ab"}
Sep 10 14:12:17.359712 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:17.359679    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:12:17.359989 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:17.359726    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:12:17.359989 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:17.359821    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:12:17.363998 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:17.363972    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 14:12:17.364121 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:17.364021    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 14:12:17.364121 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:17.364038    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4vfcf\""
Sep 10 14:12:17.364121 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:17.364059    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 14:12:17.364121 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:17.363972    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 14:12:17.364323 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:17.363974    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jzwbc\""
Sep 10 14:12:17.419407 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:17.419364    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls\") pod \"dns-default-whqv6\" (UID: \"b803a53c-a904-436c-9d1b-4956ef29b1e7\") " pod="openshift-dns/dns-default-whqv6"
Sep 10 14:12:17.419856 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:17.419553    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 14:12:17.419856 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:17.419639    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls podName:b803a53c-a904-436c-9d1b-4956ef29b1e7 nodeName:}" failed. No retries permitted until 2026-09-10 14:12:19.419617419 +0000 UTC m=+37.537158876 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls") pod "dns-default-whqv6" (UID: "b803a53c-a904-436c-9d1b-4956ef29b1e7") : secret "dns-default-metrics-tls" not found
Sep 10 14:12:19.435418 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:19.435176    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls\") pod \"dns-default-whqv6\" (UID: \"b803a53c-a904-436c-9d1b-4956ef29b1e7\") " pod="openshift-dns/dns-default-whqv6"
Sep 10 14:12:19.435833 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:19.435337    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 14:12:19.435833 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:19.435574    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls podName:b803a53c-a904-436c-9d1b-4956ef29b1e7 nodeName:}" failed. No retries permitted until 2026-09-10 14:12:23.435557233 +0000 UTC m=+41.553098685 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls") pod "dns-default-whqv6" (UID: "b803a53c-a904-436c-9d1b-4956ef29b1e7") : secret "dns-default-metrics-tls" not found
Sep 10 14:12:22.552192 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:22.552149    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hhnkw" event={"ID":"50606e5c-a872-4b2f-9437-a490b24bcda9","Type":"ContainerStarted","Data":"b079c92951e1b6f5fb6062f5ab329dec3ff4ae34e458cd42581814e42afe4049"}
Sep 10 14:12:22.554756 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:22.554732    2545 generic.go:356] "Generic (PLEG): container finished" podID="8c3c3e79-574d-4f59-ab18-d906e6480e94" containerID="f5ed14815f356926fcf5469cbb49b2fbe4eede25b6e03ef56837a53986749614" exitCode=0
Sep 10 14:12:22.554866 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:22.554771    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6dsj" event={"ID":"8c3c3e79-574d-4f59-ab18-d906e6480e94","Type":"ContainerDied","Data":"f5ed14815f356926fcf5469cbb49b2fbe4eede25b6e03ef56837a53986749614"}
Sep 10 14:12:22.593096 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:22.593044    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hhnkw" podStartSLOduration=2.4228014509999998 podStartE2EDuration="7.593025816s" totalImagesPullingTime="5.170224365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:12:22.592171834 +0000 UTC m=+40.709713309" watchObservedRunningTime="2026-09-10 14:12:22.593025816 +0000 UTC m=+40.710567290"
Sep 10 14:12:23.465337 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:23.465291    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls\") pod \"dns-default-whqv6\" (UID: \"b803a53c-a904-436c-9d1b-4956ef29b1e7\") " pod="openshift-dns/dns-default-whqv6"
Sep 10 14:12:23.465522 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:23.465447    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 14:12:23.465571 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:23.465541    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls podName:b803a53c-a904-436c-9d1b-4956ef29b1e7 nodeName:}" failed. No retries permitted until 2026-09-10 14:12:31.46552418 +0000 UTC m=+49.583065647 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls") pod "dns-default-whqv6" (UID: "b803a53c-a904-436c-9d1b-4956ef29b1e7") : secret "dns-default-metrics-tls" not found
Sep 10 14:12:23.559847 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:23.559814    2545 generic.go:356] "Generic (PLEG): container finished" podID="8c3c3e79-574d-4f59-ab18-d906e6480e94" containerID="336a5ccb88eba527374a998940f06f300a2e82dd2107b5d75ec6aef1ae647b44" exitCode=0
Sep 10 14:12:23.560194 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:23.559900    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6dsj" event={"ID":"8c3c3e79-574d-4f59-ab18-d906e6480e94","Type":"ContainerDied","Data":"336a5ccb88eba527374a998940f06f300a2e82dd2107b5d75ec6aef1ae647b44"}
Sep 10 14:12:24.565689 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:24.565651    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6dsj" event={"ID":"8c3c3e79-574d-4f59-ab18-d906e6480e94","Type":"ContainerStarted","Data":"5e1632b5913e78badb35f071ec21d7c7f7ae79af39ab2dc36f5b93fd5b669aad"}
Sep 10 14:12:24.589774 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:24.589724    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-n6dsj" podStartSLOduration=7.803512952 podStartE2EDuration="41.589709263s" totalImagesPullingTime="33.786196311s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:11:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:12:24.587817463 +0000 UTC m=+42.705358937" watchObservedRunningTime="2026-09-10 14:12:24.589709263 +0000 UTC m=+42.707250735"
Sep 10 14:12:31.521145 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:31.521107    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls\") pod \"dns-default-whqv6\" (UID: \"b803a53c-a904-436c-9d1b-4956ef29b1e7\") " pod="openshift-dns/dns-default-whqv6"
Sep 10 14:12:31.521547 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:31.521265    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 14:12:31.521547 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:31.521330    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls podName:b803a53c-a904-436c-9d1b-4956ef29b1e7 nodeName:}" failed. No retries permitted until 2026-09-10 14:12:47.52131585 +0000 UTC m=+65.638857302 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls") pod "dns-default-whqv6" (UID: "b803a53c-a904-436c-9d1b-4956ef29b1e7") : secret "dns-default-metrics-tls" not found
Sep 10 14:12:41.533997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:41.533970    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fcvs7"
Sep 10 14:12:47.531420 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:47.531381    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls\") pod \"dns-default-whqv6\" (UID: \"b803a53c-a904-436c-9d1b-4956ef29b1e7\") " pod="openshift-dns/dns-default-whqv6"
Sep 10 14:12:47.531809 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:47.531558    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 14:12:47.531809 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:47.531639    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls podName:b803a53c-a904-436c-9d1b-4956ef29b1e7 nodeName:}" failed. No retries permitted until 2026-09-10 14:13:19.531622996 +0000 UTC m=+97.649164453 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls") pod "dns-default-whqv6" (UID: "b803a53c-a904-436c-9d1b-4956ef29b1e7") : secret "dns-default-metrics-tls" not found
Sep 10 14:12:48.033977 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:48.033943    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn4j7\" (UniqueName: \"kubernetes.io/projected/721760bd-9049-4f00-999a-078410f3cd57-kube-api-access-gn4j7\") pod \"network-check-target-w6sct\" (UID: \"721760bd-9049-4f00-999a-078410f3cd57\") " pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:12:48.036901 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:48.036883    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 14:12:48.046427 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:48.046402    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 14:12:48.057188 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:48.057166    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn4j7\" (UniqueName: \"kubernetes.io/projected/721760bd-9049-4f00-999a-078410f3cd57-kube-api-access-gn4j7\") pod \"network-check-target-w6sct\" (UID: \"721760bd-9049-4f00-999a-078410f3cd57\") " pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:12:48.134398 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:48.134357    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-original-pull-secret\") pod \"global-pull-secret-syncer-6rscd\" (UID: \"c49d3edb-4324-4cce-aeb7-aa73eda47a3b\") " pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:12:48.134398 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:48.134403    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs\") pod \"network-metrics-daemon-dzrg2\" (UID: \"f60ac0b0-5ece-478d-855b-9ed8c8bff1d2\") " pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:12:48.136985 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:48.136967    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 14:12:48.137150 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:48.137131    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 14:12:48.144689 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:48.144672    2545 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 10 14:12:48.144753 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:12:48.144743    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs podName:f60ac0b0-5ece-478d-855b-9ed8c8bff1d2 nodeName:}" failed. No retries permitted until 2026-09-10 14:13:52.144725164 +0000 UTC m=+130.262266629 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs") pod "network-metrics-daemon-dzrg2" (UID: "f60ac0b0-5ece-478d-855b-9ed8c8bff1d2") : secret "metrics-daemon-secret" not found
Sep 10 14:12:48.146699 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:48.146672    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c49d3edb-4324-4cce-aeb7-aa73eda47a3b-original-pull-secret\") pod \"global-pull-secret-syncer-6rscd\" (UID: \"c49d3edb-4324-4cce-aeb7-aa73eda47a3b\") " pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:12:48.273417 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:48.273384    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4vfcf\""
Sep 10 14:12:48.280699 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:48.280677    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:12:48.287603 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:48.287554    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6rscd"
Sep 10 14:12:48.546963 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:48.546889    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w6sct"]
Sep 10 14:12:48.553771 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:12:48.553748    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod721760bd_9049_4f00_999a_078410f3cd57.slice/crio-c1a3de21a5e38d5d3287f2d5bac93ae3ac979e859ae9097137e019b076d97bc1 WatchSource:0}: Error finding container c1a3de21a5e38d5d3287f2d5bac93ae3ac979e859ae9097137e019b076d97bc1: Status 404 returned error can't find the container with id c1a3de21a5e38d5d3287f2d5bac93ae3ac979e859ae9097137e019b076d97bc1
Sep 10 14:12:48.563947 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:48.563926    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6rscd"]
Sep 10 14:12:48.566264 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:12:48.566242    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc49d3edb_4324_4cce_aeb7_aa73eda47a3b.slice/crio-31cac5202c7a10a010d4fba59ff50872297f2f7baa9a6cd005b6f31263443da6 WatchSource:0}: Error finding container 31cac5202c7a10a010d4fba59ff50872297f2f7baa9a6cd005b6f31263443da6: Status 404 returned error can't find the container with id 31cac5202c7a10a010d4fba59ff50872297f2f7baa9a6cd005b6f31263443da6
Sep 10 14:12:48.622327 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:48.622305    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6rscd" event={"ID":"c49d3edb-4324-4cce-aeb7-aa73eda47a3b","Type":"ContainerStarted","Data":"31cac5202c7a10a010d4fba59ff50872297f2f7baa9a6cd005b6f31263443da6"}
Sep 10 14:12:48.623406 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:48.623385    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w6sct" event={"ID":"721760bd-9049-4f00-999a-078410f3cd57","Type":"ContainerStarted","Data":"c1a3de21a5e38d5d3287f2d5bac93ae3ac979e859ae9097137e019b076d97bc1"}
Sep 10 14:12:54.640897 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:54.640857    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6rscd" event={"ID":"c49d3edb-4324-4cce-aeb7-aa73eda47a3b","Type":"ContainerStarted","Data":"41cb9c83753a5a28b61dbf0252cf214dd2aed2cf7b32881dd550c8af7afed0bd"}
Sep 10 14:12:54.645439 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:54.645407    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w6sct" event={"ID":"721760bd-9049-4f00-999a-078410f3cd57","Type":"ContainerStarted","Data":"28fe6cc26c307ef71711c5f28ecbbc81ac39739f24ba2c8088e2d5df01e22221"}
Sep 10 14:12:54.645584 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:54.645511    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:12:54.656825 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:54.656773    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6rscd" podStartSLOduration=66.117339817 podStartE2EDuration="1m11.656759876s" totalImagesPullingTime="5.539420059s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:12:54.656353334 +0000 UTC m=+72.773894810" watchObservedRunningTime="2026-09-10 14:12:54.656759876 +0000 UTC m=+72.774301351"
Sep 10 14:12:54.671527 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:12:54.671464    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-w6sct" podStartSLOduration=66.131459726 podStartE2EDuration="1m11.671450461s" totalImagesPullingTime="5.539990735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:12:54.670939599 +0000 UTC m=+72.788481074" watchObservedRunningTime="2026-09-10 14:12:54.671450461 +0000 UTC m=+72.788991936"
Sep 10 14:13:19.532937 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:19.532904    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls\") pod \"dns-default-whqv6\" (UID: \"b803a53c-a904-436c-9d1b-4956ef29b1e7\") " pod="openshift-dns/dns-default-whqv6"
Sep 10 14:13:19.533321 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:19.533044    2545 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 14:13:19.533321 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:19.533109    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls podName:b803a53c-a904-436c-9d1b-4956ef29b1e7 nodeName:}" failed. No retries permitted until 2026-09-10 14:14:23.533092427 +0000 UTC m=+161.650633884 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls") pod "dns-default-whqv6" (UID: "b803a53c-a904-436c-9d1b-4956ef29b1e7") : secret "dns-default-metrics-tls" not found
Sep 10 14:13:25.650305 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:25.650274    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-w6sct"
Sep 10 14:13:28.354947 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.354915    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jfq22"]
Sep 10 14:13:28.357410 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.357391    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jfq22"
Sep 10 14:13:28.363111 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.363084    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 10 14:13:28.364666 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.364641    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8q84f\""
Sep 10 14:13:28.365450 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.365426    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 10 14:13:28.365585 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.365564    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 10 14:13:28.366048 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.366026    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 10 14:13:28.389065 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.389043    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jfq22"]
Sep 10 14:13:28.392452 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.392431    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/242ed23a-ba27-4858-b8ea-2cdd4488fea4-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-jfq22\" (UID: \"242ed23a-ba27-4858-b8ea-2cdd4488fea4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jfq22"
Sep 10 14:13:28.392565 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.392466    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/242ed23a-ba27-4858-b8ea-2cdd4488fea4-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-jfq22\" (UID: \"242ed23a-ba27-4858-b8ea-2cdd4488fea4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jfq22"
Sep 10 14:13:28.392565 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.392525    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n2sk\" (UniqueName: \"kubernetes.io/projected/242ed23a-ba27-4858-b8ea-2cdd4488fea4-kube-api-access-5n2sk\") pod \"kube-storage-version-migrator-operator-8d7dd4675-jfq22\" (UID: \"242ed23a-ba27-4858-b8ea-2cdd4488fea4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jfq22"
Sep 10 14:13:28.469448 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.469421    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m2bgl"]
Sep 10 14:13:28.471198 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.471183    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m2bgl"
Sep 10 14:13:28.475475 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.475423    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 10 14:13:28.475736 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.475709    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 10 14:13:28.475892 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.475875    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 10 14:13:28.493398 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.493372    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2600ce61-7f55-481d-b4b7-6d6da86e6f7d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-m2bgl\" (UID: \"2600ce61-7f55-481d-b4b7-6d6da86e6f7d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m2bgl"
Sep 10 14:13:28.493573 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.493413    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/242ed23a-ba27-4858-b8ea-2cdd4488fea4-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-jfq22\" (UID: \"242ed23a-ba27-4858-b8ea-2cdd4488fea4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jfq22"
Sep 10 14:13:28.493573 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.493433    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/242ed23a-ba27-4858-b8ea-2cdd4488fea4-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-jfq22\" (UID: \"242ed23a-ba27-4858-b8ea-2cdd4488fea4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jfq22"
Sep 10 14:13:28.493661 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.493619    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9h7n\" (UniqueName: \"kubernetes.io/projected/2600ce61-7f55-481d-b4b7-6d6da86e6f7d-kube-api-access-m9h7n\") pod \"cluster-samples-operator-7cdcfcf76c-m2bgl\" (UID: \"2600ce61-7f55-481d-b4b7-6d6da86e6f7d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m2bgl"
Sep 10 14:13:28.493718 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.493704    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n2sk\" (UniqueName: \"kubernetes.io/projected/242ed23a-ba27-4858-b8ea-2cdd4488fea4-kube-api-access-5n2sk\") pod \"kube-storage-version-migrator-operator-8d7dd4675-jfq22\" (UID: \"242ed23a-ba27-4858-b8ea-2cdd4488fea4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jfq22"
Sep 10 14:13:28.493875 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.493854    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/242ed23a-ba27-4858-b8ea-2cdd4488fea4-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-jfq22\" (UID: \"242ed23a-ba27-4858-b8ea-2cdd4488fea4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jfq22"
Sep 10 14:13:28.495622 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.495604    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/242ed23a-ba27-4858-b8ea-2cdd4488fea4-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-jfq22\" (UID: \"242ed23a-ba27-4858-b8ea-2cdd4488fea4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jfq22"
Sep 10 14:13:28.496683 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.496668    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-b87kf\""
Sep 10 14:13:28.513904 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.513880    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-mttrc"]
Sep 10 14:13:28.515701 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.515684    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mttrc"
Sep 10 14:13:28.516218 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.516199    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m2bgl"]
Sep 10 14:13:28.528473 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.528455    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 10 14:13:28.528588 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.528458    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 10 14:13:28.528693 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.528677    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6zj4l\""
Sep 10 14:13:28.528886 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.528873    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 10 14:13:28.529371 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.529359    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 10 14:13:28.534300 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.534281    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n2sk\" (UniqueName: \"kubernetes.io/projected/242ed23a-ba27-4858-b8ea-2cdd4488fea4-kube-api-access-5n2sk\") pod \"kube-storage-version-migrator-operator-8d7dd4675-jfq22\" (UID: \"242ed23a-ba27-4858-b8ea-2cdd4488fea4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jfq22"
Sep 10 14:13:28.548979 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.548958    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-mttrc"]
Sep 10 14:13:28.570327 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.570304    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-58d678bf84-6skhd"]
Sep 10 14:13:28.572064 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.572051    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:13:28.578432 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.578414    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 10 14:13:28.578639 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.578623    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 10 14:13:28.578957 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.578943    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 10 14:13:28.579389 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.579375    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 10 14:13:28.581415 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.581397    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 14:13:28.581523 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.581401    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wkcmq\""
Sep 10 14:13:28.581651 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.581637    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 14:13:28.593993 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.593974    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/754eead4-4f50-4e8d-be76-e3d98c6427b7-serving-cert\") pod \"service-ca-operator-859f94c4b-mttrc\" (UID: \"754eead4-4f50-4e8d-be76-e3d98c6427b7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mttrc"
Sep 10 14:13:28.594080 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.594006    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-service-ca-bundle\") pod \"router-default-58d678bf84-6skhd\" (UID: \"b9ef0e19-99ad-4e56-b12a-e21a168b04b9\") " pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:13:28.594080 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.594040    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/754eead4-4f50-4e8d-be76-e3d98c6427b7-config\") pod \"service-ca-operator-859f94c4b-mttrc\" (UID: \"754eead4-4f50-4e8d-be76-e3d98c6427b7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mttrc"
Sep 10 14:13:28.594148 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.594084    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9h7n\" (UniqueName: \"kubernetes.io/projected/2600ce61-7f55-481d-b4b7-6d6da86e6f7d-kube-api-access-m9h7n\") pod \"cluster-samples-operator-7cdcfcf76c-m2bgl\" (UID: \"2600ce61-7f55-481d-b4b7-6d6da86e6f7d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m2bgl"
Sep 10 14:13:28.594148 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.594108    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c88wl\" (UniqueName: \"kubernetes.io/projected/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-kube-api-access-c88wl\") pod \"router-default-58d678bf84-6skhd\" (UID: \"b9ef0e19-99ad-4e56-b12a-e21a168b04b9\") " pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:13:28.594148 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.594144    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-default-certificate\") pod \"router-default-58d678bf84-6skhd\" (UID: \"b9ef0e19-99ad-4e56-b12a-e21a168b04b9\") " pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:13:28.594295 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.594178    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2600ce61-7f55-481d-b4b7-6d6da86e6f7d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-m2bgl\" (UID: \"2600ce61-7f55-481d-b4b7-6d6da86e6f7d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m2bgl"
Sep 10 14:13:28.594295 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.594205    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf6gd\" (UniqueName: \"kubernetes.io/projected/754eead4-4f50-4e8d-be76-e3d98c6427b7-kube-api-access-rf6gd\") pod \"service-ca-operator-859f94c4b-mttrc\" (UID: \"754eead4-4f50-4e8d-be76-e3d98c6427b7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mttrc"
Sep 10 14:13:28.594295 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.594228    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-stats-auth\") pod \"router-default-58d678bf84-6skhd\" (UID: \"b9ef0e19-99ad-4e56-b12a-e21a168b04b9\") " pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:13:28.594295 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.594242    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-metrics-certs\") pod \"router-default-58d678bf84-6skhd\" (UID: \"b9ef0e19-99ad-4e56-b12a-e21a168b04b9\") " pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:13:28.594295 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:28.594272    2545 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 14:13:28.594591 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:28.594346    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2600ce61-7f55-481d-b4b7-6d6da86e6f7d-samples-operator-tls podName:2600ce61-7f55-481d-b4b7-6d6da86e6f7d nodeName:}" failed. No retries permitted until 2026-09-10 14:13:29.094326886 +0000 UTC m=+107.211868354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2600ce61-7f55-481d-b4b7-6d6da86e6f7d-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-m2bgl" (UID: "2600ce61-7f55-481d-b4b7-6d6da86e6f7d") : secret "samples-operator-tls" not found
Sep 10 14:13:28.604400 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.604376    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-58d678bf84-6skhd"]
Sep 10 14:13:28.622085 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.622027    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9h7n\" (UniqueName: \"kubernetes.io/projected/2600ce61-7f55-481d-b4b7-6d6da86e6f7d-kube-api-access-m9h7n\") pod \"cluster-samples-operator-7cdcfcf76c-m2bgl\" (UID: \"2600ce61-7f55-481d-b4b7-6d6da86e6f7d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m2bgl"
Sep 10 14:13:28.667714 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.667695    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jfq22"
Sep 10 14:13:28.695028 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.695002    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf6gd\" (UniqueName: \"kubernetes.io/projected/754eead4-4f50-4e8d-be76-e3d98c6427b7-kube-api-access-rf6gd\") pod \"service-ca-operator-859f94c4b-mttrc\" (UID: \"754eead4-4f50-4e8d-be76-e3d98c6427b7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mttrc"
Sep 10 14:13:28.695181 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.695034    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-stats-auth\") pod \"router-default-58d678bf84-6skhd\" (UID: \"b9ef0e19-99ad-4e56-b12a-e21a168b04b9\") " pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:13:28.695181 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.695051    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-metrics-certs\") pod \"router-default-58d678bf84-6skhd\" (UID: \"b9ef0e19-99ad-4e56-b12a-e21a168b04b9\") " pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:13:28.695181 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.695075    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/754eead4-4f50-4e8d-be76-e3d98c6427b7-serving-cert\") pod \"service-ca-operator-859f94c4b-mttrc\" (UID: \"754eead4-4f50-4e8d-be76-e3d98c6427b7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mttrc"
Sep 10 14:13:28.695181 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.695123    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-service-ca-bundle\") pod \"router-default-58d678bf84-6skhd\" (UID: \"b9ef0e19-99ad-4e56-b12a-e21a168b04b9\") " pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:13:28.695181 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:28.695165    2545 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 14:13:28.695420 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.695166    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/754eead4-4f50-4e8d-be76-e3d98c6427b7-config\") pod \"service-ca-operator-859f94c4b-mttrc\" (UID: \"754eead4-4f50-4e8d-be76-e3d98c6427b7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mttrc"
Sep 10 14:13:28.695420 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:28.695239    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-metrics-certs podName:b9ef0e19-99ad-4e56-b12a-e21a168b04b9 nodeName:}" failed. No retries permitted until 2026-09-10 14:13:29.195219957 +0000 UTC m=+107.312761414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-metrics-certs") pod "router-default-58d678bf84-6skhd" (UID: "b9ef0e19-99ad-4e56-b12a-e21a168b04b9") : secret "router-metrics-certs-default" not found
Sep 10 14:13:28.695420 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.695278    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c88wl\" (UniqueName: \"kubernetes.io/projected/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-kube-api-access-c88wl\") pod \"router-default-58d678bf84-6skhd\" (UID: \"b9ef0e19-99ad-4e56-b12a-e21a168b04b9\") " pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:13:28.695420 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:28.695289    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-service-ca-bundle podName:b9ef0e19-99ad-4e56-b12a-e21a168b04b9 nodeName:}" failed. No retries permitted until 2026-09-10 14:13:29.195271326 +0000 UTC m=+107.312812799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-service-ca-bundle") pod "router-default-58d678bf84-6skhd" (UID: "b9ef0e19-99ad-4e56-b12a-e21a168b04b9") : configmap references non-existent config key: service-ca.crt
Sep 10 14:13:28.695420 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.695344    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-default-certificate\") pod \"router-default-58d678bf84-6skhd\" (UID: \"b9ef0e19-99ad-4e56-b12a-e21a168b04b9\") " pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:13:28.695942 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.695910    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/754eead4-4f50-4e8d-be76-e3d98c6427b7-config\") pod \"service-ca-operator-859f94c4b-mttrc\" (UID: \"754eead4-4f50-4e8d-be76-e3d98c6427b7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mttrc"
Sep 10 14:13:28.697207 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.697185    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/754eead4-4f50-4e8d-be76-e3d98c6427b7-serving-cert\") pod \"service-ca-operator-859f94c4b-mttrc\" (UID: \"754eead4-4f50-4e8d-be76-e3d98c6427b7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mttrc"
Sep 10 14:13:28.698047 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.698027    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-stats-auth\") pod \"router-default-58d678bf84-6skhd\" (UID: \"b9ef0e19-99ad-4e56-b12a-e21a168b04b9\") " pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:13:28.698122 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.698034    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-default-certificate\") pod \"router-default-58d678bf84-6skhd\" (UID: \"b9ef0e19-99ad-4e56-b12a-e21a168b04b9\") " pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:13:28.712701 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.712672    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf6gd\" (UniqueName: \"kubernetes.io/projected/754eead4-4f50-4e8d-be76-e3d98c6427b7-kube-api-access-rf6gd\") pod \"service-ca-operator-859f94c4b-mttrc\" (UID: \"754eead4-4f50-4e8d-be76-e3d98c6427b7\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mttrc"
Sep 10 14:13:28.731909 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.731885    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c88wl\" (UniqueName: \"kubernetes.io/projected/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-kube-api-access-c88wl\") pod \"router-default-58d678bf84-6skhd\" (UID: \"b9ef0e19-99ad-4e56-b12a-e21a168b04b9\") " pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:13:28.824220 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.824182    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mttrc"
Sep 10 14:13:28.935152 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:28.935087    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jfq22"]
Sep 10 14:13:28.938426 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:13:28.938399    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod242ed23a_ba27_4858_b8ea_2cdd4488fea4.slice/crio-c1d495a400e3f9963359131139d0ea643d18e268b816fe7e378b8ec3397ff584 WatchSource:0}: Error finding container c1d495a400e3f9963359131139d0ea643d18e268b816fe7e378b8ec3397ff584: Status 404 returned error can't find the container with id c1d495a400e3f9963359131139d0ea643d18e268b816fe7e378b8ec3397ff584
Sep 10 14:13:29.091857 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:29.091824    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-mttrc"]
Sep 10 14:13:29.094556 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:13:29.094529    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod754eead4_4f50_4e8d_be76_e3d98c6427b7.slice/crio-21090cd04fae2bdf710237f2479b2a913e7056f9e2b6e9acc851202b986457ef WatchSource:0}: Error finding container 21090cd04fae2bdf710237f2479b2a913e7056f9e2b6e9acc851202b986457ef: Status 404 returned error can't find the container with id 21090cd04fae2bdf710237f2479b2a913e7056f9e2b6e9acc851202b986457ef
Sep 10 14:13:29.098132 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:29.098109    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2600ce61-7f55-481d-b4b7-6d6da86e6f7d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-m2bgl\" (UID: \"2600ce61-7f55-481d-b4b7-6d6da86e6f7d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m2bgl"
Sep 10 14:13:29.098280 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:29.098264    2545 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 14:13:29.098346 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:29.098319    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2600ce61-7f55-481d-b4b7-6d6da86e6f7d-samples-operator-tls podName:2600ce61-7f55-481d-b4b7-6d6da86e6f7d nodeName:}" failed. No retries permitted until 2026-09-10 14:13:30.098304395 +0000 UTC m=+108.215845847 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2600ce61-7f55-481d-b4b7-6d6da86e6f7d-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-m2bgl" (UID: "2600ce61-7f55-481d-b4b7-6d6da86e6f7d") : secret "samples-operator-tls" not found
Sep 10 14:13:29.198459 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:29.198373    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-service-ca-bundle\") pod \"router-default-58d678bf84-6skhd\" (UID: \"b9ef0e19-99ad-4e56-b12a-e21a168b04b9\") " pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:13:29.198459 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:29.198457    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-metrics-certs\") pod \"router-default-58d678bf84-6skhd\" (UID: \"b9ef0e19-99ad-4e56-b12a-e21a168b04b9\") " pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:13:29.198655 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:29.198561    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-service-ca-bundle podName:b9ef0e19-99ad-4e56-b12a-e21a168b04b9 nodeName:}" failed. No retries permitted until 2026-09-10 14:13:30.198540826 +0000 UTC m=+108.316082300 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-service-ca-bundle") pod "router-default-58d678bf84-6skhd" (UID: "b9ef0e19-99ad-4e56-b12a-e21a168b04b9") : configmap references non-existent config key: service-ca.crt
Sep 10 14:13:29.198655 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:29.198581    2545 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 14:13:29.198655 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:29.198627    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-metrics-certs podName:b9ef0e19-99ad-4e56-b12a-e21a168b04b9 nodeName:}" failed. No retries permitted until 2026-09-10 14:13:30.198613483 +0000 UTC m=+108.316154942 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-metrics-certs") pod "router-default-58d678bf84-6skhd" (UID: "b9ef0e19-99ad-4e56-b12a-e21a168b04b9") : secret "router-metrics-certs-default" not found
Sep 10 14:13:29.732640 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:29.732609    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mttrc" event={"ID":"754eead4-4f50-4e8d-be76-e3d98c6427b7","Type":"ContainerStarted","Data":"21090cd04fae2bdf710237f2479b2a913e7056f9e2b6e9acc851202b986457ef"}
Sep 10 14:13:29.733700 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:29.733676    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jfq22" event={"ID":"242ed23a-ba27-4858-b8ea-2cdd4488fea4","Type":"ContainerStarted","Data":"c1d495a400e3f9963359131139d0ea643d18e268b816fe7e378b8ec3397ff584"}
Sep 10 14:13:30.109470 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:30.109433    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2600ce61-7f55-481d-b4b7-6d6da86e6f7d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-m2bgl\" (UID: \"2600ce61-7f55-481d-b4b7-6d6da86e6f7d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m2bgl"
Sep 10 14:13:30.109640 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:30.109620    2545 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 14:13:30.109719 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:30.109707    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2600ce61-7f55-481d-b4b7-6d6da86e6f7d-samples-operator-tls podName:2600ce61-7f55-481d-b4b7-6d6da86e6f7d nodeName:}" failed. No retries permitted until 2026-09-10 14:13:32.109684978 +0000 UTC m=+110.227226444 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2600ce61-7f55-481d-b4b7-6d6da86e6f7d-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-m2bgl" (UID: "2600ce61-7f55-481d-b4b7-6d6da86e6f7d") : secret "samples-operator-tls" not found
Sep 10 14:13:30.210746 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:30.210707    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-metrics-certs\") pod \"router-default-58d678bf84-6skhd\" (UID: \"b9ef0e19-99ad-4e56-b12a-e21a168b04b9\") " pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:13:30.210927 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:30.210763    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-service-ca-bundle\") pod \"router-default-58d678bf84-6skhd\" (UID: \"b9ef0e19-99ad-4e56-b12a-e21a168b04b9\") " pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:13:30.210927 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:30.210866    2545 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 14:13:30.211043 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:30.210939    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-metrics-certs podName:b9ef0e19-99ad-4e56-b12a-e21a168b04b9 nodeName:}" failed. No retries permitted until 2026-09-10 14:13:32.210920659 +0000 UTC m=+110.328462130 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-metrics-certs") pod "router-default-58d678bf84-6skhd" (UID: "b9ef0e19-99ad-4e56-b12a-e21a168b04b9") : secret "router-metrics-certs-default" not found
Sep 10 14:13:30.211043 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:30.210958    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-service-ca-bundle podName:b9ef0e19-99ad-4e56-b12a-e21a168b04b9 nodeName:}" failed. No retries permitted until 2026-09-10 14:13:32.210948754 +0000 UTC m=+110.328490211 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-service-ca-bundle") pod "router-default-58d678bf84-6skhd" (UID: "b9ef0e19-99ad-4e56-b12a-e21a168b04b9") : configmap references non-existent config key: service-ca.crt
Sep 10 14:13:31.739803 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:31.739773    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jfq22" event={"ID":"242ed23a-ba27-4858-b8ea-2cdd4488fea4","Type":"ContainerStarted","Data":"5075fff476dd25e7c88bc0af2530ce0aec5a0767aba3c65ad96c8faf989b79a9"}
Sep 10 14:13:31.760651 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:31.760598    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jfq22" podStartSLOduration=1.027075658 podStartE2EDuration="3.760584077s" totalImagesPullingTime="2.733508419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:13:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:13:31.759905509 +0000 UTC m=+109.877446990" watchObservedRunningTime="2026-09-10 14:13:31.760584077 +0000 UTC m=+109.878125551"
Sep 10 14:13:32.125452 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:32.125408    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2600ce61-7f55-481d-b4b7-6d6da86e6f7d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-m2bgl\" (UID: \"2600ce61-7f55-481d-b4b7-6d6da86e6f7d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m2bgl"
Sep 10 14:13:32.125646 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:32.125571    2545 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 14:13:32.125646 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:32.125640    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2600ce61-7f55-481d-b4b7-6d6da86e6f7d-samples-operator-tls podName:2600ce61-7f55-481d-b4b7-6d6da86e6f7d nodeName:}" failed. No retries permitted until 2026-09-10 14:13:36.125622149 +0000 UTC m=+114.243163607 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2600ce61-7f55-481d-b4b7-6d6da86e6f7d-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-m2bgl" (UID: "2600ce61-7f55-481d-b4b7-6d6da86e6f7d") : secret "samples-operator-tls" not found
Sep 10 14:13:32.226120 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:32.226082    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-metrics-certs\") pod \"router-default-58d678bf84-6skhd\" (UID: \"b9ef0e19-99ad-4e56-b12a-e21a168b04b9\") " pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:13:32.226320 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:32.226140    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-service-ca-bundle\") pod \"router-default-58d678bf84-6skhd\" (UID: \"b9ef0e19-99ad-4e56-b12a-e21a168b04b9\") " pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:13:32.226320 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:32.226252    2545 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 14:13:32.226320 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:32.226295    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-service-ca-bundle podName:b9ef0e19-99ad-4e56-b12a-e21a168b04b9 nodeName:}" failed. No retries permitted until 2026-09-10 14:13:36.226276824 +0000 UTC m=+114.343818289 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-service-ca-bundle") pod "router-default-58d678bf84-6skhd" (UID: "b9ef0e19-99ad-4e56-b12a-e21a168b04b9") : configmap references non-existent config key: service-ca.crt
Sep 10 14:13:32.226320 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:32.226316    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-metrics-certs podName:b9ef0e19-99ad-4e56-b12a-e21a168b04b9 nodeName:}" failed. No retries permitted until 2026-09-10 14:13:36.226307614 +0000 UTC m=+114.343849071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-metrics-certs") pod "router-default-58d678bf84-6skhd" (UID: "b9ef0e19-99ad-4e56-b12a-e21a168b04b9") : secret "router-metrics-certs-default" not found
Sep 10 14:13:32.743915 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:32.743881    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mttrc" event={"ID":"754eead4-4f50-4e8d-be76-e3d98c6427b7","Type":"ContainerStarted","Data":"a1728aa70b830522e2825f3b70dff2f4a60d27f1391c922f37c869970cba5030"}
Sep 10 14:13:32.765710 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:32.765667    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mttrc" podStartSLOduration=1.508948465 podStartE2EDuration="4.765651129s" totalImagesPullingTime="3.256702664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:13:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:13:32.764180399 +0000 UTC m=+110.881721874" watchObservedRunningTime="2026-09-10 14:13:32.765651129 +0000 UTC m=+110.883192600"
Sep 10 14:13:33.154839 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:33.154736    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-djjnx"]
Sep 10 14:13:33.156786 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:33.156764    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:13:33.159878 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:33.159812    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 14:13:33.159878 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:33.159828    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 14:13:33.160047 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:33.159837    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2mhjl\""
Sep 10 14:13:33.161056 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:33.161038    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 14:13:33.161196 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:33.161038    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 14:13:33.170557 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:33.170534    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-djjnx"]
Sep 10 14:13:33.235061 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:33.235032    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba0e5564-7333-4c1f-acdf-89ebb69989ca-crio-socket\") pod \"insights-runtime-extractor-djjnx\" (UID: \"ba0e5564-7333-4c1f-acdf-89ebb69989ca\") " pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:13:33.235061 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:33.235067    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2mrc\" (UniqueName: \"kubernetes.io/projected/ba0e5564-7333-4c1f-acdf-89ebb69989ca-kube-api-access-c2mrc\") pod \"insights-runtime-extractor-djjnx\" (UID: \"ba0e5564-7333-4c1f-acdf-89ebb69989ca\") " pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:13:33.235276 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:33.235098    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba0e5564-7333-4c1f-acdf-89ebb69989ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-djjnx\" (UID: \"ba0e5564-7333-4c1f-acdf-89ebb69989ca\") " pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:13:33.235276 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:33.235205    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba0e5564-7333-4c1f-acdf-89ebb69989ca-data-volume\") pod \"insights-runtime-extractor-djjnx\" (UID: \"ba0e5564-7333-4c1f-acdf-89ebb69989ca\") " pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:13:33.235276 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:33.235243    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba0e5564-7333-4c1f-acdf-89ebb69989ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-djjnx\" (UID: \"ba0e5564-7333-4c1f-acdf-89ebb69989ca\") " pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:13:33.336676 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:33.336637    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba0e5564-7333-4c1f-acdf-89ebb69989ca-crio-socket\") pod \"insights-runtime-extractor-djjnx\" (UID: \"ba0e5564-7333-4c1f-acdf-89ebb69989ca\") " pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:13:33.336676 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:33.336677    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2mrc\" (UniqueName: \"kubernetes.io/projected/ba0e5564-7333-4c1f-acdf-89ebb69989ca-kube-api-access-c2mrc\") pod \"insights-runtime-extractor-djjnx\" (UID: \"ba0e5564-7333-4c1f-acdf-89ebb69989ca\") " pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:13:33.336864 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:33.336698    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba0e5564-7333-4c1f-acdf-89ebb69989ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-djjnx\" (UID: \"ba0e5564-7333-4c1f-acdf-89ebb69989ca\") " pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:13:33.336864 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:33.336733    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba0e5564-7333-4c1f-acdf-89ebb69989ca-data-volume\") pod \"insights-runtime-extractor-djjnx\" (UID: \"ba0e5564-7333-4c1f-acdf-89ebb69989ca\") " pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:13:33.336864 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:33.336750    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba0e5564-7333-4c1f-acdf-89ebb69989ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-djjnx\" (UID: \"ba0e5564-7333-4c1f-acdf-89ebb69989ca\") " pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:13:33.336864 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:33.336818    2545 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 14:13:33.336864 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:33.336850    2545 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 14:13:33.337020 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:33.336888    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba0e5564-7333-4c1f-acdf-89ebb69989ca-kube-rbac-proxy-cm podName:ba0e5564-7333-4c1f-acdf-89ebb69989ca nodeName:}" failed. No retries permitted until 2026-09-10 14:13:33.836871501 +0000 UTC m=+111.954412954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ba0e5564-7333-4c1f-acdf-89ebb69989ca-kube-rbac-proxy-cm") pod "insights-runtime-extractor-djjnx" (UID: "ba0e5564-7333-4c1f-acdf-89ebb69989ca") : configmap "kube-rbac-proxy" not found
Sep 10 14:13:33.337020 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:33.336906    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba0e5564-7333-4c1f-acdf-89ebb69989ca-insights-runtime-extractor-tls podName:ba0e5564-7333-4c1f-acdf-89ebb69989ca nodeName:}" failed. No retries permitted until 2026-09-10 14:13:33.836897923 +0000 UTC m=+111.954439376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba0e5564-7333-4c1f-acdf-89ebb69989ca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-djjnx" (UID: "ba0e5564-7333-4c1f-acdf-89ebb69989ca") : secret "insights-runtime-extractor-tls" not found
Sep 10 14:13:33.337020 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:33.336942    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba0e5564-7333-4c1f-acdf-89ebb69989ca-crio-socket\") pod \"insights-runtime-extractor-djjnx\" (UID: \"ba0e5564-7333-4c1f-acdf-89ebb69989ca\") " pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:13:33.337121 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:33.337053    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba0e5564-7333-4c1f-acdf-89ebb69989ca-data-volume\") pod \"insights-runtime-extractor-djjnx\" (UID: \"ba0e5564-7333-4c1f-acdf-89ebb69989ca\") " pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:13:33.345680 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:33.345659    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2mrc\" (UniqueName: \"kubernetes.io/projected/ba0e5564-7333-4c1f-acdf-89ebb69989ca-kube-api-access-c2mrc\") pod \"insights-runtime-extractor-djjnx\" (UID: \"ba0e5564-7333-4c1f-acdf-89ebb69989ca\") " pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:13:33.841737 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:33.841702    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba0e5564-7333-4c1f-acdf-89ebb69989ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-djjnx\" (UID: \"ba0e5564-7333-4c1f-acdf-89ebb69989ca\") " pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:13:33.842182 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:33.841760    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba0e5564-7333-4c1f-acdf-89ebb69989ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-djjnx\" (UID: \"ba0e5564-7333-4c1f-acdf-89ebb69989ca\") " pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:13:33.842182 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:33.841845    2545 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 14:13:33.842182 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:33.841935    2545 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 14:13:33.842182 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:33.841963    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba0e5564-7333-4c1f-acdf-89ebb69989ca-kube-rbac-proxy-cm podName:ba0e5564-7333-4c1f-acdf-89ebb69989ca nodeName:}" failed. No retries permitted until 2026-09-10 14:13:34.841944542 +0000 UTC m=+112.959486010 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ba0e5564-7333-4c1f-acdf-89ebb69989ca-kube-rbac-proxy-cm") pod "insights-runtime-extractor-djjnx" (UID: "ba0e5564-7333-4c1f-acdf-89ebb69989ca") : configmap "kube-rbac-proxy" not found
Sep 10 14:13:33.842182 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:33.842002    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba0e5564-7333-4c1f-acdf-89ebb69989ca-insights-runtime-extractor-tls podName:ba0e5564-7333-4c1f-acdf-89ebb69989ca nodeName:}" failed. No retries permitted until 2026-09-10 14:13:34.841986057 +0000 UTC m=+112.959527530 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba0e5564-7333-4c1f-acdf-89ebb69989ca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-djjnx" (UID: "ba0e5564-7333-4c1f-acdf-89ebb69989ca") : secret "insights-runtime-extractor-tls" not found
Sep 10 14:13:34.848420 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:34.848383    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba0e5564-7333-4c1f-acdf-89ebb69989ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-djjnx\" (UID: \"ba0e5564-7333-4c1f-acdf-89ebb69989ca\") " pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:13:34.848900 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:34.848432    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba0e5564-7333-4c1f-acdf-89ebb69989ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-djjnx\" (UID: \"ba0e5564-7333-4c1f-acdf-89ebb69989ca\") " pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:13:34.848900 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:34.848519    2545 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 14:13:34.848900 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:34.848547    2545 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 14:13:34.848900 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:34.848573    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba0e5564-7333-4c1f-acdf-89ebb69989ca-kube-rbac-proxy-cm podName:ba0e5564-7333-4c1f-acdf-89ebb69989ca nodeName:}" failed. No retries permitted until 2026-09-10 14:13:36.848560387 +0000 UTC m=+114.966101839 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ba0e5564-7333-4c1f-acdf-89ebb69989ca-kube-rbac-proxy-cm") pod "insights-runtime-extractor-djjnx" (UID: "ba0e5564-7333-4c1f-acdf-89ebb69989ca") : configmap "kube-rbac-proxy" not found
Sep 10 14:13:34.848900 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:34.848597    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba0e5564-7333-4c1f-acdf-89ebb69989ca-insights-runtime-extractor-tls podName:ba0e5564-7333-4c1f-acdf-89ebb69989ca nodeName:}" failed. No retries permitted until 2026-09-10 14:13:36.848583892 +0000 UTC m=+114.966125344 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba0e5564-7333-4c1f-acdf-89ebb69989ca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-djjnx" (UID: "ba0e5564-7333-4c1f-acdf-89ebb69989ca") : secret "insights-runtime-extractor-tls" not found
Sep 10 14:13:35.919798 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:35.919770    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ff5pl_0ea5e2be-249a-4829-8bad-e978cbdaf6fe/dns-node-resolver/0.log"
Sep 10 14:13:36.159428 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:36.159378    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2600ce61-7f55-481d-b4b7-6d6da86e6f7d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-m2bgl\" (UID: \"2600ce61-7f55-481d-b4b7-6d6da86e6f7d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m2bgl"
Sep 10 14:13:36.159624 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:36.159547    2545 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 14:13:36.159624 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:36.159609    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2600ce61-7f55-481d-b4b7-6d6da86e6f7d-samples-operator-tls podName:2600ce61-7f55-481d-b4b7-6d6da86e6f7d nodeName:}" failed. No retries permitted until 2026-09-10 14:13:44.15959466 +0000 UTC m=+122.277136118 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2600ce61-7f55-481d-b4b7-6d6da86e6f7d-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-m2bgl" (UID: "2600ce61-7f55-481d-b4b7-6d6da86e6f7d") : secret "samples-operator-tls" not found
Sep 10 14:13:36.260647 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:36.260620    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-metrics-certs\") pod \"router-default-58d678bf84-6skhd\" (UID: \"b9ef0e19-99ad-4e56-b12a-e21a168b04b9\") " pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:13:36.260790 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:36.260670    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-service-ca-bundle\") pod \"router-default-58d678bf84-6skhd\" (UID: \"b9ef0e19-99ad-4e56-b12a-e21a168b04b9\") " pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:13:36.260790 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:36.260773    2545 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 14:13:36.260883 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:36.260779    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-service-ca-bundle podName:b9ef0e19-99ad-4e56-b12a-e21a168b04b9 nodeName:}" failed. No retries permitted until 2026-09-10 14:13:44.260767102 +0000 UTC m=+122.378308555 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-service-ca-bundle") pod "router-default-58d678bf84-6skhd" (UID: "b9ef0e19-99ad-4e56-b12a-e21a168b04b9") : configmap references non-existent config key: service-ca.crt
Sep 10 14:13:36.260883 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:36.260834    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-metrics-certs podName:b9ef0e19-99ad-4e56-b12a-e21a168b04b9 nodeName:}" failed. No retries permitted until 2026-09-10 14:13:44.260820846 +0000 UTC m=+122.378362298 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-metrics-certs") pod "router-default-58d678bf84-6skhd" (UID: "b9ef0e19-99ad-4e56-b12a-e21a168b04b9") : secret "router-metrics-certs-default" not found
Sep 10 14:13:36.724514 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:36.724423    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rw64n_370d222e-be9d-42d0-aa73-d9934e17cdfb/node-ca/0.log"
Sep 10 14:13:36.865034 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:36.864991    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba0e5564-7333-4c1f-acdf-89ebb69989ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-djjnx\" (UID: \"ba0e5564-7333-4c1f-acdf-89ebb69989ca\") " pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:13:36.865226 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:36.865051    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba0e5564-7333-4c1f-acdf-89ebb69989ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-djjnx\" (UID: \"ba0e5564-7333-4c1f-acdf-89ebb69989ca\") " pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:13:36.865226 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:36.865137    2545 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 14:13:36.865226 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:36.865158    2545 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 14:13:36.865226 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:36.865201    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba0e5564-7333-4c1f-acdf-89ebb69989ca-insights-runtime-extractor-tls podName:ba0e5564-7333-4c1f-acdf-89ebb69989ca nodeName:}" failed. No retries permitted until 2026-09-10 14:13:40.865187587 +0000 UTC m=+118.982729040 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba0e5564-7333-4c1f-acdf-89ebb69989ca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-djjnx" (UID: "ba0e5564-7333-4c1f-acdf-89ebb69989ca") : secret "insights-runtime-extractor-tls" not found
Sep 10 14:13:36.865226 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:36.865217    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba0e5564-7333-4c1f-acdf-89ebb69989ca-kube-rbac-proxy-cm podName:ba0e5564-7333-4c1f-acdf-89ebb69989ca nodeName:}" failed. No retries permitted until 2026-09-10 14:13:40.865208773 +0000 UTC m=+118.982750225 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ba0e5564-7333-4c1f-acdf-89ebb69989ca-kube-rbac-proxy-cm") pod "insights-runtime-extractor-djjnx" (UID: "ba0e5564-7333-4c1f-acdf-89ebb69989ca") : configmap "kube-rbac-proxy" not found
Sep 10 14:13:37.322204 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:37.322175    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hhnkw_50606e5c-a872-4b2f-9437-a490b24bcda9/serve-healthcheck-canary/0.log"
Sep 10 14:13:38.326872 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:38.326827    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-jfq22_242ed23a-ba27-4858-b8ea-2cdd4488fea4/kube-storage-version-migrator-operator/0.log"
Sep 10 14:13:40.897422 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:40.897376    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba0e5564-7333-4c1f-acdf-89ebb69989ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-djjnx\" (UID: \"ba0e5564-7333-4c1f-acdf-89ebb69989ca\") " pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:13:40.897920 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:40.897436    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba0e5564-7333-4c1f-acdf-89ebb69989ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-djjnx\" (UID: \"ba0e5564-7333-4c1f-acdf-89ebb69989ca\") " pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:13:40.897920 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:40.897535    2545 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 14:13:40.897920 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:40.897543    2545 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 14:13:40.897920 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:40.897611    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba0e5564-7333-4c1f-acdf-89ebb69989ca-kube-rbac-proxy-cm podName:ba0e5564-7333-4c1f-acdf-89ebb69989ca nodeName:}" failed. No retries permitted until 2026-09-10 14:13:48.89758901 +0000 UTC m=+127.015130477 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ba0e5564-7333-4c1f-acdf-89ebb69989ca-kube-rbac-proxy-cm") pod "insights-runtime-extractor-djjnx" (UID: "ba0e5564-7333-4c1f-acdf-89ebb69989ca") : configmap "kube-rbac-proxy" not found
Sep 10 14:13:40.897920 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:40.897629    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba0e5564-7333-4c1f-acdf-89ebb69989ca-insights-runtime-extractor-tls podName:ba0e5564-7333-4c1f-acdf-89ebb69989ca nodeName:}" failed. No retries permitted until 2026-09-10 14:13:48.897620949 +0000 UTC m=+127.015162401 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba0e5564-7333-4c1f-acdf-89ebb69989ca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-djjnx" (UID: "ba0e5564-7333-4c1f-acdf-89ebb69989ca") : secret "insights-runtime-extractor-tls" not found
Sep 10 14:13:44.221598 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:44.221563    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2600ce61-7f55-481d-b4b7-6d6da86e6f7d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-m2bgl\" (UID: \"2600ce61-7f55-481d-b4b7-6d6da86e6f7d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m2bgl"
Sep 10 14:13:44.223839 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:44.223819    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2600ce61-7f55-481d-b4b7-6d6da86e6f7d-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-m2bgl\" (UID: \"2600ce61-7f55-481d-b4b7-6d6da86e6f7d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m2bgl"
Sep 10 14:13:44.322809 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:44.322775    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-metrics-certs\") pod \"router-default-58d678bf84-6skhd\" (UID: \"b9ef0e19-99ad-4e56-b12a-e21a168b04b9\") " pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:13:44.323017 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:44.322836    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-service-ca-bundle\") pod \"router-default-58d678bf84-6skhd\" (UID: \"b9ef0e19-99ad-4e56-b12a-e21a168b04b9\") " pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:13:44.323017 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:44.322968    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-service-ca-bundle podName:b9ef0e19-99ad-4e56-b12a-e21a168b04b9 nodeName:}" failed. No retries permitted until 2026-09-10 14:14:00.322948574 +0000 UTC m=+138.440490048 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-service-ca-bundle") pod "router-default-58d678bf84-6skhd" (UID: "b9ef0e19-99ad-4e56-b12a-e21a168b04b9") : configmap references non-existent config key: service-ca.crt
Sep 10 14:13:44.325116 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:44.325094    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-metrics-certs\") pod \"router-default-58d678bf84-6skhd\" (UID: \"b9ef0e19-99ad-4e56-b12a-e21a168b04b9\") " pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:13:44.382684 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:44.382655    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-b87kf\""
Sep 10 14:13:44.390290 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:44.390271    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m2bgl"
Sep 10 14:13:44.682804 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:44.682773    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m2bgl"]
Sep 10 14:13:44.775249 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:44.775214    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m2bgl" event={"ID":"2600ce61-7f55-481d-b4b7-6d6da86e6f7d","Type":"ContainerStarted","Data":"3bc6747b6573a9d08763d2b3a38565243a4e81089ebfe293ac034fe5a39434ef"}
Sep 10 14:13:46.782882 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:46.782847    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m2bgl" event={"ID":"2600ce61-7f55-481d-b4b7-6d6da86e6f7d","Type":"ContainerStarted","Data":"e77ead2842b65e14110f49674bc96115a8ec21542b8356be7baa7f9d8eb1bfc8"}
Sep 10 14:13:46.783248 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:46.782928    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m2bgl" event={"ID":"2600ce61-7f55-481d-b4b7-6d6da86e6f7d","Type":"ContainerStarted","Data":"5da77a088b62541c2ba36fc543d3a763567b198ad6755f876da4c400605d792e"}
Sep 10 14:13:46.809404 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:46.809355    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m2bgl" podStartSLOduration=16.953012288 podStartE2EDuration="18.80933996s" totalImagesPullingTime="1.856327672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:13:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:13:46.807511978 +0000 UTC m=+124.925053450" watchObservedRunningTime="2026-09-10 14:13:46.80933996 +0000 UTC m=+124.926881430"
Sep 10 14:13:48.961212 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:48.961170    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba0e5564-7333-4c1f-acdf-89ebb69989ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-djjnx\" (UID: \"ba0e5564-7333-4c1f-acdf-89ebb69989ca\") " pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:13:48.961212 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:48.961218    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba0e5564-7333-4c1f-acdf-89ebb69989ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-djjnx\" (UID: \"ba0e5564-7333-4c1f-acdf-89ebb69989ca\") " pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:13:48.961743 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:48.961336    2545 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 14:13:48.961743 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:13:48.961419    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba0e5564-7333-4c1f-acdf-89ebb69989ca-insights-runtime-extractor-tls podName:ba0e5564-7333-4c1f-acdf-89ebb69989ca nodeName:}" failed. No retries permitted until 2026-09-10 14:14:04.961397989 +0000 UTC m=+143.078939448 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba0e5564-7333-4c1f-acdf-89ebb69989ca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-djjnx" (UID: "ba0e5564-7333-4c1f-acdf-89ebb69989ca") : secret "insights-runtime-extractor-tls" not found
Sep 10 14:13:48.961743 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:48.961699    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba0e5564-7333-4c1f-acdf-89ebb69989ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-djjnx\" (UID: \"ba0e5564-7333-4c1f-acdf-89ebb69989ca\") " pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:13:52.185819 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:52.185768    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs\") pod \"network-metrics-daemon-dzrg2\" (UID: \"f60ac0b0-5ece-478d-855b-9ed8c8bff1d2\") " pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:13:52.188004 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:52.187980    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f60ac0b0-5ece-478d-855b-9ed8c8bff1d2-metrics-certs\") pod \"network-metrics-daemon-dzrg2\" (UID: \"f60ac0b0-5ece-478d-855b-9ed8c8bff1d2\") " pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:13:52.481122 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:52.481043    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jzwbc\""
Sep 10 14:13:52.488170 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:52.488147    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dzrg2"
Sep 10 14:13:52.769553 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:52.769516    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dzrg2"]
Sep 10 14:13:52.773043 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:13:52.773008    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf60ac0b0_5ece_478d_855b_9ed8c8bff1d2.slice/crio-7af6956921fdbe99756876f22c894bfd887630f49d6b8b7044d7a934f3d1bbf5 WatchSource:0}: Error finding container 7af6956921fdbe99756876f22c894bfd887630f49d6b8b7044d7a934f3d1bbf5: Status 404 returned error can't find the container with id 7af6956921fdbe99756876f22c894bfd887630f49d6b8b7044d7a934f3d1bbf5
Sep 10 14:13:52.802268 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:52.802231    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dzrg2" event={"ID":"f60ac0b0-5ece-478d-855b-9ed8c8bff1d2","Type":"ContainerStarted","Data":"7af6956921fdbe99756876f22c894bfd887630f49d6b8b7044d7a934f3d1bbf5"}
Sep 10 14:13:54.813868 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:54.813831    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dzrg2" event={"ID":"f60ac0b0-5ece-478d-855b-9ed8c8bff1d2","Type":"ContainerStarted","Data":"368b907f29aad3f202bf66bf00177521416488ce0c9796c426736c5d23b0e9b1"}
Sep 10 14:13:54.814314 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:54.813923    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dzrg2" event={"ID":"f60ac0b0-5ece-478d-855b-9ed8c8bff1d2","Type":"ContainerStarted","Data":"18585fb1acb473e7aaa719af9140664d3c0a6875b9a68cef0138663e1b9e727d"}
Sep 10 14:13:54.837303 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:13:54.837245    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dzrg2" podStartSLOduration=130.564918365 podStartE2EDuration="2m11.8372276s" totalImagesPullingTime="1.272309235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:13:54.835941158 +0000 UTC m=+132.953482632" watchObservedRunningTime="2026-09-10 14:13:54.8372276 +0000 UTC m=+132.954769086"
Sep 10 14:14:00.351760 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:00.351716    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-service-ca-bundle\") pod \"router-default-58d678bf84-6skhd\" (UID: \"b9ef0e19-99ad-4e56-b12a-e21a168b04b9\") " pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:14:00.352330 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:00.352308    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ef0e19-99ad-4e56-b12a-e21a168b04b9-service-ca-bundle\") pod \"router-default-58d678bf84-6skhd\" (UID: \"b9ef0e19-99ad-4e56-b12a-e21a168b04b9\") " pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:14:00.385459 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:00.385430    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wkcmq\""
Sep 10 14:14:00.390133 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:00.390114    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:14:00.676748 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:00.676672    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-58d678bf84-6skhd"]
Sep 10 14:14:00.679820 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:14:00.679792    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ef0e19_99ad_4e56_b12a_e21a168b04b9.slice/crio-2ed5f0e440a50d8d67a77ed535df7d217560707058c1617b58d7b17abf726c2d WatchSource:0}: Error finding container 2ed5f0e440a50d8d67a77ed535df7d217560707058c1617b58d7b17abf726c2d: Status 404 returned error can't find the container with id 2ed5f0e440a50d8d67a77ed535df7d217560707058c1617b58d7b17abf726c2d
Sep 10 14:14:00.834006 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:00.833974    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-58d678bf84-6skhd" event={"ID":"b9ef0e19-99ad-4e56-b12a-e21a168b04b9","Type":"ContainerStarted","Data":"f7071cdc5f88dfad417b630705f1794ab0350ebc74cde0d618eb571c44a2a0f4"}
Sep 10 14:14:00.834161 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:00.834024    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-58d678bf84-6skhd" event={"ID":"b9ef0e19-99ad-4e56-b12a-e21a168b04b9","Type":"ContainerStarted","Data":"2ed5f0e440a50d8d67a77ed535df7d217560707058c1617b58d7b17abf726c2d"}
Sep 10 14:14:00.877047 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:00.876997    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-58d678bf84-6skhd" podStartSLOduration=32.876980791 podStartE2EDuration="32.876980791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:13:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:14:00.875927691 +0000 UTC m=+138.993469166" watchObservedRunningTime="2026-09-10 14:14:00.876980791 +0000 UTC m=+138.994522265"
Sep 10 14:14:01.391226 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:01.391185    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:14:01.393756 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:01.393730    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:14:01.837356 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:01.837321    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:14:01.838608 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:01.838590    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-58d678bf84-6skhd"
Sep 10 14:14:02.033368 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.033337    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfbf8f57b-g6b27"]
Sep 10 14:14:02.036466 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.036450    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfbf8f57b-g6b27"
Sep 10 14:14:02.045187 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.045164    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 10 14:14:02.045187 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.045182    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 10 14:14:02.045344 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.045247    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 10 14:14:02.050147 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.050130    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 10 14:14:02.063152 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.063128    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d64bb7c6b-gjh49"]
Sep 10 14:14:02.065937 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.065919    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.072622 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.072601    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 14:14:02.072800 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.072786    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wzphp\""
Sep 10 14:14:02.073278 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.073261    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 14:14:02.075479 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.075462    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 14:14:02.081998 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.081981    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 14:14:02.098078 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.098026    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d64bb7c6b-gjh49"]
Sep 10 14:14:02.104926 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.104903    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfbf8f57b-g6b27"]
Sep 10 14:14:02.166135 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.166104    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d64bb7c6b-gjh49"]
Sep 10 14:14:02.166361 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.166340    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zghr\" (UniqueName: \"kubernetes.io/projected/d52c90ab-6343-49de-94ca-bbb43726f11b-kube-api-access-8zghr\") pod \"klusterlet-addon-workmgr-5cfbf8f57b-g6b27\" (UID: \"d52c90ab-6343-49de-94ca-bbb43726f11b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfbf8f57b-g6b27"
Sep 10 14:14:02.166411 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:14:02.166338    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-tlxb2 registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49" podUID="93c0692a-f877-4a87-9aea-44c3153639b8"
Sep 10 14:14:02.166454 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.166405    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93c0692a-f877-4a87-9aea-44c3153639b8-image-registry-private-configuration\") pod \"image-registry-d64bb7c6b-gjh49\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") " pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.166454 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.166435    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93c0692a-f877-4a87-9aea-44c3153639b8-bound-sa-token\") pod \"image-registry-d64bb7c6b-gjh49\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") " pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.166554 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.166457    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlxb2\" (UniqueName: \"kubernetes.io/projected/93c0692a-f877-4a87-9aea-44c3153639b8-kube-api-access-tlxb2\") pod \"image-registry-d64bb7c6b-gjh49\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") " pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.166554 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.166507    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93c0692a-f877-4a87-9aea-44c3153639b8-registry-tls\") pod \"image-registry-d64bb7c6b-gjh49\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") " pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.166554 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.166543    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93c0692a-f877-4a87-9aea-44c3153639b8-ca-trust-extracted\") pod \"image-registry-d64bb7c6b-gjh49\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") " pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.166683 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.166563    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d52c90ab-6343-49de-94ca-bbb43726f11b-tmp\") pod \"klusterlet-addon-workmgr-5cfbf8f57b-g6b27\" (UID: \"d52c90ab-6343-49de-94ca-bbb43726f11b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfbf8f57b-g6b27"
Sep 10 14:14:02.166683 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.166642    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93c0692a-f877-4a87-9aea-44c3153639b8-trusted-ca\") pod \"image-registry-d64bb7c6b-gjh49\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") " pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.166781 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.166714    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d52c90ab-6343-49de-94ca-bbb43726f11b-klusterlet-config\") pod \"klusterlet-addon-workmgr-5cfbf8f57b-g6b27\" (UID: \"d52c90ab-6343-49de-94ca-bbb43726f11b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfbf8f57b-g6b27"
Sep 10 14:14:02.166781 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.166769    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93c0692a-f877-4a87-9aea-44c3153639b8-installation-pull-secrets\") pod \"image-registry-d64bb7c6b-gjh49\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") " pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.166878 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.166824    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93c0692a-f877-4a87-9aea-44c3153639b8-registry-certificates\") pod \"image-registry-d64bb7c6b-gjh49\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") " pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.267697 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.267664    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93c0692a-f877-4a87-9aea-44c3153639b8-registry-certificates\") pod \"image-registry-d64bb7c6b-gjh49\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") " pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.267697 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.267700    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zghr\" (UniqueName: \"kubernetes.io/projected/d52c90ab-6343-49de-94ca-bbb43726f11b-kube-api-access-8zghr\") pod \"klusterlet-addon-workmgr-5cfbf8f57b-g6b27\" (UID: \"d52c90ab-6343-49de-94ca-bbb43726f11b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfbf8f57b-g6b27"
Sep 10 14:14:02.267942 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.267730    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93c0692a-f877-4a87-9aea-44c3153639b8-image-registry-private-configuration\") pod \"image-registry-d64bb7c6b-gjh49\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") " pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.267942 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.267858    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93c0692a-f877-4a87-9aea-44c3153639b8-bound-sa-token\") pod \"image-registry-d64bb7c6b-gjh49\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") " pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.267942 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.267903    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlxb2\" (UniqueName: \"kubernetes.io/projected/93c0692a-f877-4a87-9aea-44c3153639b8-kube-api-access-tlxb2\") pod \"image-registry-d64bb7c6b-gjh49\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") " pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.268123 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.268078    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93c0692a-f877-4a87-9aea-44c3153639b8-registry-tls\") pod \"image-registry-d64bb7c6b-gjh49\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") " pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.268210 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.268124    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93c0692a-f877-4a87-9aea-44c3153639b8-ca-trust-extracted\") pod \"image-registry-d64bb7c6b-gjh49\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") " pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.268210 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.268146    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d52c90ab-6343-49de-94ca-bbb43726f11b-tmp\") pod \"klusterlet-addon-workmgr-5cfbf8f57b-g6b27\" (UID: \"d52c90ab-6343-49de-94ca-bbb43726f11b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfbf8f57b-g6b27"
Sep 10 14:14:02.268210 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.268170    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93c0692a-f877-4a87-9aea-44c3153639b8-trusted-ca\") pod \"image-registry-d64bb7c6b-gjh49\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") " pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.268210 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.268186    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d52c90ab-6343-49de-94ca-bbb43726f11b-klusterlet-config\") pod \"klusterlet-addon-workmgr-5cfbf8f57b-g6b27\" (UID: \"d52c90ab-6343-49de-94ca-bbb43726f11b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfbf8f57b-g6b27"
Sep 10 14:14:02.268410 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.268215    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93c0692a-f877-4a87-9aea-44c3153639b8-installation-pull-secrets\") pod \"image-registry-d64bb7c6b-gjh49\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") " pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.268506 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.268470    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93c0692a-f877-4a87-9aea-44c3153639b8-ca-trust-extracted\") pod \"image-registry-d64bb7c6b-gjh49\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") " pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.268592 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.268570    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d52c90ab-6343-49de-94ca-bbb43726f11b-tmp\") pod \"klusterlet-addon-workmgr-5cfbf8f57b-g6b27\" (UID: \"d52c90ab-6343-49de-94ca-bbb43726f11b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfbf8f57b-g6b27"
Sep 10 14:14:02.268669 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.268646    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93c0692a-f877-4a87-9aea-44c3153639b8-registry-certificates\") pod \"image-registry-d64bb7c6b-gjh49\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") " pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.269296 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.269269    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93c0692a-f877-4a87-9aea-44c3153639b8-trusted-ca\") pod \"image-registry-d64bb7c6b-gjh49\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") " pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.270331 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.270303    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93c0692a-f877-4a87-9aea-44c3153639b8-image-registry-private-configuration\") pod \"image-registry-d64bb7c6b-gjh49\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") " pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.270544 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.270526    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93c0692a-f877-4a87-9aea-44c3153639b8-installation-pull-secrets\") pod \"image-registry-d64bb7c6b-gjh49\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") " pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.270623 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.270585    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93c0692a-f877-4a87-9aea-44c3153639b8-registry-tls\") pod \"image-registry-d64bb7c6b-gjh49\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") " pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.270977 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.270956    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d52c90ab-6343-49de-94ca-bbb43726f11b-klusterlet-config\") pod \"klusterlet-addon-workmgr-5cfbf8f57b-g6b27\" (UID: \"d52c90ab-6343-49de-94ca-bbb43726f11b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfbf8f57b-g6b27"
Sep 10 14:14:02.287155 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.287134    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlxb2\" (UniqueName: \"kubernetes.io/projected/93c0692a-f877-4a87-9aea-44c3153639b8-kube-api-access-tlxb2\") pod \"image-registry-d64bb7c6b-gjh49\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") " pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.287244 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.287204    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93c0692a-f877-4a87-9aea-44c3153639b8-bound-sa-token\") pod \"image-registry-d64bb7c6b-gjh49\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") " pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.287244 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.287226    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zghr\" (UniqueName: \"kubernetes.io/projected/d52c90ab-6343-49de-94ca-bbb43726f11b-kube-api-access-8zghr\") pod \"klusterlet-addon-workmgr-5cfbf8f57b-g6b27\" (UID: \"d52c90ab-6343-49de-94ca-bbb43726f11b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfbf8f57b-g6b27"
Sep 10 14:14:02.345534 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.345510    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfbf8f57b-g6b27"
Sep 10 14:14:02.631565 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.631537    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfbf8f57b-g6b27"]
Sep 10 14:14:02.633910 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:14:02.633885    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd52c90ab_6343_49de_94ca_bbb43726f11b.slice/crio-4567411de5d25285e6f4d380855581ab89b950b757233b0e0e11582508f777eb WatchSource:0}: Error finding container 4567411de5d25285e6f4d380855581ab89b950b757233b0e0e11582508f777eb: Status 404 returned error can't find the container with id 4567411de5d25285e6f4d380855581ab89b950b757233b0e0e11582508f777eb
Sep 10 14:14:02.841812 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.841782    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.842003 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.841774    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfbf8f57b-g6b27" event={"ID":"d52c90ab-6343-49de-94ca-bbb43726f11b","Type":"ContainerStarted","Data":"4567411de5d25285e6f4d380855581ab89b950b757233b0e0e11582508f777eb"}
Sep 10 14:14:02.849464 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.849442    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:02.976739 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.976648    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93c0692a-f877-4a87-9aea-44c3153639b8-installation-pull-secrets\") pod \"93c0692a-f877-4a87-9aea-44c3153639b8\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") "
Sep 10 14:14:02.976739 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.976694    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93c0692a-f877-4a87-9aea-44c3153639b8-ca-trust-extracted\") pod \"93c0692a-f877-4a87-9aea-44c3153639b8\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") "
Sep 10 14:14:02.976739 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.976714    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlxb2\" (UniqueName: \"kubernetes.io/projected/93c0692a-f877-4a87-9aea-44c3153639b8-kube-api-access-tlxb2\") pod \"93c0692a-f877-4a87-9aea-44c3153639b8\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") "
Sep 10 14:14:02.976739 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.976733    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93c0692a-f877-4a87-9aea-44c3153639b8-registry-certificates\") pod \"93c0692a-f877-4a87-9aea-44c3153639b8\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") "
Sep 10 14:14:02.977055 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.976755    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93c0692a-f877-4a87-9aea-44c3153639b8-trusted-ca\") pod \"93c0692a-f877-4a87-9aea-44c3153639b8\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") "
Sep 10 14:14:02.977055 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.976783    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93c0692a-f877-4a87-9aea-44c3153639b8-bound-sa-token\") pod \"93c0692a-f877-4a87-9aea-44c3153639b8\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") "
Sep 10 14:14:02.977055 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.976853    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93c0692a-f877-4a87-9aea-44c3153639b8-image-registry-private-configuration\") pod \"93c0692a-f877-4a87-9aea-44c3153639b8\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") "
Sep 10 14:14:02.977055 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.976892    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93c0692a-f877-4a87-9aea-44c3153639b8-registry-tls\") pod \"93c0692a-f877-4a87-9aea-44c3153639b8\" (UID: \"93c0692a-f877-4a87-9aea-44c3153639b8\") "
Sep 10 14:14:02.977055 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.976972    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93c0692a-f877-4a87-9aea-44c3153639b8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "93c0692a-f877-4a87-9aea-44c3153639b8" (UID: "93c0692a-f877-4a87-9aea-44c3153639b8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:14:02.977308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.977195    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93c0692a-f877-4a87-9aea-44c3153639b8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "93c0692a-f877-4a87-9aea-44c3153639b8" (UID: "93c0692a-f877-4a87-9aea-44c3153639b8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:14:02.977308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.977264    2545 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93c0692a-f877-4a87-9aea-44c3153639b8-ca-trust-extracted\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:14:02.977308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.977282    2545 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93c0692a-f877-4a87-9aea-44c3153639b8-registry-certificates\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:14:02.977824 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.977557    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93c0692a-f877-4a87-9aea-44c3153639b8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "93c0692a-f877-4a87-9aea-44c3153639b8" (UID: "93c0692a-f877-4a87-9aea-44c3153639b8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:14:02.979069 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.979044    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93c0692a-f877-4a87-9aea-44c3153639b8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "93c0692a-f877-4a87-9aea-44c3153639b8" (UID: "93c0692a-f877-4a87-9aea-44c3153639b8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:14:02.979347 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.979315    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93c0692a-f877-4a87-9aea-44c3153639b8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "93c0692a-f877-4a87-9aea-44c3153639b8" (UID: "93c0692a-f877-4a87-9aea-44c3153639b8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:14:02.979347 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.979328    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93c0692a-f877-4a87-9aea-44c3153639b8-kube-api-access-tlxb2" (OuterVolumeSpecName: "kube-api-access-tlxb2") pod "93c0692a-f877-4a87-9aea-44c3153639b8" (UID: "93c0692a-f877-4a87-9aea-44c3153639b8"). InnerVolumeSpecName "kube-api-access-tlxb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:14:02.979463 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.979330    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93c0692a-f877-4a87-9aea-44c3153639b8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "93c0692a-f877-4a87-9aea-44c3153639b8" (UID: "93c0692a-f877-4a87-9aea-44c3153639b8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:14:02.979551 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:02.979534    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93c0692a-f877-4a87-9aea-44c3153639b8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "93c0692a-f877-4a87-9aea-44c3153639b8" (UID: "93c0692a-f877-4a87-9aea-44c3153639b8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:14:03.077674 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:03.077636    2545 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93c0692a-f877-4a87-9aea-44c3153639b8-registry-tls\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:14:03.077674 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:03.077664    2545 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93c0692a-f877-4a87-9aea-44c3153639b8-installation-pull-secrets\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:14:03.077674 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:03.077675    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlxb2\" (UniqueName: \"kubernetes.io/projected/93c0692a-f877-4a87-9aea-44c3153639b8-kube-api-access-tlxb2\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:14:03.077674 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:03.077684    2545 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93c0692a-f877-4a87-9aea-44c3153639b8-trusted-ca\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:14:03.077932 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:03.077696    2545 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93c0692a-f877-4a87-9aea-44c3153639b8-bound-sa-token\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:14:03.077932 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:03.077705    2545 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93c0692a-f877-4a87-9aea-44c3153639b8-image-registry-private-configuration\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:14:03.846633 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:03.846603    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d64bb7c6b-gjh49"
Sep 10 14:14:03.891441 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:03.891412    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d64bb7c6b-gjh49"]
Sep 10 14:14:03.895166 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:03.895141    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-d64bb7c6b-gjh49"]
Sep 10 14:14:04.364127 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:04.364095    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93c0692a-f877-4a87-9aea-44c3153639b8" path="/var/lib/kubelet/pods/93c0692a-f877-4a87-9aea-44c3153639b8/volumes"
Sep 10 14:14:04.991946 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:04.991908    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba0e5564-7333-4c1f-acdf-89ebb69989ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-djjnx\" (UID: \"ba0e5564-7333-4c1f-acdf-89ebb69989ca\") " pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:14:04.994380 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:04.994356    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba0e5564-7333-4c1f-acdf-89ebb69989ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-djjnx\" (UID: \"ba0e5564-7333-4c1f-acdf-89ebb69989ca\") " pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:14:05.269875 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:05.269796    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2mhjl\""
Sep 10 14:14:05.278149 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:05.278122    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-djjnx"
Sep 10 14:14:05.580186 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:05.580108    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-djjnx"]
Sep 10 14:14:05.584186 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:14:05.584160    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba0e5564_7333_4c1f_acdf_89ebb69989ca.slice/crio-75acd94e63553c90a69b82a69b0c2f2a84c259cc7d92861c0c3bd6548ca02d20 WatchSource:0}: Error finding container 75acd94e63553c90a69b82a69b0c2f2a84c259cc7d92861c0c3bd6548ca02d20: Status 404 returned error can't find the container with id 75acd94e63553c90a69b82a69b0c2f2a84c259cc7d92861c0c3bd6548ca02d20
Sep 10 14:14:05.856856 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:05.856769    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-djjnx" event={"ID":"ba0e5564-7333-4c1f-acdf-89ebb69989ca","Type":"ContainerStarted","Data":"cfbc07c6a413f90d2907489bd97ca12df956f834d996cd386010f35fd4766bdc"}
Sep 10 14:14:05.856856 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:05.856836    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-djjnx" event={"ID":"ba0e5564-7333-4c1f-acdf-89ebb69989ca","Type":"ContainerStarted","Data":"75acd94e63553c90a69b82a69b0c2f2a84c259cc7d92861c0c3bd6548ca02d20"}
Sep 10 14:14:06.330972 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:06.330937    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-7nwnj"]
Sep 10 14:14:06.333373 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:06.333350    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-7nwnj"
Sep 10 14:14:06.337634 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:06.337600    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 10 14:14:06.337634 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:06.337614    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 14:14:06.337798 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:06.337669    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-zxff9\""
Sep 10 14:14:06.337798 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:06.337669    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 10 14:14:06.337798 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:06.337724    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 14:14:06.337798 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:06.337729    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 14:14:06.343946 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:06.343927    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-7nwnj"]
Sep 10 14:14:06.505603 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:06.505560    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp2ht\" (UniqueName: \"kubernetes.io/projected/706ff688-277b-4996-ad23-b73d1bfbb843-kube-api-access-xp2ht\") pod \"prometheus-operator-6f4946db56-7nwnj\" (UID: \"706ff688-277b-4996-ad23-b73d1bfbb843\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-7nwnj"
Sep 10 14:14:06.505790 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:06.505638    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/706ff688-277b-4996-ad23-b73d1bfbb843-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-7nwnj\" (UID: \"706ff688-277b-4996-ad23-b73d1bfbb843\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-7nwnj"
Sep 10 14:14:06.505790 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:06.505680    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/706ff688-277b-4996-ad23-b73d1bfbb843-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-7nwnj\" (UID: \"706ff688-277b-4996-ad23-b73d1bfbb843\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-7nwnj"
Sep 10 14:14:06.505790 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:06.505719    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/706ff688-277b-4996-ad23-b73d1bfbb843-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-7nwnj\" (UID: \"706ff688-277b-4996-ad23-b73d1bfbb843\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-7nwnj"
Sep 10 14:14:06.606898 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:06.606813    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/706ff688-277b-4996-ad23-b73d1bfbb843-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-7nwnj\" (UID: \"706ff688-277b-4996-ad23-b73d1bfbb843\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-7nwnj"
Sep 10 14:14:06.606898 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:06.606874    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/706ff688-277b-4996-ad23-b73d1bfbb843-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-7nwnj\" (UID: \"706ff688-277b-4996-ad23-b73d1bfbb843\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-7nwnj"
Sep 10 14:14:06.607131 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:06.606914    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/706ff688-277b-4996-ad23-b73d1bfbb843-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-7nwnj\" (UID: \"706ff688-277b-4996-ad23-b73d1bfbb843\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-7nwnj"
Sep 10 14:14:06.607131 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:06.606974    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp2ht\" (UniqueName: \"kubernetes.io/projected/706ff688-277b-4996-ad23-b73d1bfbb843-kube-api-access-xp2ht\") pod \"prometheus-operator-6f4946db56-7nwnj\" (UID: \"706ff688-277b-4996-ad23-b73d1bfbb843\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-7nwnj"
Sep 10 14:14:06.607761 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:06.607731    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/706ff688-277b-4996-ad23-b73d1bfbb843-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-7nwnj\" (UID: \"706ff688-277b-4996-ad23-b73d1bfbb843\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-7nwnj"
Sep 10 14:14:06.609688 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:06.609660    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/706ff688-277b-4996-ad23-b73d1bfbb843-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-7nwnj\" (UID: \"706ff688-277b-4996-ad23-b73d1bfbb843\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-7nwnj"
Sep 10 14:14:06.609809 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:06.609707    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/706ff688-277b-4996-ad23-b73d1bfbb843-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-7nwnj\" (UID: \"706ff688-277b-4996-ad23-b73d1bfbb843\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-7nwnj"
Sep 10 14:14:06.617713 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:06.617690    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp2ht\" (UniqueName: \"kubernetes.io/projected/706ff688-277b-4996-ad23-b73d1bfbb843-kube-api-access-xp2ht\") pod \"prometheus-operator-6f4946db56-7nwnj\" (UID: \"706ff688-277b-4996-ad23-b73d1bfbb843\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-7nwnj"
Sep 10 14:14:06.644425 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:06.644401    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-7nwnj"
Sep 10 14:14:07.382330 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:07.382292    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-7nwnj"]
Sep 10 14:14:07.385025 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:14:07.384998    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod706ff688_277b_4996_ad23_b73d1bfbb843.slice/crio-a1e7822ff8bb8a667dad0722702ee0c092a2feedc70cd9bdf392a42efbd0f728 WatchSource:0}: Error finding container a1e7822ff8bb8a667dad0722702ee0c092a2feedc70cd9bdf392a42efbd0f728: Status 404 returned error can't find the container with id a1e7822ff8bb8a667dad0722702ee0c092a2feedc70cd9bdf392a42efbd0f728
Sep 10 14:14:07.865714 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:07.865676    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfbf8f57b-g6b27" event={"ID":"d52c90ab-6343-49de-94ca-bbb43726f11b","Type":"ContainerStarted","Data":"521ce1e296a0c7139156d7c36be87d856636085b2c11a8bb6434ec6cf2e1d594"}
Sep 10 14:14:07.865871 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:07.865821    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfbf8f57b-g6b27"
Sep 10 14:14:07.867020 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:07.866994    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-7nwnj" event={"ID":"706ff688-277b-4996-ad23-b73d1bfbb843","Type":"ContainerStarted","Data":"a1e7822ff8bb8a667dad0722702ee0c092a2feedc70cd9bdf392a42efbd0f728"}
Sep 10 14:14:07.867733 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:07.867714    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfbf8f57b-g6b27"
Sep 10 14:14:07.868752 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:07.868724    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-djjnx" event={"ID":"ba0e5564-7333-4c1f-acdf-89ebb69989ca","Type":"ContainerStarted","Data":"ac43ec39e13c8676fcc2e57011388c38803abca4b6d22b386ec70533a5de9027"}
Sep 10 14:14:07.883697 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:07.883656    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5cfbf8f57b-g6b27" podStartSLOduration=2.36352752 podStartE2EDuration="6.883642486s" totalImagesPullingTime="4.520114966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:14:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:14:07.882474347 +0000 UTC m=+146.000015821" watchObservedRunningTime="2026-09-10 14:14:07.883642486 +0000 UTC m=+146.001184009"
Sep 10 14:14:09.878097 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:09.878011    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-7nwnj" event={"ID":"706ff688-277b-4996-ad23-b73d1bfbb843","Type":"ContainerStarted","Data":"30059814fac83f2ed848039086f37dbba636f7b1d58249035eeab700b108e3d3"}
Sep 10 14:14:09.878097 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:09.878066    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-7nwnj" event={"ID":"706ff688-277b-4996-ad23-b73d1bfbb843","Type":"ContainerStarted","Data":"142265f13bfa8d7e9d1d4fed0d012d39d03e39cdf01543ee24d4d0229f998233"}
Sep 10 14:14:09.880200 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:09.880170    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-djjnx" event={"ID":"ba0e5564-7333-4c1f-acdf-89ebb69989ca","Type":"ContainerStarted","Data":"2d9e902201e70b74a5413d121ab51867bfa1ead75339f36e22f9420c0bd33a25"}
Sep 10 14:14:09.898138 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:09.898096    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-7nwnj" podStartSLOduration=1.70014626 podStartE2EDuration="3.898081151s" totalImagesPullingTime="2.197934891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:14:09.897108181 +0000 UTC m=+148.014649657" watchObservedRunningTime="2026-09-10 14:14:09.898081151 +0000 UTC m=+148.015622638"
Sep 10 14:14:09.918570 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:09.918524    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-djjnx" podStartSLOduration=33.08953482 podStartE2EDuration="36.918506583s" totalImagesPullingTime="3.828971763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:13:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:14:09.917867664 +0000 UTC m=+148.035409144" watchObservedRunningTime="2026-09-10 14:14:09.918506583 +0000 UTC m=+148.036048050"
Sep 10 14:14:11.798291 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.798254    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vknb5"]
Sep 10 14:14:11.801544 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.801528    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:11.806649 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.806626    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 14:14:11.807511 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.807385    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-z2qt2\""
Sep 10 14:14:11.807964 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.807944    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 14:14:11.812279 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.812258    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 14:14:11.845594 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.845572    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a6a16df-bc28-4257-b604-a4fb088d70ab-metrics-client-ca\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:11.845698 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.845602    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a6a16df-bc28-4257-b604-a4fb088d70ab-node-exporter-wtmp\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:11.845698 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.845620    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a6a16df-bc28-4257-b604-a4fb088d70ab-root\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:11.845698 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.845665    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a6a16df-bc28-4257-b604-a4fb088d70ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:11.845801 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.845730    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a6a16df-bc28-4257-b604-a4fb088d70ab-node-exporter-tls\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:11.845801 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.845757    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a6a16df-bc28-4257-b604-a4fb088d70ab-node-exporter-textfile\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:11.845801 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.845781    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a6a16df-bc28-4257-b604-a4fb088d70ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:11.845895 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.845812    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a6a16df-bc28-4257-b604-a4fb088d70ab-sys\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:11.845895 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.845829    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhs7k\" (UniqueName: \"kubernetes.io/projected/0a6a16df-bc28-4257-b604-a4fb088d70ab-kube-api-access-mhs7k\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:11.946481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.946448    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a6a16df-bc28-4257-b604-a4fb088d70ab-node-exporter-textfile\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:11.946656 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.946511    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a6a16df-bc28-4257-b604-a4fb088d70ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:11.946656 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.946538    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a6a16df-bc28-4257-b604-a4fb088d70ab-sys\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:11.946656 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.946563    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhs7k\" (UniqueName: \"kubernetes.io/projected/0a6a16df-bc28-4257-b604-a4fb088d70ab-kube-api-access-mhs7k\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:11.946656 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.946644    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a6a16df-bc28-4257-b604-a4fb088d70ab-sys\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:11.946849 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.946683    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a6a16df-bc28-4257-b604-a4fb088d70ab-metrics-client-ca\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:11.946849 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.946708    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a6a16df-bc28-4257-b604-a4fb088d70ab-node-exporter-wtmp\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:11.946849 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.946726    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a6a16df-bc28-4257-b604-a4fb088d70ab-root\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:11.946849 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.946750    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a6a16df-bc28-4257-b604-a4fb088d70ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:11.946849 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.946781    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a6a16df-bc28-4257-b604-a4fb088d70ab-node-exporter-tls\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:11.946849 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.946823    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a6a16df-bc28-4257-b604-a4fb088d70ab-node-exporter-textfile\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:11.946849 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.946816    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a6a16df-bc28-4257-b604-a4fb088d70ab-root\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:11.947076 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.946868    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a6a16df-bc28-4257-b604-a4fb088d70ab-node-exporter-wtmp\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:11.947076 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:14:11.946932    2545 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 10 14:14:11.947076 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:14:11.946983    2545 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a6a16df-bc28-4257-b604-a4fb088d70ab-node-exporter-tls podName:0a6a16df-bc28-4257-b604-a4fb088d70ab nodeName:}" failed. No retries permitted until 2026-09-10 14:14:12.446967029 +0000 UTC m=+150.564508489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0a6a16df-bc28-4257-b604-a4fb088d70ab-node-exporter-tls") pod "node-exporter-vknb5" (UID: "0a6a16df-bc28-4257-b604-a4fb088d70ab") : secret "node-exporter-tls" not found
Sep 10 14:14:11.947184 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.947099    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a6a16df-bc28-4257-b604-a4fb088d70ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:11.947184 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.947170    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a6a16df-bc28-4257-b604-a4fb088d70ab-metrics-client-ca\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:11.948960 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.948938    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a6a16df-bc28-4257-b604-a4fb088d70ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:11.955807 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:11.955788    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhs7k\" (UniqueName: \"kubernetes.io/projected/0a6a16df-bc28-4257-b604-a4fb088d70ab-kube-api-access-mhs7k\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:12.451674 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.451639    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a6a16df-bc28-4257-b604-a4fb088d70ab-node-exporter-tls\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:12.453943 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.453918    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a6a16df-bc28-4257-b604-a4fb088d70ab-node-exporter-tls\") pod \"node-exporter-vknb5\" (UID: \"0a6a16df-bc28-4257-b604-a4fb088d70ab\") " pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:12.709981 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.709893    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vknb5"
Sep 10 14:14:12.721366 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:14:12.721339    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a6a16df_bc28_4257_b604_a4fb088d70ab.slice/crio-4fa1c4cddb789f29dd4c50fc15ab79316ab0202f44bd9cdb38f6780170beea1f WatchSource:0}: Error finding container 4fa1c4cddb789f29dd4c50fc15ab79316ab0202f44bd9cdb38f6780170beea1f: Status 404 returned error can't find the container with id 4fa1c4cddb789f29dd4c50fc15ab79316ab0202f44bd9cdb38f6780170beea1f
Sep 10 14:14:12.789259 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.789225    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 14:14:12.793732 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.793711    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.798978 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.798951    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 10 14:14:12.799390 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.798947    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 10 14:14:12.799390 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.799210    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4hkzb\""
Sep 10 14:14:12.799390 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.799365    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 10 14:14:12.799586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.799452    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 10 14:14:12.799643 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.799611    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 10 14:14:12.800365 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.800343    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 10 14:14:12.800365 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.800360    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 10 14:14:12.800543 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.800383    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 10 14:14:12.800543 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.800387    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 10 14:14:12.817805 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.817768    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 14:14:12.855717 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.855677    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.855717 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.855718    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.855970 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.855749    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.855970 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.855806    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6qrd\" (UniqueName: \"kubernetes.io/projected/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-kube-api-access-g6qrd\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.855970 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.855839    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.855970 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.855896    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.855970 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.855923    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.855970 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.855953    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-web-config\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.856222 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.855981    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.856222 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.856009    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.856222 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.856041    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-config-volume\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.856222 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.856066    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.856222 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.856121    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-config-out\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.894382 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.894347    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vknb5" event={"ID":"0a6a16df-bc28-4257-b604-a4fb088d70ab","Type":"ContainerStarted","Data":"4fa1c4cddb789f29dd4c50fc15ab79316ab0202f44bd9cdb38f6780170beea1f"}
Sep 10 14:14:12.957050 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.957009    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.957242 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.957057    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.957242 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.957091    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-config-volume\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.957242 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.957113    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.957394 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.957258    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-config-out\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.957394 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.957301    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.957394 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.957324    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.957394 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.957342    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.957394 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.957386    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6qrd\" (UniqueName: \"kubernetes.io/projected/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-kube-api-access-g6qrd\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.957851 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.957822    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.957994 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.957892    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.957994 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.957930    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.957994 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.957943    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.957994 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.957962    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-web-config\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.958216 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.958063    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.958751 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.958716    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.960442 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.960352    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.960889 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.960657    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.960889 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.960852    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-config-volume\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.961017 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.960925    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.961065 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.961038    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-web-config\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.961261 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.961237    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-config-out\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.961338 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.961280    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.961528 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.961512    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.962131 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.962116    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:12.966162 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:12.966137    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6qrd\" (UniqueName: \"kubernetes.io/projected/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-kube-api-access-g6qrd\") pod \"alertmanager-main-0\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:13.105539 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:13.105479    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:14:13.386978 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:13.386954    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 14:14:13.389271 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:14:13.389229    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96bdb0b0_20fb_4ef8_b801_1c6d534b4b0f.slice/crio-07b60e2f313dbd5d639da2f9386db5a30de28772f4ddedc4e36edfd4d149a8a2 WatchSource:0}: Error finding container 07b60e2f313dbd5d639da2f9386db5a30de28772f4ddedc4e36edfd4d149a8a2: Status 404 returned error can't find the container with id 07b60e2f313dbd5d639da2f9386db5a30de28772f4ddedc4e36edfd4d149a8a2
Sep 10 14:14:13.900556 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:13.900523    2545 generic.go:356] "Generic (PLEG): container finished" podID="0a6a16df-bc28-4257-b604-a4fb088d70ab" containerID="7033aa43e13df7a8f5d49d7f754a41b594cb38a36d7ce5a26848ad1a5e882af2" exitCode=0
Sep 10 14:14:13.900994 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:13.900606    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vknb5" event={"ID":"0a6a16df-bc28-4257-b604-a4fb088d70ab","Type":"ContainerDied","Data":"7033aa43e13df7a8f5d49d7f754a41b594cb38a36d7ce5a26848ad1a5e882af2"}
Sep 10 14:14:13.901885 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:13.901863    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f","Type":"ContainerStarted","Data":"07b60e2f313dbd5d639da2f9386db5a30de28772f4ddedc4e36edfd4d149a8a2"}
Sep 10 14:14:14.683984 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.683945    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"]
Sep 10 14:14:14.687354 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.687329    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:14.690234 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.690211    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 10 14:14:14.690353 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.690211    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-w7pxj\""
Sep 10 14:14:14.690477 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.690463    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 10 14:14:14.690977 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.690961    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 10 14:14:14.691075 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.691061    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 10 14:14:14.691356 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.691342    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 10 14:14:14.691417 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.691403    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-772lnb9d86p79\""
Sep 10 14:14:14.702561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.702537    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"]
Sep 10 14:14:14.772797 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.772714    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1d018408-6349-4c02-b94d-05652645b698-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67dd4dc5c8-nbxfs\" (UID: \"1d018408-6349-4c02-b94d-05652645b698\") " pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:14.772797 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.772757    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d018408-6349-4c02-b94d-05652645b698-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67dd4dc5c8-nbxfs\" (UID: \"1d018408-6349-4c02-b94d-05652645b698\") " pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:14.772797 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.772780    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1d018408-6349-4c02-b94d-05652645b698-secret-thanos-querier-tls\") pod \"thanos-querier-67dd4dc5c8-nbxfs\" (UID: \"1d018408-6349-4c02-b94d-05652645b698\") " pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:14.772995 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.772822    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1d018408-6349-4c02-b94d-05652645b698-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67dd4dc5c8-nbxfs\" (UID: \"1d018408-6349-4c02-b94d-05652645b698\") " pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:14.772995 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.772857    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d018408-6349-4c02-b94d-05652645b698-metrics-client-ca\") pod \"thanos-querier-67dd4dc5c8-nbxfs\" (UID: \"1d018408-6349-4c02-b94d-05652645b698\") " pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:14.772995 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.772900    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d018408-6349-4c02-b94d-05652645b698-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67dd4dc5c8-nbxfs\" (UID: \"1d018408-6349-4c02-b94d-05652645b698\") " pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:14.772995 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.772939    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr494\" (UniqueName: \"kubernetes.io/projected/1d018408-6349-4c02-b94d-05652645b698-kube-api-access-kr494\") pod \"thanos-querier-67dd4dc5c8-nbxfs\" (UID: \"1d018408-6349-4c02-b94d-05652645b698\") " pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:14.772995 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.772966    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1d018408-6349-4c02-b94d-05652645b698-secret-grpc-tls\") pod \"thanos-querier-67dd4dc5c8-nbxfs\" (UID: \"1d018408-6349-4c02-b94d-05652645b698\") " pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:14.873783 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.873742    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1d018408-6349-4c02-b94d-05652645b698-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67dd4dc5c8-nbxfs\" (UID: \"1d018408-6349-4c02-b94d-05652645b698\") " pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:14.873783 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.873785    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d018408-6349-4c02-b94d-05652645b698-metrics-client-ca\") pod \"thanos-querier-67dd4dc5c8-nbxfs\" (UID: \"1d018408-6349-4c02-b94d-05652645b698\") " pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:14.873980 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.873809    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d018408-6349-4c02-b94d-05652645b698-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67dd4dc5c8-nbxfs\" (UID: \"1d018408-6349-4c02-b94d-05652645b698\") " pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:14.874018 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.873980    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr494\" (UniqueName: \"kubernetes.io/projected/1d018408-6349-4c02-b94d-05652645b698-kube-api-access-kr494\") pod \"thanos-querier-67dd4dc5c8-nbxfs\" (UID: \"1d018408-6349-4c02-b94d-05652645b698\") " pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:14.874074 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.874021    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1d018408-6349-4c02-b94d-05652645b698-secret-grpc-tls\") pod \"thanos-querier-67dd4dc5c8-nbxfs\" (UID: \"1d018408-6349-4c02-b94d-05652645b698\") " pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:14.874074 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.874052    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1d018408-6349-4c02-b94d-05652645b698-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67dd4dc5c8-nbxfs\" (UID: \"1d018408-6349-4c02-b94d-05652645b698\") " pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:14.874166 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.874099    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d018408-6349-4c02-b94d-05652645b698-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67dd4dc5c8-nbxfs\" (UID: \"1d018408-6349-4c02-b94d-05652645b698\") " pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:14.874166 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.874123    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1d018408-6349-4c02-b94d-05652645b698-secret-thanos-querier-tls\") pod \"thanos-querier-67dd4dc5c8-nbxfs\" (UID: \"1d018408-6349-4c02-b94d-05652645b698\") " pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:14.874714 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.874682    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d018408-6349-4c02-b94d-05652645b698-metrics-client-ca\") pod \"thanos-querier-67dd4dc5c8-nbxfs\" (UID: \"1d018408-6349-4c02-b94d-05652645b698\") " pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:14.876402 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.876372    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1d018408-6349-4c02-b94d-05652645b698-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67dd4dc5c8-nbxfs\" (UID: \"1d018408-6349-4c02-b94d-05652645b698\") " pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:14.876482 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.876452    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1d018408-6349-4c02-b94d-05652645b698-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67dd4dc5c8-nbxfs\" (UID: \"1d018408-6349-4c02-b94d-05652645b698\") " pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:14.876764 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.876741    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d018408-6349-4c02-b94d-05652645b698-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67dd4dc5c8-nbxfs\" (UID: \"1d018408-6349-4c02-b94d-05652645b698\") " pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:14.876904 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.876883    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d018408-6349-4c02-b94d-05652645b698-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67dd4dc5c8-nbxfs\" (UID: \"1d018408-6349-4c02-b94d-05652645b698\") " pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:14.876939 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.876903    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1d018408-6349-4c02-b94d-05652645b698-secret-thanos-querier-tls\") pod \"thanos-querier-67dd4dc5c8-nbxfs\" (UID: \"1d018408-6349-4c02-b94d-05652645b698\") " pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:14.876939 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.876919    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1d018408-6349-4c02-b94d-05652645b698-secret-grpc-tls\") pod \"thanos-querier-67dd4dc5c8-nbxfs\" (UID: \"1d018408-6349-4c02-b94d-05652645b698\") " pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:14.882428 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.882411    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr494\" (UniqueName: \"kubernetes.io/projected/1d018408-6349-4c02-b94d-05652645b698-kube-api-access-kr494\") pod \"thanos-querier-67dd4dc5c8-nbxfs\" (UID: \"1d018408-6349-4c02-b94d-05652645b698\") " pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:14.907548 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.907515    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vknb5" event={"ID":"0a6a16df-bc28-4257-b604-a4fb088d70ab","Type":"ContainerStarted","Data":"f7f71b376ff3c7662dbfdc817e75d8556048d036fa47248964ee605153409f47"}
Sep 10 14:14:14.907892 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.907587    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vknb5" event={"ID":"0a6a16df-bc28-4257-b604-a4fb088d70ab","Type":"ContainerStarted","Data":"bf9103f6796b14657bdb01bed5638e3fdf003fb0a16c2d7828b4c68a2abc1b7d"}
Sep 10 14:14:14.909034 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.909007    2545 generic.go:356] "Generic (PLEG): container finished" podID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerID="3fd70dcc4002ef1c1f59a86cf1f71640d26598a324bd58f17e082874328acfa0" exitCode=0
Sep 10 14:14:14.909123 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.909046    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f","Type":"ContainerDied","Data":"3fd70dcc4002ef1c1f59a86cf1f71640d26598a324bd58f17e082874328acfa0"}
Sep 10 14:14:14.928452 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.926405    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vknb5" podStartSLOduration=2.889508443 podStartE2EDuration="3.926385994s" totalImagesPullingTime="974.072409ms" totalInitContainerRuntime="62.805142ms" isStatefulPod=true podCreationTimestamp="2026-09-10 14:14:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:14:14.926133471 +0000 UTC m=+153.043674947" watchObservedRunningTime="2026-09-10 14:14:14.926385994 +0000 UTC m=+153.043927469"
Sep 10 14:14:14.996823 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:14.996786    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:15.271000 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:15.270975    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"]
Sep 10 14:14:15.273379 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:14:15.273349    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d018408_6349_4c02_b94d_05652645b698.slice/crio-8156f9baace2e456358ebd1f820cc62f1573e87b0a78228cd0f67425ee246e86 WatchSource:0}: Error finding container 8156f9baace2e456358ebd1f820cc62f1573e87b0a78228cd0f67425ee246e86: Status 404 returned error can't find the container with id 8156f9baace2e456358ebd1f820cc62f1573e87b0a78228cd0f67425ee246e86
Sep 10 14:14:15.913579 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:15.913541    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs" event={"ID":"1d018408-6349-4c02-b94d-05652645b698","Type":"ContainerStarted","Data":"8156f9baace2e456358ebd1f820cc62f1573e87b0a78228cd0f67425ee246e86"}
Sep 10 14:14:16.149922 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.149883    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"]
Sep 10 14:14:16.153142 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.153119    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:14:16.155874 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.155849    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 10 14:14:16.156003 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.155915    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 10 14:14:16.157016 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.156973    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-chotaldq9dt24\""
Sep 10 14:14:16.157264 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.157244    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 10 14:14:16.157334 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.157299    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 10 14:14:16.157581 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.157556    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-fngcd\""
Sep 10 14:14:16.164383 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.164329    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"]
Sep 10 14:14:16.185354 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.185320    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5f594479-f14f-4d4b-8fe5-a3b69e421ad2-audit-log\") pod \"metrics-server-7b4589cc5b-zhcd4\" (UID: \"5f594479-f14f-4d4b-8fe5-a3b69e421ad2\") " pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:14:16.185522 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.185366    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5f594479-f14f-4d4b-8fe5-a3b69e421ad2-secret-metrics-server-client-certs\") pod \"metrics-server-7b4589cc5b-zhcd4\" (UID: \"5f594479-f14f-4d4b-8fe5-a3b69e421ad2\") " pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:14:16.185522 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.185424    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f594479-f14f-4d4b-8fe5-a3b69e421ad2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b4589cc5b-zhcd4\" (UID: \"5f594479-f14f-4d4b-8fe5-a3b69e421ad2\") " pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:14:16.185522 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.185479    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5f594479-f14f-4d4b-8fe5-a3b69e421ad2-metrics-server-audit-profiles\") pod \"metrics-server-7b4589cc5b-zhcd4\" (UID: \"5f594479-f14f-4d4b-8fe5-a3b69e421ad2\") " pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:14:16.185685 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.185533    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f594479-f14f-4d4b-8fe5-a3b69e421ad2-client-ca-bundle\") pod \"metrics-server-7b4589cc5b-zhcd4\" (UID: \"5f594479-f14f-4d4b-8fe5-a3b69e421ad2\") " pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:14:16.185685 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.185601    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tj2l\" (UniqueName: \"kubernetes.io/projected/5f594479-f14f-4d4b-8fe5-a3b69e421ad2-kube-api-access-7tj2l\") pod \"metrics-server-7b4589cc5b-zhcd4\" (UID: \"5f594479-f14f-4d4b-8fe5-a3b69e421ad2\") " pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:14:16.185685 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.185652    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5f594479-f14f-4d4b-8fe5-a3b69e421ad2-secret-metrics-server-tls\") pod \"metrics-server-7b4589cc5b-zhcd4\" (UID: \"5f594479-f14f-4d4b-8fe5-a3b69e421ad2\") " pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:14:16.286567 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.286532    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5f594479-f14f-4d4b-8fe5-a3b69e421ad2-audit-log\") pod \"metrics-server-7b4589cc5b-zhcd4\" (UID: \"5f594479-f14f-4d4b-8fe5-a3b69e421ad2\") " pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:14:16.286751 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.286582    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5f594479-f14f-4d4b-8fe5-a3b69e421ad2-secret-metrics-server-client-certs\") pod \"metrics-server-7b4589cc5b-zhcd4\" (UID: \"5f594479-f14f-4d4b-8fe5-a3b69e421ad2\") " pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:14:16.286751 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.286623    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f594479-f14f-4d4b-8fe5-a3b69e421ad2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b4589cc5b-zhcd4\" (UID: \"5f594479-f14f-4d4b-8fe5-a3b69e421ad2\") " pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:14:16.286751 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.286681    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5f594479-f14f-4d4b-8fe5-a3b69e421ad2-metrics-server-audit-profiles\") pod \"metrics-server-7b4589cc5b-zhcd4\" (UID: \"5f594479-f14f-4d4b-8fe5-a3b69e421ad2\") " pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:14:16.286751 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.286715    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f594479-f14f-4d4b-8fe5-a3b69e421ad2-client-ca-bundle\") pod \"metrics-server-7b4589cc5b-zhcd4\" (UID: \"5f594479-f14f-4d4b-8fe5-a3b69e421ad2\") " pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:14:16.286751 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.286756    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tj2l\" (UniqueName: \"kubernetes.io/projected/5f594479-f14f-4d4b-8fe5-a3b69e421ad2-kube-api-access-7tj2l\") pod \"metrics-server-7b4589cc5b-zhcd4\" (UID: \"5f594479-f14f-4d4b-8fe5-a3b69e421ad2\") " pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:14:16.287012 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.286777    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5f594479-f14f-4d4b-8fe5-a3b69e421ad2-secret-metrics-server-tls\") pod \"metrics-server-7b4589cc5b-zhcd4\" (UID: \"5f594479-f14f-4d4b-8fe5-a3b69e421ad2\") " pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:14:16.287012 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.286981    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5f594479-f14f-4d4b-8fe5-a3b69e421ad2-audit-log\") pod \"metrics-server-7b4589cc5b-zhcd4\" (UID: \"5f594479-f14f-4d4b-8fe5-a3b69e421ad2\") " pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:14:16.287454 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.287427    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f594479-f14f-4d4b-8fe5-a3b69e421ad2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b4589cc5b-zhcd4\" (UID: \"5f594479-f14f-4d4b-8fe5-a3b69e421ad2\") " pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:14:16.288351 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.288329    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5f594479-f14f-4d4b-8fe5-a3b69e421ad2-metrics-server-audit-profiles\") pod \"metrics-server-7b4589cc5b-zhcd4\" (UID: \"5f594479-f14f-4d4b-8fe5-a3b69e421ad2\") " pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:14:16.289801 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.289776    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5f594479-f14f-4d4b-8fe5-a3b69e421ad2-secret-metrics-server-tls\") pod \"metrics-server-7b4589cc5b-zhcd4\" (UID: \"5f594479-f14f-4d4b-8fe5-a3b69e421ad2\") " pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:14:16.289901 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.289840    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f594479-f14f-4d4b-8fe5-a3b69e421ad2-client-ca-bundle\") pod \"metrics-server-7b4589cc5b-zhcd4\" (UID: \"5f594479-f14f-4d4b-8fe5-a3b69e421ad2\") " pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:14:16.290330 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.290307    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5f594479-f14f-4d4b-8fe5-a3b69e421ad2-secret-metrics-server-client-certs\") pod \"metrics-server-7b4589cc5b-zhcd4\" (UID: \"5f594479-f14f-4d4b-8fe5-a3b69e421ad2\") " pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:14:16.295502 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.295454    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tj2l\" (UniqueName: \"kubernetes.io/projected/5f594479-f14f-4d4b-8fe5-a3b69e421ad2-kube-api-access-7tj2l\") pod \"metrics-server-7b4589cc5b-zhcd4\" (UID: \"5f594479-f14f-4d4b-8fe5-a3b69e421ad2\") " pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:14:16.466338 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.466253    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:14:16.513220 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.513179    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-548d8d447c-2fn8h"]
Sep 10 14:14:16.516750 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.516729    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:16.519395 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.519265    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 14:14:16.519684 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.519572    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 14:14:16.519781 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.519699    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 14:14:16.519781 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.519699    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-x4r25\""
Sep 10 14:14:16.520097 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.520073    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 14:14:16.520198 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.520079    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 14:14:16.520258 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.520078    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 14:14:16.520590 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.520522    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 14:14:16.529203 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.529146    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-548d8d447c-2fn8h"]
Sep 10 14:14:16.529428 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.529408    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 14:14:16.589085 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.589034    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6qng\" (UniqueName: \"kubernetes.io/projected/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-kube-api-access-g6qng\") pod \"console-548d8d447c-2fn8h\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") " pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:16.589085 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.589102    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-console-serving-cert\") pod \"console-548d8d447c-2fn8h\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") " pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:16.589312 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.589128    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-console-oauth-config\") pod \"console-548d8d447c-2fn8h\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") " pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:16.589312 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.589209    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-service-ca\") pod \"console-548d8d447c-2fn8h\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") " pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:16.589312 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.589250    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-trusted-ca-bundle\") pod \"console-548d8d447c-2fn8h\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") " pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:16.589312 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.589295    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-oauth-serving-cert\") pod \"console-548d8d447c-2fn8h\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") " pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:16.589539 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.589330    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-console-config\") pod \"console-548d8d447c-2fn8h\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") " pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:16.690799 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.690765    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-service-ca\") pod \"console-548d8d447c-2fn8h\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") " pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:16.690991 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.690808    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-trusted-ca-bundle\") pod \"console-548d8d447c-2fn8h\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") " pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:16.690991 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.690869    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-oauth-serving-cert\") pod \"console-548d8d447c-2fn8h\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") " pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:16.690991 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.690928    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-console-config\") pod \"console-548d8d447c-2fn8h\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") " pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:16.690991 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.690957    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6qng\" (UniqueName: \"kubernetes.io/projected/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-kube-api-access-g6qng\") pod \"console-548d8d447c-2fn8h\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") " pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:16.691214 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.691000    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-console-serving-cert\") pod \"console-548d8d447c-2fn8h\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") " pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:16.691214 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.691024    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-console-oauth-config\") pod \"console-548d8d447c-2fn8h\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") " pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:16.691797 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.691747    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-oauth-serving-cert\") pod \"console-548d8d447c-2fn8h\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") " pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:16.691964 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.691913    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-trusted-ca-bundle\") pod \"console-548d8d447c-2fn8h\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") " pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:16.692040 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.691979    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-console-config\") pod \"console-548d8d447c-2fn8h\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") " pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:16.692095 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.692060    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-service-ca\") pod \"console-548d8d447c-2fn8h\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") " pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:16.694157 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.694133    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-console-serving-cert\") pod \"console-548d8d447c-2fn8h\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") " pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:16.694302 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.694279    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-console-oauth-config\") pod \"console-548d8d447c-2fn8h\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") " pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:16.702863 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.702816    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6qng\" (UniqueName: \"kubernetes.io/projected/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-kube-api-access-g6qng\") pod \"console-548d8d447c-2fn8h\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") " pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:16.830294 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:16.830256    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:17.123764 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:17.123638    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"]
Sep 10 14:14:17.125116 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:17.125085    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-548d8d447c-2fn8h"]
Sep 10 14:14:17.127027 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:14:17.126974    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f594479_f14f_4d4b_8fe5_a3b69e421ad2.slice/crio-d6f97d6b38f53b03ee7b141856f50462266a1029ec7430a88539aa11412fd1b0 WatchSource:0}: Error finding container d6f97d6b38f53b03ee7b141856f50462266a1029ec7430a88539aa11412fd1b0: Status 404 returned error can't find the container with id d6f97d6b38f53b03ee7b141856f50462266a1029ec7430a88539aa11412fd1b0
Sep 10 14:14:17.130050 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:14:17.130028    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod226ec8a8_cef0_4afc_a6b7_06c015b0fb56.slice/crio-aaf35ae6d10485c58e83506f865a9d54a7f7184adaf3e84bc97463c7f307b330 WatchSource:0}: Error finding container aaf35ae6d10485c58e83506f865a9d54a7f7184adaf3e84bc97463c7f307b330: Status 404 returned error can't find the container with id aaf35ae6d10485c58e83506f865a9d54a7f7184adaf3e84bc97463c7f307b330
Sep 10 14:14:17.931373 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:17.931339    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f","Type":"ContainerStarted","Data":"584bfe93faf75fe5934ed63b2363649576eacef58fae29ac6125ba4ce769ee40"}
Sep 10 14:14:17.931541 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:17.931461    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f","Type":"ContainerStarted","Data":"b262c00a3b897add4b6e2386094b2d894f9e7581c1452024058f809e2caaa9f8"}
Sep 10 14:14:17.931541 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:17.931532    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f","Type":"ContainerStarted","Data":"b578e2eb275eb23310de32c43f397b7ee22df12ca9d47b1bb40959c0c458f599"}
Sep 10 14:14:17.931624 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:17.931572    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f","Type":"ContainerStarted","Data":"f3299a76fd30fb70193d14d6ea66e1872e487d05049d96b3e10f540c38e97bca"}
Sep 10 14:14:17.931624 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:17.931611    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f","Type":"ContainerStarted","Data":"dc49aa3d10bd3041f9f9292554e926a6f3ddd698a13384339f8abd782e549582"}
Sep 10 14:14:17.932650 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:17.932624    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548d8d447c-2fn8h" event={"ID":"226ec8a8-cef0-4afc-a6b7-06c015b0fb56","Type":"ContainerStarted","Data":"aaf35ae6d10485c58e83506f865a9d54a7f7184adaf3e84bc97463c7f307b330"}
Sep 10 14:14:17.933772 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:17.933749    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4" event={"ID":"5f594479-f14f-4d4b-8fe5-a3b69e421ad2","Type":"ContainerStarted","Data":"d6f97d6b38f53b03ee7b141856f50462266a1029ec7430a88539aa11412fd1b0"}
Sep 10 14:14:18.731326 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:14:18.731281    2545 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-whqv6" podUID="b803a53c-a904-436c-9d1b-4956ef29b1e7"
Sep 10 14:14:18.942869 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:18.942727    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f","Type":"ContainerStarted","Data":"6b671766baecba0399b48dbc22a9688a681812e444e3b95ec42dd31b2d23f5b5"}
Sep 10 14:14:18.945833 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:18.945700    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs" event={"ID":"1d018408-6349-4c02-b94d-05652645b698","Type":"ContainerStarted","Data":"2302f7afe933daf54147f7e4621f0176d910bfe1209af6c008249de9ed2c1f9c"}
Sep 10 14:14:18.945833 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:18.945731    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-whqv6"
Sep 10 14:14:18.945833 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:18.945782    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs" event={"ID":"1d018408-6349-4c02-b94d-05652645b698","Type":"ContainerStarted","Data":"2a7cb95385b92eb67e1a059cc26705e49406d58dedd625eb8518116e3c7ab77f"}
Sep 10 14:14:18.945833 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:18.945826    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs" event={"ID":"1d018408-6349-4c02-b94d-05652645b698","Type":"ContainerStarted","Data":"7ef6b7ba29d9c727dd1763415c42daa6b9157642c0a01ed97f54ede8d17f5b0e"}
Sep 10 14:14:18.976917 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:18.976754    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.565841819 podStartE2EDuration="6.976732262s" totalImagesPullingTime="4.394727279s" totalInitContainerRuntime="16.163164ms" isStatefulPod=false podCreationTimestamp="2026-09-10 14:14:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:14:18.973891672 +0000 UTC m=+157.091433171" watchObservedRunningTime="2026-09-10 14:14:18.976732262 +0000 UTC m=+157.094273738"
Sep 10 14:14:19.952442 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:19.952401    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4" event={"ID":"5f594479-f14f-4d4b-8fe5-a3b69e421ad2","Type":"ContainerStarted","Data":"256c35d8aed4ed87a295ebd2e2400d13c709b3e470e584f21ba48291e9c29a4f"}
Sep 10 14:14:19.956148 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:19.956118    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs" event={"ID":"1d018408-6349-4c02-b94d-05652645b698","Type":"ContainerStarted","Data":"a97cd4297a5027cbebb4b487174868181a8ae646588e29d41c57767b3589b237"}
Sep 10 14:14:19.956549 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:19.956532    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:19.956638 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:19.956595    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs" event={"ID":"1d018408-6349-4c02-b94d-05652645b698","Type":"ContainerStarted","Data":"7a8364d5c0c9979813c095b7ebee565d46a268ac576e5ae7f34c83b3901a3189"}
Sep 10 14:14:19.956693 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:19.956642    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs" event={"ID":"1d018408-6349-4c02-b94d-05652645b698","Type":"ContainerStarted","Data":"4029f7263a0ad9a03eefc2f476303d505988e8183d612d735f6c8681914a27c9"}
Sep 10 14:14:19.971273 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:19.971219    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4" podStartSLOduration=1.884415962 podStartE2EDuration="3.97120424s" totalImagesPullingTime="2.086788278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:14:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:14:19.969756622 +0000 UTC m=+158.087298098" watchObservedRunningTime="2026-09-10 14:14:19.97120424 +0000 UTC m=+158.088745714"
Sep 10 14:14:19.992094 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:19.992034    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs" podStartSLOduration=2.307326818 podStartE2EDuration="5.992011823s" totalImagesPullingTime="3.684685005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:14:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:14:19.99029256 +0000 UTC m=+158.107834038" watchObservedRunningTime="2026-09-10 14:14:19.992011823 +0000 UTC m=+158.109553302"
Sep 10 14:14:20.961261 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:20.961159    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548d8d447c-2fn8h" event={"ID":"226ec8a8-cef0-4afc-a6b7-06c015b0fb56","Type":"ContainerStarted","Data":"9eb4f921f25614876c9e19d397e7d86b3fba3ab5b3d6e4fae530dbf16380574b"}
Sep 10 14:14:20.991564 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:20.991517    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-548d8d447c-2fn8h" podStartSLOduration=1.54634649 podStartE2EDuration="4.991502705s" totalImagesPullingTime="3.445156215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:14:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:14:20.990476069 +0000 UTC m=+159.108017544" watchObservedRunningTime="2026-09-10 14:14:20.991502705 +0000 UTC m=+159.109044172"
Sep 10 14:14:23.559331 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:23.559295    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls\") pod \"dns-default-whqv6\" (UID: \"b803a53c-a904-436c-9d1b-4956ef29b1e7\") " pod="openshift-dns/dns-default-whqv6"
Sep 10 14:14:23.561625 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:23.561603    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b803a53c-a904-436c-9d1b-4956ef29b1e7-metrics-tls\") pod \"dns-default-whqv6\" (UID: \"b803a53c-a904-436c-9d1b-4956ef29b1e7\") " pod="openshift-dns/dns-default-whqv6"
Sep 10 14:14:23.750136 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:23.750104    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xwswr\""
Sep 10 14:14:23.757763 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:23.757745    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-whqv6"
Sep 10 14:14:24.030831 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:24.030805    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-whqv6"]
Sep 10 14:14:24.033186 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:14:24.033153    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb803a53c_a904_436c_9d1b_4956ef29b1e7.slice/crio-86ff4d8d2f0604770aa8be5d3c57eb70553434135d355c489d0aac19790d7b93 WatchSource:0}: Error finding container 86ff4d8d2f0604770aa8be5d3c57eb70553434135d355c489d0aac19790d7b93: Status 404 returned error can't find the container with id 86ff4d8d2f0604770aa8be5d3c57eb70553434135d355c489d0aac19790d7b93
Sep 10 14:14:24.979716 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:24.979676    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-whqv6" event={"ID":"b803a53c-a904-436c-9d1b-4956ef29b1e7","Type":"ContainerStarted","Data":"86ff4d8d2f0604770aa8be5d3c57eb70553434135d355c489d0aac19790d7b93"}
Sep 10 14:14:25.970151 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:25.970118    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-67dd4dc5c8-nbxfs"
Sep 10 14:14:26.830776 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:26.830740    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:26.831228 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:26.830800    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:26.836972 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:26.836940    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:26.993294 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:26.993258    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-whqv6" event={"ID":"b803a53c-a904-436c-9d1b-4956ef29b1e7","Type":"ContainerStarted","Data":"c273294636f58659c05cf062206bac3503b07b70c66af206ee539e6b0b967108"}
Sep 10 14:14:26.993450 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:26.993324    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-whqv6" event={"ID":"b803a53c-a904-436c-9d1b-4956ef29b1e7","Type":"ContainerStarted","Data":"e704b0382c8ec260fa8de35d88cdedd54c4252631c39fc5549b53055509f1273"}
Sep 10 14:14:26.993450 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:26.993415    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-whqv6"
Sep 10 14:14:26.997289 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:26.997266    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:14:27.013585 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:27.013534    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-whqv6" podStartSLOduration=129.935473751 podStartE2EDuration="2m12.013518393s" totalImagesPullingTime="2.078044642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:14:27.012615251 +0000 UTC m=+165.130156725" watchObservedRunningTime="2026-09-10 14:14:27.013518393 +0000 UTC m=+165.131059867"
Sep 10 14:14:36.467132 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:36.467045    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:14:36.467132 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:36.467118    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:14:36.999331 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:36.999299    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-whqv6"
Sep 10 14:14:38.042343 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:38.042311    2545 generic.go:356] "Generic (PLEG): container finished" podID="242ed23a-ba27-4858-b8ea-2cdd4488fea4" containerID="5075fff476dd25e7c88bc0af2530ce0aec5a0767aba3c65ad96c8faf989b79a9" exitCode=0
Sep 10 14:14:38.042807 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:38.042387    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jfq22" event={"ID":"242ed23a-ba27-4858-b8ea-2cdd4488fea4","Type":"ContainerDied","Data":"5075fff476dd25e7c88bc0af2530ce0aec5a0767aba3c65ad96c8faf989b79a9"}
Sep 10 14:14:38.042875 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:38.042817    2545 scope.go:117] "RemoveContainer" containerID="5075fff476dd25e7c88bc0af2530ce0aec5a0767aba3c65ad96c8faf989b79a9"
Sep 10 14:14:39.049293 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:39.049259    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jfq22" event={"ID":"242ed23a-ba27-4858-b8ea-2cdd4488fea4","Type":"ContainerStarted","Data":"940d9939da67e1563086dabf477879cf35a9b5a23e29375eca62e2941aafadc3"}
Sep 10 14:14:43.066197 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:43.066157    2545 generic.go:356] "Generic (PLEG): container finished" podID="754eead4-4f50-4e8d-be76-e3d98c6427b7" containerID="a1728aa70b830522e2825f3b70dff2f4a60d27f1391c922f37c869970cba5030" exitCode=0
Sep 10 14:14:43.066568 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:43.066218    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mttrc" event={"ID":"754eead4-4f50-4e8d-be76-e3d98c6427b7","Type":"ContainerDied","Data":"a1728aa70b830522e2825f3b70dff2f4a60d27f1391c922f37c869970cba5030"}
Sep 10 14:14:43.066568 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:43.066546    2545 scope.go:117] "RemoveContainer" containerID="a1728aa70b830522e2825f3b70dff2f4a60d27f1391c922f37c869970cba5030"
Sep 10 14:14:44.071165 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:44.071125    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mttrc" event={"ID":"754eead4-4f50-4e8d-be76-e3d98c6427b7","Type":"ContainerStarted","Data":"ce4cd43b4bc94f60dbbfeea5790bbccbf1cc7046b3eb4d57aa0e5b74284f86a3"}
Sep 10 14:14:56.472601 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:56.472305    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:14:56.476334 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:14:56.476314    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7b4589cc5b-zhcd4"
Sep 10 14:15:31.982194 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:31.982157    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 14:15:31.982673 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:31.982437    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerName="alertmanager" containerID="cri-o://dc49aa3d10bd3041f9f9292554e926a6f3ddd698a13384339f8abd782e549582" gracePeriod=120
Sep 10 14:15:31.982673 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:31.982514    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerName="kube-rbac-proxy-metric" containerID="cri-o://584bfe93faf75fe5934ed63b2363649576eacef58fae29ac6125ba4ce769ee40" gracePeriod=120
Sep 10 14:15:31.982673 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:31.982541    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerName="prom-label-proxy" containerID="cri-o://6b671766baecba0399b48dbc22a9688a681812e444e3b95ec42dd31b2d23f5b5" gracePeriod=120
Sep 10 14:15:31.982673 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:31.982561    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerName="config-reloader" containerID="cri-o://f3299a76fd30fb70193d14d6ea66e1872e487d05049d96b3e10f540c38e97bca" gracePeriod=120
Sep 10 14:15:31.982673 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:31.982561    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerName="kube-rbac-proxy-web" containerID="cri-o://b578e2eb275eb23310de32c43f397b7ee22df12ca9d47b1bb40959c0c458f599" gracePeriod=120
Sep 10 14:15:31.982947 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:31.982897    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerName="kube-rbac-proxy" containerID="cri-o://b262c00a3b897add4b6e2386094b2d894f9e7581c1452024058f809e2caaa9f8" gracePeriod=120
Sep 10 14:15:32.269788 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:32.269756    2545 generic.go:356] "Generic (PLEG): container finished" podID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerID="6b671766baecba0399b48dbc22a9688a681812e444e3b95ec42dd31b2d23f5b5" exitCode=0
Sep 10 14:15:32.269788 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:32.269782    2545 generic.go:356] "Generic (PLEG): container finished" podID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerID="b262c00a3b897add4b6e2386094b2d894f9e7581c1452024058f809e2caaa9f8" exitCode=0
Sep 10 14:15:32.269788 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:32.269789    2545 generic.go:356] "Generic (PLEG): container finished" podID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerID="f3299a76fd30fb70193d14d6ea66e1872e487d05049d96b3e10f540c38e97bca" exitCode=0
Sep 10 14:15:32.269788 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:32.269794    2545 generic.go:356] "Generic (PLEG): container finished" podID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerID="dc49aa3d10bd3041f9f9292554e926a6f3ddd698a13384339f8abd782e549582" exitCode=0
Sep 10 14:15:32.270049 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:32.269832    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f","Type":"ContainerDied","Data":"6b671766baecba0399b48dbc22a9688a681812e444e3b95ec42dd31b2d23f5b5"}
Sep 10 14:15:32.270049 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:32.269893    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f","Type":"ContainerDied","Data":"b262c00a3b897add4b6e2386094b2d894f9e7581c1452024058f809e2caaa9f8"}
Sep 10 14:15:32.270049 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:32.269920    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f","Type":"ContainerDied","Data":"f3299a76fd30fb70193d14d6ea66e1872e487d05049d96b3e10f540c38e97bca"}
Sep 10 14:15:32.270049 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:32.269946    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f","Type":"ContainerDied","Data":"dc49aa3d10bd3041f9f9292554e926a6f3ddd698a13384339f8abd782e549582"}
Sep 10 14:15:33.225653 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.225633    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.278769 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.278736    2545 generic.go:356] "Generic (PLEG): container finished" podID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerID="584bfe93faf75fe5934ed63b2363649576eacef58fae29ac6125ba4ce769ee40" exitCode=0
Sep 10 14:15:33.278769 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.278764    2545 generic.go:356] "Generic (PLEG): container finished" podID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerID="b578e2eb275eb23310de32c43f397b7ee22df12ca9d47b1bb40959c0c458f599" exitCode=0
Sep 10 14:15:33.278953 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.278812    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.278953 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.278832    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f","Type":"ContainerDied","Data":"584bfe93faf75fe5934ed63b2363649576eacef58fae29ac6125ba4ce769ee40"}
Sep 10 14:15:33.278953 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.278930    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f","Type":"ContainerDied","Data":"b578e2eb275eb23310de32c43f397b7ee22df12ca9d47b1bb40959c0c458f599"}
Sep 10 14:15:33.279061 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.278960    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f","Type":"ContainerDied","Data":"07b60e2f313dbd5d639da2f9386db5a30de28772f4ddedc4e36edfd4d149a8a2"}
Sep 10 14:15:33.279061 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.279004    2545 scope.go:117] "RemoveContainer" containerID="6b671766baecba0399b48dbc22a9688a681812e444e3b95ec42dd31b2d23f5b5"
Sep 10 14:15:33.288476 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.288459    2545 scope.go:117] "RemoveContainer" containerID="584bfe93faf75fe5934ed63b2363649576eacef58fae29ac6125ba4ce769ee40"
Sep 10 14:15:33.295632 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.295612    2545 scope.go:117] "RemoveContainer" containerID="b262c00a3b897add4b6e2386094b2d894f9e7581c1452024058f809e2caaa9f8"
Sep 10 14:15:33.302656 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.302636    2545 scope.go:117] "RemoveContainer" containerID="b578e2eb275eb23310de32c43f397b7ee22df12ca9d47b1bb40959c0c458f599"
Sep 10 14:15:33.309147 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.309130    2545 scope.go:117] "RemoveContainer" containerID="f3299a76fd30fb70193d14d6ea66e1872e487d05049d96b3e10f540c38e97bca"
Sep 10 14:15:33.315860 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.315844    2545 scope.go:117] "RemoveContainer" containerID="dc49aa3d10bd3041f9f9292554e926a6f3ddd698a13384339f8abd782e549582"
Sep 10 14:15:33.324014 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.323997    2545 scope.go:117] "RemoveContainer" containerID="3fd70dcc4002ef1c1f59a86cf1f71640d26598a324bd58f17e082874328acfa0"
Sep 10 14:15:33.330380 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.330362    2545 scope.go:117] "RemoveContainer" containerID="6b671766baecba0399b48dbc22a9688a681812e444e3b95ec42dd31b2d23f5b5"
Sep 10 14:15:33.330664 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:15:33.330643    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b671766baecba0399b48dbc22a9688a681812e444e3b95ec42dd31b2d23f5b5\": container with ID starting with 6b671766baecba0399b48dbc22a9688a681812e444e3b95ec42dd31b2d23f5b5 not found: ID does not exist" containerID="6b671766baecba0399b48dbc22a9688a681812e444e3b95ec42dd31b2d23f5b5"
Sep 10 14:15:33.330716 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.330675    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b671766baecba0399b48dbc22a9688a681812e444e3b95ec42dd31b2d23f5b5"} err="failed to get container status \"6b671766baecba0399b48dbc22a9688a681812e444e3b95ec42dd31b2d23f5b5\": rpc error: code = NotFound desc = could not find container \"6b671766baecba0399b48dbc22a9688a681812e444e3b95ec42dd31b2d23f5b5\": container with ID starting with 6b671766baecba0399b48dbc22a9688a681812e444e3b95ec42dd31b2d23f5b5 not found: ID does not exist"
Sep 10 14:15:33.330716 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.330707    2545 scope.go:117] "RemoveContainer" containerID="584bfe93faf75fe5934ed63b2363649576eacef58fae29ac6125ba4ce769ee40"
Sep 10 14:15:33.330950 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:15:33.330933    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"584bfe93faf75fe5934ed63b2363649576eacef58fae29ac6125ba4ce769ee40\": container with ID starting with 584bfe93faf75fe5934ed63b2363649576eacef58fae29ac6125ba4ce769ee40 not found: ID does not exist" containerID="584bfe93faf75fe5934ed63b2363649576eacef58fae29ac6125ba4ce769ee40"
Sep 10 14:15:33.330986 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.330958    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"584bfe93faf75fe5934ed63b2363649576eacef58fae29ac6125ba4ce769ee40"} err="failed to get container status \"584bfe93faf75fe5934ed63b2363649576eacef58fae29ac6125ba4ce769ee40\": rpc error: code = NotFound desc = could not find container \"584bfe93faf75fe5934ed63b2363649576eacef58fae29ac6125ba4ce769ee40\": container with ID starting with 584bfe93faf75fe5934ed63b2363649576eacef58fae29ac6125ba4ce769ee40 not found: ID does not exist"
Sep 10 14:15:33.330986 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.330974    2545 scope.go:117] "RemoveContainer" containerID="b262c00a3b897add4b6e2386094b2d894f9e7581c1452024058f809e2caaa9f8"
Sep 10 14:15:33.331189 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:15:33.331173    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b262c00a3b897add4b6e2386094b2d894f9e7581c1452024058f809e2caaa9f8\": container with ID starting with b262c00a3b897add4b6e2386094b2d894f9e7581c1452024058f809e2caaa9f8 not found: ID does not exist" containerID="b262c00a3b897add4b6e2386094b2d894f9e7581c1452024058f809e2caaa9f8"
Sep 10 14:15:33.331227 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.331192    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b262c00a3b897add4b6e2386094b2d894f9e7581c1452024058f809e2caaa9f8"} err="failed to get container status \"b262c00a3b897add4b6e2386094b2d894f9e7581c1452024058f809e2caaa9f8\": rpc error: code = NotFound desc = could not find container \"b262c00a3b897add4b6e2386094b2d894f9e7581c1452024058f809e2caaa9f8\": container with ID starting with b262c00a3b897add4b6e2386094b2d894f9e7581c1452024058f809e2caaa9f8 not found: ID does not exist"
Sep 10 14:15:33.331227 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.331204    2545 scope.go:117] "RemoveContainer" containerID="b578e2eb275eb23310de32c43f397b7ee22df12ca9d47b1bb40959c0c458f599"
Sep 10 14:15:33.331407 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:15:33.331394    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b578e2eb275eb23310de32c43f397b7ee22df12ca9d47b1bb40959c0c458f599\": container with ID starting with b578e2eb275eb23310de32c43f397b7ee22df12ca9d47b1bb40959c0c458f599 not found: ID does not exist" containerID="b578e2eb275eb23310de32c43f397b7ee22df12ca9d47b1bb40959c0c458f599"
Sep 10 14:15:33.331443 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.331416    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b578e2eb275eb23310de32c43f397b7ee22df12ca9d47b1bb40959c0c458f599"} err="failed to get container status \"b578e2eb275eb23310de32c43f397b7ee22df12ca9d47b1bb40959c0c458f599\": rpc error: code = NotFound desc = could not find container \"b578e2eb275eb23310de32c43f397b7ee22df12ca9d47b1bb40959c0c458f599\": container with ID starting with b578e2eb275eb23310de32c43f397b7ee22df12ca9d47b1bb40959c0c458f599 not found: ID does not exist"
Sep 10 14:15:33.331443 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.331428    2545 scope.go:117] "RemoveContainer" containerID="f3299a76fd30fb70193d14d6ea66e1872e487d05049d96b3e10f540c38e97bca"
Sep 10 14:15:33.331673 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:15:33.331657    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3299a76fd30fb70193d14d6ea66e1872e487d05049d96b3e10f540c38e97bca\": container with ID starting with f3299a76fd30fb70193d14d6ea66e1872e487d05049d96b3e10f540c38e97bca not found: ID does not exist" containerID="f3299a76fd30fb70193d14d6ea66e1872e487d05049d96b3e10f540c38e97bca"
Sep 10 14:15:33.331712 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.331677    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3299a76fd30fb70193d14d6ea66e1872e487d05049d96b3e10f540c38e97bca"} err="failed to get container status \"f3299a76fd30fb70193d14d6ea66e1872e487d05049d96b3e10f540c38e97bca\": rpc error: code = NotFound desc = could not find container \"f3299a76fd30fb70193d14d6ea66e1872e487d05049d96b3e10f540c38e97bca\": container with ID starting with f3299a76fd30fb70193d14d6ea66e1872e487d05049d96b3e10f540c38e97bca not found: ID does not exist"
Sep 10 14:15:33.331712 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.331690    2545 scope.go:117] "RemoveContainer" containerID="dc49aa3d10bd3041f9f9292554e926a6f3ddd698a13384339f8abd782e549582"
Sep 10 14:15:33.331918 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:15:33.331903    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc49aa3d10bd3041f9f9292554e926a6f3ddd698a13384339f8abd782e549582\": container with ID starting with dc49aa3d10bd3041f9f9292554e926a6f3ddd698a13384339f8abd782e549582 not found: ID does not exist" containerID="dc49aa3d10bd3041f9f9292554e926a6f3ddd698a13384339f8abd782e549582"
Sep 10 14:15:33.331968 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.331919    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc49aa3d10bd3041f9f9292554e926a6f3ddd698a13384339f8abd782e549582"} err="failed to get container status \"dc49aa3d10bd3041f9f9292554e926a6f3ddd698a13384339f8abd782e549582\": rpc error: code = NotFound desc = could not find container \"dc49aa3d10bd3041f9f9292554e926a6f3ddd698a13384339f8abd782e549582\": container with ID starting with dc49aa3d10bd3041f9f9292554e926a6f3ddd698a13384339f8abd782e549582 not found: ID does not exist"
Sep 10 14:15:33.331968 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.331930    2545 scope.go:117] "RemoveContainer" containerID="3fd70dcc4002ef1c1f59a86cf1f71640d26598a324bd58f17e082874328acfa0"
Sep 10 14:15:33.332122 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:15:33.332108    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fd70dcc4002ef1c1f59a86cf1f71640d26598a324bd58f17e082874328acfa0\": container with ID starting with 3fd70dcc4002ef1c1f59a86cf1f71640d26598a324bd58f17e082874328acfa0 not found: ID does not exist" containerID="3fd70dcc4002ef1c1f59a86cf1f71640d26598a324bd58f17e082874328acfa0"
Sep 10 14:15:33.332157 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.332124    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fd70dcc4002ef1c1f59a86cf1f71640d26598a324bd58f17e082874328acfa0"} err="failed to get container status \"3fd70dcc4002ef1c1f59a86cf1f71640d26598a324bd58f17e082874328acfa0\": rpc error: code = NotFound desc = could not find container \"3fd70dcc4002ef1c1f59a86cf1f71640d26598a324bd58f17e082874328acfa0\": container with ID starting with 3fd70dcc4002ef1c1f59a86cf1f71640d26598a324bd58f17e082874328acfa0 not found: ID does not exist"
Sep 10 14:15:33.332157 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.332136    2545 scope.go:117] "RemoveContainer" containerID="6b671766baecba0399b48dbc22a9688a681812e444e3b95ec42dd31b2d23f5b5"
Sep 10 14:15:33.332344 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.332330    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b671766baecba0399b48dbc22a9688a681812e444e3b95ec42dd31b2d23f5b5"} err="failed to get container status \"6b671766baecba0399b48dbc22a9688a681812e444e3b95ec42dd31b2d23f5b5\": rpc error: code = NotFound desc = could not find container \"6b671766baecba0399b48dbc22a9688a681812e444e3b95ec42dd31b2d23f5b5\": container with ID starting with 6b671766baecba0399b48dbc22a9688a681812e444e3b95ec42dd31b2d23f5b5 not found: ID does not exist"
Sep 10 14:15:33.332381 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.332346    2545 scope.go:117] "RemoveContainer" containerID="584bfe93faf75fe5934ed63b2363649576eacef58fae29ac6125ba4ce769ee40"
Sep 10 14:15:33.332601 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.332585    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"584bfe93faf75fe5934ed63b2363649576eacef58fae29ac6125ba4ce769ee40"} err="failed to get container status \"584bfe93faf75fe5934ed63b2363649576eacef58fae29ac6125ba4ce769ee40\": rpc error: code = NotFound desc = could not find container \"584bfe93faf75fe5934ed63b2363649576eacef58fae29ac6125ba4ce769ee40\": container with ID starting with 584bfe93faf75fe5934ed63b2363649576eacef58fae29ac6125ba4ce769ee40 not found: ID does not exist"
Sep 10 14:15:33.332601 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.332601    2545 scope.go:117] "RemoveContainer" containerID="b262c00a3b897add4b6e2386094b2d894f9e7581c1452024058f809e2caaa9f8"
Sep 10 14:15:33.332790 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.332775    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b262c00a3b897add4b6e2386094b2d894f9e7581c1452024058f809e2caaa9f8"} err="failed to get container status \"b262c00a3b897add4b6e2386094b2d894f9e7581c1452024058f809e2caaa9f8\": rpc error: code = NotFound desc = could not find container \"b262c00a3b897add4b6e2386094b2d894f9e7581c1452024058f809e2caaa9f8\": container with ID starting with b262c00a3b897add4b6e2386094b2d894f9e7581c1452024058f809e2caaa9f8 not found: ID does not exist"
Sep 10 14:15:33.332832 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.332790    2545 scope.go:117] "RemoveContainer" containerID="b578e2eb275eb23310de32c43f397b7ee22df12ca9d47b1bb40959c0c458f599"
Sep 10 14:15:33.332999 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.332983    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b578e2eb275eb23310de32c43f397b7ee22df12ca9d47b1bb40959c0c458f599"} err="failed to get container status \"b578e2eb275eb23310de32c43f397b7ee22df12ca9d47b1bb40959c0c458f599\": rpc error: code = NotFound desc = could not find container \"b578e2eb275eb23310de32c43f397b7ee22df12ca9d47b1bb40959c0c458f599\": container with ID starting with b578e2eb275eb23310de32c43f397b7ee22df12ca9d47b1bb40959c0c458f599 not found: ID does not exist"
Sep 10 14:15:33.332999 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.332998    2545 scope.go:117] "RemoveContainer" containerID="f3299a76fd30fb70193d14d6ea66e1872e487d05049d96b3e10f540c38e97bca"
Sep 10 14:15:33.333197 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.333178    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3299a76fd30fb70193d14d6ea66e1872e487d05049d96b3e10f540c38e97bca"} err="failed to get container status \"f3299a76fd30fb70193d14d6ea66e1872e487d05049d96b3e10f540c38e97bca\": rpc error: code = NotFound desc = could not find container \"f3299a76fd30fb70193d14d6ea66e1872e487d05049d96b3e10f540c38e97bca\": container with ID starting with f3299a76fd30fb70193d14d6ea66e1872e487d05049d96b3e10f540c38e97bca not found: ID does not exist"
Sep 10 14:15:33.333197 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.333194    2545 scope.go:117] "RemoveContainer" containerID="dc49aa3d10bd3041f9f9292554e926a6f3ddd698a13384339f8abd782e549582"
Sep 10 14:15:33.333388 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.333372    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc49aa3d10bd3041f9f9292554e926a6f3ddd698a13384339f8abd782e549582"} err="failed to get container status \"dc49aa3d10bd3041f9f9292554e926a6f3ddd698a13384339f8abd782e549582\": rpc error: code = NotFound desc = could not find container \"dc49aa3d10bd3041f9f9292554e926a6f3ddd698a13384339f8abd782e549582\": container with ID starting with dc49aa3d10bd3041f9f9292554e926a6f3ddd698a13384339f8abd782e549582 not found: ID does not exist"
Sep 10 14:15:33.333433 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.333389    2545 scope.go:117] "RemoveContainer" containerID="3fd70dcc4002ef1c1f59a86cf1f71640d26598a324bd58f17e082874328acfa0"
Sep 10 14:15:33.333610 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.333593    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fd70dcc4002ef1c1f59a86cf1f71640d26598a324bd58f17e082874328acfa0"} err="failed to get container status \"3fd70dcc4002ef1c1f59a86cf1f71640d26598a324bd58f17e082874328acfa0\": rpc error: code = NotFound desc = could not find container \"3fd70dcc4002ef1c1f59a86cf1f71640d26598a324bd58f17e082874328acfa0\": container with ID starting with 3fd70dcc4002ef1c1f59a86cf1f71640d26598a324bd58f17e082874328acfa0 not found: ID does not exist"
Sep 10 14:15:33.355902 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.355867    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-tls-assets\") pod \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") "
Sep 10 14:15:33.355902 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.355911    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-secret-alertmanager-main-tls\") pod \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") "
Sep 10 14:15:33.356055 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.355931    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-config-out\") pod \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") "
Sep 10 14:15:33.356055 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.355961    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-alertmanager-trusted-ca-bundle\") pod \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") "
Sep 10 14:15:33.356055 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.355982    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-metrics-client-ca\") pod \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") "
Sep 10 14:15:33.356055 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.356007    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-cluster-tls-config\") pod \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") "
Sep 10 14:15:33.356055 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.356026    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6qrd\" (UniqueName: \"kubernetes.io/projected/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-kube-api-access-g6qrd\") pod \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") "
Sep 10 14:15:33.356055 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.356041    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") "
Sep 10 14:15:33.356348 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.356100    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-config-volume\") pod \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") "
Sep 10 14:15:33.356348 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.356141    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-secret-alertmanager-kube-rbac-proxy-web\") pod \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") "
Sep 10 14:15:33.356348 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.356171    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-alertmanager-main-db\") pod \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") "
Sep 10 14:15:33.356348 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.356196    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-secret-alertmanager-kube-rbac-proxy\") pod \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") "
Sep 10 14:15:33.356348 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.356224    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-web-config\") pod \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\" (UID: \"96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f\") "
Sep 10 14:15:33.356610 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.356372    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" (UID: "96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:15:33.356610 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.356380    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" (UID: "96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:15:33.356610 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.356519    2545 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:15:33.356761 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.356720    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" (UID: "96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:15:33.357771 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.356540    2545 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-metrics-client-ca\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:15:33.358873 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.358840    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" (UID: "96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:15:33.358873 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.358857    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-config-volume" (OuterVolumeSpecName: "config-volume") pod "96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" (UID: "96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:15:33.359444 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.359412    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-config-out" (OuterVolumeSpecName: "config-out") pod "96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" (UID: "96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:15:33.359679 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.359653    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" (UID: "96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:15:33.360129 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.360102    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" (UID: "96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:15:33.360226 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.360204    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" (UID: "96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:15:33.360334 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.360309    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" (UID: "96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:15:33.360429 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.360413    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-kube-api-access-g6qrd" (OuterVolumeSpecName: "kube-api-access-g6qrd") pod "96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" (UID: "96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f"). InnerVolumeSpecName "kube-api-access-g6qrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:15:33.363877 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.363798    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" (UID: "96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:15:33.369404 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.369380    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-web-config" (OuterVolumeSpecName: "web-config") pod "96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" (UID: "96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:15:33.458284 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.458245    2545 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:15:33.458284 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.458285    2545 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:15:33.458284 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.458295    2545 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-alertmanager-main-db\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:15:33.458467 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.458308    2545 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:15:33.458467 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.458337    2545 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-web-config\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:15:33.458467 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.458345    2545 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-tls-assets\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:15:33.458467 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.458353    2545 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-secret-alertmanager-main-tls\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:15:33.458467 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.458361    2545 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-config-out\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:15:33.458467 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.458369    2545 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-cluster-tls-config\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:15:33.458467 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.458376    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6qrd\" (UniqueName: \"kubernetes.io/projected/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-kube-api-access-g6qrd\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:15:33.458467 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.458384    2545 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:15:33.603966 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.603934    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 14:15:33.608050 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.608027    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 14:15:33.633463 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.633438    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 14:15:33.633739 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.633726    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerName="init-config-reloader"
Sep 10 14:15:33.633781 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.633742    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerName="init-config-reloader"
Sep 10 14:15:33.633781 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.633751    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerName="kube-rbac-proxy"
Sep 10 14:15:33.633781 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.633758    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerName="kube-rbac-proxy"
Sep 10 14:15:33.633781 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.633770    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerName="config-reloader"
Sep 10 14:15:33.633781 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.633776    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerName="config-reloader"
Sep 10 14:15:33.633923 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.633785    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerName="kube-rbac-proxy-metric"
Sep 10 14:15:33.633923 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.633791    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerName="kube-rbac-proxy-metric"
Sep 10 14:15:33.633923 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.633799    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerName="kube-rbac-proxy-web"
Sep 10 14:15:33.633923 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.633804    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerName="kube-rbac-proxy-web"
Sep 10 14:15:33.633923 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.633811    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerName="alertmanager"
Sep 10 14:15:33.633923 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.633819    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerName="alertmanager"
Sep 10 14:15:33.633923 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.633828    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerName="prom-label-proxy"
Sep 10 14:15:33.633923 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.633835    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerName="prom-label-proxy"
Sep 10 14:15:33.633923 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.633879    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerName="kube-rbac-proxy-metric"
Sep 10 14:15:33.633923 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.633887    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerName="kube-rbac-proxy-web"
Sep 10 14:15:33.633923 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.633893    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerName="kube-rbac-proxy"
Sep 10 14:15:33.633923 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.633899    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerName="alertmanager"
Sep 10 14:15:33.633923 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.633904    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerName="config-reloader"
Sep 10 14:15:33.633923 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.633910    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" containerName="prom-label-proxy"
Sep 10 14:15:33.638813 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.638795    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.641658 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.641631    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 10 14:15:33.641755 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.641677    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 10 14:15:33.641755 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.641680    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 10 14:15:33.641859 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.641711    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 10 14:15:33.641859 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.641807    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4hkzb\""
Sep 10 14:15:33.642016 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.642000    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 10 14:15:33.642084 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.642069    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 10 14:15:33.642139 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.642082    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 10 14:15:33.642407 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.642389    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 10 14:15:33.647665 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.647645    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 10 14:15:33.649992 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.649972    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 14:15:33.759424 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.759395    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/78a47a5e-640a-47ef-a219-57caa2c2567d-web-config\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.759424 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.759429    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/78a47a5e-640a-47ef-a219-57caa2c2567d-config-volume\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.759649 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.759447    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78a47a5e-640a-47ef-a219-57caa2c2567d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.759649 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.759532    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78a47a5e-640a-47ef-a219-57caa2c2567d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.759649 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.759563    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nzb8\" (UniqueName: \"kubernetes.io/projected/78a47a5e-640a-47ef-a219-57caa2c2567d-kube-api-access-6nzb8\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.759649 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.759587    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/78a47a5e-640a-47ef-a219-57caa2c2567d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.759649 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.759604    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/78a47a5e-640a-47ef-a219-57caa2c2567d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.759649 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.759622    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/78a47a5e-640a-47ef-a219-57caa2c2567d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.759649 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.759644    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/78a47a5e-640a-47ef-a219-57caa2c2567d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.759895 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.759705    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/78a47a5e-640a-47ef-a219-57caa2c2567d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.759895 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.759746    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/78a47a5e-640a-47ef-a219-57caa2c2567d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.759895 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.759785    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/78a47a5e-640a-47ef-a219-57caa2c2567d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.759895 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.759804    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/78a47a5e-640a-47ef-a219-57caa2c2567d-config-out\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.861189 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.861103    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/78a47a5e-640a-47ef-a219-57caa2c2567d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.861189 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.861151    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/78a47a5e-640a-47ef-a219-57caa2c2567d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.861189 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.861169    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/78a47a5e-640a-47ef-a219-57caa2c2567d-config-out\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.861189 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.861193    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/78a47a5e-640a-47ef-a219-57caa2c2567d-web-config\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.861536 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.861213    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/78a47a5e-640a-47ef-a219-57caa2c2567d-config-volume\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.861536 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.861229    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78a47a5e-640a-47ef-a219-57caa2c2567d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.861536 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.861251    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78a47a5e-640a-47ef-a219-57caa2c2567d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.861536 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.861269    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nzb8\" (UniqueName: \"kubernetes.io/projected/78a47a5e-640a-47ef-a219-57caa2c2567d-kube-api-access-6nzb8\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.861698 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.861560    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/78a47a5e-640a-47ef-a219-57caa2c2567d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.861698 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.861601    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/78a47a5e-640a-47ef-a219-57caa2c2567d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.861698 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.861633    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/78a47a5e-640a-47ef-a219-57caa2c2567d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.861698 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.861679    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/78a47a5e-640a-47ef-a219-57caa2c2567d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.861835 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.861716    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/78a47a5e-640a-47ef-a219-57caa2c2567d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.862032 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.862007    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/78a47a5e-640a-47ef-a219-57caa2c2567d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.862134 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.862067    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78a47a5e-640a-47ef-a219-57caa2c2567d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.862253 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.862229    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78a47a5e-640a-47ef-a219-57caa2c2567d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.864047 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.863995    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/78a47a5e-640a-47ef-a219-57caa2c2567d-config-out\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.864454 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.864432    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/78a47a5e-640a-47ef-a219-57caa2c2567d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.864915 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.864894    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/78a47a5e-640a-47ef-a219-57caa2c2567d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.864982 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.864932    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/78a47a5e-640a-47ef-a219-57caa2c2567d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.864982 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.864959    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/78a47a5e-640a-47ef-a219-57caa2c2567d-config-volume\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.865058 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.865017    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/78a47a5e-640a-47ef-a219-57caa2c2567d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.865218 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.865202    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/78a47a5e-640a-47ef-a219-57caa2c2567d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.865622 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.865609    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/78a47a5e-640a-47ef-a219-57caa2c2567d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.865711 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.865697    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/78a47a5e-640a-47ef-a219-57caa2c2567d-web-config\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.868730 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.868710    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nzb8\" (UniqueName: \"kubernetes.io/projected/78a47a5e-640a-47ef-a219-57caa2c2567d-kube-api-access-6nzb8\") pod \"alertmanager-main-0\" (UID: \"78a47a5e-640a-47ef-a219-57caa2c2567d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:33.947838 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:33.947803    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:15:34.225010 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:34.224984    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 14:15:34.227421 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:15:34.227387    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78a47a5e_640a_47ef_a219_57caa2c2567d.slice/crio-5ac407cf8d2da7c933888a42f2264a93a1a0d64577c8b783bc8ee96641d6fb69 WatchSource:0}: Error finding container 5ac407cf8d2da7c933888a42f2264a93a1a0d64577c8b783bc8ee96641d6fb69: Status 404 returned error can't find the container with id 5ac407cf8d2da7c933888a42f2264a93a1a0d64577c8b783bc8ee96641d6fb69
Sep 10 14:15:34.284760 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:34.284728    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"78a47a5e-640a-47ef-a219-57caa2c2567d","Type":"ContainerStarted","Data":"5ac407cf8d2da7c933888a42f2264a93a1a0d64577c8b783bc8ee96641d6fb69"}
Sep 10 14:15:34.364463 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:34.364430    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f" path="/var/lib/kubelet/pods/96bdb0b0-20fb-4ef8-b801-1c6d534b4b0f/volumes"
Sep 10 14:15:35.290058 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:35.290019    2545 generic.go:356] "Generic (PLEG): container finished" podID="78a47a5e-640a-47ef-a219-57caa2c2567d" containerID="ee05dbae99eafba32367ce0b07b99b361c34f558e8fd77f749203f7ec97eda3c" exitCode=0
Sep 10 14:15:35.290431 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:35.290099    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"78a47a5e-640a-47ef-a219-57caa2c2567d","Type":"ContainerDied","Data":"ee05dbae99eafba32367ce0b07b99b361c34f558e8fd77f749203f7ec97eda3c"}
Sep 10 14:15:36.002389 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.002352    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5c844879b9-gwdf6"]
Sep 10 14:15:36.006364 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.006335    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6"
Sep 10 14:15:36.008928 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.008899    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 10 14:15:36.009412 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.009388    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 10 14:15:36.009539 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.009516    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 10 14:15:36.009613 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.009590    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-hgqht\""
Sep 10 14:15:36.009704 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.009682    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 10 14:15:36.009768 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.009747    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 10 14:15:36.015516 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.015479    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 10 14:15:36.019218 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.019198    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c844879b9-gwdf6"]
Sep 10 14:15:36.181869 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.181826    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c-metrics-client-ca\") pod \"telemeter-client-5c844879b9-gwdf6\" (UID: \"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c\") " pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6"
Sep 10 14:15:36.182047 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.181895    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c-telemeter-client-tls\") pod \"telemeter-client-5c844879b9-gwdf6\" (UID: \"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c\") " pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6"
Sep 10 14:15:36.182047 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.181938    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c-secret-telemeter-client\") pod \"telemeter-client-5c844879b9-gwdf6\" (UID: \"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c\") " pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6"
Sep 10 14:15:36.182047 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.181987    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c844879b9-gwdf6\" (UID: \"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c\") " pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6"
Sep 10 14:15:36.182047 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.182014    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdgss\" (UniqueName: \"kubernetes.io/projected/f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c-kube-api-access-bdgss\") pod \"telemeter-client-5c844879b9-gwdf6\" (UID: \"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c\") " pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6"
Sep 10 14:15:36.182265 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.182061    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c844879b9-gwdf6\" (UID: \"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c\") " pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6"
Sep 10 14:15:36.182265 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.182093    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c-serving-certs-ca-bundle\") pod \"telemeter-client-5c844879b9-gwdf6\" (UID: \"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c\") " pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6"
Sep 10 14:15:36.182265 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.182119    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c-federate-client-tls\") pod \"telemeter-client-5c844879b9-gwdf6\" (UID: \"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c\") " pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6"
Sep 10 14:15:36.283103 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.283015    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c844879b9-gwdf6\" (UID: \"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c\") " pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6"
Sep 10 14:15:36.283103 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.283079    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c-serving-certs-ca-bundle\") pod \"telemeter-client-5c844879b9-gwdf6\" (UID: \"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c\") " pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6"
Sep 10 14:15:36.283323 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.283111    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c-federate-client-tls\") pod \"telemeter-client-5c844879b9-gwdf6\" (UID: \"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c\") " pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6"
Sep 10 14:15:36.283323 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.283146    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c-metrics-client-ca\") pod \"telemeter-client-5c844879b9-gwdf6\" (UID: \"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c\") " pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6"
Sep 10 14:15:36.283436 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.283346    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c-telemeter-client-tls\") pod \"telemeter-client-5c844879b9-gwdf6\" (UID: \"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c\") " pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6"
Sep 10 14:15:36.283436 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.283417    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c-secret-telemeter-client\") pod \"telemeter-client-5c844879b9-gwdf6\" (UID: \"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c\") " pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6"
Sep 10 14:15:36.283569 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.283476    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c844879b9-gwdf6\" (UID: \"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c\") " pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6"
Sep 10 14:15:36.283569 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.283530    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdgss\" (UniqueName: \"kubernetes.io/projected/f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c-kube-api-access-bdgss\") pod \"telemeter-client-5c844879b9-gwdf6\" (UID: \"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c\") " pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6"
Sep 10 14:15:36.284016 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.283987    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c-serving-certs-ca-bundle\") pod \"telemeter-client-5c844879b9-gwdf6\" (UID: \"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c\") " pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6"
Sep 10 14:15:36.284894 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.284201    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c844879b9-gwdf6\" (UID: \"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c\") " pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6"
Sep 10 14:15:36.284894 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.284339    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c-metrics-client-ca\") pod \"telemeter-client-5c844879b9-gwdf6\" (UID: \"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c\") " pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6"
Sep 10 14:15:36.286119 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.286076    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c-federate-client-tls\") pod \"telemeter-client-5c844879b9-gwdf6\" (UID: \"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c\") " pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6"
Sep 10 14:15:36.286195 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.286131    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c-telemeter-client-tls\") pod \"telemeter-client-5c844879b9-gwdf6\" (UID: \"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c\") " pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6"
Sep 10 14:15:36.286562 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.286538    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c844879b9-gwdf6\" (UID: \"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c\") " pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6"
Sep 10 14:15:36.286608 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.286544    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c-secret-telemeter-client\") pod \"telemeter-client-5c844879b9-gwdf6\" (UID: \"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c\") " pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6"
Sep 10 14:15:36.293819 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.293795    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdgss\" (UniqueName: \"kubernetes.io/projected/f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c-kube-api-access-bdgss\") pod \"telemeter-client-5c844879b9-gwdf6\" (UID: \"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c\") " pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6"
Sep 10 14:15:36.299428 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.299403    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"78a47a5e-640a-47ef-a219-57caa2c2567d","Type":"ContainerStarted","Data":"d311d7f007283d8f7cedb6f746eff03c5555f35072bf577be2265cb55734f9a6"}
Sep 10 14:15:36.299556 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.299463    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"78a47a5e-640a-47ef-a219-57caa2c2567d","Type":"ContainerStarted","Data":"21b65b391d61e8094feff08418b3f92f210f0e791a0d150884b686ea01053c1e"}
Sep 10 14:15:36.299556 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.299513    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"78a47a5e-640a-47ef-a219-57caa2c2567d","Type":"ContainerStarted","Data":"f336b4d0e8430d989e419262f5cd167a5c82a556cdb6aa6e47d9231d32967e50"}
Sep 10 14:15:36.299556 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.299540    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"78a47a5e-640a-47ef-a219-57caa2c2567d","Type":"ContainerStarted","Data":"e7bf6f1964fd0edeebe79946b0835ab874a0b8e29956775c26b89248d59c7171"}
Sep 10 14:15:36.299701 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.299569    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"78a47a5e-640a-47ef-a219-57caa2c2567d","Type":"ContainerStarted","Data":"e6244395d707e9517697a60aca8a6878a4254257976703df4c480f2ce0b796f0"}
Sep 10 14:15:36.299701 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.299593    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"78a47a5e-640a-47ef-a219-57caa2c2567d","Type":"ContainerStarted","Data":"66c6033c23206fdf7bd37d6edbcd7a3de535dd28d3f45d704feb41068f148293"}
Sep 10 14:15:36.317841 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.317816    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6"
Sep 10 14:15:36.324639 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.324582    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.30995998 podStartE2EDuration="3.324564014s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.604034ms" isStatefulPod=false podCreationTimestamp="2026-09-10 14:15:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:15:36.323043105 +0000 UTC m=+234.440584605" watchObservedRunningTime="2026-09-10 14:15:36.324564014 +0000 UTC m=+234.442105501"
Sep 10 14:15:36.610247 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:36.610159    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c844879b9-gwdf6"]
Sep 10 14:15:36.613679 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:15:36.613652    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e32b9d_2b75_4ada_9623_5a0e7d3b0d4c.slice/crio-23f48bde785c875fe674c84994d1b8c128b8593cce6b527f63cc8e9b445ca7c8 WatchSource:0}: Error finding container 23f48bde785c875fe674c84994d1b8c128b8593cce6b527f63cc8e9b445ca7c8: Status 404 returned error can't find the container with id 23f48bde785c875fe674c84994d1b8c128b8593cce6b527f63cc8e9b445ca7c8
Sep 10 14:15:37.305376 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:37.305335    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6" event={"ID":"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c","Type":"ContainerStarted","Data":"23f48bde785c875fe674c84994d1b8c128b8593cce6b527f63cc8e9b445ca7c8"}
Sep 10 14:15:39.316346 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.316312    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6" event={"ID":"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c","Type":"ContainerStarted","Data":"f6c36d9b1fe94694173c3dab827bf98ebbf80566b9f9ce98e9ad3edfc66177c7"}
Sep 10 14:15:39.316744 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.316366    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6" event={"ID":"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c","Type":"ContainerStarted","Data":"ffe81c6335cbcd0d307688cbb24670e4a4079f45215c2b1935896ffd8e8f2294"}
Sep 10 14:15:39.316744 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.316386    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6" event={"ID":"f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c","Type":"ContainerStarted","Data":"a5cb3035e5b1f42cfe31a5a395b28099a18027eff421f528c49191f7eba6741f"}
Sep 10 14:15:39.339752 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.339702    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5c844879b9-gwdf6" podStartSLOduration=2.455008755 podStartE2EDuration="4.339685437s" totalImagesPullingTime="1.884676682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:15:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:15:39.338592252 +0000 UTC m=+237.456133727" watchObservedRunningTime="2026-09-10 14:15:39.339685437 +0000 UTC m=+237.457226958"
Sep 10 14:15:39.424432 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.424402    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6864c8b548-5kzcn"]
Sep 10 14:15:39.427609 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.427591    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:39.438631 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.438604    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6864c8b548-5kzcn"]
Sep 10 14:15:39.617578 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.617470    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b920ac40-fbe7-465f-a8bd-66e8662547ed-trusted-ca-bundle\") pod \"console-6864c8b548-5kzcn\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") " pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:39.617578 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.617544    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b920ac40-fbe7-465f-a8bd-66e8662547ed-console-serving-cert\") pod \"console-6864c8b548-5kzcn\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") " pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:39.617578 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.617568    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b920ac40-fbe7-465f-a8bd-66e8662547ed-console-oauth-config\") pod \"console-6864c8b548-5kzcn\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") " pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:39.617774 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.617587    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b920ac40-fbe7-465f-a8bd-66e8662547ed-console-config\") pod \"console-6864c8b548-5kzcn\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") " pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:39.617774 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.617666    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b920ac40-fbe7-465f-a8bd-66e8662547ed-oauth-serving-cert\") pod \"console-6864c8b548-5kzcn\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") " pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:39.617774 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.617712    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b920ac40-fbe7-465f-a8bd-66e8662547ed-service-ca\") pod \"console-6864c8b548-5kzcn\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") " pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:39.617774 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.617745    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wft45\" (UniqueName: \"kubernetes.io/projected/b920ac40-fbe7-465f-a8bd-66e8662547ed-kube-api-access-wft45\") pod \"console-6864c8b548-5kzcn\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") " pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:39.718470 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.718433    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b920ac40-fbe7-465f-a8bd-66e8662547ed-trusted-ca-bundle\") pod \"console-6864c8b548-5kzcn\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") " pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:39.718470 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.718474    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b920ac40-fbe7-465f-a8bd-66e8662547ed-console-serving-cert\") pod \"console-6864c8b548-5kzcn\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") " pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:39.718735 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.718508    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b920ac40-fbe7-465f-a8bd-66e8662547ed-console-oauth-config\") pod \"console-6864c8b548-5kzcn\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") " pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:39.718735 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.718525    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b920ac40-fbe7-465f-a8bd-66e8662547ed-console-config\") pod \"console-6864c8b548-5kzcn\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") " pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:39.718735 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.718567    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b920ac40-fbe7-465f-a8bd-66e8662547ed-oauth-serving-cert\") pod \"console-6864c8b548-5kzcn\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") " pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:39.718735 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.718584    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b920ac40-fbe7-465f-a8bd-66e8662547ed-service-ca\") pod \"console-6864c8b548-5kzcn\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") " pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:39.718735 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.718620    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wft45\" (UniqueName: \"kubernetes.io/projected/b920ac40-fbe7-465f-a8bd-66e8662547ed-kube-api-access-wft45\") pod \"console-6864c8b548-5kzcn\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") " pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:39.719454 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.719424    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b920ac40-fbe7-465f-a8bd-66e8662547ed-service-ca\") pod \"console-6864c8b548-5kzcn\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") " pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:39.719598 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.719460    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b920ac40-fbe7-465f-a8bd-66e8662547ed-trusted-ca-bundle\") pod \"console-6864c8b548-5kzcn\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") " pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:39.719598 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.719424    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b920ac40-fbe7-465f-a8bd-66e8662547ed-console-config\") pod \"console-6864c8b548-5kzcn\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") " pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:39.719598 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.719424    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b920ac40-fbe7-465f-a8bd-66e8662547ed-oauth-serving-cert\") pod \"console-6864c8b548-5kzcn\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") " pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:39.720949 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.720925    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b920ac40-fbe7-465f-a8bd-66e8662547ed-console-serving-cert\") pod \"console-6864c8b548-5kzcn\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") " pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:39.721035 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.721000    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b920ac40-fbe7-465f-a8bd-66e8662547ed-console-oauth-config\") pod \"console-6864c8b548-5kzcn\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") " pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:39.726417 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.726395    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wft45\" (UniqueName: \"kubernetes.io/projected/b920ac40-fbe7-465f-a8bd-66e8662547ed-kube-api-access-wft45\") pod \"console-6864c8b548-5kzcn\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") " pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:39.737364 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:39.737341    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:40.012337 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:40.012308    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6864c8b548-5kzcn"]
Sep 10 14:15:40.322306 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:40.322202    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6864c8b548-5kzcn" event={"ID":"b920ac40-fbe7-465f-a8bd-66e8662547ed","Type":"ContainerStarted","Data":"83711b83bddbd62634abf98a75be54b96c972387e17dd9edfd60d64b9c5d5649"}
Sep 10 14:15:40.322306 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:40.322275    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6864c8b548-5kzcn" event={"ID":"b920ac40-fbe7-465f-a8bd-66e8662547ed","Type":"ContainerStarted","Data":"f8b82dcdf3a467f18cd6420c265071f1dae9394979cd046e952cd39fae53272c"}
Sep 10 14:15:40.338567 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:40.338506    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6864c8b548-5kzcn" podStartSLOduration=1.338472253 podStartE2EDuration="1.338472253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:15:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:15:40.33790866 +0000 UTC m=+238.455450136" watchObservedRunningTime="2026-09-10 14:15:40.338472253 +0000 UTC m=+238.456013729"
Sep 10 14:15:49.737473 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:49.737433    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:49.737964 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:49.737557    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:49.742341 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:49.742314    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:50.365338 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:50.365312    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:15:50.409552 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:15:50.409523    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-548d8d447c-2fn8h"]
Sep 10 14:16:15.433236 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:15.433175    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-548d8d447c-2fn8h" podUID="226ec8a8-cef0-4afc-a6b7-06c015b0fb56" containerName="console" containerID="cri-o://9eb4f921f25614876c9e19d397e7d86b3fba3ab5b3d6e4fae530dbf16380574b" gracePeriod=15
Sep 10 14:16:15.672192 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:15.672168    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:16:15.818967 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:15.818931    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-trusted-ca-bundle\") pod \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") "
Sep 10 14:16:15.819159 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:15.818996    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-console-oauth-config\") pod \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") "
Sep 10 14:16:15.819159 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:15.819023    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-service-ca\") pod \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") "
Sep 10 14:16:15.819159 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:15.819069    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-console-config\") pod \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") "
Sep 10 14:16:15.819325 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:15.819176    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6qng\" (UniqueName: \"kubernetes.io/projected/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-kube-api-access-g6qng\") pod \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") "
Sep 10 14:16:15.819325 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:15.819208    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-console-serving-cert\") pod \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") "
Sep 10 14:16:15.819325 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:15.819232    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-oauth-serving-cert\") pod \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\" (UID: \"226ec8a8-cef0-4afc-a6b7-06c015b0fb56\") "
Sep 10 14:16:15.819469 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:15.819440    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-service-ca" (OuterVolumeSpecName: "service-ca") pod "226ec8a8-cef0-4afc-a6b7-06c015b0fb56" (UID: "226ec8a8-cef0-4afc-a6b7-06c015b0fb56"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:16:15.819469 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:15.819456    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "226ec8a8-cef0-4afc-a6b7-06c015b0fb56" (UID: "226ec8a8-cef0-4afc-a6b7-06c015b0fb56"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:16:15.819591 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:15.819445    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-console-config" (OuterVolumeSpecName: "console-config") pod "226ec8a8-cef0-4afc-a6b7-06c015b0fb56" (UID: "226ec8a8-cef0-4afc-a6b7-06c015b0fb56"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:16:15.819756 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:15.819736    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "226ec8a8-cef0-4afc-a6b7-06c015b0fb56" (UID: "226ec8a8-cef0-4afc-a6b7-06c015b0fb56"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:16:15.821441 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:15.821404    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "226ec8a8-cef0-4afc-a6b7-06c015b0fb56" (UID: "226ec8a8-cef0-4afc-a6b7-06c015b0fb56"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:16:15.821679 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:15.821660    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "226ec8a8-cef0-4afc-a6b7-06c015b0fb56" (UID: "226ec8a8-cef0-4afc-a6b7-06c015b0fb56"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:16:15.821730 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:15.821672    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-kube-api-access-g6qng" (OuterVolumeSpecName: "kube-api-access-g6qng") pod "226ec8a8-cef0-4afc-a6b7-06c015b0fb56" (UID: "226ec8a8-cef0-4afc-a6b7-06c015b0fb56"). InnerVolumeSpecName "kube-api-access-g6qng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:16:15.920798 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:15.920756    2545 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-console-config\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:16:15.920798 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:15.920791    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6qng\" (UniqueName: \"kubernetes.io/projected/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-kube-api-access-g6qng\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:16:15.920798 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:15.920804    2545 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-console-serving-cert\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:16:15.921019 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:15.920815    2545 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-oauth-serving-cert\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:16:15.921019 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:15.920824    2545 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-trusted-ca-bundle\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:16:15.921019 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:15.920834    2545 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-console-oauth-config\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:16:15.921019 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:15.920842    2545 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/226ec8a8-cef0-4afc-a6b7-06c015b0fb56-service-ca\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:16:16.463029 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:16.462998    2545 generic.go:356] "Generic (PLEG): container finished" podID="226ec8a8-cef0-4afc-a6b7-06c015b0fb56" containerID="9eb4f921f25614876c9e19d397e7d86b3fba3ab5b3d6e4fae530dbf16380574b" exitCode=0
Sep 10 14:16:16.463417 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:16.463052    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548d8d447c-2fn8h"
Sep 10 14:16:16.463417 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:16.463072    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548d8d447c-2fn8h" event={"ID":"226ec8a8-cef0-4afc-a6b7-06c015b0fb56","Type":"ContainerDied","Data":"9eb4f921f25614876c9e19d397e7d86b3fba3ab5b3d6e4fae530dbf16380574b"}
Sep 10 14:16:16.463417 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:16.463111    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548d8d447c-2fn8h" event={"ID":"226ec8a8-cef0-4afc-a6b7-06c015b0fb56","Type":"ContainerDied","Data":"aaf35ae6d10485c58e83506f865a9d54a7f7184adaf3e84bc97463c7f307b330"}
Sep 10 14:16:16.463417 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:16.463131    2545 scope.go:117] "RemoveContainer" containerID="9eb4f921f25614876c9e19d397e7d86b3fba3ab5b3d6e4fae530dbf16380574b"
Sep 10 14:16:16.471521 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:16.471501    2545 scope.go:117] "RemoveContainer" containerID="9eb4f921f25614876c9e19d397e7d86b3fba3ab5b3d6e4fae530dbf16380574b"
Sep 10 14:16:16.471790 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:16:16.471771    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9eb4f921f25614876c9e19d397e7d86b3fba3ab5b3d6e4fae530dbf16380574b\": container with ID starting with 9eb4f921f25614876c9e19d397e7d86b3fba3ab5b3d6e4fae530dbf16380574b not found: ID does not exist" containerID="9eb4f921f25614876c9e19d397e7d86b3fba3ab5b3d6e4fae530dbf16380574b"
Sep 10 14:16:16.471842 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:16.471799    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eb4f921f25614876c9e19d397e7d86b3fba3ab5b3d6e4fae530dbf16380574b"} err="failed to get container status \"9eb4f921f25614876c9e19d397e7d86b3fba3ab5b3d6e4fae530dbf16380574b\": rpc error: code = NotFound desc = could not find container \"9eb4f921f25614876c9e19d397e7d86b3fba3ab5b3d6e4fae530dbf16380574b\": container with ID starting with 9eb4f921f25614876c9e19d397e7d86b3fba3ab5b3d6e4fae530dbf16380574b not found: ID does not exist"
Sep 10 14:16:16.479749 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:16.479725    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-548d8d447c-2fn8h"]
Sep 10 14:16:16.483321 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:16.483297    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-548d8d447c-2fn8h"]
Sep 10 14:16:18.365132 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:18.365096    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="226ec8a8-cef0-4afc-a6b7-06c015b0fb56" path="/var/lib/kubelet/pods/226ec8a8-cef0-4afc-a6b7-06c015b0fb56/volumes"
Sep 10 14:16:48.928793 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:48.928760    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6459d5b75d-n99b5"]
Sep 10 14:16:48.931062 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:48.929082    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="226ec8a8-cef0-4afc-a6b7-06c015b0fb56" containerName="console"
Sep 10 14:16:48.931062 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:48.929094    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="226ec8a8-cef0-4afc-a6b7-06c015b0fb56" containerName="console"
Sep 10 14:16:48.931062 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:48.929165    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="226ec8a8-cef0-4afc-a6b7-06c015b0fb56" containerName="console"
Sep 10 14:16:48.931845 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:48.931829    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:48.946034 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:48.945992    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6459d5b75d-n99b5"]
Sep 10 14:16:48.988364 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:48.988333    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6685497-24a8-4aa3-9235-05714f198736-oauth-serving-cert\") pod \"console-6459d5b75d-n99b5\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") " pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:48.988559 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:48.988374    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6685497-24a8-4aa3-9235-05714f198736-console-oauth-config\") pod \"console-6459d5b75d-n99b5\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") " pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:48.988559 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:48.988394    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6685497-24a8-4aa3-9235-05714f198736-console-serving-cert\") pod \"console-6459d5b75d-n99b5\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") " pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:48.988559 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:48.988467    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s98c7\" (UniqueName: \"kubernetes.io/projected/b6685497-24a8-4aa3-9235-05714f198736-kube-api-access-s98c7\") pod \"console-6459d5b75d-n99b5\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") " pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:48.988559 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:48.988516    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6685497-24a8-4aa3-9235-05714f198736-trusted-ca-bundle\") pod \"console-6459d5b75d-n99b5\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") " pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:48.988559 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:48.988550    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6685497-24a8-4aa3-9235-05714f198736-console-config\") pod \"console-6459d5b75d-n99b5\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") " pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:48.988868 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:48.988593    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6685497-24a8-4aa3-9235-05714f198736-service-ca\") pod \"console-6459d5b75d-n99b5\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") " pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:49.089964 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:49.089932    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6685497-24a8-4aa3-9235-05714f198736-console-config\") pod \"console-6459d5b75d-n99b5\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") " pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:49.090138 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:49.089979    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6685497-24a8-4aa3-9235-05714f198736-service-ca\") pod \"console-6459d5b75d-n99b5\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") " pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:49.090138 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:49.089998    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6685497-24a8-4aa3-9235-05714f198736-oauth-serving-cert\") pod \"console-6459d5b75d-n99b5\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") " pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:49.090138 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:49.090044    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6685497-24a8-4aa3-9235-05714f198736-console-oauth-config\") pod \"console-6459d5b75d-n99b5\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") " pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:49.090138 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:49.090076    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6685497-24a8-4aa3-9235-05714f198736-console-serving-cert\") pod \"console-6459d5b75d-n99b5\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") " pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:49.090138 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:49.090107    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s98c7\" (UniqueName: \"kubernetes.io/projected/b6685497-24a8-4aa3-9235-05714f198736-kube-api-access-s98c7\") pod \"console-6459d5b75d-n99b5\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") " pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:49.090374 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:49.090270    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6685497-24a8-4aa3-9235-05714f198736-trusted-ca-bundle\") pod \"console-6459d5b75d-n99b5\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") " pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:49.090775 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:49.090715    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6685497-24a8-4aa3-9235-05714f198736-console-config\") pod \"console-6459d5b75d-n99b5\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") " pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:49.090906 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:49.090780    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6685497-24a8-4aa3-9235-05714f198736-service-ca\") pod \"console-6459d5b75d-n99b5\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") " pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:49.091016 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:49.090992    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6685497-24a8-4aa3-9235-05714f198736-oauth-serving-cert\") pod \"console-6459d5b75d-n99b5\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") " pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:49.091120 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:49.091097    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6685497-24a8-4aa3-9235-05714f198736-trusted-ca-bundle\") pod \"console-6459d5b75d-n99b5\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") " pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:49.092611 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:49.092587    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6685497-24a8-4aa3-9235-05714f198736-console-oauth-config\") pod \"console-6459d5b75d-n99b5\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") " pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:49.092704 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:49.092630    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6685497-24a8-4aa3-9235-05714f198736-console-serving-cert\") pod \"console-6459d5b75d-n99b5\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") " pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:49.099923 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:49.099900    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s98c7\" (UniqueName: \"kubernetes.io/projected/b6685497-24a8-4aa3-9235-05714f198736-kube-api-access-s98c7\") pod \"console-6459d5b75d-n99b5\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") " pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:49.240745 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:49.240710    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:49.511831 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:49.511591    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6459d5b75d-n99b5"]
Sep 10 14:16:49.514557 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:16:49.514529    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6685497_24a8_4aa3_9235_05714f198736.slice/crio-295c94fefdd0eec1a9d6bbffdc7ca54486ec4c77dda2289da0e39f977f0aa584 WatchSource:0}: Error finding container 295c94fefdd0eec1a9d6bbffdc7ca54486ec4c77dda2289da0e39f977f0aa584: Status 404 returned error can't find the container with id 295c94fefdd0eec1a9d6bbffdc7ca54486ec4c77dda2289da0e39f977f0aa584
Sep 10 14:16:49.591263 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:49.591230    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6459d5b75d-n99b5" event={"ID":"b6685497-24a8-4aa3-9235-05714f198736","Type":"ContainerStarted","Data":"5c74fe0734a1afbaec6f4ec35047f7f2e3decaa58755063fab03748283ff9e24"}
Sep 10 14:16:49.591397 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:49.591287    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6459d5b75d-n99b5" event={"ID":"b6685497-24a8-4aa3-9235-05714f198736","Type":"ContainerStarted","Data":"295c94fefdd0eec1a9d6bbffdc7ca54486ec4c77dda2289da0e39f977f0aa584"}
Sep 10 14:16:49.608931 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:49.608880    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6459d5b75d-n99b5" podStartSLOduration=1.608865598 podStartE2EDuration="1.608865598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:16:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:16:49.608268102 +0000 UTC m=+307.725809578" watchObservedRunningTime="2026-09-10 14:16:49.608865598 +0000 UTC m=+307.726407073"
Sep 10 14:16:59.241588 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:59.241553    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:59.242039 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:59.241638    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:59.246563 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:59.246535    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:59.635939 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:59.635867    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:16:59.684499 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:16:59.684458    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6864c8b548-5kzcn"]
Sep 10 14:17:24.706232 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:24.706193    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6864c8b548-5kzcn" podUID="b920ac40-fbe7-465f-a8bd-66e8662547ed" containerName="console" containerID="cri-o://83711b83bddbd62634abf98a75be54b96c972387e17dd9edfd60d64b9c5d5649" gracePeriod=15
Sep 10 14:17:24.955889 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:24.955866    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:17:25.083896 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.083864    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b920ac40-fbe7-465f-a8bd-66e8662547ed-console-serving-cert\") pod \"b920ac40-fbe7-465f-a8bd-66e8662547ed\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") "
Sep 10 14:17:25.084058 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.083910    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b920ac40-fbe7-465f-a8bd-66e8662547ed-oauth-serving-cert\") pod \"b920ac40-fbe7-465f-a8bd-66e8662547ed\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") "
Sep 10 14:17:25.084058 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.083925    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b920ac40-fbe7-465f-a8bd-66e8662547ed-service-ca\") pod \"b920ac40-fbe7-465f-a8bd-66e8662547ed\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") "
Sep 10 14:17:25.084058 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.083946    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b920ac40-fbe7-465f-a8bd-66e8662547ed-trusted-ca-bundle\") pod \"b920ac40-fbe7-465f-a8bd-66e8662547ed\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") "
Sep 10 14:17:25.084058 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.083981    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b920ac40-fbe7-465f-a8bd-66e8662547ed-console-oauth-config\") pod \"b920ac40-fbe7-465f-a8bd-66e8662547ed\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") "
Sep 10 14:17:25.084058 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.084019    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wft45\" (UniqueName: \"kubernetes.io/projected/b920ac40-fbe7-465f-a8bd-66e8662547ed-kube-api-access-wft45\") pod \"b920ac40-fbe7-465f-a8bd-66e8662547ed\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") "
Sep 10 14:17:25.084279 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.084065    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b920ac40-fbe7-465f-a8bd-66e8662547ed-console-config\") pod \"b920ac40-fbe7-465f-a8bd-66e8662547ed\" (UID: \"b920ac40-fbe7-465f-a8bd-66e8662547ed\") "
Sep 10 14:17:25.084322 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.084297    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b920ac40-fbe7-465f-a8bd-66e8662547ed-service-ca" (OuterVolumeSpecName: "service-ca") pod "b920ac40-fbe7-465f-a8bd-66e8662547ed" (UID: "b920ac40-fbe7-465f-a8bd-66e8662547ed"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:17:25.084368 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.084304    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b920ac40-fbe7-465f-a8bd-66e8662547ed-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b920ac40-fbe7-465f-a8bd-66e8662547ed" (UID: "b920ac40-fbe7-465f-a8bd-66e8662547ed"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:17:25.084368 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.084337    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b920ac40-fbe7-465f-a8bd-66e8662547ed-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b920ac40-fbe7-465f-a8bd-66e8662547ed" (UID: "b920ac40-fbe7-465f-a8bd-66e8662547ed"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:17:25.084567 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.084547    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b920ac40-fbe7-465f-a8bd-66e8662547ed-console-config" (OuterVolumeSpecName: "console-config") pod "b920ac40-fbe7-465f-a8bd-66e8662547ed" (UID: "b920ac40-fbe7-465f-a8bd-66e8662547ed"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:17:25.086299 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.086277    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b920ac40-fbe7-465f-a8bd-66e8662547ed-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b920ac40-fbe7-465f-a8bd-66e8662547ed" (UID: "b920ac40-fbe7-465f-a8bd-66e8662547ed"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:17:25.086401 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.086314    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b920ac40-fbe7-465f-a8bd-66e8662547ed-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b920ac40-fbe7-465f-a8bd-66e8662547ed" (UID: "b920ac40-fbe7-465f-a8bd-66e8662547ed"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:17:25.086401 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.086324    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b920ac40-fbe7-465f-a8bd-66e8662547ed-kube-api-access-wft45" (OuterVolumeSpecName: "kube-api-access-wft45") pod "b920ac40-fbe7-465f-a8bd-66e8662547ed" (UID: "b920ac40-fbe7-465f-a8bd-66e8662547ed"). InnerVolumeSpecName "kube-api-access-wft45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:17:25.185624 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.185585    2545 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b920ac40-fbe7-465f-a8bd-66e8662547ed-console-config\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:17:25.185624 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.185620    2545 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b920ac40-fbe7-465f-a8bd-66e8662547ed-console-serving-cert\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:17:25.185624 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.185629    2545 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b920ac40-fbe7-465f-a8bd-66e8662547ed-oauth-serving-cert\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:17:25.185624 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.185638    2545 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b920ac40-fbe7-465f-a8bd-66e8662547ed-service-ca\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:17:25.185846 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.185647    2545 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b920ac40-fbe7-465f-a8bd-66e8662547ed-trusted-ca-bundle\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:17:25.185846 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.185656    2545 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b920ac40-fbe7-465f-a8bd-66e8662547ed-console-oauth-config\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:17:25.185846 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.185664    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wft45\" (UniqueName: \"kubernetes.io/projected/b920ac40-fbe7-465f-a8bd-66e8662547ed-kube-api-access-wft45\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:17:25.739457 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.739421    2545 generic.go:356] "Generic (PLEG): container finished" podID="b920ac40-fbe7-465f-a8bd-66e8662547ed" containerID="83711b83bddbd62634abf98a75be54b96c972387e17dd9edfd60d64b9c5d5649" exitCode=0
Sep 10 14:17:25.739843 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.739462    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6864c8b548-5kzcn"
Sep 10 14:17:25.739843 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.739462    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6864c8b548-5kzcn" event={"ID":"b920ac40-fbe7-465f-a8bd-66e8662547ed","Type":"ContainerDied","Data":"83711b83bddbd62634abf98a75be54b96c972387e17dd9edfd60d64b9c5d5649"}
Sep 10 14:17:25.739843 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.739594    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6864c8b548-5kzcn" event={"ID":"b920ac40-fbe7-465f-a8bd-66e8662547ed","Type":"ContainerDied","Data":"f8b82dcdf3a467f18cd6420c265071f1dae9394979cd046e952cd39fae53272c"}
Sep 10 14:17:25.739843 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.739617    2545 scope.go:117] "RemoveContainer" containerID="83711b83bddbd62634abf98a75be54b96c972387e17dd9edfd60d64b9c5d5649"
Sep 10 14:17:25.748247 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.748231    2545 scope.go:117] "RemoveContainer" containerID="83711b83bddbd62634abf98a75be54b96c972387e17dd9edfd60d64b9c5d5649"
Sep 10 14:17:25.748507 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:17:25.748469    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83711b83bddbd62634abf98a75be54b96c972387e17dd9edfd60d64b9c5d5649\": container with ID starting with 83711b83bddbd62634abf98a75be54b96c972387e17dd9edfd60d64b9c5d5649 not found: ID does not exist" containerID="83711b83bddbd62634abf98a75be54b96c972387e17dd9edfd60d64b9c5d5649"
Sep 10 14:17:25.748568 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.748510    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83711b83bddbd62634abf98a75be54b96c972387e17dd9edfd60d64b9c5d5649"} err="failed to get container status \"83711b83bddbd62634abf98a75be54b96c972387e17dd9edfd60d64b9c5d5649\": rpc error: code = NotFound desc = could not find container \"83711b83bddbd62634abf98a75be54b96c972387e17dd9edfd60d64b9c5d5649\": container with ID starting with 83711b83bddbd62634abf98a75be54b96c972387e17dd9edfd60d64b9c5d5649 not found: ID does not exist"
Sep 10 14:17:25.758587 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.758567    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6864c8b548-5kzcn"]
Sep 10 14:17:25.760694 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:25.760675    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6864c8b548-5kzcn"]
Sep 10 14:17:26.365468 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:26.365418    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b920ac40-fbe7-465f-a8bd-66e8662547ed" path="/var/lib/kubelet/pods/b920ac40-fbe7-465f-a8bd-66e8662547ed/volumes"
Sep 10 14:17:53.317881 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:53.317843    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429"]
Sep 10 14:17:53.318463 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:53.318312    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b920ac40-fbe7-465f-a8bd-66e8662547ed" containerName="console"
Sep 10 14:17:53.318463 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:53.318331    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="b920ac40-fbe7-465f-a8bd-66e8662547ed" containerName="console"
Sep 10 14:17:53.318463 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:53.318411    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="b920ac40-fbe7-465f-a8bd-66e8662547ed" containerName="console"
Sep 10 14:17:53.322715 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:53.322695    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429"
Sep 10 14:17:53.325109 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:53.325088    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 14:17:53.326151 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:53.326136    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tmlb9\""
Sep 10 14:17:53.326220 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:53.326191    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 14:17:53.332513 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:53.332458    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429"]
Sep 10 14:17:53.408041 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:53.408010    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89189748-fdae-49c9-ac10-8d901326af2a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429\" (UID: \"89189748-fdae-49c9-ac10-8d901326af2a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429"
Sep 10 14:17:53.408182 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:53.408046    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbk8q\" (UniqueName: \"kubernetes.io/projected/89189748-fdae-49c9-ac10-8d901326af2a-kube-api-access-pbk8q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429\" (UID: \"89189748-fdae-49c9-ac10-8d901326af2a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429"
Sep 10 14:17:53.408182 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:53.408116    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89189748-fdae-49c9-ac10-8d901326af2a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429\" (UID: \"89189748-fdae-49c9-ac10-8d901326af2a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429"
Sep 10 14:17:53.508469 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:53.508441    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89189748-fdae-49c9-ac10-8d901326af2a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429\" (UID: \"89189748-fdae-49c9-ac10-8d901326af2a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429"
Sep 10 14:17:53.508587 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:53.508474    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbk8q\" (UniqueName: \"kubernetes.io/projected/89189748-fdae-49c9-ac10-8d901326af2a-kube-api-access-pbk8q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429\" (UID: \"89189748-fdae-49c9-ac10-8d901326af2a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429"
Sep 10 14:17:53.508587 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:53.508536    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89189748-fdae-49c9-ac10-8d901326af2a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429\" (UID: \"89189748-fdae-49c9-ac10-8d901326af2a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429"
Sep 10 14:17:53.508807 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:53.508787    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89189748-fdae-49c9-ac10-8d901326af2a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429\" (UID: \"89189748-fdae-49c9-ac10-8d901326af2a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429"
Sep 10 14:17:53.508854 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:53.508815    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89189748-fdae-49c9-ac10-8d901326af2a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429\" (UID: \"89189748-fdae-49c9-ac10-8d901326af2a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429"
Sep 10 14:17:53.519159 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:53.519129    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbk8q\" (UniqueName: \"kubernetes.io/projected/89189748-fdae-49c9-ac10-8d901326af2a-kube-api-access-pbk8q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429\" (UID: \"89189748-fdae-49c9-ac10-8d901326af2a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429"
Sep 10 14:17:53.637187 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:53.637104    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429"
Sep 10 14:17:53.904407 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:53.904331    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429"]
Sep 10 14:17:53.906946 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:17:53.906919    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89189748_fdae_49c9_ac10_8d901326af2a.slice/crio-6b74c66df5341c7e46ec6e1def94870b41691d4d63ed16ab5eafd4466f33b477 WatchSource:0}: Error finding container 6b74c66df5341c7e46ec6e1def94870b41691d4d63ed16ab5eafd4466f33b477: Status 404 returned error can't find the container with id 6b74c66df5341c7e46ec6e1def94870b41691d4d63ed16ab5eafd4466f33b477
Sep 10 14:17:53.908893 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:53.908878    2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 14:17:54.851679 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:17:54.851629    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429" event={"ID":"89189748-fdae-49c9-ac10-8d901326af2a","Type":"ContainerStarted","Data":"6b74c66df5341c7e46ec6e1def94870b41691d4d63ed16ab5eafd4466f33b477"}
Sep 10 14:18:00.879553 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:00.879515    2545 generic.go:356] "Generic (PLEG): container finished" podID="89189748-fdae-49c9-ac10-8d901326af2a" containerID="8f093bab9721bac9912810478b6384d26de08a595dbc90742686d1fbc45435f7" exitCode=0
Sep 10 14:18:00.879985 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:00.879580    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429" event={"ID":"89189748-fdae-49c9-ac10-8d901326af2a","Type":"ContainerDied","Data":"8f093bab9721bac9912810478b6384d26de08a595dbc90742686d1fbc45435f7"}
Sep 10 14:18:03.892454 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:03.892414    2545 generic.go:356] "Generic (PLEG): container finished" podID="89189748-fdae-49c9-ac10-8d901326af2a" containerID="2fd10ee8b949cbaa74a3dcad4b060646367d44618447e111338395666ecbeb78" exitCode=0
Sep 10 14:18:03.892910 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:03.892506    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429" event={"ID":"89189748-fdae-49c9-ac10-8d901326af2a","Type":"ContainerDied","Data":"2fd10ee8b949cbaa74a3dcad4b060646367d44618447e111338395666ecbeb78"}
Sep 10 14:18:10.923482 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:10.923440    2545 generic.go:356] "Generic (PLEG): container finished" podID="89189748-fdae-49c9-ac10-8d901326af2a" containerID="c1bbe3201237056029aa8df18964c2359db45a98881118e873ebcfb82d7d6397" exitCode=0
Sep 10 14:18:10.923858 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:10.923507    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429" event={"ID":"89189748-fdae-49c9-ac10-8d901326af2a","Type":"ContainerDied","Data":"c1bbe3201237056029aa8df18964c2359db45a98881118e873ebcfb82d7d6397"}
Sep 10 14:18:12.049328 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:12.049301    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429"
Sep 10 14:18:12.175718 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:12.175666    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89189748-fdae-49c9-ac10-8d901326af2a-bundle\") pod \"89189748-fdae-49c9-ac10-8d901326af2a\" (UID: \"89189748-fdae-49c9-ac10-8d901326af2a\") "
Sep 10 14:18:12.175904 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:12.175755    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbk8q\" (UniqueName: \"kubernetes.io/projected/89189748-fdae-49c9-ac10-8d901326af2a-kube-api-access-pbk8q\") pod \"89189748-fdae-49c9-ac10-8d901326af2a\" (UID: \"89189748-fdae-49c9-ac10-8d901326af2a\") "
Sep 10 14:18:12.175904 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:12.175781    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89189748-fdae-49c9-ac10-8d901326af2a-util\") pod \"89189748-fdae-49c9-ac10-8d901326af2a\" (UID: \"89189748-fdae-49c9-ac10-8d901326af2a\") "
Sep 10 14:18:12.176358 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:12.176331    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89189748-fdae-49c9-ac10-8d901326af2a-bundle" (OuterVolumeSpecName: "bundle") pod "89189748-fdae-49c9-ac10-8d901326af2a" (UID: "89189748-fdae-49c9-ac10-8d901326af2a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:18:12.177891 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:12.177868    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89189748-fdae-49c9-ac10-8d901326af2a-kube-api-access-pbk8q" (OuterVolumeSpecName: "kube-api-access-pbk8q") pod "89189748-fdae-49c9-ac10-8d901326af2a" (UID: "89189748-fdae-49c9-ac10-8d901326af2a"). InnerVolumeSpecName "kube-api-access-pbk8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:18:12.179933 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:12.179870    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89189748-fdae-49c9-ac10-8d901326af2a-util" (OuterVolumeSpecName: "util") pod "89189748-fdae-49c9-ac10-8d901326af2a" (UID: "89189748-fdae-49c9-ac10-8d901326af2a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:18:12.276630 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:12.276594    2545 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89189748-fdae-49c9-ac10-8d901326af2a-bundle\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:18:12.276630 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:12.276628    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbk8q\" (UniqueName: \"kubernetes.io/projected/89189748-fdae-49c9-ac10-8d901326af2a-kube-api-access-pbk8q\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:18:12.276808 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:12.276641    2545 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89189748-fdae-49c9-ac10-8d901326af2a-util\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:18:12.932886 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:12.932855    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429" event={"ID":"89189748-fdae-49c9-ac10-8d901326af2a","Type":"ContainerDied","Data":"6b74c66df5341c7e46ec6e1def94870b41691d4d63ed16ab5eafd4466f33b477"}
Sep 10 14:18:12.933046 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:12.932903    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b74c66df5341c7e46ec6e1def94870b41691d4d63ed16ab5eafd4466f33b477"
Sep 10 14:18:12.933046 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:12.932863    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754056429"
Sep 10 14:18:16.249701 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:16.249667    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpqd4"]
Sep 10 14:18:16.250065 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:16.249966    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89189748-fdae-49c9-ac10-8d901326af2a" containerName="pull"
Sep 10 14:18:16.250065 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:16.249977    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="89189748-fdae-49c9-ac10-8d901326af2a" containerName="pull"
Sep 10 14:18:16.250065 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:16.249990    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89189748-fdae-49c9-ac10-8d901326af2a" containerName="extract"
Sep 10 14:18:16.250065 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:16.249997    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="89189748-fdae-49c9-ac10-8d901326af2a" containerName="extract"
Sep 10 14:18:16.250065 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:16.250007    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89189748-fdae-49c9-ac10-8d901326af2a" containerName="util"
Sep 10 14:18:16.250065 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:16.250012    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="89189748-fdae-49c9-ac10-8d901326af2a" containerName="util"
Sep 10 14:18:16.250288 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:16.250078    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="89189748-fdae-49c9-ac10-8d901326af2a" containerName="extract"
Sep 10 14:18:16.254985 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:16.254967    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpqd4"
Sep 10 14:18:16.257603 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:16.257578    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 10 14:18:16.257603 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:16.257582    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 10 14:18:16.257762 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:16.257586    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-2wwwt\""
Sep 10 14:18:16.266120 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:16.266100    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpqd4"]
Sep 10 14:18:16.411258 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:16.411218    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhtsl\" (UniqueName: \"kubernetes.io/projected/0b648841-5120-4d8b-90d5-d2ee7295d612-kube-api-access-xhtsl\") pod \"cert-manager-operator-controller-manager-55c444bf86-rpqd4\" (UID: \"0b648841-5120-4d8b-90d5-d2ee7295d612\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpqd4"
Sep 10 14:18:16.411258 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:16.411258    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b648841-5120-4d8b-90d5-d2ee7295d612-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rpqd4\" (UID: \"0b648841-5120-4d8b-90d5-d2ee7295d612\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpqd4"
Sep 10 14:18:16.512549 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:16.512459    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhtsl\" (UniqueName: \"kubernetes.io/projected/0b648841-5120-4d8b-90d5-d2ee7295d612-kube-api-access-xhtsl\") pod \"cert-manager-operator-controller-manager-55c444bf86-rpqd4\" (UID: \"0b648841-5120-4d8b-90d5-d2ee7295d612\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpqd4"
Sep 10 14:18:16.512718 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:16.512588    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b648841-5120-4d8b-90d5-d2ee7295d612-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rpqd4\" (UID: \"0b648841-5120-4d8b-90d5-d2ee7295d612\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpqd4"
Sep 10 14:18:16.513199 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:16.513174    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b648841-5120-4d8b-90d5-d2ee7295d612-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rpqd4\" (UID: \"0b648841-5120-4d8b-90d5-d2ee7295d612\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpqd4"
Sep 10 14:18:16.522949 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:16.522918    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhtsl\" (UniqueName: \"kubernetes.io/projected/0b648841-5120-4d8b-90d5-d2ee7295d612-kube-api-access-xhtsl\") pod \"cert-manager-operator-controller-manager-55c444bf86-rpqd4\" (UID: \"0b648841-5120-4d8b-90d5-d2ee7295d612\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpqd4"
Sep 10 14:18:16.564361 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:16.564338    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpqd4"
Sep 10 14:18:16.890329 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:16.890305    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpqd4"]
Sep 10 14:18:16.891841 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:18:16.891805    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b648841_5120_4d8b_90d5_d2ee7295d612.slice/crio-a8442e40ff06056957b24cff120e4a6fbd2d9df60f49de15b85a2dd0a44b2386 WatchSource:0}: Error finding container a8442e40ff06056957b24cff120e4a6fbd2d9df60f49de15b85a2dd0a44b2386: Status 404 returned error can't find the container with id a8442e40ff06056957b24cff120e4a6fbd2d9df60f49de15b85a2dd0a44b2386
Sep 10 14:18:16.957520 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:16.957467    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpqd4" event={"ID":"0b648841-5120-4d8b-90d5-d2ee7295d612","Type":"ContainerStarted","Data":"a8442e40ff06056957b24cff120e4a6fbd2d9df60f49de15b85a2dd0a44b2386"}
Sep 10 14:18:19.971264 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:19.971229    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpqd4" event={"ID":"0b648841-5120-4d8b-90d5-d2ee7295d612","Type":"ContainerStarted","Data":"35669fac2d6f1468a1ece8af25874566ed9eb320b6157c1ab430341ff224405e"}
Sep 10 14:18:19.994359 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:19.994310    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rpqd4" podStartSLOduration=1.539934271 podStartE2EDuration="3.994294664s" totalImagesPullingTime="2.454360393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:18:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:18:19.991265728 +0000 UTC m=+398.108807204" watchObservedRunningTime="2026-09-10 14:18:19.994294664 +0000 UTC m=+398.111836138"
Sep 10 14:18:20.015427 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.015400    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lrt6d"]
Sep 10 14:18:20.040425 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.040397    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lrt6d"]
Sep 10 14:18:20.040576 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.040404    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lrt6d"
Sep 10 14:18:20.049858 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.049836    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 14:18:20.049965 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.049836    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-8kx4g\""
Sep 10 14:18:20.050029 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.050006    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 14:18:20.146906 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.146875    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dlml\" (UniqueName: \"kubernetes.io/projected/210e9338-b2cf-4708-b953-8629387fb16e-kube-api-access-2dlml\") pod \"cert-manager-webhook-6486ffd997-lrt6d\" (UID: \"210e9338-b2cf-4708-b953-8629387fb16e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lrt6d"
Sep 10 14:18:20.147062 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.146928    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/210e9338-b2cf-4708-b953-8629387fb16e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lrt6d\" (UID: \"210e9338-b2cf-4708-b953-8629387fb16e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lrt6d"
Sep 10 14:18:20.247435 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.247403    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dlml\" (UniqueName: \"kubernetes.io/projected/210e9338-b2cf-4708-b953-8629387fb16e-kube-api-access-2dlml\") pod \"cert-manager-webhook-6486ffd997-lrt6d\" (UID: \"210e9338-b2cf-4708-b953-8629387fb16e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lrt6d"
Sep 10 14:18:20.247609 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.247444    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/210e9338-b2cf-4708-b953-8629387fb16e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lrt6d\" (UID: \"210e9338-b2cf-4708-b953-8629387fb16e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lrt6d"
Sep 10 14:18:20.268831 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.268795    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dlml\" (UniqueName: \"kubernetes.io/projected/210e9338-b2cf-4708-b953-8629387fb16e-kube-api-access-2dlml\") pod \"cert-manager-webhook-6486ffd997-lrt6d\" (UID: \"210e9338-b2cf-4708-b953-8629387fb16e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lrt6d"
Sep 10 14:18:20.276503 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.276468    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/210e9338-b2cf-4708-b953-8629387fb16e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lrt6d\" (UID: \"210e9338-b2cf-4708-b953-8629387fb16e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lrt6d"
Sep 10 14:18:20.359602 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.359569    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lrt6d"
Sep 10 14:18:20.623770 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.623687    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx"]
Sep 10 14:18:20.644716 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.644685    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx"]
Sep 10 14:18:20.644853 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.644786    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx"
Sep 10 14:18:20.648932 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.648909    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tmlb9\""
Sep 10 14:18:20.649090 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.649075    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 14:18:20.649169 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.649112    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 14:18:20.661925 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.661903    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lrt6d"]
Sep 10 14:18:20.664219 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:18:20.664193    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod210e9338_b2cf_4708_b953_8629387fb16e.slice/crio-8960aaac9e45a3f4a0ae3b7c8d86fa64d522f6069b3c27bcb05646c8b4b87305 WatchSource:0}: Error finding container 8960aaac9e45a3f4a0ae3b7c8d86fa64d522f6069b3c27bcb05646c8b4b87305: Status 404 returned error can't find the container with id 8960aaac9e45a3f4a0ae3b7c8d86fa64d522f6069b3c27bcb05646c8b4b87305
Sep 10 14:18:20.752459 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.752423    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx\" (UID: \"8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx"
Sep 10 14:18:20.752459 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.752462    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56r6r\" (UniqueName: \"kubernetes.io/projected/8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389-kube-api-access-56r6r\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx\" (UID: \"8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx"
Sep 10 14:18:20.752668 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.752573    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx\" (UID: \"8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx"
Sep 10 14:18:20.853004 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.852964    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx\" (UID: \"8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx"
Sep 10 14:18:20.853004 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.853005    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56r6r\" (UniqueName: \"kubernetes.io/projected/8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389-kube-api-access-56r6r\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx\" (UID: \"8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx"
Sep 10 14:18:20.853241 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.853083    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx\" (UID: \"8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx"
Sep 10 14:18:20.853417 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.853392    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx\" (UID: \"8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx"
Sep 10 14:18:20.853519 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.853423    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx\" (UID: \"8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx"
Sep 10 14:18:20.860885 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.860859    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56r6r\" (UniqueName: \"kubernetes.io/projected/8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389-kube-api-access-56r6r\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx\" (UID: \"8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx"
Sep 10 14:18:20.955178 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.955092    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx"
Sep 10 14:18:20.977143 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:20.977104    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lrt6d" event={"ID":"210e9338-b2cf-4708-b953-8629387fb16e","Type":"ContainerStarted","Data":"8960aaac9e45a3f4a0ae3b7c8d86fa64d522f6069b3c27bcb05646c8b4b87305"}
Sep 10 14:18:21.259894 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:21.257999    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx"]
Sep 10 14:18:21.263532 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:18:21.263505    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ebfb0f2_cd5f_4b15_9e5f_3ae7d8e9b389.slice/crio-2f59c7dbc2eec890f3bfa44f7640cf79193a49e3e8481a2036b45270808466eb WatchSource:0}: Error finding container 2f59c7dbc2eec890f3bfa44f7640cf79193a49e3e8481a2036b45270808466eb: Status 404 returned error can't find the container with id 2f59c7dbc2eec890f3bfa44f7640cf79193a49e3e8481a2036b45270808466eb
Sep 10 14:18:21.983067 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:21.983031    2545 generic.go:356] "Generic (PLEG): container finished" podID="8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389" containerID="f47d901f35c63c9c79be73c3c8eb0f38c1f23de7fcdf54074568a41fd8724bfa" exitCode=0
Sep 10 14:18:21.983461 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:21.983093    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx" event={"ID":"8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389","Type":"ContainerDied","Data":"f47d901f35c63c9c79be73c3c8eb0f38c1f23de7fcdf54074568a41fd8724bfa"}
Sep 10 14:18:21.983461 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:21.983132    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx" event={"ID":"8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389","Type":"ContainerStarted","Data":"2f59c7dbc2eec890f3bfa44f7640cf79193a49e3e8481a2036b45270808466eb"}
Sep 10 14:18:24.997289 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:24.997257    2545 generic.go:356] "Generic (PLEG): container finished" podID="8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389" containerID="1f67d6f431054d0087eaf6605a2aa01a6f7e54da54b50323294c5d072c288e97" exitCode=0
Sep 10 14:18:24.997765 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:24.997318    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx" event={"ID":"8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389","Type":"ContainerDied","Data":"1f67d6f431054d0087eaf6605a2aa01a6f7e54da54b50323294c5d072c288e97"}
Sep 10 14:18:26.004292 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:26.004247    2545 generic.go:356] "Generic (PLEG): container finished" podID="8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389" containerID="123ccd4be3289a5ca0856f4ccebf6da35052fd1affcc56602b9b6272e9388f1f" exitCode=0
Sep 10 14:18:26.004734 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:26.004311    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx" event={"ID":"8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389","Type":"ContainerDied","Data":"123ccd4be3289a5ca0856f4ccebf6da35052fd1affcc56602b9b6272e9388f1f"}
Sep 10 14:18:28.016004 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:28.015975    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx" event={"ID":"8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389","Type":"ContainerDied","Data":"2f59c7dbc2eec890f3bfa44f7640cf79193a49e3e8481a2036b45270808466eb"}
Sep 10 14:18:28.016288 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:28.016058    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f59c7dbc2eec890f3bfa44f7640cf79193a49e3e8481a2036b45270808466eb"
Sep 10 14:18:28.020577 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:28.020552    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx"
Sep 10 14:18:28.115355 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:28.115323    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56r6r\" (UniqueName: \"kubernetes.io/projected/8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389-kube-api-access-56r6r\") pod \"8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389\" (UID: \"8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389\") "
Sep 10 14:18:28.115466 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:28.115396    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389-util\") pod \"8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389\" (UID: \"8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389\") "
Sep 10 14:18:28.115547 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:28.115518    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389-bundle\") pod \"8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389\" (UID: \"8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389\") "
Sep 10 14:18:28.115822 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:28.115796    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389-bundle" (OuterVolumeSpecName: "bundle") pod "8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389" (UID: "8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:18:28.115929 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:28.115902    2545 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389-bundle\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:18:28.117346 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:28.117317    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389-kube-api-access-56r6r" (OuterVolumeSpecName: "kube-api-access-56r6r") pod "8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389" (UID: "8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389"). InnerVolumeSpecName "kube-api-access-56r6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:18:28.119928 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:28.119906    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389-util" (OuterVolumeSpecName: "util") pod "8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389" (UID: "8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:18:28.216655 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:28.216622    2545 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389-util\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:18:28.216655 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:28.216650    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56r6r\" (UniqueName: \"kubernetes.io/projected/8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389-kube-api-access-56r6r\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:18:29.021729 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:29.021695    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lrt6d" event={"ID":"210e9338-b2cf-4708-b953-8629387fb16e","Type":"ContainerStarted","Data":"be24110e4be38ddcc3fb2d238adb538459303c16bdd5cf6ff9d3e92121431791"}
Sep 10 14:18:29.022129 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:29.021786    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lrt6d"
Sep 10 14:18:29.022129 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:29.021821    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkltvx"
Sep 10 14:18:29.038207 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:29.038158    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-lrt6d" podStartSLOduration=1.665905414 podStartE2EDuration="9.038143751s" totalImagesPullingTime="7.372238337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:18:29.036189526 +0000 UTC m=+407.153731001" watchObservedRunningTime="2026-09-10 14:18:29.038143751 +0000 UTC m=+407.155685227"
Sep 10 14:18:31.841066 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:31.841039    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hlf2x"]
Sep 10 14:18:31.841418 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:31.841341    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389" containerName="extract"
Sep 10 14:18:31.841418 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:31.841351    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389" containerName="extract"
Sep 10 14:18:31.841418 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:31.841361    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389" containerName="util"
Sep 10 14:18:31.841418 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:31.841370    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389" containerName="util"
Sep 10 14:18:31.841418 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:31.841384    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389" containerName="pull"
Sep 10 14:18:31.841418 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:31.841389    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389" containerName="pull"
Sep 10 14:18:31.841651 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:31.841449    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ebfb0f2-cd5f-4b15-9e5f-3ae7d8e9b389" containerName="extract"
Sep 10 14:18:31.843302 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:31.843285    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-hlf2x"
Sep 10 14:18:31.845602 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:31.845582    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghhm8\" (UniqueName: \"kubernetes.io/projected/4818e5c7-7d9c-4999-bc40-4ad40f4b75f9-kube-api-access-ghhm8\") pod \"cert-manager-55b4d954d5-hlf2x\" (UID: \"4818e5c7-7d9c-4999-bc40-4ad40f4b75f9\") " pod="cert-manager/cert-manager-55b4d954d5-hlf2x"
Sep 10 14:18:31.845715 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:31.845636    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4818e5c7-7d9c-4999-bc40-4ad40f4b75f9-bound-sa-token\") pod \"cert-manager-55b4d954d5-hlf2x\" (UID: \"4818e5c7-7d9c-4999-bc40-4ad40f4b75f9\") " pod="cert-manager/cert-manager-55b4d954d5-hlf2x"
Sep 10 14:18:31.845808 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:31.845795    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-tfvpp\""
Sep 10 14:18:31.853044 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:31.853019    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hlf2x"]
Sep 10 14:18:31.946688 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:31.946652    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4818e5c7-7d9c-4999-bc40-4ad40f4b75f9-bound-sa-token\") pod \"cert-manager-55b4d954d5-hlf2x\" (UID: \"4818e5c7-7d9c-4999-bc40-4ad40f4b75f9\") " pod="cert-manager/cert-manager-55b4d954d5-hlf2x"
Sep 10 14:18:31.946837 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:31.946720    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghhm8\" (UniqueName: \"kubernetes.io/projected/4818e5c7-7d9c-4999-bc40-4ad40f4b75f9-kube-api-access-ghhm8\") pod \"cert-manager-55b4d954d5-hlf2x\" (UID: \"4818e5c7-7d9c-4999-bc40-4ad40f4b75f9\") " pod="cert-manager/cert-manager-55b4d954d5-hlf2x"
Sep 10 14:18:31.955002 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:31.954970    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4818e5c7-7d9c-4999-bc40-4ad40f4b75f9-bound-sa-token\") pod \"cert-manager-55b4d954d5-hlf2x\" (UID: \"4818e5c7-7d9c-4999-bc40-4ad40f4b75f9\") " pod="cert-manager/cert-manager-55b4d954d5-hlf2x"
Sep 10 14:18:31.955124 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:31.955055    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghhm8\" (UniqueName: \"kubernetes.io/projected/4818e5c7-7d9c-4999-bc40-4ad40f4b75f9-kube-api-access-ghhm8\") pod \"cert-manager-55b4d954d5-hlf2x\" (UID: \"4818e5c7-7d9c-4999-bc40-4ad40f4b75f9\") " pod="cert-manager/cert-manager-55b4d954d5-hlf2x"
Sep 10 14:18:32.152335 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:32.152254    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-hlf2x"
Sep 10 14:18:32.419326 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:32.419245    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hlf2x"]
Sep 10 14:18:32.422184 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:18:32.422161    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4818e5c7_7d9c_4999_bc40_4ad40f4b75f9.slice/crio-ef10b546040cb6c0785482801103a9992bb6d1c99c6bba26a37855e5e6c76699 WatchSource:0}: Error finding container ef10b546040cb6c0785482801103a9992bb6d1c99c6bba26a37855e5e6c76699: Status 404 returned error can't find the container with id ef10b546040cb6c0785482801103a9992bb6d1c99c6bba26a37855e5e6c76699
Sep 10 14:18:33.040621 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:33.040584    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-hlf2x" event={"ID":"4818e5c7-7d9c-4999-bc40-4ad40f4b75f9","Type":"ContainerStarted","Data":"4d233b76c941bd55db4ab8b7f5600f8804139337e51afb1e85ca5fc4bb77691e"}
Sep 10 14:18:33.040621 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:33.040625    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-hlf2x" event={"ID":"4818e5c7-7d9c-4999-bc40-4ad40f4b75f9","Type":"ContainerStarted","Data":"ef10b546040cb6c0785482801103a9992bb6d1c99c6bba26a37855e5e6c76699"}
Sep 10 14:18:33.060378 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:33.060335    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-hlf2x" podStartSLOduration=2.060319885 podStartE2EDuration="2.060319885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:18:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:18:33.059375445 +0000 UTC m=+411.176916920" watchObservedRunningTime="2026-09-10 14:18:33.060319885 +0000 UTC m=+411.177861360"
Sep 10 14:18:35.027959 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:35.027921    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lrt6d"
Sep 10 14:18:40.333673 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:40.333645    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m"]
Sep 10 14:18:40.336078 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:40.336060    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m"
Sep 10 14:18:40.338591 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:40.338563    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 14:18:40.338591 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:40.338581    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 14:18:40.338864 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:40.338847    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tmlb9\""
Sep 10 14:18:40.344589 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:40.344566    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m"]
Sep 10 14:18:40.415033 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:40.414995    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7c20bbf-7839-4062-b0b6-74b744cfc894-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m\" (UID: \"c7c20bbf-7839-4062-b0b6-74b744cfc894\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m"
Sep 10 14:18:40.415183 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:40.415048    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp2zg\" (UniqueName: \"kubernetes.io/projected/c7c20bbf-7839-4062-b0b6-74b744cfc894-kube-api-access-hp2zg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m\" (UID: \"c7c20bbf-7839-4062-b0b6-74b744cfc894\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m"
Sep 10 14:18:40.415232 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:40.415184    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7c20bbf-7839-4062-b0b6-74b744cfc894-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m\" (UID: \"c7c20bbf-7839-4062-b0b6-74b744cfc894\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m"
Sep 10 14:18:40.515992 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:40.515951    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7c20bbf-7839-4062-b0b6-74b744cfc894-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m\" (UID: \"c7c20bbf-7839-4062-b0b6-74b744cfc894\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m"
Sep 10 14:18:40.516134 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:40.515998    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp2zg\" (UniqueName: \"kubernetes.io/projected/c7c20bbf-7839-4062-b0b6-74b744cfc894-kube-api-access-hp2zg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m\" (UID: \"c7c20bbf-7839-4062-b0b6-74b744cfc894\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m"
Sep 10 14:18:40.516134 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:40.516053    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7c20bbf-7839-4062-b0b6-74b744cfc894-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m\" (UID: \"c7c20bbf-7839-4062-b0b6-74b744cfc894\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m"
Sep 10 14:18:40.516343 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:40.516312    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7c20bbf-7839-4062-b0b6-74b744cfc894-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m\" (UID: \"c7c20bbf-7839-4062-b0b6-74b744cfc894\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m"
Sep 10 14:18:40.516455 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:40.516436    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7c20bbf-7839-4062-b0b6-74b744cfc894-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m\" (UID: \"c7c20bbf-7839-4062-b0b6-74b744cfc894\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m"
Sep 10 14:18:40.523913 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:40.523891    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp2zg\" (UniqueName: \"kubernetes.io/projected/c7c20bbf-7839-4062-b0b6-74b744cfc894-kube-api-access-hp2zg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m\" (UID: \"c7c20bbf-7839-4062-b0b6-74b744cfc894\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m"
Sep 10 14:18:40.646353 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:40.646280    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m"
Sep 10 14:18:40.934696 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:40.934671    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m"]
Sep 10 14:18:40.936700 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:18:40.936674    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7c20bbf_7839_4062_b0b6_74b744cfc894.slice/crio-65835ab1225d486ec33af2a920cc7ad8e9b95071e115a65c5f30526b1e9594a1 WatchSource:0}: Error finding container 65835ab1225d486ec33af2a920cc7ad8e9b95071e115a65c5f30526b1e9594a1: Status 404 returned error can't find the container with id 65835ab1225d486ec33af2a920cc7ad8e9b95071e115a65c5f30526b1e9594a1
Sep 10 14:18:41.079929 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:41.079899    2545 generic.go:356] "Generic (PLEG): container finished" podID="c7c20bbf-7839-4062-b0b6-74b744cfc894" containerID="297b0c289ae201320c6773787e95f7d33e1c9a76a3ee3f79da8302e11873ff0c" exitCode=0
Sep 10 14:18:41.080067 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:41.079991    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m" event={"ID":"c7c20bbf-7839-4062-b0b6-74b744cfc894","Type":"ContainerDied","Data":"297b0c289ae201320c6773787e95f7d33e1c9a76a3ee3f79da8302e11873ff0c"}
Sep 10 14:18:41.080067 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:41.080052    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m" event={"ID":"c7c20bbf-7839-4062-b0b6-74b744cfc894","Type":"ContainerStarted","Data":"65835ab1225d486ec33af2a920cc7ad8e9b95071e115a65c5f30526b1e9594a1"}
Sep 10 14:18:42.086940 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:42.086908    2545 generic.go:356] "Generic (PLEG): container finished" podID="c7c20bbf-7839-4062-b0b6-74b744cfc894" containerID="0871f87f8a401016d03dd18230acea4fcb160c9bf438e3d40362d7b8d07af613" exitCode=0
Sep 10 14:18:42.087321 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:42.086998    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m" event={"ID":"c7c20bbf-7839-4062-b0b6-74b744cfc894","Type":"ContainerDied","Data":"0871f87f8a401016d03dd18230acea4fcb160c9bf438e3d40362d7b8d07af613"}
Sep 10 14:18:43.094182 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:43.094150    2545 generic.go:356] "Generic (PLEG): container finished" podID="c7c20bbf-7839-4062-b0b6-74b744cfc894" containerID="9c98f8e5f840a5e12b2dbc6a7790251983e58dbe0f79f798f7077e88dbc4f47a" exitCode=0
Sep 10 14:18:43.094574 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:43.094226    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m" event={"ID":"c7c20bbf-7839-4062-b0b6-74b744cfc894","Type":"ContainerDied","Data":"9c98f8e5f840a5e12b2dbc6a7790251983e58dbe0f79f798f7077e88dbc4f47a"}
Sep 10 14:18:44.222286 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:44.222259    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m"
Sep 10 14:18:44.246114 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:44.246091    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hp2zg\" (UniqueName: \"kubernetes.io/projected/c7c20bbf-7839-4062-b0b6-74b744cfc894-kube-api-access-hp2zg\") pod \"c7c20bbf-7839-4062-b0b6-74b744cfc894\" (UID: \"c7c20bbf-7839-4062-b0b6-74b744cfc894\") "
Sep 10 14:18:44.246236 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:44.246128    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7c20bbf-7839-4062-b0b6-74b744cfc894-util\") pod \"c7c20bbf-7839-4062-b0b6-74b744cfc894\" (UID: \"c7c20bbf-7839-4062-b0b6-74b744cfc894\") "
Sep 10 14:18:44.246236 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:44.246156    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7c20bbf-7839-4062-b0b6-74b744cfc894-bundle\") pod \"c7c20bbf-7839-4062-b0b6-74b744cfc894\" (UID: \"c7c20bbf-7839-4062-b0b6-74b744cfc894\") "
Sep 10 14:18:44.246893 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:44.246865    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7c20bbf-7839-4062-b0b6-74b744cfc894-bundle" (OuterVolumeSpecName: "bundle") pod "c7c20bbf-7839-4062-b0b6-74b744cfc894" (UID: "c7c20bbf-7839-4062-b0b6-74b744cfc894"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:18:44.248172 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:44.248145    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7c20bbf-7839-4062-b0b6-74b744cfc894-kube-api-access-hp2zg" (OuterVolumeSpecName: "kube-api-access-hp2zg") pod "c7c20bbf-7839-4062-b0b6-74b744cfc894" (UID: "c7c20bbf-7839-4062-b0b6-74b744cfc894"). InnerVolumeSpecName "kube-api-access-hp2zg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:18:44.251874 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:44.251853    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7c20bbf-7839-4062-b0b6-74b744cfc894-util" (OuterVolumeSpecName: "util") pod "c7c20bbf-7839-4062-b0b6-74b744cfc894" (UID: "c7c20bbf-7839-4062-b0b6-74b744cfc894"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:18:44.346784 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:44.346750    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hp2zg\" (UniqueName: \"kubernetes.io/projected/c7c20bbf-7839-4062-b0b6-74b744cfc894-kube-api-access-hp2zg\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:18:44.346784 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:44.346780    2545 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7c20bbf-7839-4062-b0b6-74b744cfc894-util\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:18:44.346960 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:44.346794    2545 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7c20bbf-7839-4062-b0b6-74b744cfc894-bundle\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:18:45.105189 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:45.105159    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m"
Sep 10 14:18:45.105358 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:45.105146    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afz7d6m" event={"ID":"c7c20bbf-7839-4062-b0b6-74b744cfc894","Type":"ContainerDied","Data":"65835ab1225d486ec33af2a920cc7ad8e9b95071e115a65c5f30526b1e9594a1"}
Sep 10 14:18:45.105358 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:45.105277    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65835ab1225d486ec33af2a920cc7ad8e9b95071e115a65c5f30526b1e9594a1"
Sep 10 14:18:50.800361 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:50.800324    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b64d8b6d6-72cj6"]
Sep 10 14:18:50.800744 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:50.800673    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7c20bbf-7839-4062-b0b6-74b744cfc894" containerName="util"
Sep 10 14:18:50.800744 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:50.800684    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7c20bbf-7839-4062-b0b6-74b744cfc894" containerName="util"
Sep 10 14:18:50.800744 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:50.800697    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7c20bbf-7839-4062-b0b6-74b744cfc894" containerName="pull"
Sep 10 14:18:50.800744 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:50.800703    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7c20bbf-7839-4062-b0b6-74b744cfc894" containerName="pull"
Sep 10 14:18:50.800744 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:50.800712    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7c20bbf-7839-4062-b0b6-74b744cfc894" containerName="extract"
Sep 10 14:18:50.800744 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:50.800718    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7c20bbf-7839-4062-b0b6-74b744cfc894" containerName="extract"
Sep 10 14:18:50.800928 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:50.800781    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7c20bbf-7839-4062-b0b6-74b744cfc894" containerName="extract"
Sep 10 14:18:50.805801 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:50.805780    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b64d8b6d6-72cj6"
Sep 10 14:18:50.810097 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:50.810076    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 10 14:18:50.810220 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:50.810075    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vtmhk\""
Sep 10 14:18:50.810220 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:50.810203    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 10 14:18:50.810350 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:50.810332    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 10 14:18:50.810412 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:50.810401    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 10 14:18:50.810529 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:50.810512    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 10 14:18:50.826083 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:50.826060    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b64d8b6d6-72cj6"]
Sep 10 14:18:50.898500 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:50.898460    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e38bf9dd-9f7d-4156-878d-a32a0e7a68ec-cert\") pod \"lws-controller-manager-7b64d8b6d6-72cj6\" (UID: \"e38bf9dd-9f7d-4156-878d-a32a0e7a68ec\") " pod="openshift-lws-operator/lws-controller-manager-7b64d8b6d6-72cj6"
Sep 10 14:18:50.898655 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:50.898534    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e38bf9dd-9f7d-4156-878d-a32a0e7a68ec-manager-config\") pod \"lws-controller-manager-7b64d8b6d6-72cj6\" (UID: \"e38bf9dd-9f7d-4156-878d-a32a0e7a68ec\") " pod="openshift-lws-operator/lws-controller-manager-7b64d8b6d6-72cj6"
Sep 10 14:18:50.898655 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:50.898570    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97584\" (UniqueName: \"kubernetes.io/projected/e38bf9dd-9f7d-4156-878d-a32a0e7a68ec-kube-api-access-97584\") pod \"lws-controller-manager-7b64d8b6d6-72cj6\" (UID: \"e38bf9dd-9f7d-4156-878d-a32a0e7a68ec\") " pod="openshift-lws-operator/lws-controller-manager-7b64d8b6d6-72cj6"
Sep 10 14:18:50.898655 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:50.898601    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e38bf9dd-9f7d-4156-878d-a32a0e7a68ec-metrics-cert\") pod \"lws-controller-manager-7b64d8b6d6-72cj6\" (UID: \"e38bf9dd-9f7d-4156-878d-a32a0e7a68ec\") " pod="openshift-lws-operator/lws-controller-manager-7b64d8b6d6-72cj6"
Sep 10 14:18:50.999909 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:50.999873    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e38bf9dd-9f7d-4156-878d-a32a0e7a68ec-cert\") pod \"lws-controller-manager-7b64d8b6d6-72cj6\" (UID: \"e38bf9dd-9f7d-4156-878d-a32a0e7a68ec\") " pod="openshift-lws-operator/lws-controller-manager-7b64d8b6d6-72cj6"
Sep 10 14:18:51.000061 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:50.999915    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e38bf9dd-9f7d-4156-878d-a32a0e7a68ec-manager-config\") pod \"lws-controller-manager-7b64d8b6d6-72cj6\" (UID: \"e38bf9dd-9f7d-4156-878d-a32a0e7a68ec\") " pod="openshift-lws-operator/lws-controller-manager-7b64d8b6d6-72cj6"
Sep 10 14:18:51.000061 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:51.000036    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97584\" (UniqueName: \"kubernetes.io/projected/e38bf9dd-9f7d-4156-878d-a32a0e7a68ec-kube-api-access-97584\") pod \"lws-controller-manager-7b64d8b6d6-72cj6\" (UID: \"e38bf9dd-9f7d-4156-878d-a32a0e7a68ec\") " pod="openshift-lws-operator/lws-controller-manager-7b64d8b6d6-72cj6"
Sep 10 14:18:51.000130 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:51.000087    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e38bf9dd-9f7d-4156-878d-a32a0e7a68ec-metrics-cert\") pod \"lws-controller-manager-7b64d8b6d6-72cj6\" (UID: \"e38bf9dd-9f7d-4156-878d-a32a0e7a68ec\") " pod="openshift-lws-operator/lws-controller-manager-7b64d8b6d6-72cj6"
Sep 10 14:18:51.000535 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:51.000510    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e38bf9dd-9f7d-4156-878d-a32a0e7a68ec-manager-config\") pod \"lws-controller-manager-7b64d8b6d6-72cj6\" (UID: \"e38bf9dd-9f7d-4156-878d-a32a0e7a68ec\") " pod="openshift-lws-operator/lws-controller-manager-7b64d8b6d6-72cj6"
Sep 10 14:18:51.002332 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:51.002305    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e38bf9dd-9f7d-4156-878d-a32a0e7a68ec-metrics-cert\") pod \"lws-controller-manager-7b64d8b6d6-72cj6\" (UID: \"e38bf9dd-9f7d-4156-878d-a32a0e7a68ec\") " pod="openshift-lws-operator/lws-controller-manager-7b64d8b6d6-72cj6"
Sep 10 14:18:51.002419 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:51.002334    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e38bf9dd-9f7d-4156-878d-a32a0e7a68ec-cert\") pod \"lws-controller-manager-7b64d8b6d6-72cj6\" (UID: \"e38bf9dd-9f7d-4156-878d-a32a0e7a68ec\") " pod="openshift-lws-operator/lws-controller-manager-7b64d8b6d6-72cj6"
Sep 10 14:18:51.009062 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:51.009036    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97584\" (UniqueName: \"kubernetes.io/projected/e38bf9dd-9f7d-4156-878d-a32a0e7a68ec-kube-api-access-97584\") pod \"lws-controller-manager-7b64d8b6d6-72cj6\" (UID: \"e38bf9dd-9f7d-4156-878d-a32a0e7a68ec\") " pod="openshift-lws-operator/lws-controller-manager-7b64d8b6d6-72cj6"
Sep 10 14:18:51.115110 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:51.115027    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b64d8b6d6-72cj6"
Sep 10 14:18:51.387428 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:51.387359    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b64d8b6d6-72cj6"]
Sep 10 14:18:51.390785 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:18:51.390760    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode38bf9dd_9f7d_4156_878d_a32a0e7a68ec.slice/crio-f7563904682618085110034d0e0260d9cecee58b499aa0530ecd51f0c2e49207 WatchSource:0}: Error finding container f7563904682618085110034d0e0260d9cecee58b499aa0530ecd51f0c2e49207: Status 404 returned error can't find the container with id f7563904682618085110034d0e0260d9cecee58b499aa0530ecd51f0c2e49207
Sep 10 14:18:52.138793 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:52.138757    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b64d8b6d6-72cj6" event={"ID":"e38bf9dd-9f7d-4156-878d-a32a0e7a68ec","Type":"ContainerStarted","Data":"f7563904682618085110034d0e0260d9cecee58b499aa0530ecd51f0c2e49207"}
Sep 10 14:18:53.952307 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:53.952270    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf"]
Sep 10 14:18:53.955792 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:53.955775    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf"
Sep 10 14:18:53.958250 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:53.958230    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 14:18:53.959249 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:53.959230    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 14:18:53.959337 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:53.959235    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tmlb9\""
Sep 10 14:18:53.965999 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:53.965976    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf"]
Sep 10 14:18:54.028200 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:54.028168    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b16673d-e409-402f-9f2f-27f15fa7a505-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf\" (UID: \"1b16673d-e409-402f-9f2f-27f15fa7a505\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf"
Sep 10 14:18:54.028343 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:54.028218    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dmj9\" (UniqueName: \"kubernetes.io/projected/1b16673d-e409-402f-9f2f-27f15fa7a505-kube-api-access-6dmj9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf\" (UID: \"1b16673d-e409-402f-9f2f-27f15fa7a505\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf"
Sep 10 14:18:54.028343 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:54.028292    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b16673d-e409-402f-9f2f-27f15fa7a505-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf\" (UID: \"1b16673d-e409-402f-9f2f-27f15fa7a505\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf"
Sep 10 14:18:54.129226 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:54.129197    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b16673d-e409-402f-9f2f-27f15fa7a505-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf\" (UID: \"1b16673d-e409-402f-9f2f-27f15fa7a505\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf"
Sep 10 14:18:54.129401 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:54.129249    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b16673d-e409-402f-9f2f-27f15fa7a505-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf\" (UID: \"1b16673d-e409-402f-9f2f-27f15fa7a505\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf"
Sep 10 14:18:54.129401 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:54.129287    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dmj9\" (UniqueName: \"kubernetes.io/projected/1b16673d-e409-402f-9f2f-27f15fa7a505-kube-api-access-6dmj9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf\" (UID: \"1b16673d-e409-402f-9f2f-27f15fa7a505\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf"
Sep 10 14:18:54.129612 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:54.129590    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b16673d-e409-402f-9f2f-27f15fa7a505-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf\" (UID: \"1b16673d-e409-402f-9f2f-27f15fa7a505\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf"
Sep 10 14:18:54.129703 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:54.129681    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b16673d-e409-402f-9f2f-27f15fa7a505-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf\" (UID: \"1b16673d-e409-402f-9f2f-27f15fa7a505\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf"
Sep 10 14:18:54.146834 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:54.146812    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dmj9\" (UniqueName: \"kubernetes.io/projected/1b16673d-e409-402f-9f2f-27f15fa7a505-kube-api-access-6dmj9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf\" (UID: \"1b16673d-e409-402f-9f2f-27f15fa7a505\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf"
Sep 10 14:18:54.149762 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:54.149739    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b64d8b6d6-72cj6" event={"ID":"e38bf9dd-9f7d-4156-878d-a32a0e7a68ec","Type":"ContainerStarted","Data":"ee5eba60e8ceb408d07ff12f88a7548804d58dfaa1e16b17955632dd764fc15f"}
Sep 10 14:18:54.149855 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:54.149838    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7b64d8b6d6-72cj6"
Sep 10 14:18:54.167971 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:54.167933    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7b64d8b6d6-72cj6" podStartSLOduration=2.404455766 podStartE2EDuration="4.167919505s" totalImagesPullingTime="1.763463739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:18:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:18:54.166464053 +0000 UTC m=+432.284005550" watchObservedRunningTime="2026-09-10 14:18:54.167919505 +0000 UTC m=+432.285460979"
Sep 10 14:18:54.265160 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:54.265138    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf"
Sep 10 14:18:54.542311 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:54.542287    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf"]
Sep 10 14:18:54.543985 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:18:54.543957    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b16673d_e409_402f_9f2f_27f15fa7a505.slice/crio-1b4d644ac21045d494f0db5c8e3e7cd3f1c40d1f1ea77404f6b37a39d35eacf3 WatchSource:0}: Error finding container 1b4d644ac21045d494f0db5c8e3e7cd3f1c40d1f1ea77404f6b37a39d35eacf3: Status 404 returned error can't find the container with id 1b4d644ac21045d494f0db5c8e3e7cd3f1c40d1f1ea77404f6b37a39d35eacf3
Sep 10 14:18:55.155509 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.155457    2545 generic.go:356] "Generic (PLEG): container finished" podID="1b16673d-e409-402f-9f2f-27f15fa7a505" containerID="eba0329e2e6b6fca38bdffc1239a383147e39bd4fe74779f91e44a967a99a51e" exitCode=0
Sep 10 14:18:55.155872 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.155518    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf" event={"ID":"1b16673d-e409-402f-9f2f-27f15fa7a505","Type":"ContainerDied","Data":"eba0329e2e6b6fca38bdffc1239a383147e39bd4fe74779f91e44a967a99a51e"}
Sep 10 14:18:55.155872 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.155566    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf" event={"ID":"1b16673d-e409-402f-9f2f-27f15fa7a505","Type":"ContainerStarted","Data":"1b4d644ac21045d494f0db5c8e3e7cd3f1c40d1f1ea77404f6b37a39d35eacf3"}
Sep 10 14:18:55.196034 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.195998    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts"]
Sep 10 14:18:55.199523 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.199501    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts"
Sep 10 14:18:55.202033 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.202012    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 14:18:55.202165 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.202114    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 14:18:55.202563 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.202549    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4t9x5\""
Sep 10 14:18:55.202617 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.202569    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 14:18:55.202814 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.202803    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 14:18:55.223311 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.223285    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts"]
Sep 10 14:18:55.238474 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.238447    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4066b4c7-3deb-416f-a03d-417d4e016898-manifests\") pod \"opendatahub-operator-controller-manager-55f59f54dd-stpts\" (UID: \"4066b4c7-3deb-416f-a03d-417d4e016898\") " pod="opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts"
Sep 10 14:18:55.238617 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.238476    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4066b4c7-3deb-416f-a03d-417d4e016898-tmp\") pod \"opendatahub-operator-controller-manager-55f59f54dd-stpts\" (UID: \"4066b4c7-3deb-416f-a03d-417d4e016898\") " pod="opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts"
Sep 10 14:18:55.238699 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.238680    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4066b4c7-3deb-416f-a03d-417d4e016898-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55f59f54dd-stpts\" (UID: \"4066b4c7-3deb-416f-a03d-417d4e016898\") " pod="opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts"
Sep 10 14:18:55.238758 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.238731    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4066b4c7-3deb-416f-a03d-417d4e016898-webhook-cert\") pod \"opendatahub-operator-controller-manager-55f59f54dd-stpts\" (UID: \"4066b4c7-3deb-416f-a03d-417d4e016898\") " pod="opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts"
Sep 10 14:18:55.238888 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.238865    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxppj\" (UniqueName: \"kubernetes.io/projected/4066b4c7-3deb-416f-a03d-417d4e016898-kube-api-access-rxppj\") pod \"opendatahub-operator-controller-manager-55f59f54dd-stpts\" (UID: \"4066b4c7-3deb-416f-a03d-417d4e016898\") " pod="opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts"
Sep 10 14:18:55.339465 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.339424    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4066b4c7-3deb-416f-a03d-417d4e016898-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55f59f54dd-stpts\" (UID: \"4066b4c7-3deb-416f-a03d-417d4e016898\") " pod="opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts"
Sep 10 14:18:55.339465 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.339463    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4066b4c7-3deb-416f-a03d-417d4e016898-webhook-cert\") pod \"opendatahub-operator-controller-manager-55f59f54dd-stpts\" (UID: \"4066b4c7-3deb-416f-a03d-417d4e016898\") " pod="opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts"
Sep 10 14:18:55.339707 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.339481    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxppj\" (UniqueName: \"kubernetes.io/projected/4066b4c7-3deb-416f-a03d-417d4e016898-kube-api-access-rxppj\") pod \"opendatahub-operator-controller-manager-55f59f54dd-stpts\" (UID: \"4066b4c7-3deb-416f-a03d-417d4e016898\") " pod="opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts"
Sep 10 14:18:55.339707 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.339575    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4066b4c7-3deb-416f-a03d-417d4e016898-manifests\") pod \"opendatahub-operator-controller-manager-55f59f54dd-stpts\" (UID: \"4066b4c7-3deb-416f-a03d-417d4e016898\") " pod="opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts"
Sep 10 14:18:55.339707 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.339595    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4066b4c7-3deb-416f-a03d-417d4e016898-tmp\") pod \"opendatahub-operator-controller-manager-55f59f54dd-stpts\" (UID: \"4066b4c7-3deb-416f-a03d-417d4e016898\") " pod="opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts"
Sep 10 14:18:55.339976 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.339940    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4066b4c7-3deb-416f-a03d-417d4e016898-manifests\") pod \"opendatahub-operator-controller-manager-55f59f54dd-stpts\" (UID: \"4066b4c7-3deb-416f-a03d-417d4e016898\") " pod="opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts"
Sep 10 14:18:55.341914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.341888    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4066b4c7-3deb-416f-a03d-417d4e016898-tmp\") pod \"opendatahub-operator-controller-manager-55f59f54dd-stpts\" (UID: \"4066b4c7-3deb-416f-a03d-417d4e016898\") " pod="opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts"
Sep 10 14:18:55.342014 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.341992    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4066b4c7-3deb-416f-a03d-417d4e016898-webhook-cert\") pod \"opendatahub-operator-controller-manager-55f59f54dd-stpts\" (UID: \"4066b4c7-3deb-416f-a03d-417d4e016898\") " pod="opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts"
Sep 10 14:18:55.342113 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.342095    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4066b4c7-3deb-416f-a03d-417d4e016898-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55f59f54dd-stpts\" (UID: \"4066b4c7-3deb-416f-a03d-417d4e016898\") " pod="opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts"
Sep 10 14:18:55.347537 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.347479    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxppj\" (UniqueName: \"kubernetes.io/projected/4066b4c7-3deb-416f-a03d-417d4e016898-kube-api-access-rxppj\") pod \"opendatahub-operator-controller-manager-55f59f54dd-stpts\" (UID: \"4066b4c7-3deb-416f-a03d-417d4e016898\") " pod="opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts"
Sep 10 14:18:55.509520 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.509464    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts"
Sep 10 14:18:55.794853 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:55.794826    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts"]
Sep 10 14:18:55.795932 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:18:55.795908    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4066b4c7_3deb_416f_a03d_417d4e016898.slice/crio-e149073b576b88149502524540d0c448df6d8b5de17a90de71343ab11f8e99a1 WatchSource:0}: Error finding container e149073b576b88149502524540d0c448df6d8b5de17a90de71343ab11f8e99a1: Status 404 returned error can't find the container with id e149073b576b88149502524540d0c448df6d8b5de17a90de71343ab11f8e99a1
Sep 10 14:18:56.162327 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:56.162234    2545 generic.go:356] "Generic (PLEG): container finished" podID="1b16673d-e409-402f-9f2f-27f15fa7a505" containerID="294391ad658bef0f17f36b432d2cd1e8af50d0a533b42166960c45905c4b6e46" exitCode=0
Sep 10 14:18:56.162775 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:56.162322    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf" event={"ID":"1b16673d-e409-402f-9f2f-27f15fa7a505","Type":"ContainerDied","Data":"294391ad658bef0f17f36b432d2cd1e8af50d0a533b42166960c45905c4b6e46"}
Sep 10 14:18:56.163901 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:56.163772    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts" event={"ID":"4066b4c7-3deb-416f-a03d-417d4e016898","Type":"ContainerStarted","Data":"e149073b576b88149502524540d0c448df6d8b5de17a90de71343ab11f8e99a1"}
Sep 10 14:18:57.172196 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:57.172156    2545 generic.go:356] "Generic (PLEG): container finished" podID="1b16673d-e409-402f-9f2f-27f15fa7a505" containerID="2dbb6dd7c37bace997b9be6a6fa1dedf416a9e555f6f8db6b25debf21569dca7" exitCode=0
Sep 10 14:18:57.172680 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:57.172256    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf" event={"ID":"1b16673d-e409-402f-9f2f-27f15fa7a505","Type":"ContainerDied","Data":"2dbb6dd7c37bace997b9be6a6fa1dedf416a9e555f6f8db6b25debf21569dca7"}
Sep 10 14:18:58.689646 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:58.689621    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf"
Sep 10 14:18:58.770198 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:58.770181    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b16673d-e409-402f-9f2f-27f15fa7a505-bundle\") pod \"1b16673d-e409-402f-9f2f-27f15fa7a505\" (UID: \"1b16673d-e409-402f-9f2f-27f15fa7a505\") "
Sep 10 14:18:58.770284 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:58.770214    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b16673d-e409-402f-9f2f-27f15fa7a505-util\") pod \"1b16673d-e409-402f-9f2f-27f15fa7a505\" (UID: \"1b16673d-e409-402f-9f2f-27f15fa7a505\") "
Sep 10 14:18:58.770322 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:58.770282    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dmj9\" (UniqueName: \"kubernetes.io/projected/1b16673d-e409-402f-9f2f-27f15fa7a505-kube-api-access-6dmj9\") pod \"1b16673d-e409-402f-9f2f-27f15fa7a505\" (UID: \"1b16673d-e409-402f-9f2f-27f15fa7a505\") "
Sep 10 14:18:58.771057 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:58.771029    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b16673d-e409-402f-9f2f-27f15fa7a505-bundle" (OuterVolumeSpecName: "bundle") pod "1b16673d-e409-402f-9f2f-27f15fa7a505" (UID: "1b16673d-e409-402f-9f2f-27f15fa7a505"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:18:58.772245 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:58.772218    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b16673d-e409-402f-9f2f-27f15fa7a505-kube-api-access-6dmj9" (OuterVolumeSpecName: "kube-api-access-6dmj9") pod "1b16673d-e409-402f-9f2f-27f15fa7a505" (UID: "1b16673d-e409-402f-9f2f-27f15fa7a505"). InnerVolumeSpecName "kube-api-access-6dmj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:18:58.775778 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:58.775756    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b16673d-e409-402f-9f2f-27f15fa7a505-util" (OuterVolumeSpecName: "util") pod "1b16673d-e409-402f-9f2f-27f15fa7a505" (UID: "1b16673d-e409-402f-9f2f-27f15fa7a505"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:18:58.871096 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:58.871060    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dmj9\" (UniqueName: \"kubernetes.io/projected/1b16673d-e409-402f-9f2f-27f15fa7a505-kube-api-access-6dmj9\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:18:58.871096 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:58.871089    2545 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b16673d-e409-402f-9f2f-27f15fa7a505-bundle\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:18:58.871096 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:58.871098    2545 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b16673d-e409-402f-9f2f-27f15fa7a505-util\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:18:59.185424 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:59.185397    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf"
Sep 10 14:18:59.185602 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:59.185395    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kgcgf" event={"ID":"1b16673d-e409-402f-9f2f-27f15fa7a505","Type":"ContainerDied","Data":"1b4d644ac21045d494f0db5c8e3e7cd3f1c40d1f1ea77404f6b37a39d35eacf3"}
Sep 10 14:18:59.185602 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:59.185529    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b4d644ac21045d494f0db5c8e3e7cd3f1c40d1f1ea77404f6b37a39d35eacf3"
Sep 10 14:18:59.187183 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:18:59.187158    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts" event={"ID":"4066b4c7-3deb-416f-a03d-417d4e016898","Type":"ContainerStarted","Data":"636f696157bcdc5450225d5155104273d3ba1114c38e12898ed9ccb19c0f7b3d"}
Sep 10 14:19:00.194025 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:00.193941    2545 generic.go:356] "Generic (PLEG): container finished" podID="4066b4c7-3deb-416f-a03d-417d4e016898" containerID="636f696157bcdc5450225d5155104273d3ba1114c38e12898ed9ccb19c0f7b3d" exitCode=0
Sep 10 14:19:00.194358 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:00.194026    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts" event={"ID":"4066b4c7-3deb-416f-a03d-417d4e016898","Type":"ContainerDied","Data":"636f696157bcdc5450225d5155104273d3ba1114c38e12898ed9ccb19c0f7b3d"}
Sep 10 14:19:01.200715 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:01.200666    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts" event={"ID":"4066b4c7-3deb-416f-a03d-417d4e016898","Type":"ContainerStarted","Data":"d9bc9c08bcb990440cb023a283785107b677e5132b58cf9775f74514e633d92a"}
Sep 10 14:19:01.201173 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:01.200783    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts"
Sep 10 14:19:01.223564 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:01.223512    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts" podStartSLOduration=1.754356923 podStartE2EDuration="6.223477054s" totalImagesPullingTime="3.407006168s" totalInitContainerRuntime="1.062113963s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:18:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:19:01.221626807 +0000 UTC m=+439.339168282" watchObservedRunningTime="2026-09-10 14:19:01.223477054 +0000 UTC m=+439.341018527"
Sep 10 14:19:05.158116 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:05.158082    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7b64d8b6d6-72cj6"
Sep 10 14:19:12.207763 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:12.207725    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-55f59f54dd-stpts"
Sep 10 14:19:22.846008 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:22.845974    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"]
Sep 10 14:19:22.846364 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:22.846320    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b16673d-e409-402f-9f2f-27f15fa7a505" containerName="pull"
Sep 10 14:19:22.846364 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:22.846331    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b16673d-e409-402f-9f2f-27f15fa7a505" containerName="pull"
Sep 10 14:19:22.846364 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:22.846347    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b16673d-e409-402f-9f2f-27f15fa7a505" containerName="util"
Sep 10 14:19:22.846364 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:22.846353    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b16673d-e409-402f-9f2f-27f15fa7a505" containerName="util"
Sep 10 14:19:22.846364 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:22.846360    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b16673d-e409-402f-9f2f-27f15fa7a505" containerName="extract"
Sep 10 14:19:22.846364 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:22.846365    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b16673d-e409-402f-9f2f-27f15fa7a505" containerName="extract"
Sep 10 14:19:22.846581 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:22.846419    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b16673d-e409-402f-9f2f-27f15fa7a505" containerName="extract"
Sep 10 14:19:22.850651 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:22.850630    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:22.853111 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:22.853085    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 14:19:22.853271 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:22.853127    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-6g5pk\""
Sep 10 14:19:22.859617 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:22.859592    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"]
Sep 10 14:19:22.990677 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:22.990646    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:22.990844 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:22.990684    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf49h\" (UniqueName: \"kubernetes.io/projected/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-kube-api-access-kf49h\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:22.990844 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:22.990708    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:22.990844 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:22.990738    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:22.990844 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:22.990790    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:22.990844 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:22.990805    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:22.991006 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:22.990856    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:22.991006 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:22.990912    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:22.991006 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:22.990933    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:23.091674 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:23.091640    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:23.091841 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:23.091684    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:23.091841 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:23.091704    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:23.091841 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:23.091746    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:23.091841 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:23.091769    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf49h\" (UniqueName: \"kubernetes.io/projected/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-kube-api-access-kf49h\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:23.092057 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:23.091861    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:23.092057 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:23.091916    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:23.092057 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:23.091969    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:23.092057 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:23.091993    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:23.092237 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:23.092053    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:23.092293 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:23.092253    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:23.092293 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:23.092268    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:23.092388 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:23.092378    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:23.092656 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:23.092605    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:23.093975 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:23.093956    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:23.094251 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:23.094233    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:23.098982 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:23.098926    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:23.099169 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:23.099151    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf49h\" (UniqueName: \"kubernetes.io/projected/567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7-kube-api-access-kf49h\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5\" (UID: \"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:23.160943 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:23.160902    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:23.452499 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:23.452459    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"]
Sep 10 14:19:23.453916 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:19:23.453885    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod567cf522_3a1d_47b4_8bd4_7a4b6f9e60c7.slice/crio-c41eaea537c318c96361683f015d60773ddff207a54e32b2b60f5003f37b2abc WatchSource:0}: Error finding container c41eaea537c318c96361683f015d60773ddff207a54e32b2b60f5003f37b2abc: Status 404 returned error can't find the container with id c41eaea537c318c96361683f015d60773ddff207a54e32b2b60f5003f37b2abc
Sep 10 14:19:24.308890 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:24.308848    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5" event={"ID":"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7","Type":"ContainerStarted","Data":"c41eaea537c318c96361683f015d60773ddff207a54e32b2b60f5003f37b2abc"}
Sep 10 14:19:25.527246 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:25.527207    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hfbhz"]
Sep 10 14:19:25.530782 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:25.530759    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hfbhz"
Sep 10 14:19:25.533714 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:25.533477    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 10 14:19:25.533714 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:25.533528    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-69bzj\""
Sep 10 14:19:25.539897 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:25.539871    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hfbhz"]
Sep 10 14:19:25.717932 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:25.717880    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85337035-a698-4b91-b90e-ce7f70677d0e-cert\") pod \"odh-model-controller-7998c67dc4-hfbhz\" (UID: \"85337035-a698-4b91-b90e-ce7f70677d0e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hfbhz"
Sep 10 14:19:25.718109 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:25.717951    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckmpf\" (UniqueName: \"kubernetes.io/projected/85337035-a698-4b91-b90e-ce7f70677d0e-kube-api-access-ckmpf\") pod \"odh-model-controller-7998c67dc4-hfbhz\" (UID: \"85337035-a698-4b91-b90e-ce7f70677d0e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hfbhz"
Sep 10 14:19:25.819400 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:25.819316    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckmpf\" (UniqueName: \"kubernetes.io/projected/85337035-a698-4b91-b90e-ce7f70677d0e-kube-api-access-ckmpf\") pod \"odh-model-controller-7998c67dc4-hfbhz\" (UID: \"85337035-a698-4b91-b90e-ce7f70677d0e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hfbhz"
Sep 10 14:19:25.819576 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:25.819436    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85337035-a698-4b91-b90e-ce7f70677d0e-cert\") pod \"odh-model-controller-7998c67dc4-hfbhz\" (UID: \"85337035-a698-4b91-b90e-ce7f70677d0e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hfbhz"
Sep 10 14:19:25.822019 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:25.821987    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85337035-a698-4b91-b90e-ce7f70677d0e-cert\") pod \"odh-model-controller-7998c67dc4-hfbhz\" (UID: \"85337035-a698-4b91-b90e-ce7f70677d0e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hfbhz"
Sep 10 14:19:25.830598 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:25.830569    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckmpf\" (UniqueName: \"kubernetes.io/projected/85337035-a698-4b91-b90e-ce7f70677d0e-kube-api-access-ckmpf\") pod \"odh-model-controller-7998c67dc4-hfbhz\" (UID: \"85337035-a698-4b91-b90e-ce7f70677d0e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hfbhz"
Sep 10 14:19:25.846461 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:25.846406    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hfbhz"
Sep 10 14:19:26.562430 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:26.562379    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:19:26.562715 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:26.562507    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:19:26.562715 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:26.562556    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:19:26.757143 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:26.757051    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hfbhz"]
Sep 10 14:19:26.764747 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:19:26.764712    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85337035_a698_4b91_b90e_ce7f70677d0e.slice/crio-f7f6c5aefcbcdf09a2855eecb62de69bb29fae8def2fef9ff811fb5eeadb435f WatchSource:0}: Error finding container f7f6c5aefcbcdf09a2855eecb62de69bb29fae8def2fef9ff811fb5eeadb435f: Status 404 returned error can't find the container with id f7f6c5aefcbcdf09a2855eecb62de69bb29fae8def2fef9ff811fb5eeadb435f
Sep 10 14:19:27.331821 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:27.331784    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5" event={"ID":"567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7","Type":"ContainerStarted","Data":"ae863839c205dd539cbb3455ee6d64fb83529de60f82dedd9c5c743aed1e54ae"}
Sep 10 14:19:27.333023 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:27.333001    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hfbhz" event={"ID":"85337035-a698-4b91-b90e-ce7f70677d0e","Type":"ContainerStarted","Data":"f7f6c5aefcbcdf09a2855eecb62de69bb29fae8def2fef9ff811fb5eeadb435f"}
Sep 10 14:19:27.355862 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:27.355761    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5" podStartSLOduration=2.2500078 podStartE2EDuration="5.355745966s" totalImagesPullingTime="3.105738166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:19:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:19:27.355065811 +0000 UTC m=+465.472607284" watchObservedRunningTime="2026-09-10 14:19:27.355745966 +0000 UTC m=+465.473287441"
Sep 10 14:19:28.162001 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:28.161961    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:28.167198 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:28.167173    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:28.339565 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:28.339534    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:28.340735 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:28.340709    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5"
Sep 10 14:19:30.352842 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:30.352792    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hfbhz" event={"ID":"85337035-a698-4b91-b90e-ce7f70677d0e","Type":"ContainerStarted","Data":"e2a5b593343f18e51905e9cd302f4521de8e0314973b1a2f4f0e19f6b5848fc9"}
Sep 10 14:19:30.353341 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:30.353092    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-hfbhz"
Sep 10 14:19:30.369550 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:30.369508    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-hfbhz" podStartSLOduration=2.354705805 podStartE2EDuration="5.369474828s" totalImagesPullingTime="3.014769023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:19:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:19:30.368754721 +0000 UTC m=+468.486296195" watchObservedRunningTime="2026-09-10 14:19:30.369474828 +0000 UTC m=+468.487016577"
Sep 10 14:19:31.902804 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:31.902769    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"]
Sep 10 14:19:31.905576 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:31.905559    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"
Sep 10 14:19:31.908181 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:31.908159    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 14:19:31.908268 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:31.908202    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2bd7v\""
Sep 10 14:19:31.908419 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:31.908404    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 14:19:31.908483 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:31.908407    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 14:19:31.916932 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:31.916910    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"]
Sep 10 14:19:31.975309 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:31.975280    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c899a529-91d7-4bd5-a0f5-0dfba4d6cea7-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-zzg9d\" (UID: \"c899a529-91d7-4bd5-a0f5-0dfba4d6cea7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"
Sep 10 14:19:31.975469 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:31.975318    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c899a529-91d7-4bd5-a0f5-0dfba4d6cea7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-zzg9d\" (UID: \"c899a529-91d7-4bd5-a0f5-0dfba4d6cea7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"
Sep 10 14:19:31.975469 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:31.975345    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c899a529-91d7-4bd5-a0f5-0dfba4d6cea7-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-zzg9d\" (UID: \"c899a529-91d7-4bd5-a0f5-0dfba4d6cea7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"
Sep 10 14:19:31.975469 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:31.975403    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr6q4\" (UniqueName: \"kubernetes.io/projected/c899a529-91d7-4bd5-a0f5-0dfba4d6cea7-kube-api-access-dr6q4\") pod \"istiod-openshift-gateway-5677ccb49b-zzg9d\" (UID: \"c899a529-91d7-4bd5-a0f5-0dfba4d6cea7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"
Sep 10 14:19:31.975629 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:31.975474    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c899a529-91d7-4bd5-a0f5-0dfba4d6cea7-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-zzg9d\" (UID: \"c899a529-91d7-4bd5-a0f5-0dfba4d6cea7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"
Sep 10 14:19:31.975629 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:31.975517    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c899a529-91d7-4bd5-a0f5-0dfba4d6cea7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-zzg9d\" (UID: \"c899a529-91d7-4bd5-a0f5-0dfba4d6cea7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"
Sep 10 14:19:31.975629 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:31.975544    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c899a529-91d7-4bd5-a0f5-0dfba4d6cea7-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-zzg9d\" (UID: \"c899a529-91d7-4bd5-a0f5-0dfba4d6cea7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"
Sep 10 14:19:32.076643 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:32.076610    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c899a529-91d7-4bd5-a0f5-0dfba4d6cea7-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-zzg9d\" (UID: \"c899a529-91d7-4bd5-a0f5-0dfba4d6cea7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"
Sep 10 14:19:32.076643 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:32.076643    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c899a529-91d7-4bd5-a0f5-0dfba4d6cea7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-zzg9d\" (UID: \"c899a529-91d7-4bd5-a0f5-0dfba4d6cea7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"
Sep 10 14:19:32.076861 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:32.076670    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c899a529-91d7-4bd5-a0f5-0dfba4d6cea7-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-zzg9d\" (UID: \"c899a529-91d7-4bd5-a0f5-0dfba4d6cea7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"
Sep 10 14:19:32.076861 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:32.076792    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr6q4\" (UniqueName: \"kubernetes.io/projected/c899a529-91d7-4bd5-a0f5-0dfba4d6cea7-kube-api-access-dr6q4\") pod \"istiod-openshift-gateway-5677ccb49b-zzg9d\" (UID: \"c899a529-91d7-4bd5-a0f5-0dfba4d6cea7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"
Sep 10 14:19:32.076952 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:32.076863    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c899a529-91d7-4bd5-a0f5-0dfba4d6cea7-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-zzg9d\" (UID: \"c899a529-91d7-4bd5-a0f5-0dfba4d6cea7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"
Sep 10 14:19:32.076952 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:32.076900    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c899a529-91d7-4bd5-a0f5-0dfba4d6cea7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-zzg9d\" (UID: \"c899a529-91d7-4bd5-a0f5-0dfba4d6cea7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"
Sep 10 14:19:32.076952 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:32.076940    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c899a529-91d7-4bd5-a0f5-0dfba4d6cea7-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-zzg9d\" (UID: \"c899a529-91d7-4bd5-a0f5-0dfba4d6cea7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"
Sep 10 14:19:32.077650 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:32.077621    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c899a529-91d7-4bd5-a0f5-0dfba4d6cea7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-zzg9d\" (UID: \"c899a529-91d7-4bd5-a0f5-0dfba4d6cea7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"
Sep 10 14:19:32.079019 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:32.078990    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c899a529-91d7-4bd5-a0f5-0dfba4d6cea7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-zzg9d\" (UID: \"c899a529-91d7-4bd5-a0f5-0dfba4d6cea7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"
Sep 10 14:19:32.079019 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:32.079015    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c899a529-91d7-4bd5-a0f5-0dfba4d6cea7-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-zzg9d\" (UID: \"c899a529-91d7-4bd5-a0f5-0dfba4d6cea7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"
Sep 10 14:19:32.079151 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:32.079035    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c899a529-91d7-4bd5-a0f5-0dfba4d6cea7-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-zzg9d\" (UID: \"c899a529-91d7-4bd5-a0f5-0dfba4d6cea7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"
Sep 10 14:19:32.079151 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:32.079119    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c899a529-91d7-4bd5-a0f5-0dfba4d6cea7-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-zzg9d\" (UID: \"c899a529-91d7-4bd5-a0f5-0dfba4d6cea7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"
Sep 10 14:19:32.093362 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:32.093335    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr6q4\" (UniqueName: \"kubernetes.io/projected/c899a529-91d7-4bd5-a0f5-0dfba4d6cea7-kube-api-access-dr6q4\") pod \"istiod-openshift-gateway-5677ccb49b-zzg9d\" (UID: \"c899a529-91d7-4bd5-a0f5-0dfba4d6cea7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"
Sep 10 14:19:32.093843 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:32.093826    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c899a529-91d7-4bd5-a0f5-0dfba4d6cea7-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-zzg9d\" (UID: \"c899a529-91d7-4bd5-a0f5-0dfba4d6cea7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"
Sep 10 14:19:32.214327 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:32.214246    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"
Sep 10 14:19:32.484637 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:32.484614    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"]
Sep 10 14:19:32.486585 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:19:32.486559    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc899a529_91d7_4bd5_a0f5_0dfba4d6cea7.slice/crio-8e0556a042dc268c64ff866adb99fefef79d44787089a1e10a625255d5001ef3 WatchSource:0}: Error finding container 8e0556a042dc268c64ff866adb99fefef79d44787089a1e10a625255d5001ef3: Status 404 returned error can't find the container with id 8e0556a042dc268c64ff866adb99fefef79d44787089a1e10a625255d5001ef3
Sep 10 14:19:33.369873 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:33.369839    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d" event={"ID":"c899a529-91d7-4bd5-a0f5-0dfba4d6cea7","Type":"ContainerStarted","Data":"8e0556a042dc268c64ff866adb99fefef79d44787089a1e10a625255d5001ef3"}
Sep 10 14:19:34.785336 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:34.785298    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:19:34.785643 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:34.785361    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:19:35.380948 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:35.380918    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d" event={"ID":"c899a529-91d7-4bd5-a0f5-0dfba4d6cea7","Type":"ContainerStarted","Data":"f5d891bc602342df08eeee35ed9dc856b9460cfa670dca62817f0fcdec71ed11"}
Sep 10 14:19:35.381111 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:35.380961    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"
Sep 10 14:19:35.382765 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:35.382737    2545 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-zzg9d container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 14:19:35.382873 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:35.382789    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d" podUID="c899a529-91d7-4bd5-a0f5-0dfba4d6cea7" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 14:19:35.428435 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:35.428383    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d" podStartSLOduration=2.131676588 podStartE2EDuration="4.428366164s" totalImagesPullingTime="2.296689576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:19:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:19:35.426013765 +0000 UTC m=+473.543555238" watchObservedRunningTime="2026-09-10 14:19:35.428366164 +0000 UTC m=+473.545907640"
Sep 10 14:19:36.386879 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:36.386846    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-zzg9d"
Sep 10 14:19:41.359228 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:19:41.359197    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-hfbhz"
Sep 10 14:20:30.999554 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:30.999520    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr"]
Sep 10 14:20:31.004681 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.004662    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr"
Sep 10 14:20:31.007233 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.007213    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 14:20:31.008295 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.008277    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tmlb9\""
Sep 10 14:20:31.008372 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.008286    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 14:20:31.014445 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.014422    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr"]
Sep 10 14:20:31.086830 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.086797    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88a0a150-edfd-4a70-9715-62257d7fd6ee-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr\" (UID: \"88a0a150-edfd-4a70-9715-62257d7fd6ee\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr"
Sep 10 14:20:31.087019 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.086927    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6g6w\" (UniqueName: \"kubernetes.io/projected/88a0a150-edfd-4a70-9715-62257d7fd6ee-kube-api-access-q6g6w\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr\" (UID: \"88a0a150-edfd-4a70-9715-62257d7fd6ee\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr"
Sep 10 14:20:31.087019 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.086973    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88a0a150-edfd-4a70-9715-62257d7fd6ee-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr\" (UID: \"88a0a150-edfd-4a70-9715-62257d7fd6ee\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr"
Sep 10 14:20:31.094271 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.094245    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk"]
Sep 10 14:20:31.096796 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.096781    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk"
Sep 10 14:20:31.107588 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.107566    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk"]
Sep 10 14:20:31.187880 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.187841    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6g6w\" (UniqueName: \"kubernetes.io/projected/88a0a150-edfd-4a70-9715-62257d7fd6ee-kube-api-access-q6g6w\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr\" (UID: \"88a0a150-edfd-4a70-9715-62257d7fd6ee\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr"
Sep 10 14:20:31.188071 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.187888    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vg9h\" (UniqueName: \"kubernetes.io/projected/28e1c73b-80ef-4244-979e-31ccb5992dec-kube-api-access-6vg9h\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk\" (UID: \"28e1c73b-80ef-4244-979e-31ccb5992dec\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk"
Sep 10 14:20:31.188071 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.187923    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88a0a150-edfd-4a70-9715-62257d7fd6ee-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr\" (UID: \"88a0a150-edfd-4a70-9715-62257d7fd6ee\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr"
Sep 10 14:20:31.188071 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.187988    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88a0a150-edfd-4a70-9715-62257d7fd6ee-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr\" (UID: \"88a0a150-edfd-4a70-9715-62257d7fd6ee\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr"
Sep 10 14:20:31.188071 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.188051    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28e1c73b-80ef-4244-979e-31ccb5992dec-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk\" (UID: \"28e1c73b-80ef-4244-979e-31ccb5992dec\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk"
Sep 10 14:20:31.188235 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.188115    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28e1c73b-80ef-4244-979e-31ccb5992dec-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk\" (UID: \"28e1c73b-80ef-4244-979e-31ccb5992dec\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk"
Sep 10 14:20:31.188333 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.188315    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88a0a150-edfd-4a70-9715-62257d7fd6ee-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr\" (UID: \"88a0a150-edfd-4a70-9715-62257d7fd6ee\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr"
Sep 10 14:20:31.188372 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.188341    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88a0a150-edfd-4a70-9715-62257d7fd6ee-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr\" (UID: \"88a0a150-edfd-4a70-9715-62257d7fd6ee\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr"
Sep 10 14:20:31.192922 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.192898    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp"]
Sep 10 14:20:31.195611 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.195596    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp"
Sep 10 14:20:31.196415 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.196392    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6g6w\" (UniqueName: \"kubernetes.io/projected/88a0a150-edfd-4a70-9715-62257d7fd6ee-kube-api-access-q6g6w\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr\" (UID: \"88a0a150-edfd-4a70-9715-62257d7fd6ee\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr"
Sep 10 14:20:31.208666 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.208378    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp"]
Sep 10 14:20:31.289157 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.289088    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc2f1286-6c50-408e-a49d-798df292e9e3-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp\" (UID: \"dc2f1286-6c50-408e-a49d-798df292e9e3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp"
Sep 10 14:20:31.289157 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.289130    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28e1c73b-80ef-4244-979e-31ccb5992dec-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk\" (UID: \"28e1c73b-80ef-4244-979e-31ccb5992dec\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk"
Sep 10 14:20:31.289157 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.289147    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc2f1286-6c50-408e-a49d-798df292e9e3-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp\" (UID: \"dc2f1286-6c50-408e-a49d-798df292e9e3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp"
Sep 10 14:20:31.289345 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.289218    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28e1c73b-80ef-4244-979e-31ccb5992dec-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk\" (UID: \"28e1c73b-80ef-4244-979e-31ccb5992dec\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk"
Sep 10 14:20:31.289345 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.289253    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vg9h\" (UniqueName: \"kubernetes.io/projected/28e1c73b-80ef-4244-979e-31ccb5992dec-kube-api-access-6vg9h\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk\" (UID: \"28e1c73b-80ef-4244-979e-31ccb5992dec\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk"
Sep 10 14:20:31.289345 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.289273    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpnl9\" (UniqueName: \"kubernetes.io/projected/dc2f1286-6c50-408e-a49d-798df292e9e3-kube-api-access-vpnl9\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp\" (UID: \"dc2f1286-6c50-408e-a49d-798df292e9e3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp"
Sep 10 14:20:31.289529 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.289508    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28e1c73b-80ef-4244-979e-31ccb5992dec-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk\" (UID: \"28e1c73b-80ef-4244-979e-31ccb5992dec\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk"
Sep 10 14:20:31.289597 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.289578    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28e1c73b-80ef-4244-979e-31ccb5992dec-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk\" (UID: \"28e1c73b-80ef-4244-979e-31ccb5992dec\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk"
Sep 10 14:20:31.304070 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.304041    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6"]
Sep 10 14:20:31.304974 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.304951    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vg9h\" (UniqueName: \"kubernetes.io/projected/28e1c73b-80ef-4244-979e-31ccb5992dec-kube-api-access-6vg9h\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk\" (UID: \"28e1c73b-80ef-4244-979e-31ccb5992dec\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk"
Sep 10 14:20:31.306583 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.306567    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6"
Sep 10 14:20:31.315012 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.314995    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr"
Sep 10 14:20:31.319396 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.319375    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6"]
Sep 10 14:20:31.390241 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.390208    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc2f1286-6c50-408e-a49d-798df292e9e3-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp\" (UID: \"dc2f1286-6c50-408e-a49d-798df292e9e3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp"
Sep 10 14:20:31.390366 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.390259    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc2f1286-6c50-408e-a49d-798df292e9e3-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp\" (UID: \"dc2f1286-6c50-408e-a49d-798df292e9e3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp"
Sep 10 14:20:31.390366 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.390319    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/121219d2-e57f-43f5-82bb-492040e08540-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6\" (UID: \"121219d2-e57f-43f5-82bb-492040e08540\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6"
Sep 10 14:20:31.390452 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.390366    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4c8t\" (UniqueName: \"kubernetes.io/projected/121219d2-e57f-43f5-82bb-492040e08540-kube-api-access-r4c8t\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6\" (UID: \"121219d2-e57f-43f5-82bb-492040e08540\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6"
Sep 10 14:20:31.390452 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.390415    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpnl9\" (UniqueName: \"kubernetes.io/projected/dc2f1286-6c50-408e-a49d-798df292e9e3-kube-api-access-vpnl9\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp\" (UID: \"dc2f1286-6c50-408e-a49d-798df292e9e3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp"
Sep 10 14:20:31.390452 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.390440    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/121219d2-e57f-43f5-82bb-492040e08540-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6\" (UID: \"121219d2-e57f-43f5-82bb-492040e08540\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6"
Sep 10 14:20:31.390649 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.390633    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc2f1286-6c50-408e-a49d-798df292e9e3-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp\" (UID: \"dc2f1286-6c50-408e-a49d-798df292e9e3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp"
Sep 10 14:20:31.390708 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.390652    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc2f1286-6c50-408e-a49d-798df292e9e3-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp\" (UID: \"dc2f1286-6c50-408e-a49d-798df292e9e3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp"
Sep 10 14:20:31.398825 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.398798    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpnl9\" (UniqueName: \"kubernetes.io/projected/dc2f1286-6c50-408e-a49d-798df292e9e3-kube-api-access-vpnl9\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp\" (UID: \"dc2f1286-6c50-408e-a49d-798df292e9e3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp"
Sep 10 14:20:31.405424 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.405401    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk"
Sep 10 14:20:31.491230 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.491199    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/121219d2-e57f-43f5-82bb-492040e08540-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6\" (UID: \"121219d2-e57f-43f5-82bb-492040e08540\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6"
Sep 10 14:20:31.491383 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.491252    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4c8t\" (UniqueName: \"kubernetes.io/projected/121219d2-e57f-43f5-82bb-492040e08540-kube-api-access-r4c8t\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6\" (UID: \"121219d2-e57f-43f5-82bb-492040e08540\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6"
Sep 10 14:20:31.491383 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.491293    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/121219d2-e57f-43f5-82bb-492040e08540-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6\" (UID: \"121219d2-e57f-43f5-82bb-492040e08540\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6"
Sep 10 14:20:31.491698 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.491681    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/121219d2-e57f-43f5-82bb-492040e08540-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6\" (UID: \"121219d2-e57f-43f5-82bb-492040e08540\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6"
Sep 10 14:20:31.491844 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.491814    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/121219d2-e57f-43f5-82bb-492040e08540-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6\" (UID: \"121219d2-e57f-43f5-82bb-492040e08540\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6"
Sep 10 14:20:31.499660 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.499635    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4c8t\" (UniqueName: \"kubernetes.io/projected/121219d2-e57f-43f5-82bb-492040e08540-kube-api-access-r4c8t\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6\" (UID: \"121219d2-e57f-43f5-82bb-492040e08540\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6"
Sep 10 14:20:31.518435 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.518415    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp"
Sep 10 14:20:31.587150 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.587124    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr"]
Sep 10 14:20:31.589697 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:20:31.589668    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88a0a150_edfd_4a70_9715_62257d7fd6ee.slice/crio-dc71ba4fe24e9abb09daa1b09557a2dc198541bea2b65d474ce59aae643912af WatchSource:0}: Error finding container dc71ba4fe24e9abb09daa1b09557a2dc198541bea2b65d474ce59aae643912af: Status 404 returned error can't find the container with id dc71ba4fe24e9abb09daa1b09557a2dc198541bea2b65d474ce59aae643912af
Sep 10 14:20:31.621883 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.621863    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6"
Sep 10 14:20:31.655770 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.655730    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr" event={"ID":"88a0a150-edfd-4a70-9715-62257d7fd6ee","Type":"ContainerStarted","Data":"1014d5ddc29864e4136e06b11dce7ad4b51a4dbee850850b273e6c419b1dbb5b"}
Sep 10 14:20:31.655896 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.655806    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr" event={"ID":"88a0a150-edfd-4a70-9715-62257d7fd6ee","Type":"ContainerStarted","Data":"dc71ba4fe24e9abb09daa1b09557a2dc198541bea2b65d474ce59aae643912af"}
Sep 10 14:20:31.680196 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.680167    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk"]
Sep 10 14:20:31.787191 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.787166    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp"]
Sep 10 14:20:31.788376 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:20:31.788348    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc2f1286_6c50_408e_a49d_798df292e9e3.slice/crio-9d7e6753d40a914a052ceaa03bceb1ebe963ec0c0c22c7720ec44671957a6dac WatchSource:0}: Error finding container 9d7e6753d40a914a052ceaa03bceb1ebe963ec0c0c22c7720ec44671957a6dac: Status 404 returned error can't find the container with id 9d7e6753d40a914a052ceaa03bceb1ebe963ec0c0c22c7720ec44671957a6dac
Sep 10 14:20:31.897987 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:31.897962    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6"]
Sep 10 14:20:31.936252 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:20:31.936228    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod121219d2_e57f_43f5_82bb_492040e08540.slice/crio-55facde938b77fcf98ddb577550ed01e36384faebabaf84db3b6fb251fd886ca WatchSource:0}: Error finding container 55facde938b77fcf98ddb577550ed01e36384faebabaf84db3b6fb251fd886ca: Status 404 returned error can't find the container with id 55facde938b77fcf98ddb577550ed01e36384faebabaf84db3b6fb251fd886ca
Sep 10 14:20:32.661801 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:32.661770    2545 generic.go:356] "Generic (PLEG): container finished" podID="dc2f1286-6c50-408e-a49d-798df292e9e3" containerID="08369955a5361088dbdd54a8326239009e73a4163fde8ad4a1564932563c9add" exitCode=0
Sep 10 14:20:32.662188 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:32.661808    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp" event={"ID":"dc2f1286-6c50-408e-a49d-798df292e9e3","Type":"ContainerDied","Data":"08369955a5361088dbdd54a8326239009e73a4163fde8ad4a1564932563c9add"}
Sep 10 14:20:32.662188 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:32.661854    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp" event={"ID":"dc2f1286-6c50-408e-a49d-798df292e9e3","Type":"ContainerStarted","Data":"9d7e6753d40a914a052ceaa03bceb1ebe963ec0c0c22c7720ec44671957a6dac"}
Sep 10 14:20:32.663503 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:32.663465    2545 generic.go:356] "Generic (PLEG): container finished" podID="88a0a150-edfd-4a70-9715-62257d7fd6ee" containerID="1014d5ddc29864e4136e06b11dce7ad4b51a4dbee850850b273e6c419b1dbb5b" exitCode=0
Sep 10 14:20:32.663586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:32.663522    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr" event={"ID":"88a0a150-edfd-4a70-9715-62257d7fd6ee","Type":"ContainerDied","Data":"1014d5ddc29864e4136e06b11dce7ad4b51a4dbee850850b273e6c419b1dbb5b"}
Sep 10 14:20:32.665156 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:32.665140    2545 generic.go:356] "Generic (PLEG): container finished" podID="121219d2-e57f-43f5-82bb-492040e08540" containerID="7b81ee4772f83ed2bb5dd5628677ade0f4824feb42fadd5d4be33902882a3d29" exitCode=0
Sep 10 14:20:32.665241 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:32.665220    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6" event={"ID":"121219d2-e57f-43f5-82bb-492040e08540","Type":"ContainerDied","Data":"7b81ee4772f83ed2bb5dd5628677ade0f4824feb42fadd5d4be33902882a3d29"}
Sep 10 14:20:32.665306 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:32.665265    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6" event={"ID":"121219d2-e57f-43f5-82bb-492040e08540","Type":"ContainerStarted","Data":"55facde938b77fcf98ddb577550ed01e36384faebabaf84db3b6fb251fd886ca"}
Sep 10 14:20:32.666846 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:32.666828    2545 generic.go:356] "Generic (PLEG): container finished" podID="28e1c73b-80ef-4244-979e-31ccb5992dec" containerID="bd0b98e6ff9621a9f425a48034b0115c87ac0b3e03c0c79681c2e1098d1490cf" exitCode=0
Sep 10 14:20:32.666933 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:32.666872    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk" event={"ID":"28e1c73b-80ef-4244-979e-31ccb5992dec","Type":"ContainerDied","Data":"bd0b98e6ff9621a9f425a48034b0115c87ac0b3e03c0c79681c2e1098d1490cf"}
Sep 10 14:20:32.666933 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:32.666905    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk" event={"ID":"28e1c73b-80ef-4244-979e-31ccb5992dec","Type":"ContainerStarted","Data":"30682d538ee196e4b3093e8940516ee1f85733928e28c7a7cfffee74eaa9bffa"}
Sep 10 14:20:34.680900 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:34.680818    2545 generic.go:356] "Generic (PLEG): container finished" podID="88a0a150-edfd-4a70-9715-62257d7fd6ee" containerID="86e3856587b4948c66a6c393e1b416e91f191e1968a748488c55744fee89c27f" exitCode=0
Sep 10 14:20:34.681292 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:34.680904    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr" event={"ID":"88a0a150-edfd-4a70-9715-62257d7fd6ee","Type":"ContainerDied","Data":"86e3856587b4948c66a6c393e1b416e91f191e1968a748488c55744fee89c27f"}
Sep 10 14:20:34.682701 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:34.682680    2545 generic.go:356] "Generic (PLEG): container finished" podID="121219d2-e57f-43f5-82bb-492040e08540" containerID="6f10076f8c05fa367ff54ce344b3f5d0b0da65ac37b82bd5a2e586e1c9f1704b" exitCode=0
Sep 10 14:20:34.682787 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:34.682756    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6" event={"ID":"121219d2-e57f-43f5-82bb-492040e08540","Type":"ContainerDied","Data":"6f10076f8c05fa367ff54ce344b3f5d0b0da65ac37b82bd5a2e586e1c9f1704b"}
Sep 10 14:20:34.684821 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:34.684799    2545 generic.go:356] "Generic (PLEG): container finished" podID="28e1c73b-80ef-4244-979e-31ccb5992dec" containerID="f616902cb89c70829fe2773ef08be24e78d1d8c2f489107c9b511440f43ba66e" exitCode=0
Sep 10 14:20:34.684913 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:34.684889    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk" event={"ID":"28e1c73b-80ef-4244-979e-31ccb5992dec","Type":"ContainerDied","Data":"f616902cb89c70829fe2773ef08be24e78d1d8c2f489107c9b511440f43ba66e"}
Sep 10 14:20:34.686891 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:34.686872    2545 generic.go:356] "Generic (PLEG): container finished" podID="dc2f1286-6c50-408e-a49d-798df292e9e3" containerID="845fd299ae42bc45f47292a9a931c201c2ef2c029d2dd62a3d41638b9e3d7b05" exitCode=0
Sep 10 14:20:34.686997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:34.686899    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp" event={"ID":"dc2f1286-6c50-408e-a49d-798df292e9e3","Type":"ContainerDied","Data":"845fd299ae42bc45f47292a9a931c201c2ef2c029d2dd62a3d41638b9e3d7b05"}
Sep 10 14:20:35.694635 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:35.694596    2545 generic.go:356] "Generic (PLEG): container finished" podID="121219d2-e57f-43f5-82bb-492040e08540" containerID="96df6cb1c5065dab9e85c50c16eea8c947bbd9da280f29ab6c12f6021c460536" exitCode=0
Sep 10 14:20:35.695047 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:35.694674    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6" event={"ID":"121219d2-e57f-43f5-82bb-492040e08540","Type":"ContainerDied","Data":"96df6cb1c5065dab9e85c50c16eea8c947bbd9da280f29ab6c12f6021c460536"}
Sep 10 14:20:35.696700 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:35.696679    2545 generic.go:356] "Generic (PLEG): container finished" podID="28e1c73b-80ef-4244-979e-31ccb5992dec" containerID="0fbbeea4121613d32dc763c5314a1ab375d3332b935095a24e45734ac8f45448" exitCode=0
Sep 10 14:20:35.696809 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:35.696720    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk" event={"ID":"28e1c73b-80ef-4244-979e-31ccb5992dec","Type":"ContainerDied","Data":"0fbbeea4121613d32dc763c5314a1ab375d3332b935095a24e45734ac8f45448"}
Sep 10 14:20:35.698679 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:35.698655    2545 generic.go:356] "Generic (PLEG): container finished" podID="dc2f1286-6c50-408e-a49d-798df292e9e3" containerID="37f598083af8141bd6cff8f88170a9d5662890dff7220a1572ee2e1199bb5123" exitCode=0
Sep 10 14:20:35.698756 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:35.698728    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp" event={"ID":"dc2f1286-6c50-408e-a49d-798df292e9e3","Type":"ContainerDied","Data":"37f598083af8141bd6cff8f88170a9d5662890dff7220a1572ee2e1199bb5123"}
Sep 10 14:20:35.700657 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:35.700639    2545 generic.go:356] "Generic (PLEG): container finished" podID="88a0a150-edfd-4a70-9715-62257d7fd6ee" containerID="8e2801b6dfb433ae05f5c73d7c500ffdfcc0e707f469da448a5303f7d2667e05" exitCode=0
Sep 10 14:20:35.700723 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:35.700665    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr" event={"ID":"88a0a150-edfd-4a70-9715-62257d7fd6ee","Type":"ContainerDied","Data":"8e2801b6dfb433ae05f5c73d7c500ffdfcc0e707f469da448a5303f7d2667e05"}
Sep 10 14:20:36.845693 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:36.845670    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6"
Sep 10 14:20:36.891926 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:36.891900    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr"
Sep 10 14:20:36.919001 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:36.918976    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk"
Sep 10 14:20:36.921680 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:36.921659    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp"
Sep 10 14:20:36.941627 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:36.941601    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88a0a150-edfd-4a70-9715-62257d7fd6ee-util\") pod \"88a0a150-edfd-4a70-9715-62257d7fd6ee\" (UID: \"88a0a150-edfd-4a70-9715-62257d7fd6ee\") "
Sep 10 14:20:36.941853 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:36.941638    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6g6w\" (UniqueName: \"kubernetes.io/projected/88a0a150-edfd-4a70-9715-62257d7fd6ee-kube-api-access-q6g6w\") pod \"88a0a150-edfd-4a70-9715-62257d7fd6ee\" (UID: \"88a0a150-edfd-4a70-9715-62257d7fd6ee\") "
Sep 10 14:20:36.941853 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:36.941661    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88a0a150-edfd-4a70-9715-62257d7fd6ee-bundle\") pod \"88a0a150-edfd-4a70-9715-62257d7fd6ee\" (UID: \"88a0a150-edfd-4a70-9715-62257d7fd6ee\") "
Sep 10 14:20:36.941853 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:36.941739    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4c8t\" (UniqueName: \"kubernetes.io/projected/121219d2-e57f-43f5-82bb-492040e08540-kube-api-access-r4c8t\") pod \"121219d2-e57f-43f5-82bb-492040e08540\" (UID: \"121219d2-e57f-43f5-82bb-492040e08540\") "
Sep 10 14:20:36.941853 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:36.941793    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/121219d2-e57f-43f5-82bb-492040e08540-util\") pod \"121219d2-e57f-43f5-82bb-492040e08540\" (UID: \"121219d2-e57f-43f5-82bb-492040e08540\") "
Sep 10 14:20:36.941853 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:36.941826    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/121219d2-e57f-43f5-82bb-492040e08540-bundle\") pod \"121219d2-e57f-43f5-82bb-492040e08540\" (UID: \"121219d2-e57f-43f5-82bb-492040e08540\") "
Sep 10 14:20:36.942528 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:36.942480    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/121219d2-e57f-43f5-82bb-492040e08540-bundle" (OuterVolumeSpecName: "bundle") pod "121219d2-e57f-43f5-82bb-492040e08540" (UID: "121219d2-e57f-43f5-82bb-492040e08540"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:20:36.942643 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:36.942564    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88a0a150-edfd-4a70-9715-62257d7fd6ee-bundle" (OuterVolumeSpecName: "bundle") pod "88a0a150-edfd-4a70-9715-62257d7fd6ee" (UID: "88a0a150-edfd-4a70-9715-62257d7fd6ee"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:20:36.944061 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:36.944036    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/121219d2-e57f-43f5-82bb-492040e08540-kube-api-access-r4c8t" (OuterVolumeSpecName: "kube-api-access-r4c8t") pod "121219d2-e57f-43f5-82bb-492040e08540" (UID: "121219d2-e57f-43f5-82bb-492040e08540"). InnerVolumeSpecName "kube-api-access-r4c8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:20:36.944733 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:36.944701    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88a0a150-edfd-4a70-9715-62257d7fd6ee-kube-api-access-q6g6w" (OuterVolumeSpecName: "kube-api-access-q6g6w") pod "88a0a150-edfd-4a70-9715-62257d7fd6ee" (UID: "88a0a150-edfd-4a70-9715-62257d7fd6ee"). InnerVolumeSpecName "kube-api-access-q6g6w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:20:36.947592 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:36.947568    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/121219d2-e57f-43f5-82bb-492040e08540-util" (OuterVolumeSpecName: "util") pod "121219d2-e57f-43f5-82bb-492040e08540" (UID: "121219d2-e57f-43f5-82bb-492040e08540"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:20:37.042509 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.042445    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc2f1286-6c50-408e-a49d-798df292e9e3-bundle\") pod \"dc2f1286-6c50-408e-a49d-798df292e9e3\" (UID: \"dc2f1286-6c50-408e-a49d-798df292e9e3\") "
Sep 10 14:20:37.042509 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.042483    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28e1c73b-80ef-4244-979e-31ccb5992dec-bundle\") pod \"28e1c73b-80ef-4244-979e-31ccb5992dec\" (UID: \"28e1c73b-80ef-4244-979e-31ccb5992dec\") "
Sep 10 14:20:37.042760 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.042522    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28e1c73b-80ef-4244-979e-31ccb5992dec-util\") pod \"28e1c73b-80ef-4244-979e-31ccb5992dec\" (UID: \"28e1c73b-80ef-4244-979e-31ccb5992dec\") "
Sep 10 14:20:37.042760 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.042578    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vg9h\" (UniqueName: \"kubernetes.io/projected/28e1c73b-80ef-4244-979e-31ccb5992dec-kube-api-access-6vg9h\") pod \"28e1c73b-80ef-4244-979e-31ccb5992dec\" (UID: \"28e1c73b-80ef-4244-979e-31ccb5992dec\") "
Sep 10 14:20:37.042760 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.042596    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpnl9\" (UniqueName: \"kubernetes.io/projected/dc2f1286-6c50-408e-a49d-798df292e9e3-kube-api-access-vpnl9\") pod \"dc2f1286-6c50-408e-a49d-798df292e9e3\" (UID: \"dc2f1286-6c50-408e-a49d-798df292e9e3\") "
Sep 10 14:20:37.042760 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.042747    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc2f1286-6c50-408e-a49d-798df292e9e3-util\") pod \"dc2f1286-6c50-408e-a49d-798df292e9e3\" (UID: \"dc2f1286-6c50-408e-a49d-798df292e9e3\") "
Sep 10 14:20:37.043092 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.043066    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4c8t\" (UniqueName: \"kubernetes.io/projected/121219d2-e57f-43f5-82bb-492040e08540-kube-api-access-r4c8t\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:20:37.043092 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.043092    2545 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/121219d2-e57f-43f5-82bb-492040e08540-util\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:20:37.043308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.043106    2545 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/121219d2-e57f-43f5-82bb-492040e08540-bundle\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:20:37.043308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.043118    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6g6w\" (UniqueName: \"kubernetes.io/projected/88a0a150-edfd-4a70-9715-62257d7fd6ee-kube-api-access-q6g6w\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:20:37.043308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.043130    2545 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/88a0a150-edfd-4a70-9715-62257d7fd6ee-bundle\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:20:37.043308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.043138    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc2f1286-6c50-408e-a49d-798df292e9e3-bundle" (OuterVolumeSpecName: "bundle") pod "dc2f1286-6c50-408e-a49d-798df292e9e3" (UID: "dc2f1286-6c50-408e-a49d-798df292e9e3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:20:37.043516 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.043434    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28e1c73b-80ef-4244-979e-31ccb5992dec-bundle" (OuterVolumeSpecName: "bundle") pod "28e1c73b-80ef-4244-979e-31ccb5992dec" (UID: "28e1c73b-80ef-4244-979e-31ccb5992dec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:20:37.044669 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.044650    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc2f1286-6c50-408e-a49d-798df292e9e3-kube-api-access-vpnl9" (OuterVolumeSpecName: "kube-api-access-vpnl9") pod "dc2f1286-6c50-408e-a49d-798df292e9e3" (UID: "dc2f1286-6c50-408e-a49d-798df292e9e3"). InnerVolumeSpecName "kube-api-access-vpnl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:20:37.044669 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.044657    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28e1c73b-80ef-4244-979e-31ccb5992dec-kube-api-access-6vg9h" (OuterVolumeSpecName: "kube-api-access-6vg9h") pod "28e1c73b-80ef-4244-979e-31ccb5992dec" (UID: "28e1c73b-80ef-4244-979e-31ccb5992dec"). InnerVolumeSpecName "kube-api-access-6vg9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:20:37.144349 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.144315    2545 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc2f1286-6c50-408e-a49d-798df292e9e3-bundle\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:20:37.144349 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.144344    2545 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28e1c73b-80ef-4244-979e-31ccb5992dec-bundle\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:20:37.144349 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.144354    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vg9h\" (UniqueName: \"kubernetes.io/projected/28e1c73b-80ef-4244-979e-31ccb5992dec-kube-api-access-6vg9h\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:20:37.144605 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.144364    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpnl9\" (UniqueName: \"kubernetes.io/projected/dc2f1286-6c50-408e-a49d-798df292e9e3-kube-api-access-vpnl9\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:20:37.206166 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.206118    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28e1c73b-80ef-4244-979e-31ccb5992dec-util" (OuterVolumeSpecName: "util") pod "28e1c73b-80ef-4244-979e-31ccb5992dec" (UID: "28e1c73b-80ef-4244-979e-31ccb5992dec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:20:37.209397 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.209369    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc2f1286-6c50-408e-a49d-798df292e9e3-util" (OuterVolumeSpecName: "util") pod "dc2f1286-6c50-408e-a49d-798df292e9e3" (UID: "dc2f1286-6c50-408e-a49d-798df292e9e3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:20:37.209548 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.209522    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88a0a150-edfd-4a70-9715-62257d7fd6ee-util" (OuterVolumeSpecName: "util") pod "88a0a150-edfd-4a70-9715-62257d7fd6ee" (UID: "88a0a150-edfd-4a70-9715-62257d7fd6ee"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:20:37.245772 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.245733    2545 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/88a0a150-edfd-4a70-9715-62257d7fd6ee-util\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:20:37.245772 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.245771    2545 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc2f1286-6c50-408e-a49d-798df292e9e3-util\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:20:37.245772 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.245780    2545 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28e1c73b-80ef-4244-979e-31ccb5992dec-util\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:20:37.719108 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.719077    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk"
Sep 10 14:20:37.719271 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.719102    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a6djjk" event={"ID":"28e1c73b-80ef-4244-979e-31ccb5992dec","Type":"ContainerDied","Data":"30682d538ee196e4b3093e8940516ee1f85733928e28c7a7cfffee74eaa9bffa"}
Sep 10 14:20:37.719271 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.719176    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30682d538ee196e4b3093e8940516ee1f85733928e28c7a7cfffee74eaa9bffa"
Sep 10 14:20:37.721207 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.721188    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp"
Sep 10 14:20:37.721334 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.721230    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7zcwzp" event={"ID":"dc2f1286-6c50-408e-a49d-798df292e9e3","Type":"ContainerDied","Data":"9d7e6753d40a914a052ceaa03bceb1ebe963ec0c0c22c7720ec44671957a6dac"}
Sep 10 14:20:37.721334 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.721267    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d7e6753d40a914a052ceaa03bceb1ebe963ec0c0c22c7720ec44671957a6dac"
Sep 10 14:20:37.723557 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.723537    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr" event={"ID":"88a0a150-edfd-4a70-9715-62257d7fd6ee","Type":"ContainerDied","Data":"dc71ba4fe24e9abb09daa1b09557a2dc198541bea2b65d474ce59aae643912af"}
Sep 10 14:20:37.723557 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.723551    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz9vrr"
Sep 10 14:20:37.723717 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.723575    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc71ba4fe24e9abb09daa1b09557a2dc198541bea2b65d474ce59aae643912af"
Sep 10 14:20:37.725440 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.725421    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6" event={"ID":"121219d2-e57f-43f5-82bb-492040e08540","Type":"ContainerDied","Data":"55facde938b77fcf98ddb577550ed01e36384faebabaf84db3b6fb251fd886ca"}
Sep 10 14:20:37.725550 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.725444    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kv4v6"
Sep 10 14:20:37.725550 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:20:37.725457    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55facde938b77fcf98ddb577550ed01e36384faebabaf84db3b6fb251fd886ca"
Sep 10 14:21:47.351279 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.351241    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"]
Sep 10 14:21:47.351840 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.351818    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="121219d2-e57f-43f5-82bb-492040e08540" containerName="pull"
Sep 10 14:21:47.351916 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.351844    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="121219d2-e57f-43f5-82bb-492040e08540" containerName="pull"
Sep 10 14:21:47.351916 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.351858    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28e1c73b-80ef-4244-979e-31ccb5992dec" containerName="pull"
Sep 10 14:21:47.351916 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.351866    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="28e1c73b-80ef-4244-979e-31ccb5992dec" containerName="pull"
Sep 10 14:21:47.351916 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.351884    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc2f1286-6c50-408e-a49d-798df292e9e3" containerName="pull"
Sep 10 14:21:47.351916 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.351892    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc2f1286-6c50-408e-a49d-798df292e9e3" containerName="pull"
Sep 10 14:21:47.351916 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.351906    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="121219d2-e57f-43f5-82bb-492040e08540" containerName="util"
Sep 10 14:21:47.351916 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.351914    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="121219d2-e57f-43f5-82bb-492040e08540" containerName="util"
Sep 10 14:21:47.352260 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.351926    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28e1c73b-80ef-4244-979e-31ccb5992dec" containerName="extract"
Sep 10 14:21:47.352260 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.351933    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="28e1c73b-80ef-4244-979e-31ccb5992dec" containerName="extract"
Sep 10 14:21:47.352260 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.351945    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc2f1286-6c50-408e-a49d-798df292e9e3" containerName="extract"
Sep 10 14:21:47.352260 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.351954    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc2f1286-6c50-408e-a49d-798df292e9e3" containerName="extract"
Sep 10 14:21:47.352260 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.351965    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28e1c73b-80ef-4244-979e-31ccb5992dec" containerName="util"
Sep 10 14:21:47.352260 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.351973    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="28e1c73b-80ef-4244-979e-31ccb5992dec" containerName="util"
Sep 10 14:21:47.352260 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.351984    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc2f1286-6c50-408e-a49d-798df292e9e3" containerName="util"
Sep 10 14:21:47.352260 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.351993    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc2f1286-6c50-408e-a49d-798df292e9e3" containerName="util"
Sep 10 14:21:47.352260 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.352004    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88a0a150-edfd-4a70-9715-62257d7fd6ee" containerName="pull"
Sep 10 14:21:47.352260 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.352012    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="88a0a150-edfd-4a70-9715-62257d7fd6ee" containerName="pull"
Sep 10 14:21:47.352260 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.352026    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88a0a150-edfd-4a70-9715-62257d7fd6ee" containerName="extract"
Sep 10 14:21:47.352260 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.352033    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="88a0a150-edfd-4a70-9715-62257d7fd6ee" containerName="extract"
Sep 10 14:21:47.352260 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.352044    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="121219d2-e57f-43f5-82bb-492040e08540" containerName="extract"
Sep 10 14:21:47.352260 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.352052    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="121219d2-e57f-43f5-82bb-492040e08540" containerName="extract"
Sep 10 14:21:47.352260 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.352065    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88a0a150-edfd-4a70-9715-62257d7fd6ee" containerName="util"
Sep 10 14:21:47.352260 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.352073    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="88a0a150-edfd-4a70-9715-62257d7fd6ee" containerName="util"
Sep 10 14:21:47.352260 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.352156    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="121219d2-e57f-43f5-82bb-492040e08540" containerName="extract"
Sep 10 14:21:47.352260 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.352170    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="88a0a150-edfd-4a70-9715-62257d7fd6ee" containerName="extract"
Sep 10 14:21:47.352260 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.352184    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc2f1286-6c50-408e-a49d-798df292e9e3" containerName="extract"
Sep 10 14:21:47.352260 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.352198    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="28e1c73b-80ef-4244-979e-31ccb5992dec" containerName="extract"
Sep 10 14:21:47.355386 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.355365    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.358384 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.358363    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-dw9qk\""
Sep 10 14:21:47.366653 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.366630    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"]
Sep 10 14:21:47.485932 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.485897    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f081950b-a0fa-45fd-a638-7672785e5170-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.486104 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.485942    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f081950b-a0fa-45fd-a638-7672785e5170-istio-token\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.486104 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.485972    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f081950b-a0fa-45fd-a638-7672785e5170-workload-certs\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.486104 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.486027    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f081950b-a0fa-45fd-a638-7672785e5170-credential-socket\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.486218 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.486097    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f081950b-a0fa-45fd-a638-7672785e5170-istio-envoy\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.486218 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.486124    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f081950b-a0fa-45fd-a638-7672785e5170-istio-data\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.486218 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.486160    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f081950b-a0fa-45fd-a638-7672785e5170-workload-socket\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.486218 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.486185    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl4l9\" (UniqueName: \"kubernetes.io/projected/f081950b-a0fa-45fd-a638-7672785e5170-kube-api-access-pl4l9\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.486344 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.486265    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f081950b-a0fa-45fd-a638-7672785e5170-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.587415 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.587375    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f081950b-a0fa-45fd-a638-7672785e5170-workload-certs\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.587631 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.587432    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f081950b-a0fa-45fd-a638-7672785e5170-credential-socket\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.587631 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.587481    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f081950b-a0fa-45fd-a638-7672785e5170-istio-envoy\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.587631 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.587527    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f081950b-a0fa-45fd-a638-7672785e5170-istio-data\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.587631 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.587562    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f081950b-a0fa-45fd-a638-7672785e5170-workload-socket\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.587834 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.587680    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl4l9\" (UniqueName: \"kubernetes.io/projected/f081950b-a0fa-45fd-a638-7672785e5170-kube-api-access-pl4l9\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.587834 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.587773    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f081950b-a0fa-45fd-a638-7672785e5170-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.587834 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.587821    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f081950b-a0fa-45fd-a638-7672785e5170-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.587996 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.587826    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f081950b-a0fa-45fd-a638-7672785e5170-workload-certs\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.587996 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.587858    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f081950b-a0fa-45fd-a638-7672785e5170-istio-token\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.587996 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.587859    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f081950b-a0fa-45fd-a638-7672785e5170-credential-socket\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.588152 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.588123    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f081950b-a0fa-45fd-a638-7672785e5170-workload-socket\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.588404 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.588375    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f081950b-a0fa-45fd-a638-7672785e5170-istio-data\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.588547 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.588380    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f081950b-a0fa-45fd-a638-7672785e5170-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.589786 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.589763    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f081950b-a0fa-45fd-a638-7672785e5170-istio-envoy\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.590142 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.590123    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f081950b-a0fa-45fd-a638-7672785e5170-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.596776 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.596743    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f081950b-a0fa-45fd-a638-7672785e5170-istio-token\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.596776 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.596752    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl4l9\" (UniqueName: \"kubernetes.io/projected/f081950b-a0fa-45fd-a638-7672785e5170-kube-api-access-pl4l9\") pod \"maas-default-gateway-openshift-default-c747fcbf8-7sjh4\" (UID: \"f081950b-a0fa-45fd-a638-7672785e5170\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.665579 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.665480    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:47.943156 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.943131    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"]
Sep 10 14:21:47.945888 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:21:47.945857    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf081950b_a0fa_45fd_a638_7672785e5170.slice/crio-d39f251c21c2e4b9e6c5c50c49aafc639c15de0a249e0c72bfc4f54d1e4d1086 WatchSource:0}: Error finding container d39f251c21c2e4b9e6c5c50c49aafc639c15de0a249e0c72bfc4f54d1e4d1086: Status 404 returned error can't find the container with id d39f251c21c2e4b9e6c5c50c49aafc639c15de0a249e0c72bfc4f54d1e4d1086
Sep 10 14:21:47.948466 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.948429    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:21:47.948544 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.948523    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:21:47.948585 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:47.948552    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:21:48.109578 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:48.109523    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4" event={"ID":"f081950b-a0fa-45fd-a638-7672785e5170","Type":"ContainerStarted","Data":"71cea4f907cbbb6e493dda06cdd33def3e42304a4a4855014ceee248916dae33"}
Sep 10 14:21:48.109748 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:48.109602    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4" event={"ID":"f081950b-a0fa-45fd-a638-7672785e5170","Type":"ContainerStarted","Data":"d39f251c21c2e4b9e6c5c50c49aafc639c15de0a249e0c72bfc4f54d1e4d1086"}
Sep 10 14:21:48.134778 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:48.134722    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4" podStartSLOduration=1.134704183 podStartE2EDuration="1.134704183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:21:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:21:48.131724684 +0000 UTC m=+606.249266160" watchObservedRunningTime="2026-09-10 14:21:48.134704183 +0000 UTC m=+606.252245658"
Sep 10 14:21:48.666701 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:48.666657    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:48.671593 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:48.671565    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:49.114837 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:49.114807    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:21:49.116903 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:21:49.115718    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:23:19.467357 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:19.467325    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-bbcvl"]
Sep 10 14:23:19.470390 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:19.470368    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-bbcvl"
Sep 10 14:23:19.472878 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:19.472860    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 10 14:23:19.472967 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:19.472923    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-j6v6d\""
Sep 10 14:23:19.482678 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:19.482649    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-bbcvl"]
Sep 10 14:23:19.633088 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:19.632984    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvwvt\" (UniqueName: \"kubernetes.io/projected/bbf1ec85-8ba1-4185-b9f4-e8ac8b82464d-kube-api-access-cvwvt\") pod \"payload-processing-5b54b7fbb7-bbcvl\" (UID: \"bbf1ec85-8ba1-4185-b9f4-e8ac8b82464d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-bbcvl"
Sep 10 14:23:19.633088 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:19.633040    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbf1ec85-8ba1-4185-b9f4-e8ac8b82464d-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-bbcvl\" (UID: \"bbf1ec85-8ba1-4185-b9f4-e8ac8b82464d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-bbcvl"
Sep 10 14:23:19.733769 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:19.733732    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvwvt\" (UniqueName: \"kubernetes.io/projected/bbf1ec85-8ba1-4185-b9f4-e8ac8b82464d-kube-api-access-cvwvt\") pod \"payload-processing-5b54b7fbb7-bbcvl\" (UID: \"bbf1ec85-8ba1-4185-b9f4-e8ac8b82464d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-bbcvl"
Sep 10 14:23:19.733959 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:19.733774    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbf1ec85-8ba1-4185-b9f4-e8ac8b82464d-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-bbcvl\" (UID: \"bbf1ec85-8ba1-4185-b9f4-e8ac8b82464d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-bbcvl"
Sep 10 14:23:19.734481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:19.734461    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbf1ec85-8ba1-4185-b9f4-e8ac8b82464d-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-bbcvl\" (UID: \"bbf1ec85-8ba1-4185-b9f4-e8ac8b82464d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-bbcvl"
Sep 10 14:23:19.743986 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:19.743954    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvwvt\" (UniqueName: \"kubernetes.io/projected/bbf1ec85-8ba1-4185-b9f4-e8ac8b82464d-kube-api-access-cvwvt\") pod \"payload-processing-5b54b7fbb7-bbcvl\" (UID: \"bbf1ec85-8ba1-4185-b9f4-e8ac8b82464d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-bbcvl"
Sep 10 14:23:19.780672 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:19.780633    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-bbcvl"
Sep 10 14:23:20.056002 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:20.055962    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-bbcvl"]
Sep 10 14:23:20.065019 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:20.064174    2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 14:23:20.593230 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:20.593188    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-bbcvl" event={"ID":"bbf1ec85-8ba1-4185-b9f4-e8ac8b82464d","Type":"ContainerStarted","Data":"88db29e6a6c12d2b6e13571fa6ef3d814e70fddeb36bf1512c240cd2a8dc1a91"}
Sep 10 14:23:22.606310 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:22.606270    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-bbcvl" event={"ID":"bbf1ec85-8ba1-4185-b9f4-e8ac8b82464d","Type":"ContainerStarted","Data":"e6870a7922f08753b3cce9e04671edb87bf975f6fe5a3d6f3f2255ceb9966fd9"}
Sep 10 14:23:22.606711 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:22.606448    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-bbcvl"
Sep 10 14:23:22.625066 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:22.625010    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-bbcvl" podStartSLOduration=1.468742895 podStartE2EDuration="3.624996375s" totalImagesPullingTime="2.15625348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:23:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:23:22.621666444 +0000 UTC m=+700.739207916" watchObservedRunningTime="2026-09-10 14:23:22.624996375 +0000 UTC m=+700.742537883"
Sep 10 14:23:28.638796 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:28.638762    2545 generic.go:356] "Generic (PLEG): container finished" podID="f081950b-a0fa-45fd-a638-7672785e5170" containerID="71cea4f907cbbb6e493dda06cdd33def3e42304a4a4855014ceee248916dae33" exitCode=0
Sep 10 14:23:28.639233 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:28.638835    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4" event={"ID":"f081950b-a0fa-45fd-a638-7672785e5170","Type":"ContainerDied","Data":"71cea4f907cbbb6e493dda06cdd33def3e42304a4a4855014ceee248916dae33"}
Sep 10 14:23:28.639233 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:28.639204    2545 scope.go:117] "RemoveContainer" containerID="71cea4f907cbbb6e493dda06cdd33def3e42304a4a4855014ceee248916dae33"
Sep 10 14:23:28.640138 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:28.640110    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:23:28.640236 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:28.640216    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:23:28.640302 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:28.640267    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:23:29.646453 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:29.646421    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4" event={"ID":"f081950b-a0fa-45fd-a638-7672785e5170","Type":"ContainerStarted","Data":"5d3addd9cafb03066c1e58ea381a0308033ddfd349d7c55f5a3207b7f5345804"}
Sep 10 14:23:29.667890 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:29.667788    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:23:29.671630 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:29.671594    2545 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-c747fcbf8-7sjh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 10 14:23:29.671787 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:29.671652    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4" podUID="f081950b-a0fa-45fd-a638-7672785e5170" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 10 14:23:30.666928 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:30.666891    2545 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-c747fcbf8-7sjh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 10 14:23:30.667420 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:30.666959    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4" podUID="f081950b-a0fa-45fd-a638-7672785e5170" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 10 14:23:31.666563 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:31.666521    2545 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-c747fcbf8-7sjh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 10 14:23:31.666776 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:31.666588    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4" podUID="f081950b-a0fa-45fd-a638-7672785e5170" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 10 14:23:32.666417 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:32.666380    2545 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-c747fcbf8-7sjh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 10 14:23:32.667010 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:32.666978    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4" podUID="f081950b-a0fa-45fd-a638-7672785e5170" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 10 14:23:33.201228 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.201189    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"]
Sep 10 14:23:33.206735 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.206714    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"
Sep 10 14:23:33.210548 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.210521    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 14:23:33.210854 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.210561    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4c25c\""
Sep 10 14:23:33.210854 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.210614    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 14:23:33.210854 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.210671    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 10 14:23:33.213614 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.213593    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"]
Sep 10 14:23:33.280979 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.280942    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18db6c81-c322-4059-99b4-38efea583db7-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69\" (UID: \"18db6c81-c322-4059-99b4-38efea583db7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"
Sep 10 14:23:33.280979 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.280979    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18db6c81-c322-4059-99b4-38efea583db7-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69\" (UID: \"18db6c81-c322-4059-99b4-38efea583db7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"
Sep 10 14:23:33.281214 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.281002    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18db6c81-c322-4059-99b4-38efea583db7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69\" (UID: \"18db6c81-c322-4059-99b4-38efea583db7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"
Sep 10 14:23:33.281214 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.281091    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtnn2\" (UniqueName: \"kubernetes.io/projected/18db6c81-c322-4059-99b4-38efea583db7-kube-api-access-qtnn2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69\" (UID: \"18db6c81-c322-4059-99b4-38efea583db7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"
Sep 10 14:23:33.281214 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.281121    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18db6c81-c322-4059-99b4-38efea583db7-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69\" (UID: \"18db6c81-c322-4059-99b4-38efea583db7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"
Sep 10 14:23:33.281214 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.281182    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18db6c81-c322-4059-99b4-38efea583db7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69\" (UID: \"18db6c81-c322-4059-99b4-38efea583db7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"
Sep 10 14:23:33.382382 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.382339    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtnn2\" (UniqueName: \"kubernetes.io/projected/18db6c81-c322-4059-99b4-38efea583db7-kube-api-access-qtnn2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69\" (UID: \"18db6c81-c322-4059-99b4-38efea583db7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"
Sep 10 14:23:33.382598 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.382396    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18db6c81-c322-4059-99b4-38efea583db7-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69\" (UID: \"18db6c81-c322-4059-99b4-38efea583db7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"
Sep 10 14:23:33.382598 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.382478    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18db6c81-c322-4059-99b4-38efea583db7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69\" (UID: \"18db6c81-c322-4059-99b4-38efea583db7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"
Sep 10 14:23:33.382598 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.382579    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18db6c81-c322-4059-99b4-38efea583db7-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69\" (UID: \"18db6c81-c322-4059-99b4-38efea583db7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"
Sep 10 14:23:33.382772 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.382605    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18db6c81-c322-4059-99b4-38efea583db7-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69\" (UID: \"18db6c81-c322-4059-99b4-38efea583db7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"
Sep 10 14:23:33.382772 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.382649    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18db6c81-c322-4059-99b4-38efea583db7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69\" (UID: \"18db6c81-c322-4059-99b4-38efea583db7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"
Sep 10 14:23:33.382882 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.382817    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18db6c81-c322-4059-99b4-38efea583db7-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69\" (UID: \"18db6c81-c322-4059-99b4-38efea583db7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"
Sep 10 14:23:33.383019 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.382997    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18db6c81-c322-4059-99b4-38efea583db7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69\" (UID: \"18db6c81-c322-4059-99b4-38efea583db7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"
Sep 10 14:23:33.383082 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.383024    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18db6c81-c322-4059-99b4-38efea583db7-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69\" (UID: \"18db6c81-c322-4059-99b4-38efea583db7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"
Sep 10 14:23:33.385124 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.385101    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18db6c81-c322-4059-99b4-38efea583db7-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69\" (UID: \"18db6c81-c322-4059-99b4-38efea583db7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"
Sep 10 14:23:33.385452 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.385433    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18db6c81-c322-4059-99b4-38efea583db7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69\" (UID: \"18db6c81-c322-4059-99b4-38efea583db7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"
Sep 10 14:23:33.389824 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.389803    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtnn2\" (UniqueName: \"kubernetes.io/projected/18db6c81-c322-4059-99b4-38efea583db7-kube-api-access-qtnn2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69\" (UID: \"18db6c81-c322-4059-99b4-38efea583db7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"
Sep 10 14:23:33.519502 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.519460    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"
Sep 10 14:23:33.613371 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.613303    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-bbcvl"
Sep 10 14:23:33.668294 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.667858    2545 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-c747fcbf8-7sjh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 10 14:23:33.668294 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.667924    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4" podUID="f081950b-a0fa-45fd-a638-7672785e5170" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 10 14:23:33.817906 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:33.817878    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"]
Sep 10 14:23:33.819893 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:23:33.819866    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18db6c81_c322_4059_99b4_38efea583db7.slice/crio-25f170d00d8066a1b3cf89fbcd1c141e2598b27ca146cb1690ebfb7f9c35a45c WatchSource:0}: Error finding container 25f170d00d8066a1b3cf89fbcd1c141e2598b27ca146cb1690ebfb7f9c35a45c: Status 404 returned error can't find the container with id 25f170d00d8066a1b3cf89fbcd1c141e2598b27ca146cb1690ebfb7f9c35a45c
Sep 10 14:23:34.115109 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:34.115031    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:23:34.688657 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:34.688611    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69" event={"ID":"18db6c81-c322-4059-99b4-38efea583db7","Type":"ContainerStarted","Data":"25f170d00d8066a1b3cf89fbcd1c141e2598b27ca146cb1690ebfb7f9c35a45c"}
Sep 10 14:23:34.983533 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:34.983504    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:23:34.987780 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:34.987742    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-7sjh4"
Sep 10 14:23:35.697049 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:35.697006    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69" event={"ID":"18db6c81-c322-4059-99b4-38efea583db7","Type":"ContainerStarted","Data":"9900a3a583d98bced7635107288371d356c7a6d5a5810094b9bd51371d6e194a"}
Sep 10 14:23:35.725185 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:35.725137    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69" podStartSLOduration=1.5708311259999999 podStartE2EDuration="2.725122771s" totalImagesPullingTime="1.154291645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:23:35.724195894 +0000 UTC m=+713.841737371" watchObservedRunningTime="2026-09-10 14:23:35.725122771 +0000 UTC m=+713.842664256"
Sep 10 14:23:43.520273 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:43.520231    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"
Sep 10 14:23:43.520772 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:43.520303    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"
Sep 10 14:23:43.532782 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:43.532756    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"
Sep 10 14:23:43.751607 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:23:43.751579    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69"
Sep 10 14:24:34.017027 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:34.016994    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-684f4b5dd-ldt5b"]
Sep 10 14:24:34.020556 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:34.020534    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:34.034399 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:34.034375    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-684f4b5dd-ldt5b"]
Sep 10 14:24:34.153367 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:34.153331    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af86e634-6c18-47fa-ac8b-4afff6c559ce-service-ca\") pod \"console-684f4b5dd-ldt5b\" (UID: \"af86e634-6c18-47fa-ac8b-4afff6c559ce\") " pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:34.153367 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:34.153371    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af86e634-6c18-47fa-ac8b-4afff6c559ce-console-serving-cert\") pod \"console-684f4b5dd-ldt5b\" (UID: \"af86e634-6c18-47fa-ac8b-4afff6c559ce\") " pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:34.153612 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:34.153389    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af86e634-6c18-47fa-ac8b-4afff6c559ce-console-oauth-config\") pod \"console-684f4b5dd-ldt5b\" (UID: \"af86e634-6c18-47fa-ac8b-4afff6c559ce\") " pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:34.153612 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:34.153510    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lbcf\" (UniqueName: \"kubernetes.io/projected/af86e634-6c18-47fa-ac8b-4afff6c559ce-kube-api-access-8lbcf\") pod \"console-684f4b5dd-ldt5b\" (UID: \"af86e634-6c18-47fa-ac8b-4afff6c559ce\") " pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:34.153612 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:34.153587    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af86e634-6c18-47fa-ac8b-4afff6c559ce-trusted-ca-bundle\") pod \"console-684f4b5dd-ldt5b\" (UID: \"af86e634-6c18-47fa-ac8b-4afff6c559ce\") " pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:34.153792 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:34.153616    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af86e634-6c18-47fa-ac8b-4afff6c559ce-oauth-serving-cert\") pod \"console-684f4b5dd-ldt5b\" (UID: \"af86e634-6c18-47fa-ac8b-4afff6c559ce\") " pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:34.153792 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:34.153633    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af86e634-6c18-47fa-ac8b-4afff6c559ce-console-config\") pod \"console-684f4b5dd-ldt5b\" (UID: \"af86e634-6c18-47fa-ac8b-4afff6c559ce\") " pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:34.254721 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:34.254685    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af86e634-6c18-47fa-ac8b-4afff6c559ce-oauth-serving-cert\") pod \"console-684f4b5dd-ldt5b\" (UID: \"af86e634-6c18-47fa-ac8b-4afff6c559ce\") " pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:34.254721 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:34.254721    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af86e634-6c18-47fa-ac8b-4afff6c559ce-console-config\") pod \"console-684f4b5dd-ldt5b\" (UID: \"af86e634-6c18-47fa-ac8b-4afff6c559ce\") " pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:34.254916 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:34.254808    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af86e634-6c18-47fa-ac8b-4afff6c559ce-service-ca\") pod \"console-684f4b5dd-ldt5b\" (UID: \"af86e634-6c18-47fa-ac8b-4afff6c559ce\") " pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:34.254916 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:34.254851    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af86e634-6c18-47fa-ac8b-4afff6c559ce-console-serving-cert\") pod \"console-684f4b5dd-ldt5b\" (UID: \"af86e634-6c18-47fa-ac8b-4afff6c559ce\") " pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:34.254916 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:34.254872    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af86e634-6c18-47fa-ac8b-4afff6c559ce-console-oauth-config\") pod \"console-684f4b5dd-ldt5b\" (UID: \"af86e634-6c18-47fa-ac8b-4afff6c559ce\") " pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:34.255067 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:34.254972    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lbcf\" (UniqueName: \"kubernetes.io/projected/af86e634-6c18-47fa-ac8b-4afff6c559ce-kube-api-access-8lbcf\") pod \"console-684f4b5dd-ldt5b\" (UID: \"af86e634-6c18-47fa-ac8b-4afff6c559ce\") " pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:34.255122 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:34.255081    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af86e634-6c18-47fa-ac8b-4afff6c559ce-trusted-ca-bundle\") pod \"console-684f4b5dd-ldt5b\" (UID: \"af86e634-6c18-47fa-ac8b-4afff6c559ce\") " pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:34.255599 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:34.255576    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/af86e634-6c18-47fa-ac8b-4afff6c559ce-console-config\") pod \"console-684f4b5dd-ldt5b\" (UID: \"af86e634-6c18-47fa-ac8b-4afff6c559ce\") " pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:34.255761 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:34.255735    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/af86e634-6c18-47fa-ac8b-4afff6c559ce-oauth-serving-cert\") pod \"console-684f4b5dd-ldt5b\" (UID: \"af86e634-6c18-47fa-ac8b-4afff6c559ce\") " pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:34.255861 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:34.255775    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/af86e634-6c18-47fa-ac8b-4afff6c559ce-service-ca\") pod \"console-684f4b5dd-ldt5b\" (UID: \"af86e634-6c18-47fa-ac8b-4afff6c559ce\") " pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:34.255903 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:34.255888    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af86e634-6c18-47fa-ac8b-4afff6c559ce-trusted-ca-bundle\") pod \"console-684f4b5dd-ldt5b\" (UID: \"af86e634-6c18-47fa-ac8b-4afff6c559ce\") " pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:34.257411 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:34.257389    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/af86e634-6c18-47fa-ac8b-4afff6c559ce-console-oauth-config\") pod \"console-684f4b5dd-ldt5b\" (UID: \"af86e634-6c18-47fa-ac8b-4afff6c559ce\") " pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:34.257517 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:34.257481    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/af86e634-6c18-47fa-ac8b-4afff6c559ce-console-serving-cert\") pod \"console-684f4b5dd-ldt5b\" (UID: \"af86e634-6c18-47fa-ac8b-4afff6c559ce\") " pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:34.264048 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:34.264021    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lbcf\" (UniqueName: \"kubernetes.io/projected/af86e634-6c18-47fa-ac8b-4afff6c559ce-kube-api-access-8lbcf\") pod \"console-684f4b5dd-ldt5b\" (UID: \"af86e634-6c18-47fa-ac8b-4afff6c559ce\") " pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:34.330783 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:34.330707    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:34.608673 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:24:34.608642    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf86e634_6c18_47fa_ac8b_4afff6c559ce.slice/crio-722ae66f4b65bce568bc50797a8642250c58e82676bc6f8038c96869fdf1ba06 WatchSource:0}: Error finding container 722ae66f4b65bce568bc50797a8642250c58e82676bc6f8038c96869fdf1ba06: Status 404 returned error can't find the container with id 722ae66f4b65bce568bc50797a8642250c58e82676bc6f8038c96869fdf1ba06
Sep 10 14:24:34.608939 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:34.608917    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-684f4b5dd-ldt5b"]
Sep 10 14:24:35.031262 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:35.031222    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684f4b5dd-ldt5b" event={"ID":"af86e634-6c18-47fa-ac8b-4afff6c559ce","Type":"ContainerStarted","Data":"4638123d39a27a796a080ebb82d5fd84e8a77376a21e6b88486b7b6156b71e1a"}
Sep 10 14:24:35.031690 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:35.031277    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684f4b5dd-ldt5b" event={"ID":"af86e634-6c18-47fa-ac8b-4afff6c559ce","Type":"ContainerStarted","Data":"722ae66f4b65bce568bc50797a8642250c58e82676bc6f8038c96869fdf1ba06"}
Sep 10 14:24:35.050734 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:35.050687    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-684f4b5dd-ldt5b" podStartSLOduration=2.050672439 podStartE2EDuration="2.050672439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:24:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:24:35.04917461 +0000 UTC m=+773.166716086" watchObservedRunningTime="2026-09-10 14:24:35.050672439 +0000 UTC m=+773.168213914"
Sep 10 14:24:44.331039 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:44.331004    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:44.331528 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:44.331070    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:44.335747 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:44.335726    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:45.091689 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:45.091661    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-684f4b5dd-ldt5b"
Sep 10 14:24:45.156583 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:24:45.156508    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6459d5b75d-n99b5"]
Sep 10 14:25:10.177287 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:10.177220    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6459d5b75d-n99b5" podUID="b6685497-24a8-4aa3-9235-05714f198736" containerName="console" containerID="cri-o://5c74fe0734a1afbaec6f4ec35047f7f2e3decaa58755063fab03748283ff9e24" gracePeriod=15
Sep 10 14:25:10.417631 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:10.417609    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:25:10.468879 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:10.468816    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6685497-24a8-4aa3-9235-05714f198736-console-oauth-config\") pod \"b6685497-24a8-4aa3-9235-05714f198736\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") "
Sep 10 14:25:10.468879 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:10.468860    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6685497-24a8-4aa3-9235-05714f198736-console-config\") pod \"b6685497-24a8-4aa3-9235-05714f198736\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") "
Sep 10 14:25:10.469064 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:10.468881    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6685497-24a8-4aa3-9235-05714f198736-service-ca\") pod \"b6685497-24a8-4aa3-9235-05714f198736\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") "
Sep 10 14:25:10.469064 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:10.468939    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s98c7\" (UniqueName: \"kubernetes.io/projected/b6685497-24a8-4aa3-9235-05714f198736-kube-api-access-s98c7\") pod \"b6685497-24a8-4aa3-9235-05714f198736\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") "
Sep 10 14:25:10.469064 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:10.468959    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6685497-24a8-4aa3-9235-05714f198736-trusted-ca-bundle\") pod \"b6685497-24a8-4aa3-9235-05714f198736\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") "
Sep 10 14:25:10.469064 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:10.469007    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6685497-24a8-4aa3-9235-05714f198736-oauth-serving-cert\") pod \"b6685497-24a8-4aa3-9235-05714f198736\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") "
Sep 10 14:25:10.469064 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:10.469034    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6685497-24a8-4aa3-9235-05714f198736-console-serving-cert\") pod \"b6685497-24a8-4aa3-9235-05714f198736\" (UID: \"b6685497-24a8-4aa3-9235-05714f198736\") "
Sep 10 14:25:10.469317 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:10.469158    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6685497-24a8-4aa3-9235-05714f198736-console-config" (OuterVolumeSpecName: "console-config") pod "b6685497-24a8-4aa3-9235-05714f198736" (UID: "b6685497-24a8-4aa3-9235-05714f198736"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:25:10.469554 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:10.469378    2545 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b6685497-24a8-4aa3-9235-05714f198736-console-config\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:25:10.469554 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:10.469394    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6685497-24a8-4aa3-9235-05714f198736-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b6685497-24a8-4aa3-9235-05714f198736" (UID: "b6685497-24a8-4aa3-9235-05714f198736"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:25:10.469554 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:10.469508    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6685497-24a8-4aa3-9235-05714f198736-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b6685497-24a8-4aa3-9235-05714f198736" (UID: "b6685497-24a8-4aa3-9235-05714f198736"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:25:10.469554 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:10.469534    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6685497-24a8-4aa3-9235-05714f198736-service-ca" (OuterVolumeSpecName: "service-ca") pod "b6685497-24a8-4aa3-9235-05714f198736" (UID: "b6685497-24a8-4aa3-9235-05714f198736"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:25:10.470996 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:10.470967    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6685497-24a8-4aa3-9235-05714f198736-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b6685497-24a8-4aa3-9235-05714f198736" (UID: "b6685497-24a8-4aa3-9235-05714f198736"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:25:10.471225 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:10.471206    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6685497-24a8-4aa3-9235-05714f198736-kube-api-access-s98c7" (OuterVolumeSpecName: "kube-api-access-s98c7") pod "b6685497-24a8-4aa3-9235-05714f198736" (UID: "b6685497-24a8-4aa3-9235-05714f198736"). InnerVolumeSpecName "kube-api-access-s98c7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:25:10.471617 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:10.471596    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6685497-24a8-4aa3-9235-05714f198736-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b6685497-24a8-4aa3-9235-05714f198736" (UID: "b6685497-24a8-4aa3-9235-05714f198736"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:25:10.569823 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:10.569792    2545 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6685497-24a8-4aa3-9235-05714f198736-trusted-ca-bundle\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:25:10.569823 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:10.569818    2545 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b6685497-24a8-4aa3-9235-05714f198736-oauth-serving-cert\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:25:10.569985 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:10.569831    2545 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b6685497-24a8-4aa3-9235-05714f198736-console-serving-cert\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:25:10.569985 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:10.569844    2545 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b6685497-24a8-4aa3-9235-05714f198736-console-oauth-config\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:25:10.569985 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:10.569855    2545 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b6685497-24a8-4aa3-9235-05714f198736-service-ca\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:25:10.569985 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:10.569869    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s98c7\" (UniqueName: \"kubernetes.io/projected/b6685497-24a8-4aa3-9235-05714f198736-kube-api-access-s98c7\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:25:11.232209 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:11.232173    2545 generic.go:356] "Generic (PLEG): container finished" podID="b6685497-24a8-4aa3-9235-05714f198736" containerID="5c74fe0734a1afbaec6f4ec35047f7f2e3decaa58755063fab03748283ff9e24" exitCode=0
Sep 10 14:25:11.232634 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:11.232222    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6459d5b75d-n99b5"
Sep 10 14:25:11.232634 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:11.232247    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6459d5b75d-n99b5" event={"ID":"b6685497-24a8-4aa3-9235-05714f198736","Type":"ContainerDied","Data":"5c74fe0734a1afbaec6f4ec35047f7f2e3decaa58755063fab03748283ff9e24"}
Sep 10 14:25:11.232634 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:11.232297    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6459d5b75d-n99b5" event={"ID":"b6685497-24a8-4aa3-9235-05714f198736","Type":"ContainerDied","Data":"295c94fefdd0eec1a9d6bbffdc7ca54486ec4c77dda2289da0e39f977f0aa584"}
Sep 10 14:25:11.232634 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:11.232317    2545 scope.go:117] "RemoveContainer" containerID="5c74fe0734a1afbaec6f4ec35047f7f2e3decaa58755063fab03748283ff9e24"
Sep 10 14:25:11.249801 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:11.249783    2545 scope.go:117] "RemoveContainer" containerID="5c74fe0734a1afbaec6f4ec35047f7f2e3decaa58755063fab03748283ff9e24"
Sep 10 14:25:11.250063 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:25:11.250043    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c74fe0734a1afbaec6f4ec35047f7f2e3decaa58755063fab03748283ff9e24\": container with ID starting with 5c74fe0734a1afbaec6f4ec35047f7f2e3decaa58755063fab03748283ff9e24 not found: ID does not exist" containerID="5c74fe0734a1afbaec6f4ec35047f7f2e3decaa58755063fab03748283ff9e24"
Sep 10 14:25:11.250134 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:11.250070    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c74fe0734a1afbaec6f4ec35047f7f2e3decaa58755063fab03748283ff9e24"} err="failed to get container status \"5c74fe0734a1afbaec6f4ec35047f7f2e3decaa58755063fab03748283ff9e24\": rpc error: code = NotFound desc = could not find container \"5c74fe0734a1afbaec6f4ec35047f7f2e3decaa58755063fab03748283ff9e24\": container with ID starting with 5c74fe0734a1afbaec6f4ec35047f7f2e3decaa58755063fab03748283ff9e24 not found: ID does not exist"
Sep 10 14:25:11.259411 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:11.259391    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6459d5b75d-n99b5"]
Sep 10 14:25:11.263787 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:11.263766    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6459d5b75d-n99b5"]
Sep 10 14:25:12.365999 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:25:12.365965    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6685497-24a8-4aa3-9235-05714f198736" path="/var/lib/kubelet/pods/b6685497-24a8-4aa3-9235-05714f198736/volumes"
Sep 10 14:26:22.009705 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.009669    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"]
Sep 10 14:26:22.010227 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.010087    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6685497-24a8-4aa3-9235-05714f198736" containerName="console"
Sep 10 14:26:22.010227 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.010103    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6685497-24a8-4aa3-9235-05714f198736" containerName="console"
Sep 10 14:26:22.010227 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.010175    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6685497-24a8-4aa3-9235-05714f198736" containerName="console"
Sep 10 14:26:22.013421 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.013398    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.017325 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.017303    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-bb42d5-openshift-default-dockercfg-l6qnh\""
Sep 10 14:26:22.025430 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.025409    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"]
Sep 10 14:26:22.107378 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.107343    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istio-envoy\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.107378 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.107380    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istio-data\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.107681 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.107412    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jhfd\" (UniqueName: \"kubernetes.io/projected/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-kube-api-access-9jhfd\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.107681 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.107461    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-credential-socket\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.107681 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.107546    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istio-token\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.107681 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.107567    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istiod-ca-cert\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.107681 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.107626    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-workload-certs\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.107681 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.107653    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istio-podinfo\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.107986 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.107687    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-workload-socket\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.209079 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.209045    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-credential-socket\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.209270 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.209104    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istio-token\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.209270 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.209122    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istiod-ca-cert\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.209270 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.209141    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-workload-certs\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.209270 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.209161    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istio-podinfo\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.209270 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.209184    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-workload-socket\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.209270 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.209238    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istio-envoy\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.209270 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.209261    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istio-data\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.209652 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.209293    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jhfd\" (UniqueName: \"kubernetes.io/projected/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-kube-api-access-9jhfd\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.209652 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.209571    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-credential-socket\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.209652 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.209610    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-workload-certs\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.209810 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.209714    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istio-data\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.209810 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.209754    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-workload-socket\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.210074 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.210056    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istiod-ca-cert\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.211643 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.211610    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istio-envoy\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.211739 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.211716    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istio-podinfo\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.228210 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.228177    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istio-token\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.229385 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.229362    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jhfd\" (UniqueName: \"kubernetes.io/projected/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-kube-api-access-9jhfd\") pod \"e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") " pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.325010 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.324912    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:22.606644 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.606615    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"]
Sep 10 14:26:22.607535 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:26:22.607502    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc78cf1e_be0a_4c65_89fd_2dbb01c93dd1.slice/crio-799000f9f0957b82ce396edcccd0a1cecdbdae73771a274857aa52e62a24e762 WatchSource:0}: Error finding container 799000f9f0957b82ce396edcccd0a1cecdbdae73771a274857aa52e62a24e762: Status 404 returned error can't find the container with id 799000f9f0957b82ce396edcccd0a1cecdbdae73771a274857aa52e62a24e762
Sep 10 14:26:22.609656 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.609619    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:26:22.609746 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.609684    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:26:22.609746 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:22.609710    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:26:23.621961 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:23.621924    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq" event={"ID":"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1","Type":"ContainerStarted","Data":"fbf4e0d60ebdc488e1a09a5aacdf1921267a247dc78eb160a013dea811336fc9"}
Sep 10 14:26:23.622356 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:23.621981    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq" event={"ID":"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1","Type":"ContainerStarted","Data":"799000f9f0957b82ce396edcccd0a1cecdbdae73771a274857aa52e62a24e762"}
Sep 10 14:26:23.648026 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:23.647975    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq" podStartSLOduration=2.647956797 podStartE2EDuration="2.647956797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:26:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:26:23.645229041 +0000 UTC m=+881.762770516" watchObservedRunningTime="2026-09-10 14:26:23.647956797 +0000 UTC m=+881.765498273"
Sep 10 14:26:24.325569 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:24.325531    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:24.330364 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:24.330338    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:24.627989 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:24.627900    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:24.628940 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:24.628921    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:27.757252 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:27.757214    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94"]
Sep 10 14:26:27.761097 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:27.761062    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94"
Sep 10 14:26:27.764959 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:27.764935    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-bb42d5\""
Sep 10 14:26:27.765077 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:27.765005    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-bb42d5-dockercfg-fkqzb\""
Sep 10 14:26:27.782914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:27.782878    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94"]
Sep 10 14:26:27.877658 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:27.877622    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed16bd4e-8aae-4164-a040-13bf73c10572-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94\" (UID: \"ed16bd4e-8aae-4164-a040-13bf73c10572\") " pod="openshift-ingress/payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94"
Sep 10 14:26:27.877835 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:27.877698    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7bb5\" (UniqueName: \"kubernetes.io/projected/ed16bd4e-8aae-4164-a040-13bf73c10572-kube-api-access-x7bb5\") pod \"payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94\" (UID: \"ed16bd4e-8aae-4164-a040-13bf73c10572\") " pod="openshift-ingress/payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94"
Sep 10 14:26:27.978771 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:27.978728    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7bb5\" (UniqueName: \"kubernetes.io/projected/ed16bd4e-8aae-4164-a040-13bf73c10572-kube-api-access-x7bb5\") pod \"payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94\" (UID: \"ed16bd4e-8aae-4164-a040-13bf73c10572\") " pod="openshift-ingress/payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94"
Sep 10 14:26:27.978958 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:27.978830    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed16bd4e-8aae-4164-a040-13bf73c10572-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94\" (UID: \"ed16bd4e-8aae-4164-a040-13bf73c10572\") " pod="openshift-ingress/payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94"
Sep 10 14:26:27.979526 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:27.979509    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed16bd4e-8aae-4164-a040-13bf73c10572-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94\" (UID: \"ed16bd4e-8aae-4164-a040-13bf73c10572\") " pod="openshift-ingress/payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94"
Sep 10 14:26:27.990104 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:27.990077    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7bb5\" (UniqueName: \"kubernetes.io/projected/ed16bd4e-8aae-4164-a040-13bf73c10572-kube-api-access-x7bb5\") pod \"payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94\" (UID: \"ed16bd4e-8aae-4164-a040-13bf73c10572\") " pod="openshift-ingress/payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94"
Sep 10 14:26:28.072105 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:28.072010    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94"
Sep 10 14:26:28.354204 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:28.354170    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94"]
Sep 10 14:26:28.355478 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:26:28.355452    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded16bd4e_8aae_4164_a040_13bf73c10572.slice/crio-c4d615218f3041f4bfa7582b613457c748e64ff847d155b0136d3574a9d118a5 WatchSource:0}: Error finding container c4d615218f3041f4bfa7582b613457c748e64ff847d155b0136d3574a9d118a5: Status 404 returned error can't find the container with id c4d615218f3041f4bfa7582b613457c748e64ff847d155b0136d3574a9d118a5
Sep 10 14:26:28.660277 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:28.660184    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94" event={"ID":"ed16bd4e-8aae-4164-a040-13bf73c10572","Type":"ContainerStarted","Data":"d5b13f15109b63c49a228a481c6514ddaae6d088df52032249f9956b1c927365"}
Sep 10 14:26:28.660277 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:28.660251    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94"
Sep 10 14:26:28.660277 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:28.660276    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94" event={"ID":"ed16bd4e-8aae-4164-a040-13bf73c10572","Type":"ContainerStarted","Data":"c4d615218f3041f4bfa7582b613457c748e64ff847d155b0136d3574a9d118a5"}
Sep 10 14:26:28.682263 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:28.682194    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94" podStartSLOduration=1.6821780419999999 podStartE2EDuration="1.682178042s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:26:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:26:28.678752731 +0000 UTC m=+886.796294205" watchObservedRunningTime="2026-09-10 14:26:28.682178042 +0000 UTC m=+886.799719537"
Sep 10 14:26:30.047908 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.047870    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"]
Sep 10 14:26:30.051652 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.051630    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.054313 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.054293    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2bae5943-openshift-default-dockercfg-7v6fj\""
Sep 10 14:26:30.064611 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.064581    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"]
Sep 10 14:26:30.201246 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.201202    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75hgx\" (UniqueName: \"kubernetes.io/projected/41e33040-bc69-4f02-9579-44b2d05ce4fa-kube-api-access-75hgx\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.201417 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.201257    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41e33040-bc69-4f02-9579-44b2d05ce4fa-istio-token\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.201417 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.201322    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-istio-envoy\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.201417 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.201343    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-workload-socket\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.201548 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.201411    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-credential-socket\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.201548 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.201452    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-workload-certs\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.201548 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.201512    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-istio-data\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.201639 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.201583    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41e33040-bc69-4f02-9579-44b2d05ce4fa-istio-podinfo\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.201639 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.201605    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41e33040-bc69-4f02-9579-44b2d05ce4fa-istiod-ca-cert\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.302227 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.302132    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75hgx\" (UniqueName: \"kubernetes.io/projected/41e33040-bc69-4f02-9579-44b2d05ce4fa-kube-api-access-75hgx\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.302227 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.302188    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41e33040-bc69-4f02-9579-44b2d05ce4fa-istio-token\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.302227 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.302222    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-istio-envoy\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.302543 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.302239    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-workload-socket\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.302543 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.302273    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-credential-socket\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.302543 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.302295    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-workload-certs\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.302754 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.302730    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-istio-data\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.302824 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.302777    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-workload-socket\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.302824 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.302806    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-istio-data\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.302922 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.302817    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41e33040-bc69-4f02-9579-44b2d05ce4fa-istio-podinfo\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.302922 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.302845    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-credential-socket\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.302922 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.302870    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41e33040-bc69-4f02-9579-44b2d05ce4fa-istiod-ca-cert\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.303041 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.302869    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-workload-certs\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.303411 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.303394    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41e33040-bc69-4f02-9579-44b2d05ce4fa-istiod-ca-cert\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.304791 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.304772    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-istio-envoy\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.305041 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.305024    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41e33040-bc69-4f02-9579-44b2d05ce4fa-istio-podinfo\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.310728 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.310703    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41e33040-bc69-4f02-9579-44b2d05ce4fa-istio-token\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.311022 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.311001    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75hgx\" (UniqueName: \"kubernetes.io/projected/41e33040-bc69-4f02-9579-44b2d05ce4fa-kube-api-access-75hgx\") pod \"e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") " pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.386143 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.386107    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:30.668503 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.668453    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"]
Sep 10 14:26:30.669616 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:26:30.669577    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41e33040_bc69_4f02_9579_44b2d05ce4fa.slice/crio-757e280fc0353d5d0ec58b884a42c03b4579a4896fbdc3d8bb5625e9040d6f63 WatchSource:0}: Error finding container 757e280fc0353d5d0ec58b884a42c03b4579a4896fbdc3d8bb5625e9040d6f63: Status 404 returned error can't find the container with id 757e280fc0353d5d0ec58b884a42c03b4579a4896fbdc3d8bb5625e9040d6f63
Sep 10 14:26:30.671864 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.671836    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:26:30.671927 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.671897    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:26:30.671968 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:30.671924    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:26:31.678571 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:31.678529    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd" event={"ID":"41e33040-bc69-4f02-9579-44b2d05ce4fa","Type":"ContainerStarted","Data":"9c1088301446801b155f603a8590d4ed47b1e59ec3f3e9eaede5a0bbcbf1b679"}
Sep 10 14:26:31.679045 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:31.678586    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd" event={"ID":"41e33040-bc69-4f02-9579-44b2d05ce4fa","Type":"ContainerStarted","Data":"757e280fc0353d5d0ec58b884a42c03b4579a4896fbdc3d8bb5625e9040d6f63"}
Sep 10 14:26:31.717482 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:31.717429    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd" podStartSLOduration=1.717408978 podStartE2EDuration="1.717408978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:26:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:26:31.715481565 +0000 UTC m=+889.833023041" watchObservedRunningTime="2026-09-10 14:26:31.717408978 +0000 UTC m=+889.834950454"
Sep 10 14:26:32.386352 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:32.386314    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:32.391893 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:32.391856    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:32.684645 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:32.684548    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:32.685555 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:32.685535    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:34.809729 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:34.809640    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q"]
Sep 10 14:26:34.813452 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:34.813430    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q"
Sep 10 14:26:34.815918 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:34.815901    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-2bae5943\""
Sep 10 14:26:34.816078 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:34.816061    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-2bae5943-dockercfg-dwdnv\""
Sep 10 14:26:34.821931 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:34.821732    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q"]
Sep 10 14:26:34.841617 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:34.841579    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-946qc\" (UniqueName: \"kubernetes.io/projected/6d9304d5-c3f3-4c6c-8716-bfa7a803d14c-kube-api-access-946qc\") pod \"payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q\" (UID: \"6d9304d5-c3f3-4c6c-8716-bfa7a803d14c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q"
Sep 10 14:26:34.841771 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:34.841630    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d9304d5-c3f3-4c6c-8716-bfa7a803d14c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q\" (UID: \"6d9304d5-c3f3-4c6c-8716-bfa7a803d14c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q"
Sep 10 14:26:34.870419 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:34.870379    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2"]
Sep 10 14:26:34.875277 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:34.875238    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2"
Sep 10 14:26:34.879251 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:34.879223    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2"]
Sep 10 14:26:34.942104 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:34.942068    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d9304d5-c3f3-4c6c-8716-bfa7a803d14c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q\" (UID: \"6d9304d5-c3f3-4c6c-8716-bfa7a803d14c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q"
Sep 10 14:26:34.942329 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:34.942140    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8e06a84-b72e-4e2d-ba9c-950e11e20f9a-plugins-config-volume\") pod \"payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2\" (UID: \"d8e06a84-b72e-4e2d-ba9c-950e11e20f9a\") " pod="openshift-ingress/payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2"
Sep 10 14:26:34.942329 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:34.942287    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tftx\" (UniqueName: \"kubernetes.io/projected/d8e06a84-b72e-4e2d-ba9c-950e11e20f9a-kube-api-access-8tftx\") pod \"payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2\" (UID: \"d8e06a84-b72e-4e2d-ba9c-950e11e20f9a\") " pod="openshift-ingress/payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2"
Sep 10 14:26:34.942329 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:34.942321    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-946qc\" (UniqueName: \"kubernetes.io/projected/6d9304d5-c3f3-4c6c-8716-bfa7a803d14c-kube-api-access-946qc\") pod \"payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q\" (UID: \"6d9304d5-c3f3-4c6c-8716-bfa7a803d14c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q"
Sep 10 14:26:34.943040 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:34.943014    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d9304d5-c3f3-4c6c-8716-bfa7a803d14c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q\" (UID: \"6d9304d5-c3f3-4c6c-8716-bfa7a803d14c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q"
Sep 10 14:26:34.961336 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:34.961300    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-946qc\" (UniqueName: \"kubernetes.io/projected/6d9304d5-c3f3-4c6c-8716-bfa7a803d14c-kube-api-access-946qc\") pod \"payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q\" (UID: \"6d9304d5-c3f3-4c6c-8716-bfa7a803d14c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q"
Sep 10 14:26:35.043037 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:35.042994    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tftx\" (UniqueName: \"kubernetes.io/projected/d8e06a84-b72e-4e2d-ba9c-950e11e20f9a-kube-api-access-8tftx\") pod \"payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2\" (UID: \"d8e06a84-b72e-4e2d-ba9c-950e11e20f9a\") " pod="openshift-ingress/payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2"
Sep 10 14:26:35.043209 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:35.043091    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8e06a84-b72e-4e2d-ba9c-950e11e20f9a-plugins-config-volume\") pod \"payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2\" (UID: \"d8e06a84-b72e-4e2d-ba9c-950e11e20f9a\") " pod="openshift-ingress/payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2"
Sep 10 14:26:35.044067 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:35.044041    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8e06a84-b72e-4e2d-ba9c-950e11e20f9a-plugins-config-volume\") pod \"payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2\" (UID: \"d8e06a84-b72e-4e2d-ba9c-950e11e20f9a\") " pod="openshift-ingress/payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2"
Sep 10 14:26:35.057987 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:35.057954    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tftx\" (UniqueName: \"kubernetes.io/projected/d8e06a84-b72e-4e2d-ba9c-950e11e20f9a-kube-api-access-8tftx\") pod \"payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2\" (UID: \"d8e06a84-b72e-4e2d-ba9c-950e11e20f9a\") " pod="openshift-ingress/payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2"
Sep 10 14:26:35.125942 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:35.125836    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q"
Sep 10 14:26:35.187147 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:35.187110    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2"
Sep 10 14:26:35.430810 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:35.430786    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q"]
Sep 10 14:26:35.431947 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:26:35.431923    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d9304d5_c3f3_4c6c_8716_bfa7a803d14c.slice/crio-4711eb4b5efedfb7f4229206227f7c18404b3047849a18902c00c84d4cf95204 WatchSource:0}: Error finding container 4711eb4b5efedfb7f4229206227f7c18404b3047849a18902c00c84d4cf95204: Status 404 returned error can't find the container with id 4711eb4b5efedfb7f4229206227f7c18404b3047849a18902c00c84d4cf95204
Sep 10 14:26:35.495608 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:35.495580    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2"]
Sep 10 14:26:35.496476 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:26:35.496452    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8e06a84_b72e_4e2d_ba9c_950e11e20f9a.slice/crio-c0ed3d38b28e264c45c23e0e9e6314c28cd0cf24abe64db2fa0fd9cfc293fbfe WatchSource:0}: Error finding container c0ed3d38b28e264c45c23e0e9e6314c28cd0cf24abe64db2fa0fd9cfc293fbfe: Status 404 returned error can't find the container with id c0ed3d38b28e264c45c23e0e9e6314c28cd0cf24abe64db2fa0fd9cfc293fbfe
Sep 10 14:26:35.706897 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:35.706765    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q" event={"ID":"6d9304d5-c3f3-4c6c-8716-bfa7a803d14c","Type":"ContainerStarted","Data":"e8b12c4aee9f5a04fb32c6221a54f16a520fc90acd8348dc734de13398f42389"}
Sep 10 14:26:35.706897 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:35.706830    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q"
Sep 10 14:26:35.706897 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:35.706855    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q" event={"ID":"6d9304d5-c3f3-4c6c-8716-bfa7a803d14c","Type":"ContainerStarted","Data":"4711eb4b5efedfb7f4229206227f7c18404b3047849a18902c00c84d4cf95204"}
Sep 10 14:26:35.708839 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:35.708797    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2" event={"ID":"d8e06a84-b72e-4e2d-ba9c-950e11e20f9a","Type":"ContainerStarted","Data":"9776409ae7ada1bf01b70e43ce0bc602c3b93ddddee4ef8dc849216db9bca6c8"}
Sep 10 14:26:35.708958 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:35.708848    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2" event={"ID":"d8e06a84-b72e-4e2d-ba9c-950e11e20f9a","Type":"ContainerStarted","Data":"c0ed3d38b28e264c45c23e0e9e6314c28cd0cf24abe64db2fa0fd9cfc293fbfe"}
Sep 10 14:26:35.708958 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:35.708893    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2"
Sep 10 14:26:35.725824 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:35.725755    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q" podStartSLOduration=1.7257359349999999 podStartE2EDuration="1.725735935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:26:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:26:35.722739454 +0000 UTC m=+893.840280955" watchObservedRunningTime="2026-09-10 14:26:35.725735935 +0000 UTC m=+893.843277411"
Sep 10 14:26:35.739025 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:35.738970    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2" podStartSLOduration=1.738956152 podStartE2EDuration="1.738956152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:26:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:26:35.73763193 +0000 UTC m=+893.855173406" watchObservedRunningTime="2026-09-10 14:26:35.738956152 +0000 UTC m=+893.856497627"
Sep 10 14:26:39.667520 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:39.667417    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94"
Sep 10 14:26:40.669716 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:40.669670    2545 patch_prober.go:28] interesting pod/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 14:26:40.670187 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:40.669750    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq" podUID="dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 14:26:42.775875 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:42.775833    2545 generic.go:356] "Generic (PLEG): container finished" podID="dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1" containerID="fbf4e0d60ebdc488e1a09a5aacdf1921267a247dc78eb160a013dea811336fc9" exitCode=0
Sep 10 14:26:42.776397 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:42.775912    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq" event={"ID":"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1","Type":"ContainerDied","Data":"fbf4e0d60ebdc488e1a09a5aacdf1921267a247dc78eb160a013dea811336fc9"}
Sep 10 14:26:42.776464 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:42.776432    2545 scope.go:117] "RemoveContainer" containerID="fbf4e0d60ebdc488e1a09a5aacdf1921267a247dc78eb160a013dea811336fc9"
Sep 10 14:26:42.777823 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:42.777792    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:26:42.777941 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:42.777880    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:26:42.777941 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:42.777926    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:26:43.789004 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:43.788958    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq" event={"ID":"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1","Type":"ContainerStarted","Data":"fab76399c632c96810913336082fea36908a7dd3e10afcf8f15c8bf132da844b"}
Sep 10 14:26:44.325616 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:44.325570    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:44.325825 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:44.325762    2545 patch_prober.go:28] interesting pod/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 10 14:26:44.325899 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:44.325813    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq" podUID="dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 10 14:26:45.326140 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:45.326092    2545 patch_prober.go:28] interesting pod/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 10 14:26:45.326561 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:45.326154    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq" podUID="dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 10 14:26:46.326210 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:46.326169    2545 patch_prober.go:28] interesting pod/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 10 14:26:46.326580 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:46.326231    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq" podUID="dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 10 14:26:46.718068 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:46.717980    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q"
Sep 10 14:26:46.718068 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:46.718054    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2"
Sep 10 14:26:46.790014 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:46.789974    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22"]
Sep 10 14:26:46.795343 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:46.795310    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22"]
Sep 10 14:26:46.795553 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:46.795432    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22"
Sep 10 14:26:46.798454 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:46.798429    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-44e3af\""
Sep 10 14:26:46.893890 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:46.893853    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5mrs\" (UniqueName: \"kubernetes.io/projected/50a78ae3-bad8-4318-84a8-06fa6154db9b-kube-api-access-g5mrs\") pod \"payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22\" (UID: \"50a78ae3-bad8-4318-84a8-06fa6154db9b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22"
Sep 10 14:26:46.894045 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:46.893979    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50a78ae3-bad8-4318-84a8-06fa6154db9b-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22\" (UID: \"50a78ae3-bad8-4318-84a8-06fa6154db9b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22"
Sep 10 14:26:46.995444 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:46.995391    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50a78ae3-bad8-4318-84a8-06fa6154db9b-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22\" (UID: \"50a78ae3-bad8-4318-84a8-06fa6154db9b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22"
Sep 10 14:26:46.995693 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:46.995476    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5mrs\" (UniqueName: \"kubernetes.io/projected/50a78ae3-bad8-4318-84a8-06fa6154db9b-kube-api-access-g5mrs\") pod \"payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22\" (UID: \"50a78ae3-bad8-4318-84a8-06fa6154db9b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22"
Sep 10 14:26:46.996122 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:46.996098    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50a78ae3-bad8-4318-84a8-06fa6154db9b-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22\" (UID: \"50a78ae3-bad8-4318-84a8-06fa6154db9b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22"
Sep 10 14:26:47.004790 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:47.004761    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5mrs\" (UniqueName: \"kubernetes.io/projected/50a78ae3-bad8-4318-84a8-06fa6154db9b-kube-api-access-g5mrs\") pod \"payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22\" (UID: \"50a78ae3-bad8-4318-84a8-06fa6154db9b\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22"
Sep 10 14:26:47.109632 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:47.109593    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22"
Sep 10 14:26:47.325966 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:47.325871    2545 patch_prober.go:28] interesting pod/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 10 14:26:47.325966 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:47.325935    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq" podUID="dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 10 14:26:47.422221 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:47.422187    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22"]
Sep 10 14:26:47.423398 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:26:47.423372    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50a78ae3_bad8_4318_84a8_06fa6154db9b.slice/crio-93768e69e62cdab442405c40931626258daec1f01bb326558752809ea5b8a2be WatchSource:0}: Error finding container 93768e69e62cdab442405c40931626258daec1f01bb326558752809ea5b8a2be: Status 404 returned error can't find the container with id 93768e69e62cdab442405c40931626258daec1f01bb326558752809ea5b8a2be
Sep 10 14:26:47.823184 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:47.823135    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22" event={"ID":"50a78ae3-bad8-4318-84a8-06fa6154db9b","Type":"ContainerStarted","Data":"3eb4ad24e369c26a6842a61ad0f3f7d6335592731a57661894ceaa5f97197023"}
Sep 10 14:26:47.823384 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:47.823202    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22" event={"ID":"50a78ae3-bad8-4318-84a8-06fa6154db9b","Type":"ContainerStarted","Data":"93768e69e62cdab442405c40931626258daec1f01bb326558752809ea5b8a2be"}
Sep 10 14:26:47.823384 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:47.823235    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22"
Sep 10 14:26:47.843258 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:47.843208    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22" podStartSLOduration=1.8431892699999999 podStartE2EDuration="1.84318927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:26:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:26:47.841125633 +0000 UTC m=+905.958667109" watchObservedRunningTime="2026-09-10 14:26:47.84318927 +0000 UTC m=+905.960730745"
Sep 10 14:26:48.325987 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:48.325940    2545 patch_prober.go:28] interesting pod/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 10 14:26:48.326173 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:48.326010    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq" podUID="dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 10 14:26:48.725757 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:48.725661    2545 patch_prober.go:28] interesting pod/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 14:26:48.725757 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:48.725734    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd" podUID="41e33040-bc69-4f02-9579-44b2d05ce4fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 14:26:49.342397 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:49.342352    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:49.342866 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:49.342838    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:49.347038 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:49.347008    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:26:50.842763 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:50.842730    2545 generic.go:356] "Generic (PLEG): container finished" podID="41e33040-bc69-4f02-9579-44b2d05ce4fa" containerID="9c1088301446801b155f603a8590d4ed47b1e59ec3f3e9eaede5a0bbcbf1b679" exitCode=0
Sep 10 14:26:50.843227 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:50.842806    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd" event={"ID":"41e33040-bc69-4f02-9579-44b2d05ce4fa","Type":"ContainerDied","Data":"9c1088301446801b155f603a8590d4ed47b1e59ec3f3e9eaede5a0bbcbf1b679"}
Sep 10 14:26:50.843380 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:50.843364    2545 scope.go:117] "RemoveContainer" containerID="9c1088301446801b155f603a8590d4ed47b1e59ec3f3e9eaede5a0bbcbf1b679"
Sep 10 14:26:50.844520 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:50.844471    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:26:50.844597 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:50.844563    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:26:50.844640 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:50.844598    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:26:51.292140 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.292101    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"]
Sep 10 14:26:51.295009 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.294984    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.297826 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.297796    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-8f0c5f-openshift-default-dockercfg-6sw5f\""
Sep 10 14:26:51.310008 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.309965    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"]
Sep 10 14:26:51.456518 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.445070    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvlhx\" (UniqueName: \"kubernetes.io/projected/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-kube-api-access-xvlhx\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.456518 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.445224    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istio-envoy\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.456518 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.445347    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-credential-socket\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.456518 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.445384    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istio-podinfo\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.456518 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.445437    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-workload-certs\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.456518 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.445526    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-workload-socket\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.456518 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.445584    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istiod-ca-cert\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.456518 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.445621    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istio-token\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.456518 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.445774    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istio-data\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.546990 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.546901    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istio-envoy\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.546990 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.546949    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-credential-socket\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.546990 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.546979    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istio-podinfo\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.547227 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.547017    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-workload-certs\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.547227 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.547148    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-workload-socket\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.547227 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.547207    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istiod-ca-cert\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.547363 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.547246    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istio-token\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.547363 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.547338    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istio-data\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.547472 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.547455    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-credential-socket\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.547472 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.547465    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-workload-certs\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.547628 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.547569    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-workload-socket\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.547798 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.547767    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvlhx\" (UniqueName: \"kubernetes.io/projected/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-kube-api-access-xvlhx\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.547894 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.547845    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istio-data\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.548044 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.548021    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istiod-ca-cert\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.549852 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.549821    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istio-envoy\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.550050 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.550034    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istio-podinfo\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.556010 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.555984    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istio-token\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.556135 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.556056    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvlhx\" (UniqueName: \"kubernetes.io/projected/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-kube-api-access-xvlhx\") pod \"e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") " pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.609789 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.609752    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:51.852166 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.852082    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd" event={"ID":"41e33040-bc69-4f02-9579-44b2d05ce4fa","Type":"ContainerStarted","Data":"4366f25526dfe8a991630e067a851652344ddceaf03ab4e53744a5b47609e369"}
Sep 10 14:26:51.892022 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.891996    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"]
Sep 10 14:26:51.894136 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:26:51.894108    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7801e222_3e47_4b5c_a09b_96a7be3a1ca4.slice/crio-ad3b04196f42de8c4668a26572af4017eb7ab3d7c415df35ff8303b3236ba330 WatchSource:0}: Error finding container ad3b04196f42de8c4668a26572af4017eb7ab3d7c415df35ff8303b3236ba330: Status 404 returned error can't find the container with id ad3b04196f42de8c4668a26572af4017eb7ab3d7c415df35ff8303b3236ba330
Sep 10 14:26:51.896473 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.896444    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:26:51.896567 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.896536    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:26:51.896610 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:51.896571    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:26:52.386751 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:52.386703    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:52.386967 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:52.386943    2545 patch_prober.go:28] interesting pod/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 14:26:52.387042 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:52.387001    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd" podUID="41e33040-bc69-4f02-9579-44b2d05ce4fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 14:26:52.871804 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:52.871751    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb" event={"ID":"7801e222-3e47-4b5c-a09b-96a7be3a1ca4","Type":"ContainerStarted","Data":"b1769ce552c71a85c876f7ce63ff77931c7d5e8a0842db014221fb4ba5d2d1d4"}
Sep 10 14:26:52.872306 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:52.871866    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb" event={"ID":"7801e222-3e47-4b5c-a09b-96a7be3a1ca4","Type":"ContainerStarted","Data":"ad3b04196f42de8c4668a26572af4017eb7ab3d7c415df35ff8303b3236ba330"}
Sep 10 14:26:52.915948 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:52.915894    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb" podStartSLOduration=1.915877514 podStartE2EDuration="1.915877514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:26:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:26:52.914853897 +0000 UTC m=+911.032395373" watchObservedRunningTime="2026-09-10 14:26:52.915877514 +0000 UTC m=+911.033418988"
Sep 10 14:26:53.387429 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:53.387389    2545 patch_prober.go:28] interesting pod/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 14:26:53.387641 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:53.387455    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd" podUID="41e33040-bc69-4f02-9579-44b2d05ce4fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 14:26:53.610460 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:53.610425    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:53.615917 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:53.615891    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:53.879859 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:53.879826    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:53.880827 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:53.880806    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:26:54.386457 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:54.386422    2545 patch_prober.go:28] interesting pod/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 14:26:54.386651 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:54.386505    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd" podUID="41e33040-bc69-4f02-9579-44b2d05ce4fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 14:26:55.386512 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:55.386464    2545 patch_prober.go:28] interesting pod/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 14:26:55.386978 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:55.386544    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd" podUID="41e33040-bc69-4f02-9579-44b2d05ce4fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 14:26:56.387201 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:56.387160    2545 patch_prober.go:28] interesting pod/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 14:26:56.387599 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:56.387249    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd" podUID="41e33040-bc69-4f02-9579-44b2d05ce4fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 14:26:57.387430 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:57.387388    2545 patch_prober.go:28] interesting pod/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 10 14:26:57.387884 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:57.387462    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd" podUID="41e33040-bc69-4f02-9579-44b2d05ce4fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 10 14:26:58.390684 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:58.390653    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:58.391055 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:58.390941    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:58.391576 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:58.391557    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:26:58.541570 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:58.541532    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2bae5943-qrqdb"]
Sep 10 14:26:58.545261 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:58.545238    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2bae5943-qrqdb"
Sep 10 14:26:58.547784 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:58.547760    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:26:58.547953 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:58.547934    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pj254\""
Sep 10 14:26:58.554299 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:58.554267    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2bae5943-qrqdb"]
Sep 10 14:26:58.627404 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:58.627362    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b1f2e1f-672c-4179-8f55-c4201ac88eba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2bae5943-qrqdb\" (UID: \"2b1f2e1f-672c-4179-8f55-c4201ac88eba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2bae5943-qrqdb"
Sep 10 14:26:58.728665 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:58.728572    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b1f2e1f-672c-4179-8f55-c4201ac88eba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2bae5943-qrqdb\" (UID: \"2b1f2e1f-672c-4179-8f55-c4201ac88eba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2bae5943-qrqdb"
Sep 10 14:26:58.729225 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:58.729206    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b1f2e1f-672c-4179-8f55-c4201ac88eba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2bae5943-qrqdb\" (UID: \"2b1f2e1f-672c-4179-8f55-c4201ac88eba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2bae5943-qrqdb"
Sep 10 14:26:58.831055 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:58.831023    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22"
Sep 10 14:26:58.857525 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:58.857477    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2bae5943-qrqdb"
Sep 10 14:26:59.139031 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:59.139003    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2bae5943-qrqdb"]
Sep 10 14:26:59.141445 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:26:59.141418    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b1f2e1f_672c_4179_8f55_c4201ac88eba.slice/crio-088282beeb67ca46196c2ca91f5f12096ddd2388a0bcec83bb7b0c78b4d56052 WatchSource:0}: Error finding container 088282beeb67ca46196c2ca91f5f12096ddd2388a0bcec83bb7b0c78b4d56052: Status 404 returned error can't find the container with id 088282beeb67ca46196c2ca91f5f12096ddd2388a0bcec83bb7b0c78b4d56052
Sep 10 14:26:59.918772 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:26:59.918728    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2bae5943-qrqdb" event={"ID":"2b1f2e1f-672c-4179-8f55-c4201ac88eba","Type":"ContainerStarted","Data":"088282beeb67ca46196c2ca91f5f12096ddd2388a0bcec83bb7b0c78b4d56052"}
Sep 10 14:27:01.933033 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:01.933002    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2bae5943-qrqdb" event={"ID":"2b1f2e1f-672c-4179-8f55-c4201ac88eba","Type":"ContainerStarted","Data":"75163c678a92adeb01bbaaf9f636e2ff779821b00fc74e1ca20b40c5f802a9a0"}
Sep 10 14:27:01.955553 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:01.955481    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2bae5943-qrqdb" podStartSLOduration=1.892696349 podStartE2EDuration="3.955463115s" totalImagesPullingTime="2.062766766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:26:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:27:01.952692399 +0000 UTC m=+920.070233874" watchObservedRunningTime="2026-09-10 14:27:01.955463115 +0000 UTC m=+920.073004589"
Sep 10 14:27:02.940946 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:02.940910    2545 generic.go:356] "Generic (PLEG): container finished" podID="2b1f2e1f-672c-4179-8f55-c4201ac88eba" containerID="75163c678a92adeb01bbaaf9f636e2ff779821b00fc74e1ca20b40c5f802a9a0" exitCode=0
Sep 10 14:27:02.941354 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:02.940994    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2bae5943-qrqdb" event={"ID":"2b1f2e1f-672c-4179-8f55-c4201ac88eba","Type":"ContainerDied","Data":"75163c678a92adeb01bbaaf9f636e2ff779821b00fc74e1ca20b40c5f802a9a0"}
Sep 10 14:27:04.133521 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:04.133482    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2bae5943-qrqdb"
Sep 10 14:27:04.185149 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:04.185113    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b1f2e1f-672c-4179-8f55-c4201ac88eba-maas-api-service-ca\") pod \"2b1f2e1f-672c-4179-8f55-c4201ac88eba\" (UID: \"2b1f2e1f-672c-4179-8f55-c4201ac88eba\") "
Sep 10 14:27:04.185538 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:04.185509    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b1f2e1f-672c-4179-8f55-c4201ac88eba-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2b1f2e1f-672c-4179-8f55-c4201ac88eba" (UID: "2b1f2e1f-672c-4179-8f55-c4201ac88eba"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:27:04.185624 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:04.185609    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b1f2e1f-672c-4179-8f55-c4201ac88eba-maas-api-service-ca\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:27:04.958514 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:04.958394    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2bae5943-qrqdb" event={"ID":"2b1f2e1f-672c-4179-8f55-c4201ac88eba","Type":"ContainerDied","Data":"088282beeb67ca46196c2ca91f5f12096ddd2388a0bcec83bb7b0c78b4d56052"}
Sep 10 14:27:04.958514 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:04.958458    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="088282beeb67ca46196c2ca91f5f12096ddd2388a0bcec83bb7b0c78b4d56052"
Sep 10 14:27:04.961935 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:04.958844    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2bae5943-qrqdb"
Sep 10 14:27:09.921676 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:09.921636    2545 patch_prober.go:28] interesting pod/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 14:27:09.922066 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:09.921697    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb" podUID="7801e222-3e47-4b5c-a09b-96a7be3a1ca4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 14:27:12.007265 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:12.007231    2545 generic.go:356] "Generic (PLEG): container finished" podID="7801e222-3e47-4b5c-a09b-96a7be3a1ca4" containerID="b1769ce552c71a85c876f7ce63ff77931c7d5e8a0842db014221fb4ba5d2d1d4" exitCode=0
Sep 10 14:27:12.007797 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:12.007295    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb" event={"ID":"7801e222-3e47-4b5c-a09b-96a7be3a1ca4","Type":"ContainerDied","Data":"b1769ce552c71a85c876f7ce63ff77931c7d5e8a0842db014221fb4ba5d2d1d4"}
Sep 10 14:27:12.007797 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:12.007717    2545 scope.go:117] "RemoveContainer" containerID="b1769ce552c71a85c876f7ce63ff77931c7d5e8a0842db014221fb4ba5d2d1d4"
Sep 10 14:27:12.008873 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:12.008845    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:27:12.008951 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:12.008913    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:27:12.008951 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:12.008947    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:27:13.016567 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:13.016534    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb" event={"ID":"7801e222-3e47-4b5c-a09b-96a7be3a1ca4","Type":"ContainerStarted","Data":"8602f68255b4450fa4529cd0b921d0db66031a70257d2c0dfb63ccb677140c31"}
Sep 10 14:27:13.610657 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:13.610618    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:27:13.610924 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:13.610901    2545 patch_prober.go:28] interesting pod/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 10 14:27:13.610975 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:13.610952    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb" podUID="7801e222-3e47-4b5c-a09b-96a7be3a1ca4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 10 14:27:14.611140 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:14.611100    2545 patch_prober.go:28] interesting pod/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 10 14:27:14.611581 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:14.611157    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb" podUID="7801e222-3e47-4b5c-a09b-96a7be3a1ca4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 10 14:27:14.926904 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:14.926818    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2"]
Sep 10 14:27:14.927067 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:14.927032    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2" podUID="d8e06a84-b72e-4e2d-ba9c-950e11e20f9a" containerName="payload-processing" containerID="cri-o://9776409ae7ada1bf01b70e43ce0bc602c3b93ddddee4ef8dc849216db9bca6c8" gracePeriod=30
Sep 10 14:27:14.934926 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:14.934894    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q"]
Sep 10 14:27:14.935190 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:14.935115    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q" podUID="6d9304d5-c3f3-4c6c-8716-bfa7a803d14c" containerName="payload-pre-processing" containerID="cri-o://e8b12c4aee9f5a04fb32c6221a54f16a520fc90acd8348dc734de13398f42389" gracePeriod=30
Sep 10 14:27:15.073515 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:15.072540    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2bae5943-qrqdb"]
Sep 10 14:27:15.076218 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:15.076178    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2bae5943-qrqdb"]
Sep 10 14:27:15.208933 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:15.208815    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"]
Sep 10 14:27:15.209374 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:15.209344    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd" podUID="41e33040-bc69-4f02-9579-44b2d05ce4fa" containerName="istio-proxy" containerID="cri-o://4366f25526dfe8a991630e067a851652344ddceaf03ab4e53744a5b47609e369" gracePeriod=30
Sep 10 14:27:15.301512 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:15.301453    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2"
Sep 10 14:27:15.371940 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:15.370963    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q"
Sep 10 14:27:15.400157 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:15.399983    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8e06a84-b72e-4e2d-ba9c-950e11e20f9a-plugins-config-volume\") pod \"d8e06a84-b72e-4e2d-ba9c-950e11e20f9a\" (UID: \"d8e06a84-b72e-4e2d-ba9c-950e11e20f9a\") "
Sep 10 14:27:15.400157 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:15.400050    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d9304d5-c3f3-4c6c-8716-bfa7a803d14c-plugins-config-volume\") pod \"6d9304d5-c3f3-4c6c-8716-bfa7a803d14c\" (UID: \"6d9304d5-c3f3-4c6c-8716-bfa7a803d14c\") "
Sep 10 14:27:15.400157 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:15.400084    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tftx\" (UniqueName: \"kubernetes.io/projected/d8e06a84-b72e-4e2d-ba9c-950e11e20f9a-kube-api-access-8tftx\") pod \"d8e06a84-b72e-4e2d-ba9c-950e11e20f9a\" (UID: \"d8e06a84-b72e-4e2d-ba9c-950e11e20f9a\") "
Sep 10 14:27:15.400157 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:15.400146    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-946qc\" (UniqueName: \"kubernetes.io/projected/6d9304d5-c3f3-4c6c-8716-bfa7a803d14c-kube-api-access-946qc\") pod \"6d9304d5-c3f3-4c6c-8716-bfa7a803d14c\" (UID: \"6d9304d5-c3f3-4c6c-8716-bfa7a803d14c\") "
Sep 10 14:27:15.400653 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:15.400340    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8e06a84-b72e-4e2d-ba9c-950e11e20f9a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d8e06a84-b72e-4e2d-ba9c-950e11e20f9a" (UID: "d8e06a84-b72e-4e2d-ba9c-950e11e20f9a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:27:15.400653 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:15.400386    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d9304d5-c3f3-4c6c-8716-bfa7a803d14c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6d9304d5-c3f3-4c6c-8716-bfa7a803d14c" (UID: "6d9304d5-c3f3-4c6c-8716-bfa7a803d14c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:27:15.400653 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:15.400472    2545 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8e06a84-b72e-4e2d-ba9c-950e11e20f9a-plugins-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:27:15.400653 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:15.400507    2545 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d9304d5-c3f3-4c6c-8716-bfa7a803d14c-plugins-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:27:15.402542 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:15.402516    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8e06a84-b72e-4e2d-ba9c-950e11e20f9a-kube-api-access-8tftx" (OuterVolumeSpecName: "kube-api-access-8tftx") pod "d8e06a84-b72e-4e2d-ba9c-950e11e20f9a" (UID: "d8e06a84-b72e-4e2d-ba9c-950e11e20f9a"). InnerVolumeSpecName "kube-api-access-8tftx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:27:15.402663 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:15.402642    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d9304d5-c3f3-4c6c-8716-bfa7a803d14c-kube-api-access-946qc" (OuterVolumeSpecName: "kube-api-access-946qc") pod "6d9304d5-c3f3-4c6c-8716-bfa7a803d14c" (UID: "6d9304d5-c3f3-4c6c-8716-bfa7a803d14c"). InnerVolumeSpecName "kube-api-access-946qc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:27:15.501559 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:15.501517    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tftx\" (UniqueName: \"kubernetes.io/projected/d8e06a84-b72e-4e2d-ba9c-950e11e20f9a-kube-api-access-8tftx\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:27:15.501559 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:15.501555    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-946qc\" (UniqueName: \"kubernetes.io/projected/6d9304d5-c3f3-4c6c-8716-bfa7a803d14c-kube-api-access-946qc\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:27:15.610674 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:15.610632    2545 patch_prober.go:28] interesting pod/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 10 14:27:15.610882 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:15.610697    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb" podUID="7801e222-3e47-4b5c-a09b-96a7be3a1ca4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 10 14:27:16.037305 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:16.037265    2545 generic.go:356] "Generic (PLEG): container finished" podID="d8e06a84-b72e-4e2d-ba9c-950e11e20f9a" containerID="9776409ae7ada1bf01b70e43ce0bc602c3b93ddddee4ef8dc849216db9bca6c8" exitCode=0
Sep 10 14:27:16.037780 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:16.037315    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2"
Sep 10 14:27:16.037780 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:16.037347    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2" event={"ID":"d8e06a84-b72e-4e2d-ba9c-950e11e20f9a","Type":"ContainerDied","Data":"9776409ae7ada1bf01b70e43ce0bc602c3b93ddddee4ef8dc849216db9bca6c8"}
Sep 10 14:27:16.037780 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:16.037401    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2" event={"ID":"d8e06a84-b72e-4e2d-ba9c-950e11e20f9a","Type":"ContainerDied","Data":"c0ed3d38b28e264c45c23e0e9e6314c28cd0cf24abe64db2fa0fd9cfc293fbfe"}
Sep 10 14:27:16.037780 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:16.037424    2545 scope.go:117] "RemoveContainer" containerID="9776409ae7ada1bf01b70e43ce0bc602c3b93ddddee4ef8dc849216db9bca6c8"
Sep 10 14:27:16.038847 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:16.038823    2545 generic.go:356] "Generic (PLEG): container finished" podID="6d9304d5-c3f3-4c6c-8716-bfa7a803d14c" containerID="e8b12c4aee9f5a04fb32c6221a54f16a520fc90acd8348dc734de13398f42389" exitCode=0
Sep 10 14:27:16.038928 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:16.038880    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q"
Sep 10 14:27:16.038928 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:16.038910    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q" event={"ID":"6d9304d5-c3f3-4c6c-8716-bfa7a803d14c","Type":"ContainerDied","Data":"e8b12c4aee9f5a04fb32c6221a54f16a520fc90acd8348dc734de13398f42389"}
Sep 10 14:27:16.039033 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:16.038952    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q" event={"ID":"6d9304d5-c3f3-4c6c-8716-bfa7a803d14c","Type":"ContainerDied","Data":"4711eb4b5efedfb7f4229206227f7c18404b3047849a18902c00c84d4cf95204"}
Sep 10 14:27:16.063817 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:16.063778    2545 scope.go:117] "RemoveContainer" containerID="9776409ae7ada1bf01b70e43ce0bc602c3b93ddddee4ef8dc849216db9bca6c8"
Sep 10 14:27:16.064310 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:27:16.064277    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9776409ae7ada1bf01b70e43ce0bc602c3b93ddddee4ef8dc849216db9bca6c8\": container with ID starting with 9776409ae7ada1bf01b70e43ce0bc602c3b93ddddee4ef8dc849216db9bca6c8 not found: ID does not exist" containerID="9776409ae7ada1bf01b70e43ce0bc602c3b93ddddee4ef8dc849216db9bca6c8"
Sep 10 14:27:16.064429 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:16.064322    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9776409ae7ada1bf01b70e43ce0bc602c3b93ddddee4ef8dc849216db9bca6c8"} err="failed to get container status \"9776409ae7ada1bf01b70e43ce0bc602c3b93ddddee4ef8dc849216db9bca6c8\": rpc error: code = NotFound desc = could not find container \"9776409ae7ada1bf01b70e43ce0bc602c3b93ddddee4ef8dc849216db9bca6c8\": container with ID starting with 9776409ae7ada1bf01b70e43ce0bc602c3b93ddddee4ef8dc849216db9bca6c8 not found: ID does not exist"
Sep 10 14:27:16.064429 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:16.064351    2545 scope.go:117] "RemoveContainer" containerID="e8b12c4aee9f5a04fb32c6221a54f16a520fc90acd8348dc734de13398f42389"
Sep 10 14:27:16.079744 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:16.079719    2545 scope.go:117] "RemoveContainer" containerID="e8b12c4aee9f5a04fb32c6221a54f16a520fc90acd8348dc734de13398f42389"
Sep 10 14:27:16.080060 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:27:16.080040    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8b12c4aee9f5a04fb32c6221a54f16a520fc90acd8348dc734de13398f42389\": container with ID starting with e8b12c4aee9f5a04fb32c6221a54f16a520fc90acd8348dc734de13398f42389 not found: ID does not exist" containerID="e8b12c4aee9f5a04fb32c6221a54f16a520fc90acd8348dc734de13398f42389"
Sep 10 14:27:16.080113 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:16.080070    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8b12c4aee9f5a04fb32c6221a54f16a520fc90acd8348dc734de13398f42389"} err="failed to get container status \"e8b12c4aee9f5a04fb32c6221a54f16a520fc90acd8348dc734de13398f42389\": rpc error: code = NotFound desc = could not find container \"e8b12c4aee9f5a04fb32c6221a54f16a520fc90acd8348dc734de13398f42389\": container with ID starting with e8b12c4aee9f5a04fb32c6221a54f16a520fc90acd8348dc734de13398f42389 not found: ID does not exist"
Sep 10 14:27:16.090700 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:16.090669    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q"]
Sep 10 14:27:16.101283 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:16.101251    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-2bae5943-69c56f586-pwn6q"]
Sep 10 14:27:16.117352 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:16.117318    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2"]
Sep 10 14:27:16.124483 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:16.124449    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-2bae5943-68bf6fb749-rhft2"]
Sep 10 14:27:16.374320 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:16.374269    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b1f2e1f-672c-4179-8f55-c4201ac88eba" path="/var/lib/kubelet/pods/2b1f2e1f-672c-4179-8f55-c4201ac88eba/volumes"
Sep 10 14:27:16.374882 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:16.374853    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d9304d5-c3f3-4c6c-8716-bfa7a803d14c" path="/var/lib/kubelet/pods/6d9304d5-c3f3-4c6c-8716-bfa7a803d14c/volumes"
Sep 10 14:27:16.375354 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:16.375330    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8e06a84-b72e-4e2d-ba9c-950e11e20f9a" path="/var/lib/kubelet/pods/d8e06a84-b72e-4e2d-ba9c-950e11e20f9a/volumes"
Sep 10 14:27:16.610195 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:16.610154    2545 patch_prober.go:28] interesting pod/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 10 14:27:16.610387 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:16.610214    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb" podUID="7801e222-3e47-4b5c-a09b-96a7be3a1ca4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 10 14:27:17.610460 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:17.610419    2545 patch_prober.go:28] interesting pod/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 10 14:27:17.610880 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:17.610481    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb" podUID="7801e222-3e47-4b5c-a09b-96a7be3a1ca4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 10 14:27:18.614524 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:18.614476    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:27:18.614911 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:18.614784    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:27:18.615468 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:18.615450    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:27:19.567141 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.567108    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp"]
Sep 10 14:27:19.567564 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.567549    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b1f2e1f-672c-4179-8f55-c4201ac88eba" containerName="revoke-keys"
Sep 10 14:27:19.567564 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.567564    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b1f2e1f-672c-4179-8f55-c4201ac88eba" containerName="revoke-keys"
Sep 10 14:27:19.567666 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.567588    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d9304d5-c3f3-4c6c-8716-bfa7a803d14c" containerName="payload-pre-processing"
Sep 10 14:27:19.567666 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.567594    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d9304d5-c3f3-4c6c-8716-bfa7a803d14c" containerName="payload-pre-processing"
Sep 10 14:27:19.567666 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.567600    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8e06a84-b72e-4e2d-ba9c-950e11e20f9a" containerName="payload-processing"
Sep 10 14:27:19.567666 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.567605    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8e06a84-b72e-4e2d-ba9c-950e11e20f9a" containerName="payload-processing"
Sep 10 14:27:19.567789 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.567668    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d9304d5-c3f3-4c6c-8716-bfa7a803d14c" containerName="payload-pre-processing"
Sep 10 14:27:19.567789 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.567676    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b1f2e1f-672c-4179-8f55-c4201ac88eba" containerName="revoke-keys"
Sep 10 14:27:19.567789 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.567683    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8e06a84-b72e-4e2d-ba9c-950e11e20f9a" containerName="payload-processing"
Sep 10 14:27:19.574674 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.574655    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp"
Sep 10 14:27:19.577536 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.577510    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-59ea8af5\""
Sep 10 14:27:19.577649 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.577512    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-59ea8af5-dockercfg-86rks\""
Sep 10 14:27:19.580405 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.580381    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp"]
Sep 10 14:27:19.606321 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.606298    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp"]
Sep 10 14:27:19.610202 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.610181    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp"
Sep 10 14:27:19.619548 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.619521    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp"]
Sep 10 14:27:19.644935 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.644880    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjfdc\" (UniqueName: \"kubernetes.io/projected/edbd53dd-424a-42b7-85a4-228e0ff01aeb-kube-api-access-hjfdc\") pod \"payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp\" (UID: \"edbd53dd-424a-42b7-85a4-228e0ff01aeb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp"
Sep 10 14:27:19.645022 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.644940    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edbd53dd-424a-42b7-85a4-228e0ff01aeb-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp\" (UID: \"edbd53dd-424a-42b7-85a4-228e0ff01aeb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp"
Sep 10 14:27:19.746380 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.746333    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjfdc\" (UniqueName: \"kubernetes.io/projected/edbd53dd-424a-42b7-85a4-228e0ff01aeb-kube-api-access-hjfdc\") pod \"payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp\" (UID: \"edbd53dd-424a-42b7-85a4-228e0ff01aeb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp"
Sep 10 14:27:19.746580 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.746400    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf4866f5-c6a6-4dd0-b83e-8dcd46472a34-plugins-config-volume\") pod \"payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp\" (UID: \"bf4866f5-c6a6-4dd0-b83e-8dcd46472a34\") " pod="openshift-ingress/payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp"
Sep 10 14:27:19.746580 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.746437    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edbd53dd-424a-42b7-85a4-228e0ff01aeb-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp\" (UID: \"edbd53dd-424a-42b7-85a4-228e0ff01aeb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp"
Sep 10 14:27:19.746580 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.746501    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p4qg\" (UniqueName: \"kubernetes.io/projected/bf4866f5-c6a6-4dd0-b83e-8dcd46472a34-kube-api-access-9p4qg\") pod \"payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp\" (UID: \"bf4866f5-c6a6-4dd0-b83e-8dcd46472a34\") " pod="openshift-ingress/payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp"
Sep 10 14:27:19.747114 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.747095    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edbd53dd-424a-42b7-85a4-228e0ff01aeb-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp\" (UID: \"edbd53dd-424a-42b7-85a4-228e0ff01aeb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp"
Sep 10 14:27:19.754425 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.754392    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjfdc\" (UniqueName: \"kubernetes.io/projected/edbd53dd-424a-42b7-85a4-228e0ff01aeb-kube-api-access-hjfdc\") pod \"payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp\" (UID: \"edbd53dd-424a-42b7-85a4-228e0ff01aeb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp"
Sep 10 14:27:19.847246 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.847206    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p4qg\" (UniqueName: \"kubernetes.io/projected/bf4866f5-c6a6-4dd0-b83e-8dcd46472a34-kube-api-access-9p4qg\") pod \"payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp\" (UID: \"bf4866f5-c6a6-4dd0-b83e-8dcd46472a34\") " pod="openshift-ingress/payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp"
Sep 10 14:27:19.847412 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.847351    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf4866f5-c6a6-4dd0-b83e-8dcd46472a34-plugins-config-volume\") pod \"payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp\" (UID: \"bf4866f5-c6a6-4dd0-b83e-8dcd46472a34\") " pod="openshift-ingress/payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp"
Sep 10 14:27:19.848096 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.848075    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf4866f5-c6a6-4dd0-b83e-8dcd46472a34-plugins-config-volume\") pod \"payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp\" (UID: \"bf4866f5-c6a6-4dd0-b83e-8dcd46472a34\") " pod="openshift-ingress/payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp"
Sep 10 14:27:19.854699 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.854682    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p4qg\" (UniqueName: \"kubernetes.io/projected/bf4866f5-c6a6-4dd0-b83e-8dcd46472a34-kube-api-access-9p4qg\") pod \"payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp\" (UID: \"bf4866f5-c6a6-4dd0-b83e-8dcd46472a34\") " pod="openshift-ingress/payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp"
Sep 10 14:27:19.886557 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.886532    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp"
Sep 10 14:27:19.921136 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:19.921108    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp"
Sep 10 14:27:20.161874 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.161728    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp"]
Sep 10 14:27:20.164101 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:27:20.164075    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedbd53dd_424a_42b7_85a4_228e0ff01aeb.slice/crio-a58d6549dfb924829d5b4889fdb5d575b9b605dbb4473894d9d4a56dd861bc08 WatchSource:0}: Error finding container a58d6549dfb924829d5b4889fdb5d575b9b605dbb4473894d9d4a56dd861bc08: Status 404 returned error can't find the container with id a58d6549dfb924829d5b4889fdb5d575b9b605dbb4473894d9d4a56dd861bc08
Sep 10 14:27:20.204093 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.204069    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp"]
Sep 10 14:27:20.205052 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:27:20.205028    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf4866f5_c6a6_4dd0_b83e_8dcd46472a34.slice/crio-804831ffaeaa38e4c888c6c23b24dd2b478c7f96c338085f624514b2a35f4d55 WatchSource:0}: Error finding container 804831ffaeaa38e4c888c6c23b24dd2b478c7f96c338085f624514b2a35f4d55: Status 404 returned error can't find the container with id 804831ffaeaa38e4c888c6c23b24dd2b478c7f96c338085f624514b2a35f4d55
Sep 10 14:27:20.464873 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.464849    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:27:20.554137 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.554104    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-istio-envoy\") pod \"41e33040-bc69-4f02-9579-44b2d05ce4fa\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") "
Sep 10 14:27:20.554137 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.554139    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-istio-data\") pod \"41e33040-bc69-4f02-9579-44b2d05ce4fa\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") "
Sep 10 14:27:20.554370 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.554156    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-credential-socket\") pod \"41e33040-bc69-4f02-9579-44b2d05ce4fa\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") "
Sep 10 14:27:20.554370 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.554186    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-workload-certs\") pod \"41e33040-bc69-4f02-9579-44b2d05ce4fa\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") "
Sep 10 14:27:20.554370 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.554217    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75hgx\" (UniqueName: \"kubernetes.io/projected/41e33040-bc69-4f02-9579-44b2d05ce4fa-kube-api-access-75hgx\") pod \"41e33040-bc69-4f02-9579-44b2d05ce4fa\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") "
Sep 10 14:27:20.554370 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.554298    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-workload-socket\") pod \"41e33040-bc69-4f02-9579-44b2d05ce4fa\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") "
Sep 10 14:27:20.554370 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.554336    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41e33040-bc69-4f02-9579-44b2d05ce4fa-istio-podinfo\") pod \"41e33040-bc69-4f02-9579-44b2d05ce4fa\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") "
Sep 10 14:27:20.554370 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.554365    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41e33040-bc69-4f02-9579-44b2d05ce4fa-istio-token\") pod \"41e33040-bc69-4f02-9579-44b2d05ce4fa\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") "
Sep 10 14:27:20.554724 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.554402    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41e33040-bc69-4f02-9579-44b2d05ce4fa-istiod-ca-cert\") pod \"41e33040-bc69-4f02-9579-44b2d05ce4fa\" (UID: \"41e33040-bc69-4f02-9579-44b2d05ce4fa\") "
Sep 10 14:27:20.554724 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.554433    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-istio-data" (OuterVolumeSpecName: "istio-data") pod "41e33040-bc69-4f02-9579-44b2d05ce4fa" (UID: "41e33040-bc69-4f02-9579-44b2d05ce4fa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:27:20.554724 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.554609    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "41e33040-bc69-4f02-9579-44b2d05ce4fa" (UID: "41e33040-bc69-4f02-9579-44b2d05ce4fa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:27:20.554724 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.554644    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "41e33040-bc69-4f02-9579-44b2d05ce4fa" (UID: "41e33040-bc69-4f02-9579-44b2d05ce4fa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:27:20.554724 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.554703    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "41e33040-bc69-4f02-9579-44b2d05ce4fa" (UID: "41e33040-bc69-4f02-9579-44b2d05ce4fa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:27:20.554984 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.554732    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-istio-data\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:27:20.554984 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.554750    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-workload-certs\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:27:20.554984 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.554797    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-workload-socket\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:27:20.554984 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.554924    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41e33040-bc69-4f02-9579-44b2d05ce4fa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "41e33040-bc69-4f02-9579-44b2d05ce4fa" (UID: "41e33040-bc69-4f02-9579-44b2d05ce4fa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:27:20.556729 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.556695    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/41e33040-bc69-4f02-9579-44b2d05ce4fa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "41e33040-bc69-4f02-9579-44b2d05ce4fa" (UID: "41e33040-bc69-4f02-9579-44b2d05ce4fa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:27:20.556837 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.556760    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41e33040-bc69-4f02-9579-44b2d05ce4fa-istio-token" (OuterVolumeSpecName: "istio-token") pod "41e33040-bc69-4f02-9579-44b2d05ce4fa" (UID: "41e33040-bc69-4f02-9579-44b2d05ce4fa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:27:20.557025 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.557011    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "41e33040-bc69-4f02-9579-44b2d05ce4fa" (UID: "41e33040-bc69-4f02-9579-44b2d05ce4fa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:27:20.557130 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.557113    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41e33040-bc69-4f02-9579-44b2d05ce4fa-kube-api-access-75hgx" (OuterVolumeSpecName: "kube-api-access-75hgx") pod "41e33040-bc69-4f02-9579-44b2d05ce4fa" (UID: "41e33040-bc69-4f02-9579-44b2d05ce4fa"). InnerVolumeSpecName "kube-api-access-75hgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:27:20.655654 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.655615    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41e33040-bc69-4f02-9579-44b2d05ce4fa-istio-token\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:27:20.655654 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.655645    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41e33040-bc69-4f02-9579-44b2d05ce4fa-istiod-ca-cert\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:27:20.655654 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.655655    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-istio-envoy\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:27:20.655654 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.655663    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41e33040-bc69-4f02-9579-44b2d05ce4fa-credential-socket\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:27:20.656255 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.655674    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75hgx\" (UniqueName: \"kubernetes.io/projected/41e33040-bc69-4f02-9579-44b2d05ce4fa-kube-api-access-75hgx\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:27:20.656255 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:20.655685    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41e33040-bc69-4f02-9579-44b2d05ce4fa-istio-podinfo\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:27:21.074428 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:21.074315    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp" event={"ID":"edbd53dd-424a-42b7-85a4-228e0ff01aeb","Type":"ContainerStarted","Data":"8ce42e1f2c3ab9d738394f5e85e3ab0a1a9026c6cfbd4b9635b9b156032aa088"}
Sep 10 14:27:21.074428 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:21.074410    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp" event={"ID":"edbd53dd-424a-42b7-85a4-228e0ff01aeb","Type":"ContainerStarted","Data":"a58d6549dfb924829d5b4889fdb5d575b9b605dbb4473894d9d4a56dd861bc08"}
Sep 10 14:27:21.074814 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:21.074438    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp"
Sep 10 14:27:21.076108 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:21.076081    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp" event={"ID":"bf4866f5-c6a6-4dd0-b83e-8dcd46472a34","Type":"ContainerStarted","Data":"e2d88e073b918e4c0b2b05d23a040643de2cc161456176821c69eb5bd23e4cf5"}
Sep 10 14:27:21.076237 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:21.076132    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp" event={"ID":"bf4866f5-c6a6-4dd0-b83e-8dcd46472a34","Type":"ContainerStarted","Data":"804831ffaeaa38e4c888c6c23b24dd2b478c7f96c338085f624514b2a35f4d55"}
Sep 10 14:27:21.076237 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:21.076172    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp"
Sep 10 14:27:21.078140 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:21.078111    2545 generic.go:356] "Generic (PLEG): container finished" podID="41e33040-bc69-4f02-9579-44b2d05ce4fa" containerID="4366f25526dfe8a991630e067a851652344ddceaf03ab4e53744a5b47609e369" exitCode=0
Sep 10 14:27:21.078272 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:21.078165    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd" event={"ID":"41e33040-bc69-4f02-9579-44b2d05ce4fa","Type":"ContainerDied","Data":"4366f25526dfe8a991630e067a851652344ddceaf03ab4e53744a5b47609e369"}
Sep 10 14:27:21.078272 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:21.078174    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"
Sep 10 14:27:21.078272 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:21.078228    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd" event={"ID":"41e33040-bc69-4f02-9579-44b2d05ce4fa","Type":"ContainerDied","Data":"757e280fc0353d5d0ec58b884a42c03b4579a4896fbdc3d8bb5625e9040d6f63"}
Sep 10 14:27:21.078272 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:21.078266    2545 scope.go:117] "RemoveContainer" containerID="4366f25526dfe8a991630e067a851652344ddceaf03ab4e53744a5b47609e369"
Sep 10 14:27:21.088641 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:21.088476    2545 scope.go:117] "RemoveContainer" containerID="9c1088301446801b155f603a8590d4ed47b1e59ec3f3e9eaede5a0bbcbf1b679"
Sep 10 14:27:21.096258 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:21.096210    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp" podStartSLOduration=2.096195113 podStartE2EDuration="2.096195113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:27:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:27:21.092174952 +0000 UTC m=+939.209716428" watchObservedRunningTime="2026-09-10 14:27:21.096195113 +0000 UTC m=+939.213736588"
Sep 10 14:27:21.099201 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:21.099178    2545 scope.go:117] "RemoveContainer" containerID="4366f25526dfe8a991630e067a851652344ddceaf03ab4e53744a5b47609e369"
Sep 10 14:27:21.099524 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:27:21.099483    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4366f25526dfe8a991630e067a851652344ddceaf03ab4e53744a5b47609e369\": container with ID starting with 4366f25526dfe8a991630e067a851652344ddceaf03ab4e53744a5b47609e369 not found: ID does not exist" containerID="4366f25526dfe8a991630e067a851652344ddceaf03ab4e53744a5b47609e369"
Sep 10 14:27:21.099588 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:21.099531    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4366f25526dfe8a991630e067a851652344ddceaf03ab4e53744a5b47609e369"} err="failed to get container status \"4366f25526dfe8a991630e067a851652344ddceaf03ab4e53744a5b47609e369\": rpc error: code = NotFound desc = could not find container \"4366f25526dfe8a991630e067a851652344ddceaf03ab4e53744a5b47609e369\": container with ID starting with 4366f25526dfe8a991630e067a851652344ddceaf03ab4e53744a5b47609e369 not found: ID does not exist"
Sep 10 14:27:21.099588 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:21.099548    2545 scope.go:117] "RemoveContainer" containerID="9c1088301446801b155f603a8590d4ed47b1e59ec3f3e9eaede5a0bbcbf1b679"
Sep 10 14:27:21.099832 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:27:21.099812    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c1088301446801b155f603a8590d4ed47b1e59ec3f3e9eaede5a0bbcbf1b679\": container with ID starting with 9c1088301446801b155f603a8590d4ed47b1e59ec3f3e9eaede5a0bbcbf1b679 not found: ID does not exist" containerID="9c1088301446801b155f603a8590d4ed47b1e59ec3f3e9eaede5a0bbcbf1b679"
Sep 10 14:27:21.099882 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:21.099837    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c1088301446801b155f603a8590d4ed47b1e59ec3f3e9eaede5a0bbcbf1b679"} err="failed to get container status \"9c1088301446801b155f603a8590d4ed47b1e59ec3f3e9eaede5a0bbcbf1b679\": rpc error: code = NotFound desc = could not find container \"9c1088301446801b155f603a8590d4ed47b1e59ec3f3e9eaede5a0bbcbf1b679\": container with ID starting with 9c1088301446801b155f603a8590d4ed47b1e59ec3f3e9eaede5a0bbcbf1b679 not found: ID does not exist"
Sep 10 14:27:21.110562 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:21.110510    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp" podStartSLOduration=2.110481004 podStartE2EDuration="2.110481004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:27:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:27:21.107318611 +0000 UTC m=+939.224860087" watchObservedRunningTime="2026-09-10 14:27:21.110481004 +0000 UTC m=+939.228022479"
Sep 10 14:27:21.120762 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:21.120729    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"]
Sep 10 14:27:21.124857 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:21.124829    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2bae5943-openshift-default-647c9449b6-qglbd"]
Sep 10 14:27:22.367832 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:22.367797    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41e33040-bc69-4f02-9579-44b2d05ce4fa" path="/var/lib/kubelet/pods/41e33040-bc69-4f02-9579-44b2d05ce4fa/volumes"
Sep 10 14:27:32.086856 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:32.086824    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp"
Sep 10 14:27:32.087238 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:32.087087    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp"
Sep 10 14:27:43.722012 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:43.721975    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-59ea8af5-s26rp"]
Sep 10 14:27:43.722438 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:43.722424    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41e33040-bc69-4f02-9579-44b2d05ce4fa" containerName="istio-proxy"
Sep 10 14:27:43.722438 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:43.722439    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="41e33040-bc69-4f02-9579-44b2d05ce4fa" containerName="istio-proxy"
Sep 10 14:27:43.722538 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:43.722528    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="41e33040-bc69-4f02-9579-44b2d05ce4fa" containerName="istio-proxy"
Sep 10 14:27:43.722575 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:43.722539    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="41e33040-bc69-4f02-9579-44b2d05ce4fa" containerName="istio-proxy"
Sep 10 14:27:43.727124 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:43.727106    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-59ea8af5-s26rp"
Sep 10 14:27:43.729952 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:43.729923    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pj254\""
Sep 10 14:27:43.730068 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:43.729953    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:27:43.733850 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:43.733827    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-59ea8af5-s26rp"]
Sep 10 14:27:43.786597 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:43.786566    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e0edf8f-f7d4-4e56-8921-9139b621caec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-59ea8af5-s26rp\" (UID: \"8e0edf8f-f7d4-4e56-8921-9139b621caec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-59ea8af5-s26rp"
Sep 10 14:27:43.887929 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:43.887893    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e0edf8f-f7d4-4e56-8921-9139b621caec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-59ea8af5-s26rp\" (UID: \"8e0edf8f-f7d4-4e56-8921-9139b621caec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-59ea8af5-s26rp"
Sep 10 14:27:43.888533 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:43.888483    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e0edf8f-f7d4-4e56-8921-9139b621caec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-59ea8af5-s26rp\" (UID: \"8e0edf8f-f7d4-4e56-8921-9139b621caec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-59ea8af5-s26rp"
Sep 10 14:27:44.039947 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:44.039915    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-59ea8af5-s26rp"
Sep 10 14:27:44.308678 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:44.308652    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-59ea8af5-s26rp"]
Sep 10 14:27:44.309725 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:27:44.309702    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e0edf8f_f7d4_4e56_8921_9139b621caec.slice/crio-c43637f88dc24c2eea82679ef3c3345e9c36a47db2d50a03be9c360df2ca98e8 WatchSource:0}: Error finding container c43637f88dc24c2eea82679ef3c3345e9c36a47db2d50a03be9c360df2ca98e8: Status 404 returned error can't find the container with id c43637f88dc24c2eea82679ef3c3345e9c36a47db2d50a03be9c360df2ca98e8
Sep 10 14:27:45.226953 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:45.226854    2545 generic.go:356] "Generic (PLEG): container finished" podID="8e0edf8f-f7d4-4e56-8921-9139b621caec" containerID="1dc67d7e7e7cf858cadbde5f6038f2af01ff8183431089b975df6eab91926cc2" exitCode=0
Sep 10 14:27:45.226953 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:45.226932    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-59ea8af5-s26rp" event={"ID":"8e0edf8f-f7d4-4e56-8921-9139b621caec","Type":"ContainerDied","Data":"1dc67d7e7e7cf858cadbde5f6038f2af01ff8183431089b975df6eab91926cc2"}
Sep 10 14:27:45.227384 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:45.226980    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-59ea8af5-s26rp" event={"ID":"8e0edf8f-f7d4-4e56-8921-9139b621caec","Type":"ContainerStarted","Data":"c43637f88dc24c2eea82679ef3c3345e9c36a47db2d50a03be9c360df2ca98e8"}
Sep 10 14:27:46.373134 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:46.373109    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-59ea8af5-s26rp"
Sep 10 14:27:46.506222 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:46.506190    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e0edf8f-f7d4-4e56-8921-9139b621caec-maas-api-service-ca\") pod \"8e0edf8f-f7d4-4e56-8921-9139b621caec\" (UID: \"8e0edf8f-f7d4-4e56-8921-9139b621caec\") "
Sep 10 14:27:46.506579 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:46.506555    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e0edf8f-f7d4-4e56-8921-9139b621caec-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8e0edf8f-f7d4-4e56-8921-9139b621caec" (UID: "8e0edf8f-f7d4-4e56-8921-9139b621caec"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:27:46.606920 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:46.606883    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e0edf8f-f7d4-4e56-8921-9139b621caec-maas-api-service-ca\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:27:47.245949 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:47.245898    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-59ea8af5-s26rp" event={"ID":"8e0edf8f-f7d4-4e56-8921-9139b621caec","Type":"ContainerDied","Data":"c43637f88dc24c2eea82679ef3c3345e9c36a47db2d50a03be9c360df2ca98e8"}
Sep 10 14:27:47.246157 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:47.246013    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c43637f88dc24c2eea82679ef3c3345e9c36a47db2d50a03be9c360df2ca98e8"
Sep 10 14:27:47.246157 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:47.246097    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-59ea8af5-s26rp"
Sep 10 14:27:50.590368 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:50.590330    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp"]
Sep 10 14:27:50.590838 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:50.590604    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp" podUID="bf4866f5-c6a6-4dd0-b83e-8dcd46472a34" containerName="payload-processing" containerID="cri-o://e2d88e073b918e4c0b2b05d23a040643de2cc161456176821c69eb5bd23e4cf5" gracePeriod=30
Sep 10 14:27:50.596235 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:50.596206    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp"]
Sep 10 14:27:50.596512 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:50.596468    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp" podUID="edbd53dd-424a-42b7-85a4-228e0ff01aeb" containerName="payload-pre-processing" containerID="cri-o://8ce42e1f2c3ab9d738394f5e85e3ab0a1a9026c6cfbd4b9635b9b156032aa088" gracePeriod=30
Sep 10 14:27:50.742633 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:50.742573    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-59ea8af5-s26rp"]
Sep 10 14:27:50.746426 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:50.746398    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-59ea8af5-s26rp"]
Sep 10 14:27:50.877340 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:50.877262    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp"
Sep 10 14:27:50.909939 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:50.909904    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp"
Sep 10 14:27:50.950401 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:50.950364    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9p4qg\" (UniqueName: \"kubernetes.io/projected/bf4866f5-c6a6-4dd0-b83e-8dcd46472a34-kube-api-access-9p4qg\") pod \"bf4866f5-c6a6-4dd0-b83e-8dcd46472a34\" (UID: \"bf4866f5-c6a6-4dd0-b83e-8dcd46472a34\") "
Sep 10 14:27:50.950581 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:50.950449    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edbd53dd-424a-42b7-85a4-228e0ff01aeb-plugins-config-volume\") pod \"edbd53dd-424a-42b7-85a4-228e0ff01aeb\" (UID: \"edbd53dd-424a-42b7-85a4-228e0ff01aeb\") "
Sep 10 14:27:50.950668 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:50.950583    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjfdc\" (UniqueName: \"kubernetes.io/projected/edbd53dd-424a-42b7-85a4-228e0ff01aeb-kube-api-access-hjfdc\") pod \"edbd53dd-424a-42b7-85a4-228e0ff01aeb\" (UID: \"edbd53dd-424a-42b7-85a4-228e0ff01aeb\") "
Sep 10 14:27:50.950668 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:50.950618    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf4866f5-c6a6-4dd0-b83e-8dcd46472a34-plugins-config-volume\") pod \"bf4866f5-c6a6-4dd0-b83e-8dcd46472a34\" (UID: \"bf4866f5-c6a6-4dd0-b83e-8dcd46472a34\") "
Sep 10 14:27:50.950952 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:50.950844    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edbd53dd-424a-42b7-85a4-228e0ff01aeb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "edbd53dd-424a-42b7-85a4-228e0ff01aeb" (UID: "edbd53dd-424a-42b7-85a4-228e0ff01aeb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:27:50.951078 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:50.951010    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf4866f5-c6a6-4dd0-b83e-8dcd46472a34-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bf4866f5-c6a6-4dd0-b83e-8dcd46472a34" (UID: "bf4866f5-c6a6-4dd0-b83e-8dcd46472a34"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:27:50.952658 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:50.952634    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf4866f5-c6a6-4dd0-b83e-8dcd46472a34-kube-api-access-9p4qg" (OuterVolumeSpecName: "kube-api-access-9p4qg") pod "bf4866f5-c6a6-4dd0-b83e-8dcd46472a34" (UID: "bf4866f5-c6a6-4dd0-b83e-8dcd46472a34"). InnerVolumeSpecName "kube-api-access-9p4qg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:27:50.952786 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:50.952765    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edbd53dd-424a-42b7-85a4-228e0ff01aeb-kube-api-access-hjfdc" (OuterVolumeSpecName: "kube-api-access-hjfdc") pod "edbd53dd-424a-42b7-85a4-228e0ff01aeb" (UID: "edbd53dd-424a-42b7-85a4-228e0ff01aeb"). InnerVolumeSpecName "kube-api-access-hjfdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:27:51.052279 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.052241    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjfdc\" (UniqueName: \"kubernetes.io/projected/edbd53dd-424a-42b7-85a4-228e0ff01aeb-kube-api-access-hjfdc\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:27:51.052279 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.052271    2545 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf4866f5-c6a6-4dd0-b83e-8dcd46472a34-plugins-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:27:51.052279 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.052280    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9p4qg\" (UniqueName: \"kubernetes.io/projected/bf4866f5-c6a6-4dd0-b83e-8dcd46472a34-kube-api-access-9p4qg\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:27:51.052562 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.052291    2545 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edbd53dd-424a-42b7-85a4-228e0ff01aeb-plugins-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:27:51.272292 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.272260    2545 generic.go:356] "Generic (PLEG): container finished" podID="edbd53dd-424a-42b7-85a4-228e0ff01aeb" containerID="8ce42e1f2c3ab9d738394f5e85e3ab0a1a9026c6cfbd4b9635b9b156032aa088" exitCode=0
Sep 10 14:27:51.272513 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.272308    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp"
Sep 10 14:27:51.272513 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.272354    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp" event={"ID":"edbd53dd-424a-42b7-85a4-228e0ff01aeb","Type":"ContainerDied","Data":"8ce42e1f2c3ab9d738394f5e85e3ab0a1a9026c6cfbd4b9635b9b156032aa088"}
Sep 10 14:27:51.272513 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.272408    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp" event={"ID":"edbd53dd-424a-42b7-85a4-228e0ff01aeb","Type":"ContainerDied","Data":"a58d6549dfb924829d5b4889fdb5d575b9b605dbb4473894d9d4a56dd861bc08"}
Sep 10 14:27:51.272513 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.272430    2545 scope.go:117] "RemoveContainer" containerID="8ce42e1f2c3ab9d738394f5e85e3ab0a1a9026c6cfbd4b9635b9b156032aa088"
Sep 10 14:27:51.273750 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.273727    2545 generic.go:356] "Generic (PLEG): container finished" podID="bf4866f5-c6a6-4dd0-b83e-8dcd46472a34" containerID="e2d88e073b918e4c0b2b05d23a040643de2cc161456176821c69eb5bd23e4cf5" exitCode=0
Sep 10 14:27:51.273863 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.273775    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp"
Sep 10 14:27:51.273863 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.273808    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp" event={"ID":"bf4866f5-c6a6-4dd0-b83e-8dcd46472a34","Type":"ContainerDied","Data":"e2d88e073b918e4c0b2b05d23a040643de2cc161456176821c69eb5bd23e4cf5"}
Sep 10 14:27:51.273863 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.273850    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp" event={"ID":"bf4866f5-c6a6-4dd0-b83e-8dcd46472a34","Type":"ContainerDied","Data":"804831ffaeaa38e4c888c6c23b24dd2b478c7f96c338085f624514b2a35f4d55"}
Sep 10 14:27:51.282019 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.281999    2545 scope.go:117] "RemoveContainer" containerID="8ce42e1f2c3ab9d738394f5e85e3ab0a1a9026c6cfbd4b9635b9b156032aa088"
Sep 10 14:27:51.282307 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:27:51.282286    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ce42e1f2c3ab9d738394f5e85e3ab0a1a9026c6cfbd4b9635b9b156032aa088\": container with ID starting with 8ce42e1f2c3ab9d738394f5e85e3ab0a1a9026c6cfbd4b9635b9b156032aa088 not found: ID does not exist" containerID="8ce42e1f2c3ab9d738394f5e85e3ab0a1a9026c6cfbd4b9635b9b156032aa088"
Sep 10 14:27:51.282396 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.282318    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ce42e1f2c3ab9d738394f5e85e3ab0a1a9026c6cfbd4b9635b9b156032aa088"} err="failed to get container status \"8ce42e1f2c3ab9d738394f5e85e3ab0a1a9026c6cfbd4b9635b9b156032aa088\": rpc error: code = NotFound desc = could not find container \"8ce42e1f2c3ab9d738394f5e85e3ab0a1a9026c6cfbd4b9635b9b156032aa088\": container with ID starting with 8ce42e1f2c3ab9d738394f5e85e3ab0a1a9026c6cfbd4b9635b9b156032aa088 not found: ID does not exist"
Sep 10 14:27:51.282396 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.282341    2545 scope.go:117] "RemoveContainer" containerID="e2d88e073b918e4c0b2b05d23a040643de2cc161456176821c69eb5bd23e4cf5"
Sep 10 14:27:51.299944 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.299915    2545 scope.go:117] "RemoveContainer" containerID="e2d88e073b918e4c0b2b05d23a040643de2cc161456176821c69eb5bd23e4cf5"
Sep 10 14:27:51.300320 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:27:51.300300    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2d88e073b918e4c0b2b05d23a040643de2cc161456176821c69eb5bd23e4cf5\": container with ID starting with e2d88e073b918e4c0b2b05d23a040643de2cc161456176821c69eb5bd23e4cf5 not found: ID does not exist" containerID="e2d88e073b918e4c0b2b05d23a040643de2cc161456176821c69eb5bd23e4cf5"
Sep 10 14:27:51.300367 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.300329    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2d88e073b918e4c0b2b05d23a040643de2cc161456176821c69eb5bd23e4cf5"} err="failed to get container status \"e2d88e073b918e4c0b2b05d23a040643de2cc161456176821c69eb5bd23e4cf5\": rpc error: code = NotFound desc = could not find container \"e2d88e073b918e4c0b2b05d23a040643de2cc161456176821c69eb5bd23e4cf5\": container with ID starting with e2d88e073b918e4c0b2b05d23a040643de2cc161456176821c69eb5bd23e4cf5 not found: ID does not exist"
Sep 10 14:27:51.302138 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.302100    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp"]
Sep 10 14:27:51.305292 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.305271    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-59ea8af5-5dc88cd694-zrpdp"]
Sep 10 14:27:51.316706 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.316682    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp"]
Sep 10 14:27:51.319043 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.319024    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-59ea8af5-68994fc558-p2ctp"]
Sep 10 14:27:51.615264 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.615234    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"]
Sep 10 14:27:51.615720 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.615706    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edbd53dd-424a-42b7-85a4-228e0ff01aeb" containerName="payload-pre-processing"
Sep 10 14:27:51.615761 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.615725    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="edbd53dd-424a-42b7-85a4-228e0ff01aeb" containerName="payload-pre-processing"
Sep 10 14:27:51.615761 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.615742    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e0edf8f-f7d4-4e56-8921-9139b621caec" containerName="revoke-keys"
Sep 10 14:27:51.615761 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.615748    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e0edf8f-f7d4-4e56-8921-9139b621caec" containerName="revoke-keys"
Sep 10 14:27:51.615761 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.615760    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41e33040-bc69-4f02-9579-44b2d05ce4fa" containerName="istio-proxy"
Sep 10 14:27:51.615884 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.615766    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="41e33040-bc69-4f02-9579-44b2d05ce4fa" containerName="istio-proxy"
Sep 10 14:27:51.615884 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.615776    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf4866f5-c6a6-4dd0-b83e-8dcd46472a34" containerName="payload-processing"
Sep 10 14:27:51.615884 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.615783    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf4866f5-c6a6-4dd0-b83e-8dcd46472a34" containerName="payload-processing"
Sep 10 14:27:51.615884 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.615851    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="edbd53dd-424a-42b7-85a4-228e0ff01aeb" containerName="payload-pre-processing"
Sep 10 14:27:51.615884 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.615860    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf4866f5-c6a6-4dd0-b83e-8dcd46472a34" containerName="payload-processing"
Sep 10 14:27:51.615884 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.615867    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e0edf8f-f7d4-4e56-8921-9139b621caec" containerName="revoke-keys"
Sep 10 14:27:51.620584 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.620554    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.624701 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.624680    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-fc61ae9e-openshift-default-dockercfg-x6t6s\""
Sep 10 14:27:51.647385 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.647324    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"]
Sep 10 14:27:51.657777 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.657748    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-istio-data\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.657964 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.657788    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f0b7b5d-1615-47c8-a387-c576a325e041-istio-podinfo\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.657964 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.657810    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-workload-certs\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.657964 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.657832    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-istio-envoy\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.657964 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.657890    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f0b7b5d-1615-47c8-a387-c576a325e041-istio-token\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.657964 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.657919    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqd5v\" (UniqueName: \"kubernetes.io/projected/3f0b7b5d-1615-47c8-a387-c576a325e041-kube-api-access-nqd5v\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.658204 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.657969    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f0b7b5d-1615-47c8-a387-c576a325e041-istiod-ca-cert\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.658204 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.657999    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-credential-socket\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.658204 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.658067    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-workload-socket\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.759537 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.759474    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-workload-socket\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.759715 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.759589    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-istio-data\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.759715 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.759622    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f0b7b5d-1615-47c8-a387-c576a325e041-istio-podinfo\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.759715 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.759641    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-workload-certs\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.759715 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.759668    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-istio-envoy\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.759715 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.759713    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f0b7b5d-1615-47c8-a387-c576a325e041-istio-token\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.759999 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.759743    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqd5v\" (UniqueName: \"kubernetes.io/projected/3f0b7b5d-1615-47c8-a387-c576a325e041-kube-api-access-nqd5v\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.759999 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.759798    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f0b7b5d-1615-47c8-a387-c576a325e041-istiod-ca-cert\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.759999 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.759855    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-credential-socket\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.759999 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.759898    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-workload-socket\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.759999 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.759947    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-istio-data\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.760234 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.760024    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-workload-certs\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.760234 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.760188    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-credential-socket\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.760475 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.760450    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f0b7b5d-1615-47c8-a387-c576a325e041-istiod-ca-cert\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.762143 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.762116    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-istio-envoy\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.762234 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.762205    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f0b7b5d-1615-47c8-a387-c576a325e041-istio-podinfo\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.772444 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.772421    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqd5v\" (UniqueName: \"kubernetes.io/projected/3f0b7b5d-1615-47c8-a387-c576a325e041-kube-api-access-nqd5v\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.778048 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.778026    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f0b7b5d-1615-47c8-a387-c576a325e041-istio-token\") pod \"e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") " pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:51.930821 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:51.930724    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:52.206937 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:52.206911    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"]
Sep 10 14:27:52.208482 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:27:52.208459    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0b7b5d_1615_47c8_a387_c576a325e041.slice/crio-989b6dde04439b1a92536bc8b4e692ccaf35a5c3ff8f821952875b80e5a972d7 WatchSource:0}: Error finding container 989b6dde04439b1a92536bc8b4e692ccaf35a5c3ff8f821952875b80e5a972d7: Status 404 returned error can't find the container with id 989b6dde04439b1a92536bc8b4e692ccaf35a5c3ff8f821952875b80e5a972d7
Sep 10 14:27:52.210755 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:52.210723    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:27:52.210831 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:52.210790    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:27:52.210831 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:52.210818    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:27:52.283030 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:52.282998    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b" event={"ID":"3f0b7b5d-1615-47c8-a387-c576a325e041","Type":"ContainerStarted","Data":"3d503604e688ae6fbf34212023b152a85389edc930cc3d78aa7651fb31478a88"}
Sep 10 14:27:52.283209 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:52.283056    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b" event={"ID":"3f0b7b5d-1615-47c8-a387-c576a325e041","Type":"ContainerStarted","Data":"989b6dde04439b1a92536bc8b4e692ccaf35a5c3ff8f821952875b80e5a972d7"}
Sep 10 14:27:52.303631 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:52.303583    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b" podStartSLOduration=1.303564901 podStartE2EDuration="1.303564901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:27:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:27:52.301268447 +0000 UTC m=+970.418809922" watchObservedRunningTime="2026-09-10 14:27:52.303564901 +0000 UTC m=+970.421106375"
Sep 10 14:27:52.367619 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:52.367586    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e0edf8f-f7d4-4e56-8921-9139b621caec" path="/var/lib/kubelet/pods/8e0edf8f-f7d4-4e56-8921-9139b621caec/volumes"
Sep 10 14:27:52.367964 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:52.367949    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf4866f5-c6a6-4dd0-b83e-8dcd46472a34" path="/var/lib/kubelet/pods/bf4866f5-c6a6-4dd0-b83e-8dcd46472a34/volumes"
Sep 10 14:27:52.368268 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:52.368255    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edbd53dd-424a-42b7-85a4-228e0ff01aeb" path="/var/lib/kubelet/pods/edbd53dd-424a-42b7-85a4-228e0ff01aeb/volumes"
Sep 10 14:27:52.931131 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:52.931098    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:53.936812 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:53.936781    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:54.295164 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:54.295125    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:54.296139 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:54.296116    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:27:55.338582 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:55.338545    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb"]
Sep 10 14:27:55.343457 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:55.343438    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb"
Sep 10 14:27:55.346256 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:55.346220    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-fc61ae9e\""
Sep 10 14:27:55.346389 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:55.346229    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-fc61ae9e-dockercfg-9nbgb\""
Sep 10 14:27:55.351895 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:55.351752    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb"]
Sep 10 14:27:55.376630 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:55.376598    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz"]
Sep 10 14:27:55.380154 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:55.380131    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz"
Sep 10 14:27:55.389893 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:55.389869    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz"]
Sep 10 14:27:55.397205 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:55.397180    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtk4m\" (UniqueName: \"kubernetes.io/projected/2e16c1d0-ea67-43fb-9f36-569307a8bdcb-kube-api-access-wtk4m\") pod \"payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb\" (UID: \"2e16c1d0-ea67-43fb-9f36-569307a8bdcb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb"
Sep 10 14:27:55.397318 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:55.397299    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e16c1d0-ea67-43fb-9f36-569307a8bdcb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb\" (UID: \"2e16c1d0-ea67-43fb-9f36-569307a8bdcb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb"
Sep 10 14:27:55.499001 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:55.498961    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc433b74-4586-4d99-a14e-c0a873db3b17-plugins-config-volume\") pod \"payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz\" (UID: \"fc433b74-4586-4d99-a14e-c0a873db3b17\") " pod="openshift-ingress/payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz"
Sep 10 14:27:55.499209 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:55.499014    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e16c1d0-ea67-43fb-9f36-569307a8bdcb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb\" (UID: \"2e16c1d0-ea67-43fb-9f36-569307a8bdcb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb"
Sep 10 14:27:55.499209 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:55.499155    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtk4m\" (UniqueName: \"kubernetes.io/projected/2e16c1d0-ea67-43fb-9f36-569307a8bdcb-kube-api-access-wtk4m\") pod \"payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb\" (UID: \"2e16c1d0-ea67-43fb-9f36-569307a8bdcb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb"
Sep 10 14:27:55.499335 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:55.499270    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvrqg\" (UniqueName: \"kubernetes.io/projected/fc433b74-4586-4d99-a14e-c0a873db3b17-kube-api-access-bvrqg\") pod \"payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz\" (UID: \"fc433b74-4586-4d99-a14e-c0a873db3b17\") " pod="openshift-ingress/payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz"
Sep 10 14:27:55.499774 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:55.499756    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e16c1d0-ea67-43fb-9f36-569307a8bdcb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb\" (UID: \"2e16c1d0-ea67-43fb-9f36-569307a8bdcb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb"
Sep 10 14:27:55.507624 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:55.507596    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtk4m\" (UniqueName: \"kubernetes.io/projected/2e16c1d0-ea67-43fb-9f36-569307a8bdcb-kube-api-access-wtk4m\") pod \"payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb\" (UID: \"2e16c1d0-ea67-43fb-9f36-569307a8bdcb\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb"
Sep 10 14:27:55.604264 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:55.602699    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvrqg\" (UniqueName: \"kubernetes.io/projected/fc433b74-4586-4d99-a14e-c0a873db3b17-kube-api-access-bvrqg\") pod \"payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz\" (UID: \"fc433b74-4586-4d99-a14e-c0a873db3b17\") " pod="openshift-ingress/payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz"
Sep 10 14:27:55.604264 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:55.602775    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc433b74-4586-4d99-a14e-c0a873db3b17-plugins-config-volume\") pod \"payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz\" (UID: \"fc433b74-4586-4d99-a14e-c0a873db3b17\") " pod="openshift-ingress/payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz"
Sep 10 14:27:55.604264 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:55.603798    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc433b74-4586-4d99-a14e-c0a873db3b17-plugins-config-volume\") pod \"payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz\" (UID: \"fc433b74-4586-4d99-a14e-c0a873db3b17\") " pod="openshift-ingress/payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz"
Sep 10 14:27:55.613162 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:55.613123    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvrqg\" (UniqueName: \"kubernetes.io/projected/fc433b74-4586-4d99-a14e-c0a873db3b17-kube-api-access-bvrqg\") pod \"payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz\" (UID: \"fc433b74-4586-4d99-a14e-c0a873db3b17\") " pod="openshift-ingress/payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz"
Sep 10 14:27:55.655026 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:55.654987    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb"
Sep 10 14:27:55.691185 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:55.691135    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz"
Sep 10 14:27:55.937776 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:55.937745    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb"]
Sep 10 14:27:55.938101 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:27:55.938075    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e16c1d0_ea67_43fb_9f36_569307a8bdcb.slice/crio-34eed59695acd9e0497de836e1a7e39e306188036886260601ee2efc1e5e348e WatchSource:0}: Error finding container 34eed59695acd9e0497de836e1a7e39e306188036886260601ee2efc1e5e348e: Status 404 returned error can't find the container with id 34eed59695acd9e0497de836e1a7e39e306188036886260601ee2efc1e5e348e
Sep 10 14:27:55.985448 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:55.985424    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz"]
Sep 10 14:27:55.987400 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:27:55.987376    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc433b74_4586_4d99_a14e_c0a873db3b17.slice/crio-0b31eb3b94b7cfd86989844284a3e1e7afaa64c25aad9b0433a71be3edb1ed4e WatchSource:0}: Error finding container 0b31eb3b94b7cfd86989844284a3e1e7afaa64c25aad9b0433a71be3edb1ed4e: Status 404 returned error can't find the container with id 0b31eb3b94b7cfd86989844284a3e1e7afaa64c25aad9b0433a71be3edb1ed4e
Sep 10 14:27:56.315959 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:56.315903    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb" event={"ID":"2e16c1d0-ea67-43fb-9f36-569307a8bdcb","Type":"ContainerStarted","Data":"84442a334856ecedfd3c5de7ba4c04e2cee51d2f1cd639086212999ef48b2fb5"}
Sep 10 14:27:56.316162 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:56.315984    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb"
Sep 10 14:27:56.316162 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:56.316008    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb" event={"ID":"2e16c1d0-ea67-43fb-9f36-569307a8bdcb","Type":"ContainerStarted","Data":"34eed59695acd9e0497de836e1a7e39e306188036886260601ee2efc1e5e348e"}
Sep 10 14:27:56.317605 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:56.317575    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz" event={"ID":"fc433b74-4586-4d99-a14e-c0a873db3b17","Type":"ContainerStarted","Data":"264a3afa93ae842e955ce3ec8c630ea1c4d616569099a43da80e02c878389c18"}
Sep 10 14:27:56.317712 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:56.317629    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz" event={"ID":"fc433b74-4586-4d99-a14e-c0a873db3b17","Type":"ContainerStarted","Data":"0b31eb3b94b7cfd86989844284a3e1e7afaa64c25aad9b0433a71be3edb1ed4e"}
Sep 10 14:27:56.317712 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:56.317659    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz"
Sep 10 14:27:56.333955 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:56.333906    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb" podStartSLOduration=1.333885925 podStartE2EDuration="1.333885925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:27:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:27:56.332992044 +0000 UTC m=+974.450533522" watchObservedRunningTime="2026-09-10 14:27:56.333885925 +0000 UTC m=+974.451427399"
Sep 10 14:27:56.365177 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:27:56.365110    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz" podStartSLOduration=1.365090667 podStartE2EDuration="1.365090667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:27:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:27:56.361946764 +0000 UTC m=+974.479488242" watchObservedRunningTime="2026-09-10 14:27:56.365090667 +0000 UTC m=+974.482632161"
Sep 10 14:28:07.326482 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:07.326444    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb"
Sep 10 14:28:07.326925 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:07.326551    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz"
Sep 10 14:28:15.442202 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:15.442167    2545 generic.go:356] "Generic (PLEG): container finished" podID="3f0b7b5d-1615-47c8-a387-c576a325e041" containerID="3d503604e688ae6fbf34212023b152a85389edc930cc3d78aa7651fb31478a88" exitCode=0
Sep 10 14:28:15.442650 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:15.442247    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b" event={"ID":"3f0b7b5d-1615-47c8-a387-c576a325e041","Type":"ContainerDied","Data":"3d503604e688ae6fbf34212023b152a85389edc930cc3d78aa7651fb31478a88"}
Sep 10 14:28:15.442724 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:15.442710    2545 scope.go:117] "RemoveContainer" containerID="3d503604e688ae6fbf34212023b152a85389edc930cc3d78aa7651fb31478a88"
Sep 10 14:28:15.443814 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:15.443781    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:28:15.443922 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:15.443850    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:28:15.443922 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:15.443881    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:28:16.472514 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:16.470959    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b" event={"ID":"3f0b7b5d-1615-47c8-a387-c576a325e041","Type":"ContainerStarted","Data":"1078f9a48bd3e5cbdf9977740f79598d6c1b24bae2cbcac7b33ed46a2df9ccca"}
Sep 10 14:28:16.931731 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:16.931693    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:28:16.931968 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:16.931944    2545 patch_prober.go:28] interesting pod/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 10 14:28:16.932016 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:16.931999    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b" podUID="3f0b7b5d-1615-47c8-a387-c576a325e041" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 10 14:28:17.931834 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:17.931796    2545 patch_prober.go:28] interesting pod/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 10 14:28:17.932199 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:17.931857    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b" podUID="3f0b7b5d-1615-47c8-a387-c576a325e041" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 10 14:28:18.931827 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:18.931791    2545 patch_prober.go:28] interesting pod/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 10 14:28:18.932014 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:18.931852    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b" podUID="3f0b7b5d-1615-47c8-a387-c576a325e041" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 10 14:28:19.304071 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:19.304038    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc61ae9e-6qpmw"]
Sep 10 14:28:19.306918 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:19.306900    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc61ae9e-6qpmw"
Sep 10 14:28:19.309916 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:19.309899    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pj254\""
Sep 10 14:28:19.309982 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:19.309899    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:28:19.317081 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:19.317056    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc61ae9e-6qpmw"]
Sep 10 14:28:19.472312 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:19.472270    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fde38e0e-4ac0-4780-8f7a-f673014f84d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc61ae9e-6qpmw\" (UID: \"fde38e0e-4ac0-4780-8f7a-f673014f84d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc61ae9e-6qpmw"
Sep 10 14:28:19.573177 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:19.573066    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fde38e0e-4ac0-4780-8f7a-f673014f84d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc61ae9e-6qpmw\" (UID: \"fde38e0e-4ac0-4780-8f7a-f673014f84d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc61ae9e-6qpmw"
Sep 10 14:28:19.573871 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:19.573846    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fde38e0e-4ac0-4780-8f7a-f673014f84d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc61ae9e-6qpmw\" (UID: \"fde38e0e-4ac0-4780-8f7a-f673014f84d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc61ae9e-6qpmw"
Sep 10 14:28:19.617951 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:19.617913    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc61ae9e-6qpmw"
Sep 10 14:28:19.910704 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:19.910670    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc61ae9e-6qpmw"]
Sep 10 14:28:19.911696 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:28:19.911671    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfde38e0e_4ac0_4780_8f7a_f673014f84d3.slice/crio-fcf62a27133f88e7c131601e12ff366717f3a22ab33dca47bf24053e251a85b4 WatchSource:0}: Error finding container fcf62a27133f88e7c131601e12ff366717f3a22ab33dca47bf24053e251a85b4: Status 404 returned error can't find the container with id fcf62a27133f88e7c131601e12ff366717f3a22ab33dca47bf24053e251a85b4
Sep 10 14:28:19.931411 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:19.931380    2545 patch_prober.go:28] interesting pod/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 10 14:28:19.931551 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:19.931436    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b" podUID="3f0b7b5d-1615-47c8-a387-c576a325e041" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 10 14:28:20.504517 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:20.504465    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc61ae9e-6qpmw" event={"ID":"fde38e0e-4ac0-4780-8f7a-f673014f84d3","Type":"ContainerStarted","Data":"6c7f91042f03bb4b18ea25166d70cf297efc1ccbd80156e9959db23598af13b0"}
Sep 10 14:28:20.504909 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:20.504558    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc61ae9e-6qpmw" event={"ID":"fde38e0e-4ac0-4780-8f7a-f673014f84d3","Type":"ContainerStarted","Data":"fcf62a27133f88e7c131601e12ff366717f3a22ab33dca47bf24053e251a85b4"}
Sep 10 14:28:20.522055 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:20.521998    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc61ae9e-6qpmw" podStartSLOduration=1.521981687 podStartE2EDuration="1.521981687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:28:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:28:20.518967207 +0000 UTC m=+998.636508681" watchObservedRunningTime="2026-09-10 14:28:20.521981687 +0000 UTC m=+998.639523163"
Sep 10 14:28:20.931756 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:20.931716    2545 patch_prober.go:28] interesting pod/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 10 14:28:20.931922 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:20.931783    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b" podUID="3f0b7b5d-1615-47c8-a387-c576a325e041" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 10 14:28:21.511773 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:21.511735    2545 generic.go:356] "Generic (PLEG): container finished" podID="fde38e0e-4ac0-4780-8f7a-f673014f84d3" containerID="6c7f91042f03bb4b18ea25166d70cf297efc1ccbd80156e9959db23598af13b0" exitCode=0
Sep 10 14:28:21.512127 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:21.511824    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc61ae9e-6qpmw" event={"ID":"fde38e0e-4ac0-4780-8f7a-f673014f84d3","Type":"ContainerDied","Data":"6c7f91042f03bb4b18ea25166d70cf297efc1ccbd80156e9959db23598af13b0"}
Sep 10 14:28:21.936283 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:21.936196    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:28:21.936630 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:21.936607    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:28:21.939994 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:21.939971    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:28:22.665194 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:22.665152    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc61ae9e-6qpmw"
Sep 10 14:28:22.704281 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:22.704248    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fde38e0e-4ac0-4780-8f7a-f673014f84d3-maas-api-service-ca\") pod \"fde38e0e-4ac0-4780-8f7a-f673014f84d3\" (UID: \"fde38e0e-4ac0-4780-8f7a-f673014f84d3\") "
Sep 10 14:28:22.704677 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:22.704655    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fde38e0e-4ac0-4780-8f7a-f673014f84d3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fde38e0e-4ac0-4780-8f7a-f673014f84d3" (UID: "fde38e0e-4ac0-4780-8f7a-f673014f84d3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:28:22.805341 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:22.805242    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fde38e0e-4ac0-4780-8f7a-f673014f84d3-maas-api-service-ca\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:28:23.525875 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:23.525846    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc61ae9e-6qpmw"
Sep 10 14:28:23.525875 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:23.525877    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc61ae9e-6qpmw" event={"ID":"fde38e0e-4ac0-4780-8f7a-f673014f84d3","Type":"ContainerDied","Data":"fcf62a27133f88e7c131601e12ff366717f3a22ab33dca47bf24053e251a85b4"}
Sep 10 14:28:23.526203 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:23.525932    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fcf62a27133f88e7c131601e12ff366717f3a22ab33dca47bf24053e251a85b4"
Sep 10 14:28:25.223942 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.223901    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz"]
Sep 10 14:28:25.224349 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.224223    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz" podUID="fc433b74-4586-4d99-a14e-c0a873db3b17" containerName="payload-processing" containerID="cri-o://264a3afa93ae842e955ce3ec8c630ea1c4d616569099a43da80e02c878389c18" gracePeriod=30
Sep 10 14:28:25.231365 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.231333    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb"]
Sep 10 14:28:25.231830 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.231781    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb" podUID="2e16c1d0-ea67-43fb-9f36-569307a8bdcb" containerName="payload-pre-processing" containerID="cri-o://84442a334856ecedfd3c5de7ba4c04e2cee51d2f1cd639086212999ef48b2fb5" gracePeriod=30
Sep 10 14:28:25.369420 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.369359    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc61ae9e-6qpmw"]
Sep 10 14:28:25.374174 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.374139    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc61ae9e-6qpmw"]
Sep 10 14:28:25.531187 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.531164    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz"
Sep 10 14:28:25.534385 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.534363    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb"
Sep 10 14:28:25.539115 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.539092    2545 generic.go:356] "Generic (PLEG): container finished" podID="2e16c1d0-ea67-43fb-9f36-569307a8bdcb" containerID="84442a334856ecedfd3c5de7ba4c04e2cee51d2f1cd639086212999ef48b2fb5" exitCode=0
Sep 10 14:28:25.539233 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.539126    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb"
Sep 10 14:28:25.539233 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.539182    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb" event={"ID":"2e16c1d0-ea67-43fb-9f36-569307a8bdcb","Type":"ContainerDied","Data":"84442a334856ecedfd3c5de7ba4c04e2cee51d2f1cd639086212999ef48b2fb5"}
Sep 10 14:28:25.539329 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.539241    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb" event={"ID":"2e16c1d0-ea67-43fb-9f36-569307a8bdcb","Type":"ContainerDied","Data":"34eed59695acd9e0497de836e1a7e39e306188036886260601ee2efc1e5e348e"}
Sep 10 14:28:25.539329 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.539273    2545 scope.go:117] "RemoveContainer" containerID="84442a334856ecedfd3c5de7ba4c04e2cee51d2f1cd639086212999ef48b2fb5"
Sep 10 14:28:25.540471 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.540453    2545 generic.go:356] "Generic (PLEG): container finished" podID="fc433b74-4586-4d99-a14e-c0a873db3b17" containerID="264a3afa93ae842e955ce3ec8c630ea1c4d616569099a43da80e02c878389c18" exitCode=0
Sep 10 14:28:25.540571 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.540528    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz"
Sep 10 14:28:25.540571 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.540551    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz" event={"ID":"fc433b74-4586-4d99-a14e-c0a873db3b17","Type":"ContainerDied","Data":"264a3afa93ae842e955ce3ec8c630ea1c4d616569099a43da80e02c878389c18"}
Sep 10 14:28:25.540689 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.540600    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz" event={"ID":"fc433b74-4586-4d99-a14e-c0a873db3b17","Type":"ContainerDied","Data":"0b31eb3b94b7cfd86989844284a3e1e7afaa64c25aad9b0433a71be3edb1ed4e"}
Sep 10 14:28:25.553453 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.553423    2545 scope.go:117] "RemoveContainer" containerID="84442a334856ecedfd3c5de7ba4c04e2cee51d2f1cd639086212999ef48b2fb5"
Sep 10 14:28:25.553910 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:28:25.553879    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84442a334856ecedfd3c5de7ba4c04e2cee51d2f1cd639086212999ef48b2fb5\": container with ID starting with 84442a334856ecedfd3c5de7ba4c04e2cee51d2f1cd639086212999ef48b2fb5 not found: ID does not exist" containerID="84442a334856ecedfd3c5de7ba4c04e2cee51d2f1cd639086212999ef48b2fb5"
Sep 10 14:28:25.554040 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.553919    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84442a334856ecedfd3c5de7ba4c04e2cee51d2f1cd639086212999ef48b2fb5"} err="failed to get container status \"84442a334856ecedfd3c5de7ba4c04e2cee51d2f1cd639086212999ef48b2fb5\": rpc error: code = NotFound desc = could not find container \"84442a334856ecedfd3c5de7ba4c04e2cee51d2f1cd639086212999ef48b2fb5\": container with ID starting with 84442a334856ecedfd3c5de7ba4c04e2cee51d2f1cd639086212999ef48b2fb5 not found: ID does not exist"
Sep 10 14:28:25.554040 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.553947    2545 scope.go:117] "RemoveContainer" containerID="264a3afa93ae842e955ce3ec8c630ea1c4d616569099a43da80e02c878389c18"
Sep 10 14:28:25.564832 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.564751    2545 scope.go:117] "RemoveContainer" containerID="264a3afa93ae842e955ce3ec8c630ea1c4d616569099a43da80e02c878389c18"
Sep 10 14:28:25.565401 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:28:25.565358    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"264a3afa93ae842e955ce3ec8c630ea1c4d616569099a43da80e02c878389c18\": container with ID starting with 264a3afa93ae842e955ce3ec8c630ea1c4d616569099a43da80e02c878389c18 not found: ID does not exist" containerID="264a3afa93ae842e955ce3ec8c630ea1c4d616569099a43da80e02c878389c18"
Sep 10 14:28:25.565481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.565400    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"264a3afa93ae842e955ce3ec8c630ea1c4d616569099a43da80e02c878389c18"} err="failed to get container status \"264a3afa93ae842e955ce3ec8c630ea1c4d616569099a43da80e02c878389c18\": rpc error: code = NotFound desc = could not find container \"264a3afa93ae842e955ce3ec8c630ea1c4d616569099a43da80e02c878389c18\": container with ID starting with 264a3afa93ae842e955ce3ec8c630ea1c4d616569099a43da80e02c878389c18 not found: ID does not exist"
Sep 10 14:28:25.635366 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.635321    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e16c1d0-ea67-43fb-9f36-569307a8bdcb-plugins-config-volume\") pod \"2e16c1d0-ea67-43fb-9f36-569307a8bdcb\" (UID: \"2e16c1d0-ea67-43fb-9f36-569307a8bdcb\") "
Sep 10 14:28:25.635586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.635435    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc433b74-4586-4d99-a14e-c0a873db3b17-plugins-config-volume\") pod \"fc433b74-4586-4d99-a14e-c0a873db3b17\" (UID: \"fc433b74-4586-4d99-a14e-c0a873db3b17\") "
Sep 10 14:28:25.635586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.635464    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtk4m\" (UniqueName: \"kubernetes.io/projected/2e16c1d0-ea67-43fb-9f36-569307a8bdcb-kube-api-access-wtk4m\") pod \"2e16c1d0-ea67-43fb-9f36-569307a8bdcb\" (UID: \"2e16c1d0-ea67-43fb-9f36-569307a8bdcb\") "
Sep 10 14:28:25.635586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.635484    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvrqg\" (UniqueName: \"kubernetes.io/projected/fc433b74-4586-4d99-a14e-c0a873db3b17-kube-api-access-bvrqg\") pod \"fc433b74-4586-4d99-a14e-c0a873db3b17\" (UID: \"fc433b74-4586-4d99-a14e-c0a873db3b17\") "
Sep 10 14:28:25.635797 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.635767    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e16c1d0-ea67-43fb-9f36-569307a8bdcb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2e16c1d0-ea67-43fb-9f36-569307a8bdcb" (UID: "2e16c1d0-ea67-43fb-9f36-569307a8bdcb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:28:25.635884 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.635861    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc433b74-4586-4d99-a14e-c0a873db3b17-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fc433b74-4586-4d99-a14e-c0a873db3b17" (UID: "fc433b74-4586-4d99-a14e-c0a873db3b17"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:28:25.635943 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.635927    2545 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e16c1d0-ea67-43fb-9f36-569307a8bdcb-plugins-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:28:25.637654 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.637631    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc433b74-4586-4d99-a14e-c0a873db3b17-kube-api-access-bvrqg" (OuterVolumeSpecName: "kube-api-access-bvrqg") pod "fc433b74-4586-4d99-a14e-c0a873db3b17" (UID: "fc433b74-4586-4d99-a14e-c0a873db3b17"). InnerVolumeSpecName "kube-api-access-bvrqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:28:25.637654 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.637647    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e16c1d0-ea67-43fb-9f36-569307a8bdcb-kube-api-access-wtk4m" (OuterVolumeSpecName: "kube-api-access-wtk4m") pod "2e16c1d0-ea67-43fb-9f36-569307a8bdcb" (UID: "2e16c1d0-ea67-43fb-9f36-569307a8bdcb"). InnerVolumeSpecName "kube-api-access-wtk4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:28:25.737416 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.737383    2545 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc433b74-4586-4d99-a14e-c0a873db3b17-plugins-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:28:25.737416 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.737413    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtk4m\" (UniqueName: \"kubernetes.io/projected/2e16c1d0-ea67-43fb-9f36-569307a8bdcb-kube-api-access-wtk4m\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:28:25.737416 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.737423    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvrqg\" (UniqueName: \"kubernetes.io/projected/fc433b74-4586-4d99-a14e-c0a873db3b17-kube-api-access-bvrqg\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:28:25.864159 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.864125    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb"]
Sep 10 14:28:25.867456 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.867431    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-fc61ae9e-675f8c676b-mcvlb"]
Sep 10 14:28:25.877780 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.877754    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz"]
Sep 10 14:28:25.880108 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:25.880084    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-fc61ae9e-55b469bb67-8bxkz"]
Sep 10 14:28:26.366686 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:26.366653    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e16c1d0-ea67-43fb-9f36-569307a8bdcb" path="/var/lib/kubelet/pods/2e16c1d0-ea67-43fb-9f36-569307a8bdcb/volumes"
Sep 10 14:28:26.367056 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:26.366998    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc433b74-4586-4d99-a14e-c0a873db3b17" path="/var/lib/kubelet/pods/fc433b74-4586-4d99-a14e-c0a873db3b17/volumes"
Sep 10 14:28:26.367281 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:26.367269    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fde38e0e-4ac0-4780-8f7a-f673014f84d3" path="/var/lib/kubelet/pods/fde38e0e-4ac0-4780-8f7a-f673014f84d3/volumes"
Sep 10 14:28:26.493468 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:26.493434    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"]
Sep 10 14:28:26.493690 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:26.493650    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b" podUID="3f0b7b5d-1615-47c8-a387-c576a325e041" containerName="istio-proxy" containerID="cri-o://1078f9a48bd3e5cbdf9977740f79598d6c1b24bae2cbcac7b33ed46a2df9ccca" gracePeriod=30
Sep 10 14:28:31.724276 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.724246    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht"]
Sep 10 14:28:31.724676 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.724663    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e16c1d0-ea67-43fb-9f36-569307a8bdcb" containerName="payload-pre-processing"
Sep 10 14:28:31.724723 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.724678    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e16c1d0-ea67-43fb-9f36-569307a8bdcb" containerName="payload-pre-processing"
Sep 10 14:28:31.724723 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.724688    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc433b74-4586-4d99-a14e-c0a873db3b17" containerName="payload-processing"
Sep 10 14:28:31.724723 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.724694    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc433b74-4586-4d99-a14e-c0a873db3b17" containerName="payload-processing"
Sep 10 14:28:31.724723 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.724705    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fde38e0e-4ac0-4780-8f7a-f673014f84d3" containerName="revoke-keys"
Sep 10 14:28:31.724723 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.724711    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="fde38e0e-4ac0-4780-8f7a-f673014f84d3" containerName="revoke-keys"
Sep 10 14:28:31.724880 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.724791    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc433b74-4586-4d99-a14e-c0a873db3b17" containerName="payload-processing"
Sep 10 14:28:31.724880 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.724799    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="fde38e0e-4ac0-4780-8f7a-f673014f84d3" containerName="revoke-keys"
Sep 10 14:28:31.724880 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.724806    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e16c1d0-ea67-43fb-9f36-569307a8bdcb" containerName="payload-pre-processing"
Sep 10 14:28:31.727078 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.727059    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht"
Sep 10 14:28:31.729727 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.729700    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-369894e2\""
Sep 10 14:28:31.729835 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.729806    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-369894e2-dockercfg-qmvrp\""
Sep 10 14:28:31.742283 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.742261    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:28:31.747640 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.747614    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht"]
Sep 10 14:28:31.763168 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.763099    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x"]
Sep 10 14:28:31.763529 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.763516    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f0b7b5d-1615-47c8-a387-c576a325e041" containerName="istio-proxy"
Sep 10 14:28:31.763583 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.763530    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f0b7b5d-1615-47c8-a387-c576a325e041" containerName="istio-proxy"
Sep 10 14:28:31.763583 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.763547    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f0b7b5d-1615-47c8-a387-c576a325e041" containerName="istio-proxy"
Sep 10 14:28:31.763583 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.763553    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f0b7b5d-1615-47c8-a387-c576a325e041" containerName="istio-proxy"
Sep 10 14:28:31.763677 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.763623    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f0b7b5d-1615-47c8-a387-c576a325e041" containerName="istio-proxy"
Sep 10 14:28:31.763677 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.763631    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f0b7b5d-1615-47c8-a387-c576a325e041" containerName="istio-proxy"
Sep 10 14:28:31.766081 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.766064    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x"
Sep 10 14:28:31.778142 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.778113    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x"]
Sep 10 14:28:31.803038 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.803008    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-istio-envoy\") pod \"3f0b7b5d-1615-47c8-a387-c576a325e041\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") "
Sep 10 14:28:31.803220 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.803049    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-workload-socket\") pod \"3f0b7b5d-1615-47c8-a387-c576a325e041\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") "
Sep 10 14:28:31.803220 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.803079    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f0b7b5d-1615-47c8-a387-c576a325e041-istiod-ca-cert\") pod \"3f0b7b5d-1615-47c8-a387-c576a325e041\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") "
Sep 10 14:28:31.803220 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.803131    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqd5v\" (UniqueName: \"kubernetes.io/projected/3f0b7b5d-1615-47c8-a387-c576a325e041-kube-api-access-nqd5v\") pod \"3f0b7b5d-1615-47c8-a387-c576a325e041\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") "
Sep 10 14:28:31.803220 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.803192    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-istio-data\") pod \"3f0b7b5d-1615-47c8-a387-c576a325e041\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") "
Sep 10 14:28:31.803504 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.803228    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f0b7b5d-1615-47c8-a387-c576a325e041-istio-podinfo\") pod \"3f0b7b5d-1615-47c8-a387-c576a325e041\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") "
Sep 10 14:28:31.803504 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.803251    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-credential-socket\") pod \"3f0b7b5d-1615-47c8-a387-c576a325e041\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") "
Sep 10 14:28:31.803504 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.803320    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-workload-certs\") pod \"3f0b7b5d-1615-47c8-a387-c576a325e041\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") "
Sep 10 14:28:31.803504 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.803349    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f0b7b5d-1615-47c8-a387-c576a325e041-istio-token\") pod \"3f0b7b5d-1615-47c8-a387-c576a325e041\" (UID: \"3f0b7b5d-1615-47c8-a387-c576a325e041\") "
Sep 10 14:28:31.803504 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.803404    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3f0b7b5d-1615-47c8-a387-c576a325e041" (UID: "3f0b7b5d-1615-47c8-a387-c576a325e041"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:28:31.803751 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.803581    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f861ece-2024-468e-9b54-d11347e18515-plugins-config-volume\") pod \"payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x\" (UID: \"6f861ece-2024-468e-9b54-d11347e18515\") " pod="openshift-ingress/payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x"
Sep 10 14:28:31.803751 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.803612    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-istio-data" (OuterVolumeSpecName: "istio-data") pod "3f0b7b5d-1615-47c8-a387-c576a325e041" (UID: "3f0b7b5d-1615-47c8-a387-c576a325e041"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:28:31.803751 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.803634    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7189dffa-2ccc-4866-b4ef-089d382f0387-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht\" (UID: \"7189dffa-2ccc-4866-b4ef-089d382f0387\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht"
Sep 10 14:28:31.803751 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.803643    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3f0b7b5d-1615-47c8-a387-c576a325e041" (UID: "3f0b7b5d-1615-47c8-a387-c576a325e041"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:28:31.803751 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.803662    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f0b7b5d-1615-47c8-a387-c576a325e041-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3f0b7b5d-1615-47c8-a387-c576a325e041" (UID: "3f0b7b5d-1615-47c8-a387-c576a325e041"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:28:31.804016 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.803755    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hql4r\" (UniqueName: \"kubernetes.io/projected/7189dffa-2ccc-4866-b4ef-089d382f0387-kube-api-access-hql4r\") pod \"payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht\" (UID: \"7189dffa-2ccc-4866-b4ef-089d382f0387\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht"
Sep 10 14:28:31.804016 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.803832    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4cqn\" (UniqueName: \"kubernetes.io/projected/6f861ece-2024-468e-9b54-d11347e18515-kube-api-access-p4cqn\") pod \"payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x\" (UID: \"6f861ece-2024-468e-9b54-d11347e18515\") " pod="openshift-ingress/payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x"
Sep 10 14:28:31.804016 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.803937    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-workload-socket\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:28:31.804016 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.803955    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f0b7b5d-1615-47c8-a387-c576a325e041-istiod-ca-cert\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:28:31.804016 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.803969    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-istio-data\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:28:31.804016 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.803977    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-workload-certs\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:28:31.804016 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.803997    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3f0b7b5d-1615-47c8-a387-c576a325e041" (UID: "3f0b7b5d-1615-47c8-a387-c576a325e041"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:28:31.805643 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.805620    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3f0b7b5d-1615-47c8-a387-c576a325e041-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3f0b7b5d-1615-47c8-a387-c576a325e041" (UID: "3f0b7b5d-1615-47c8-a387-c576a325e041"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:28:31.805643 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.805637    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3f0b7b5d-1615-47c8-a387-c576a325e041" (UID: "3f0b7b5d-1615-47c8-a387-c576a325e041"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:28:31.805919 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.805902    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f0b7b5d-1615-47c8-a387-c576a325e041-kube-api-access-nqd5v" (OuterVolumeSpecName: "kube-api-access-nqd5v") pod "3f0b7b5d-1615-47c8-a387-c576a325e041" (UID: "3f0b7b5d-1615-47c8-a387-c576a325e041"). InnerVolumeSpecName "kube-api-access-nqd5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:28:31.805962 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.805924    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f0b7b5d-1615-47c8-a387-c576a325e041-istio-token" (OuterVolumeSpecName: "istio-token") pod "3f0b7b5d-1615-47c8-a387-c576a325e041" (UID: "3f0b7b5d-1615-47c8-a387-c576a325e041"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:28:31.904726 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.904685    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f861ece-2024-468e-9b54-d11347e18515-plugins-config-volume\") pod \"payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x\" (UID: \"6f861ece-2024-468e-9b54-d11347e18515\") " pod="openshift-ingress/payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x"
Sep 10 14:28:31.904726 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.904732    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7189dffa-2ccc-4866-b4ef-089d382f0387-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht\" (UID: \"7189dffa-2ccc-4866-b4ef-089d382f0387\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht"
Sep 10 14:28:31.904980 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.904774    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hql4r\" (UniqueName: \"kubernetes.io/projected/7189dffa-2ccc-4866-b4ef-089d382f0387-kube-api-access-hql4r\") pod \"payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht\" (UID: \"7189dffa-2ccc-4866-b4ef-089d382f0387\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht"
Sep 10 14:28:31.904980 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.904814    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4cqn\" (UniqueName: \"kubernetes.io/projected/6f861ece-2024-468e-9b54-d11347e18515-kube-api-access-p4cqn\") pod \"payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x\" (UID: \"6f861ece-2024-468e-9b54-d11347e18515\") " pod="openshift-ingress/payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x"
Sep 10 14:28:31.904980 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.904859    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f0b7b5d-1615-47c8-a387-c576a325e041-istio-podinfo\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:28:31.904980 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.904875    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-credential-socket\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:28:31.904980 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.904888    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f0b7b5d-1615-47c8-a387-c576a325e041-istio-token\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:28:31.904980 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.904902    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f0b7b5d-1615-47c8-a387-c576a325e041-istio-envoy\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:28:31.904980 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.904916    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqd5v\" (UniqueName: \"kubernetes.io/projected/3f0b7b5d-1615-47c8-a387-c576a325e041-kube-api-access-nqd5v\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:28:31.905675 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.905649    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f861ece-2024-468e-9b54-d11347e18515-plugins-config-volume\") pod \"payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x\" (UID: \"6f861ece-2024-468e-9b54-d11347e18515\") " pod="openshift-ingress/payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x"
Sep 10 14:28:31.905723 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.905691    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7189dffa-2ccc-4866-b4ef-089d382f0387-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht\" (UID: \"7189dffa-2ccc-4866-b4ef-089d382f0387\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht"
Sep 10 14:28:31.915161 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.915126    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4cqn\" (UniqueName: \"kubernetes.io/projected/6f861ece-2024-468e-9b54-d11347e18515-kube-api-access-p4cqn\") pod \"payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x\" (UID: \"6f861ece-2024-468e-9b54-d11347e18515\") " pod="openshift-ingress/payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x"
Sep 10 14:28:31.915283 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:31.915129    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hql4r\" (UniqueName: \"kubernetes.io/projected/7189dffa-2ccc-4866-b4ef-089d382f0387-kube-api-access-hql4r\") pod \"payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht\" (UID: \"7189dffa-2ccc-4866-b4ef-089d382f0387\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht"
Sep 10 14:28:32.049788 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:32.049695    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht"
Sep 10 14:28:32.076234 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:32.076198    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x"
Sep 10 14:28:32.323844 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:32.323806    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht"]
Sep 10 14:28:32.325606 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:28:32.325580    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7189dffa_2ccc_4866_b4ef_089d382f0387.slice/crio-2e67dd0fe0633fb0330b348491cece505c7875640c5d87af0747bec730ad1077 WatchSource:0}: Error finding container 2e67dd0fe0633fb0330b348491cece505c7875640c5d87af0747bec730ad1077: Status 404 returned error can't find the container with id 2e67dd0fe0633fb0330b348491cece505c7875640c5d87af0747bec730ad1077
Sep 10 14:28:32.357200 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:32.357175    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x"]
Sep 10 14:28:32.359614 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:28:32.359577    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f861ece_2024_468e_9b54_d11347e18515.slice/crio-43099f6904b83db5facc6c74ac33db52bc5e36cdc899453dd133d5b6ee8524a2 WatchSource:0}: Error finding container 43099f6904b83db5facc6c74ac33db52bc5e36cdc899453dd133d5b6ee8524a2: Status 404 returned error can't find the container with id 43099f6904b83db5facc6c74ac33db52bc5e36cdc899453dd133d5b6ee8524a2
Sep 10 14:28:32.589635 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:32.589531    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x" event={"ID":"6f861ece-2024-468e-9b54-d11347e18515","Type":"ContainerStarted","Data":"89766b1ce064651c8b965b6cec526b962aa78310b8275cac9056ddb58879c803"}
Sep 10 14:28:32.589635 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:32.589606    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x"
Sep 10 14:28:32.589635 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:32.589631    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x" event={"ID":"6f861ece-2024-468e-9b54-d11347e18515","Type":"ContainerStarted","Data":"43099f6904b83db5facc6c74ac33db52bc5e36cdc899453dd133d5b6ee8524a2"}
Sep 10 14:28:32.591656 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:32.591624    2545 generic.go:356] "Generic (PLEG): container finished" podID="3f0b7b5d-1615-47c8-a387-c576a325e041" containerID="1078f9a48bd3e5cbdf9977740f79598d6c1b24bae2cbcac7b33ed46a2df9ccca" exitCode=0
Sep 10 14:28:32.591773 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:32.591664    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"
Sep 10 14:28:32.591773 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:32.591713    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b" event={"ID":"3f0b7b5d-1615-47c8-a387-c576a325e041","Type":"ContainerDied","Data":"1078f9a48bd3e5cbdf9977740f79598d6c1b24bae2cbcac7b33ed46a2df9ccca"}
Sep 10 14:28:32.591773 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:32.591764    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b" event={"ID":"3f0b7b5d-1615-47c8-a387-c576a325e041","Type":"ContainerDied","Data":"989b6dde04439b1a92536bc8b4e692ccaf35a5c3ff8f821952875b80e5a972d7"}
Sep 10 14:28:32.591917 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:32.591796    2545 scope.go:117] "RemoveContainer" containerID="1078f9a48bd3e5cbdf9977740f79598d6c1b24bae2cbcac7b33ed46a2df9ccca"
Sep 10 14:28:32.594670 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:32.594586    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht" event={"ID":"7189dffa-2ccc-4866-b4ef-089d382f0387","Type":"ContainerStarted","Data":"62723d1e7e02cfc4636eefe8a88f1a37b278e062f63f3b7dbfcc440c889a4263"}
Sep 10 14:28:32.594670 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:32.594633    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht" event={"ID":"7189dffa-2ccc-4866-b4ef-089d382f0387","Type":"ContainerStarted","Data":"2e67dd0fe0633fb0330b348491cece505c7875640c5d87af0747bec730ad1077"}
Sep 10 14:28:32.594843 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:32.594743    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht"
Sep 10 14:28:32.602591 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:32.602575    2545 scope.go:117] "RemoveContainer" containerID="3d503604e688ae6fbf34212023b152a85389edc930cc3d78aa7651fb31478a88"
Sep 10 14:28:32.606336 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:32.606298    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x" podStartSLOduration=1.6062846830000002 podStartE2EDuration="1.606284683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:28:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:28:32.605251891 +0000 UTC m=+1010.722793367" watchObservedRunningTime="2026-09-10 14:28:32.606284683 +0000 UTC m=+1010.723826158"
Sep 10 14:28:32.613425 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:32.613275    2545 scope.go:117] "RemoveContainer" containerID="1078f9a48bd3e5cbdf9977740f79598d6c1b24bae2cbcac7b33ed46a2df9ccca"
Sep 10 14:28:32.613621 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:28:32.613601    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1078f9a48bd3e5cbdf9977740f79598d6c1b24bae2cbcac7b33ed46a2df9ccca\": container with ID starting with 1078f9a48bd3e5cbdf9977740f79598d6c1b24bae2cbcac7b33ed46a2df9ccca not found: ID does not exist" containerID="1078f9a48bd3e5cbdf9977740f79598d6c1b24bae2cbcac7b33ed46a2df9ccca"
Sep 10 14:28:32.613674 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:32.613629    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1078f9a48bd3e5cbdf9977740f79598d6c1b24bae2cbcac7b33ed46a2df9ccca"} err="failed to get container status \"1078f9a48bd3e5cbdf9977740f79598d6c1b24bae2cbcac7b33ed46a2df9ccca\": rpc error: code = NotFound desc = could not find container \"1078f9a48bd3e5cbdf9977740f79598d6c1b24bae2cbcac7b33ed46a2df9ccca\": container with ID starting with 1078f9a48bd3e5cbdf9977740f79598d6c1b24bae2cbcac7b33ed46a2df9ccca not found: ID does not exist"
Sep 10 14:28:32.613674 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:32.613648    2545 scope.go:117] "RemoveContainer" containerID="3d503604e688ae6fbf34212023b152a85389edc930cc3d78aa7651fb31478a88"
Sep 10 14:28:32.613931 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:28:32.613910    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d503604e688ae6fbf34212023b152a85389edc930cc3d78aa7651fb31478a88\": container with ID starting with 3d503604e688ae6fbf34212023b152a85389edc930cc3d78aa7651fb31478a88 not found: ID does not exist" containerID="3d503604e688ae6fbf34212023b152a85389edc930cc3d78aa7651fb31478a88"
Sep 10 14:28:32.613973 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:32.613938    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d503604e688ae6fbf34212023b152a85389edc930cc3d78aa7651fb31478a88"} err="failed to get container status \"3d503604e688ae6fbf34212023b152a85389edc930cc3d78aa7651fb31478a88\": rpc error: code = NotFound desc = could not find container \"3d503604e688ae6fbf34212023b152a85389edc930cc3d78aa7651fb31478a88\": container with ID starting with 3d503604e688ae6fbf34212023b152a85389edc930cc3d78aa7651fb31478a88 not found: ID does not exist"
Sep 10 14:28:32.625806 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:32.625743    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht" podStartSLOduration=1.625722949 podStartE2EDuration="1.625722949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:28:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:28:32.621235636 +0000 UTC m=+1010.738777114" watchObservedRunningTime="2026-09-10 14:28:32.625722949 +0000 UTC m=+1010.743264424"
Sep 10 14:28:32.637098 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:32.637067    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"]
Sep 10 14:28:32.641118 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:32.641090    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-fc61ae9e-openshift-default-66f79bd64-pwb6b"]
Sep 10 14:28:34.366316 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:34.366284    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f0b7b5d-1615-47c8-a387-c576a325e041" path="/var/lib/kubelet/pods/3f0b7b5d-1615-47c8-a387-c576a325e041/volumes"
Sep 10 14:28:43.603814 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:43.603781    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x"
Sep 10 14:28:43.604321 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:43.603862    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht"
Sep 10 14:28:54.834715 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:54.834678    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-369894e2-c7lzm"]
Sep 10 14:28:54.846222 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:54.846191    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-369894e2-c7lzm"
Sep 10 14:28:54.847831 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:54.847777    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-369894e2-c7lzm"]
Sep 10 14:28:54.848970 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:54.848944    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:28:54.849094 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:54.848970    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pj254\""
Sep 10 14:28:54.943304 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:54.943270    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8256db28-c265-4b24-bd26-76807b8892f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-369894e2-c7lzm\" (UID: \"8256db28-c265-4b24-bd26-76807b8892f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-369894e2-c7lzm"
Sep 10 14:28:55.043944 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:55.043912    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8256db28-c265-4b24-bd26-76807b8892f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-369894e2-c7lzm\" (UID: \"8256db28-c265-4b24-bd26-76807b8892f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-369894e2-c7lzm"
Sep 10 14:28:55.044498 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:55.044468    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8256db28-c265-4b24-bd26-76807b8892f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-369894e2-c7lzm\" (UID: \"8256db28-c265-4b24-bd26-76807b8892f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-369894e2-c7lzm"
Sep 10 14:28:55.158016 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:55.157932    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-369894e2-c7lzm"
Sep 10 14:28:55.433122 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:55.433094    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-369894e2-c7lzm"]
Sep 10 14:28:55.434245 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:28:55.434213    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8256db28_c265_4b24_bd26_76807b8892f2.slice/crio-e93c454e23e81d007d264219a738a70fcbc573e0776c9b4d772f3c91fdaf0855 WatchSource:0}: Error finding container e93c454e23e81d007d264219a738a70fcbc573e0776c9b4d772f3c91fdaf0855: Status 404 returned error can't find the container with id e93c454e23e81d007d264219a738a70fcbc573e0776c9b4d772f3c91fdaf0855
Sep 10 14:28:55.737533 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:55.737472    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-369894e2-c7lzm" event={"ID":"8256db28-c265-4b24-bd26-76807b8892f2","Type":"ContainerStarted","Data":"e93c454e23e81d007d264219a738a70fcbc573e0776c9b4d772f3c91fdaf0855"}
Sep 10 14:28:56.745290 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:56.745254    2545 generic.go:356] "Generic (PLEG): container finished" podID="8256db28-c265-4b24-bd26-76807b8892f2" containerID="86e2a18acdcd88902a55070116cd3cc93d8fefceed7f5b0717ce31ff9e54a1ba" exitCode=0
Sep 10 14:28:56.745765 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:56.745341    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-369894e2-c7lzm" event={"ID":"8256db28-c265-4b24-bd26-76807b8892f2","Type":"ContainerDied","Data":"86e2a18acdcd88902a55070116cd3cc93d8fefceed7f5b0717ce31ff9e54a1ba"}
Sep 10 14:28:57.901235 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:57.901212    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-369894e2-c7lzm"
Sep 10 14:28:57.975457 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:57.975424    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8256db28-c265-4b24-bd26-76807b8892f2-maas-api-service-ca\") pod \"8256db28-c265-4b24-bd26-76807b8892f2\" (UID: \"8256db28-c265-4b24-bd26-76807b8892f2\") "
Sep 10 14:28:57.975865 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:57.975835    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8256db28-c265-4b24-bd26-76807b8892f2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8256db28-c265-4b24-bd26-76807b8892f2" (UID: "8256db28-c265-4b24-bd26-76807b8892f2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:28:58.077209 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:58.077127    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8256db28-c265-4b24-bd26-76807b8892f2-maas-api-service-ca\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:28:58.757640 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:58.757610    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-369894e2-c7lzm"
Sep 10 14:28:58.757811 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:58.757618    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-369894e2-c7lzm" event={"ID":"8256db28-c265-4b24-bd26-76807b8892f2","Type":"ContainerDied","Data":"e93c454e23e81d007d264219a738a70fcbc573e0776c9b4d772f3c91fdaf0855"}
Sep 10 14:28:58.757811 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:28:58.757738    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e93c454e23e81d007d264219a738a70fcbc573e0776c9b4d772f3c91fdaf0855"
Sep 10 14:29:01.640975 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:01.640944    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x"]
Sep 10 14:29:01.641389 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:01.641155    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x" podUID="6f861ece-2024-468e-9b54-d11347e18515" containerName="payload-processing" containerID="cri-o://89766b1ce064651c8b965b6cec526b962aa78310b8275cac9056ddb58879c803" gracePeriod=30
Sep 10 14:29:01.653019 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:01.652981    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht"]
Sep 10 14:29:01.653429 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:01.653401    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht" podUID="7189dffa-2ccc-4866-b4ef-089d382f0387" containerName="payload-pre-processing" containerID="cri-o://62723d1e7e02cfc4636eefe8a88f1a37b278e062f63f3b7dbfcc440c889a4263" gracePeriod=30
Sep 10 14:29:01.777762 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:01.777729    2545 generic.go:356] "Generic (PLEG): container finished" podID="7189dffa-2ccc-4866-b4ef-089d382f0387" containerID="62723d1e7e02cfc4636eefe8a88f1a37b278e062f63f3b7dbfcc440c889a4263" exitCode=0
Sep 10 14:29:01.777915 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:01.777755    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht" event={"ID":"7189dffa-2ccc-4866-b4ef-089d382f0387","Type":"ContainerDied","Data":"62723d1e7e02cfc4636eefe8a88f1a37b278e062f63f3b7dbfcc440c889a4263"}
Sep 10 14:29:01.780105 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:01.780033    2545 generic.go:356] "Generic (PLEG): container finished" podID="6f861ece-2024-468e-9b54-d11347e18515" containerID="89766b1ce064651c8b965b6cec526b962aa78310b8275cac9056ddb58879c803" exitCode=0
Sep 10 14:29:01.780287 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:01.780254    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x" event={"ID":"6f861ece-2024-468e-9b54-d11347e18515","Type":"ContainerDied","Data":"89766b1ce064651c8b965b6cec526b962aa78310b8275cac9056ddb58879c803"}
Sep 10 14:29:01.782929 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:01.782894    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-369894e2-c7lzm"]
Sep 10 14:29:01.785533 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:01.785511    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-369894e2-c7lzm"]
Sep 10 14:29:01.940901 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:01.940877    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x"
Sep 10 14:29:01.961899 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:01.961873    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht"
Sep 10 14:29:02.017743 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:02.016855    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7189dffa-2ccc-4866-b4ef-089d382f0387-plugins-config-volume\") pod \"7189dffa-2ccc-4866-b4ef-089d382f0387\" (UID: \"7189dffa-2ccc-4866-b4ef-089d382f0387\") "
Sep 10 14:29:02.017743 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:02.016948    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4cqn\" (UniqueName: \"kubernetes.io/projected/6f861ece-2024-468e-9b54-d11347e18515-kube-api-access-p4cqn\") pod \"6f861ece-2024-468e-9b54-d11347e18515\" (UID: \"6f861ece-2024-468e-9b54-d11347e18515\") "
Sep 10 14:29:02.017743 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:02.016990    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hql4r\" (UniqueName: \"kubernetes.io/projected/7189dffa-2ccc-4866-b4ef-089d382f0387-kube-api-access-hql4r\") pod \"7189dffa-2ccc-4866-b4ef-089d382f0387\" (UID: \"7189dffa-2ccc-4866-b4ef-089d382f0387\") "
Sep 10 14:29:02.017743 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:02.017085    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f861ece-2024-468e-9b54-d11347e18515-plugins-config-volume\") pod \"6f861ece-2024-468e-9b54-d11347e18515\" (UID: \"6f861ece-2024-468e-9b54-d11347e18515\") "
Sep 10 14:29:02.017743 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:02.017391    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7189dffa-2ccc-4866-b4ef-089d382f0387-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7189dffa-2ccc-4866-b4ef-089d382f0387" (UID: "7189dffa-2ccc-4866-b4ef-089d382f0387"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:29:02.018968 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:02.018349    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f861ece-2024-468e-9b54-d11347e18515-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6f861ece-2024-468e-9b54-d11347e18515" (UID: "6f861ece-2024-468e-9b54-d11347e18515"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:29:02.021106 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:02.021064    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7189dffa-2ccc-4866-b4ef-089d382f0387-kube-api-access-hql4r" (OuterVolumeSpecName: "kube-api-access-hql4r") pod "7189dffa-2ccc-4866-b4ef-089d382f0387" (UID: "7189dffa-2ccc-4866-b4ef-089d382f0387"). InnerVolumeSpecName "kube-api-access-hql4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:29:02.021958 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:02.021931    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f861ece-2024-468e-9b54-d11347e18515-kube-api-access-p4cqn" (OuterVolumeSpecName: "kube-api-access-p4cqn") pod "6f861ece-2024-468e-9b54-d11347e18515" (UID: "6f861ece-2024-468e-9b54-d11347e18515"). InnerVolumeSpecName "kube-api-access-p4cqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:29:02.118597 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:02.118557    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4cqn\" (UniqueName: \"kubernetes.io/projected/6f861ece-2024-468e-9b54-d11347e18515-kube-api-access-p4cqn\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:29:02.118597 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:02.118592    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hql4r\" (UniqueName: \"kubernetes.io/projected/7189dffa-2ccc-4866-b4ef-089d382f0387-kube-api-access-hql4r\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:29:02.118796 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:02.118607    2545 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f861ece-2024-468e-9b54-d11347e18515-plugins-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:29:02.118796 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:02.118619    2545 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7189dffa-2ccc-4866-b4ef-089d382f0387-plugins-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:29:02.367380 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:02.367347    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8256db28-c265-4b24-bd26-76807b8892f2" path="/var/lib/kubelet/pods/8256db28-c265-4b24-bd26-76807b8892f2/volumes"
Sep 10 14:29:02.788244 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:02.788213    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht"
Sep 10 14:29:02.788673 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:02.788258    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht" event={"ID":"7189dffa-2ccc-4866-b4ef-089d382f0387","Type":"ContainerDied","Data":"2e67dd0fe0633fb0330b348491cece505c7875640c5d87af0747bec730ad1077"}
Sep 10 14:29:02.788673 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:02.788322    2545 scope.go:117] "RemoveContainer" containerID="62723d1e7e02cfc4636eefe8a88f1a37b278e062f63f3b7dbfcc440c889a4263"
Sep 10 14:29:02.789803 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:02.789787    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x"
Sep 10 14:29:02.789896 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:02.789786    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x" event={"ID":"6f861ece-2024-468e-9b54-d11347e18515","Type":"ContainerDied","Data":"43099f6904b83db5facc6c74ac33db52bc5e36cdc899453dd133d5b6ee8524a2"}
Sep 10 14:29:02.797694 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:02.797676    2545 scope.go:117] "RemoveContainer" containerID="89766b1ce064651c8b965b6cec526b962aa78310b8275cac9056ddb58879c803"
Sep 10 14:29:02.807420 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:02.807402    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x"]
Sep 10 14:29:02.810692 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:02.810665    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-369894e2-5bcc4c99bf-ks46x"]
Sep 10 14:29:02.822568 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:02.822541    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht"]
Sep 10 14:29:02.828466 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:02.828444    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-369894e2-867756bf8b-xr8ht"]
Sep 10 14:29:04.243806 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:04.243770    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44e3af-nhldk"]
Sep 10 14:29:04.244211 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:04.244197    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8256db28-c265-4b24-bd26-76807b8892f2" containerName="revoke-keys"
Sep 10 14:29:04.244211 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:04.244211    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="8256db28-c265-4b24-bd26-76807b8892f2" containerName="revoke-keys"
Sep 10 14:29:04.244287 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:04.244226    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7189dffa-2ccc-4866-b4ef-089d382f0387" containerName="payload-pre-processing"
Sep 10 14:29:04.244287 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:04.244232    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="7189dffa-2ccc-4866-b4ef-089d382f0387" containerName="payload-pre-processing"
Sep 10 14:29:04.244287 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:04.244246    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f861ece-2024-468e-9b54-d11347e18515" containerName="payload-processing"
Sep 10 14:29:04.244287 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:04.244252    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f861ece-2024-468e-9b54-d11347e18515" containerName="payload-processing"
Sep 10 14:29:04.244412 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:04.244307    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="8256db28-c265-4b24-bd26-76807b8892f2" containerName="revoke-keys"
Sep 10 14:29:04.244412 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:04.244315    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="7189dffa-2ccc-4866-b4ef-089d382f0387" containerName="payload-pre-processing"
Sep 10 14:29:04.244412 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:04.244320    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f861ece-2024-468e-9b54-d11347e18515" containerName="payload-processing"
Sep 10 14:29:04.249059 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:04.249042    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44e3af-nhldk"
Sep 10 14:29:04.252010 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:04.251964    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:29:04.252010 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:04.251975    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pj254\""
Sep 10 14:29:04.256929 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:04.256764    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44e3af-nhldk"]
Sep 10 14:29:04.339357 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:04.339328    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/979aa62c-ae9c-4da3-aabc-f2f950d5bb59-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-44e3af-nhldk\" (UID: \"979aa62c-ae9c-4da3-aabc-f2f950d5bb59\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44e3af-nhldk"
Sep 10 14:29:04.365889 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:04.365858    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f861ece-2024-468e-9b54-d11347e18515" path="/var/lib/kubelet/pods/6f861ece-2024-468e-9b54-d11347e18515/volumes"
Sep 10 14:29:04.366241 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:04.366219    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7189dffa-2ccc-4866-b4ef-089d382f0387" path="/var/lib/kubelet/pods/7189dffa-2ccc-4866-b4ef-089d382f0387/volumes"
Sep 10 14:29:04.440423 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:04.440379    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/979aa62c-ae9c-4da3-aabc-f2f950d5bb59-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-44e3af-nhldk\" (UID: \"979aa62c-ae9c-4da3-aabc-f2f950d5bb59\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44e3af-nhldk"
Sep 10 14:29:04.440956 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:04.440935    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/979aa62c-ae9c-4da3-aabc-f2f950d5bb59-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-44e3af-nhldk\" (UID: \"979aa62c-ae9c-4da3-aabc-f2f950d5bb59\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44e3af-nhldk"
Sep 10 14:29:04.561271 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:04.561193    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44e3af-nhldk"
Sep 10 14:29:04.836649 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:04.836618    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44e3af-nhldk"]
Sep 10 14:29:04.837852 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:29:04.837823    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod979aa62c_ae9c_4da3_aabc_f2f950d5bb59.slice/crio-4c7d79155986ec6cc0ef342f66b72085b3d7f966c4f5a232b1d3f81cc38cb06f WatchSource:0}: Error finding container 4c7d79155986ec6cc0ef342f66b72085b3d7f966c4f5a232b1d3f81cc38cb06f: Status 404 returned error can't find the container with id 4c7d79155986ec6cc0ef342f66b72085b3d7f966c4f5a232b1d3f81cc38cb06f
Sep 10 14:29:05.810741 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:05.810707    2545 generic.go:356] "Generic (PLEG): container finished" podID="979aa62c-ae9c-4da3-aabc-f2f950d5bb59" containerID="a2c58e19cfb4dc172d6ca11411379135c00a4058f48bae87555d55957eb5a5d8" exitCode=0
Sep 10 14:29:05.811121 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:05.810785    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44e3af-nhldk" event={"ID":"979aa62c-ae9c-4da3-aabc-f2f950d5bb59","Type":"ContainerDied","Data":"a2c58e19cfb4dc172d6ca11411379135c00a4058f48bae87555d55957eb5a5d8"}
Sep 10 14:29:05.811121 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:05.810834    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44e3af-nhldk" event={"ID":"979aa62c-ae9c-4da3-aabc-f2f950d5bb59","Type":"ContainerStarted","Data":"4c7d79155986ec6cc0ef342f66b72085b3d7f966c4f5a232b1d3f81cc38cb06f"}
Sep 10 14:29:06.952066 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:06.952041    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44e3af-nhldk"
Sep 10 14:29:07.067814 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:07.067724    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/979aa62c-ae9c-4da3-aabc-f2f950d5bb59-maas-api-service-ca\") pod \"979aa62c-ae9c-4da3-aabc-f2f950d5bb59\" (UID: \"979aa62c-ae9c-4da3-aabc-f2f950d5bb59\") "
Sep 10 14:29:07.068132 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:07.068112    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/979aa62c-ae9c-4da3-aabc-f2f950d5bb59-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "979aa62c-ae9c-4da3-aabc-f2f950d5bb59" (UID: "979aa62c-ae9c-4da3-aabc-f2f950d5bb59"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:29:07.169295 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:07.169261    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/979aa62c-ae9c-4da3-aabc-f2f950d5bb59-maas-api-service-ca\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:29:07.832728 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:07.832686    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44e3af-nhldk"
Sep 10 14:29:07.832728 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:07.832713    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44e3af-nhldk" event={"ID":"979aa62c-ae9c-4da3-aabc-f2f950d5bb59","Type":"ContainerDied","Data":"4c7d79155986ec6cc0ef342f66b72085b3d7f966c4f5a232b1d3f81cc38cb06f"}
Sep 10 14:29:07.832960 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:07.832798    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c7d79155986ec6cc0ef342f66b72085b3d7f966c4f5a232b1d3f81cc38cb06f"
Sep 10 14:29:14.769993 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:14.769961    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22"]
Sep 10 14:29:14.770468 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:14.770224    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22" podUID="50a78ae3-bad8-4318-84a8-06fa6154db9b" containerName="payload-pre-processing" containerID="cri-o://3eb4ad24e369c26a6842a61ad0f3f7d6335592731a57661894ceaa5f97197023" gracePeriod=30
Sep 10 14:29:14.899673 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:14.899641    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44e3af-nhldk"]
Sep 10 14:29:14.904233 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:14.904196    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-44e3af-nhldk"]
Sep 10 14:29:15.045899 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:15.045869    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22"
Sep 10 14:29:15.141675 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:15.141628    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5mrs\" (UniqueName: \"kubernetes.io/projected/50a78ae3-bad8-4318-84a8-06fa6154db9b-kube-api-access-g5mrs\") pod \"50a78ae3-bad8-4318-84a8-06fa6154db9b\" (UID: \"50a78ae3-bad8-4318-84a8-06fa6154db9b\") "
Sep 10 14:29:15.141856 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:15.141705    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50a78ae3-bad8-4318-84a8-06fa6154db9b-plugins-config-volume\") pod \"50a78ae3-bad8-4318-84a8-06fa6154db9b\" (UID: \"50a78ae3-bad8-4318-84a8-06fa6154db9b\") "
Sep 10 14:29:15.142616 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:15.142587    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50a78ae3-bad8-4318-84a8-06fa6154db9b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "50a78ae3-bad8-4318-84a8-06fa6154db9b" (UID: "50a78ae3-bad8-4318-84a8-06fa6154db9b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:29:15.144090 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:15.144069    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50a78ae3-bad8-4318-84a8-06fa6154db9b-kube-api-access-g5mrs" (OuterVolumeSpecName: "kube-api-access-g5mrs") pod "50a78ae3-bad8-4318-84a8-06fa6154db9b" (UID: "50a78ae3-bad8-4318-84a8-06fa6154db9b"). InnerVolumeSpecName "kube-api-access-g5mrs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:29:15.242560 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:15.242524    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5mrs\" (UniqueName: \"kubernetes.io/projected/50a78ae3-bad8-4318-84a8-06fa6154db9b-kube-api-access-g5mrs\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:29:15.242560 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:15.242557    2545 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50a78ae3-bad8-4318-84a8-06fa6154db9b-plugins-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:29:15.885444 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:15.885410    2545 generic.go:356] "Generic (PLEG): container finished" podID="50a78ae3-bad8-4318-84a8-06fa6154db9b" containerID="3eb4ad24e369c26a6842a61ad0f3f7d6335592731a57661894ceaa5f97197023" exitCode=0
Sep 10 14:29:15.885834 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:15.885456    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22"
Sep 10 14:29:15.885834 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:15.885522    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22" event={"ID":"50a78ae3-bad8-4318-84a8-06fa6154db9b","Type":"ContainerDied","Data":"3eb4ad24e369c26a6842a61ad0f3f7d6335592731a57661894ceaa5f97197023"}
Sep 10 14:29:15.885834 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:15.885575    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22" event={"ID":"50a78ae3-bad8-4318-84a8-06fa6154db9b","Type":"ContainerDied","Data":"93768e69e62cdab442405c40931626258daec1f01bb326558752809ea5b8a2be"}
Sep 10 14:29:15.885834 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:15.885599    2545 scope.go:117] "RemoveContainer" containerID="3eb4ad24e369c26a6842a61ad0f3f7d6335592731a57661894ceaa5f97197023"
Sep 10 14:29:15.895638 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:15.895623    2545 scope.go:117] "RemoveContainer" containerID="3eb4ad24e369c26a6842a61ad0f3f7d6335592731a57661894ceaa5f97197023"
Sep 10 14:29:15.895926 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:29:15.895908    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3eb4ad24e369c26a6842a61ad0f3f7d6335592731a57661894ceaa5f97197023\": container with ID starting with 3eb4ad24e369c26a6842a61ad0f3f7d6335592731a57661894ceaa5f97197023 not found: ID does not exist" containerID="3eb4ad24e369c26a6842a61ad0f3f7d6335592731a57661894ceaa5f97197023"
Sep 10 14:29:15.895982 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:15.895935    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eb4ad24e369c26a6842a61ad0f3f7d6335592731a57661894ceaa5f97197023"} err="failed to get container status \"3eb4ad24e369c26a6842a61ad0f3f7d6335592731a57661894ceaa5f97197023\": rpc error: code = NotFound desc = could not find container \"3eb4ad24e369c26a6842a61ad0f3f7d6335592731a57661894ceaa5f97197023\": container with ID starting with 3eb4ad24e369c26a6842a61ad0f3f7d6335592731a57661894ceaa5f97197023 not found: ID does not exist"
Sep 10 14:29:15.908307 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:15.908280    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22"]
Sep 10 14:29:15.910667 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:15.910648    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-44e3af-79b545f45d-r8h22"]
Sep 10 14:29:16.367420 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:16.367384    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50a78ae3-bad8-4318-84a8-06fa6154db9b" path="/var/lib/kubelet/pods/50a78ae3-bad8-4318-84a8-06fa6154db9b/volumes"
Sep 10 14:29:16.367756 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:16.367742    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="979aa62c-ae9c-4da3-aabc-f2f950d5bb59" path="/var/lib/kubelet/pods/979aa62c-ae9c-4da3-aabc-f2f950d5bb59/volumes"
Sep 10 14:29:26.711483 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:26.711446    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf"]
Sep 10 14:29:26.711881 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:26.711847    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="979aa62c-ae9c-4da3-aabc-f2f950d5bb59" containerName="revoke-keys"
Sep 10 14:29:26.711881 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:26.711859    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="979aa62c-ae9c-4da3-aabc-f2f950d5bb59" containerName="revoke-keys"
Sep 10 14:29:26.711881 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:26.711875    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50a78ae3-bad8-4318-84a8-06fa6154db9b" containerName="payload-pre-processing"
Sep 10 14:29:26.711881 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:26.711882    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="50a78ae3-bad8-4318-84a8-06fa6154db9b" containerName="payload-pre-processing"
Sep 10 14:29:26.712011 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:26.711948    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="50a78ae3-bad8-4318-84a8-06fa6154db9b" containerName="payload-pre-processing"
Sep 10 14:29:26.712011 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:26.711955    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="979aa62c-ae9c-4da3-aabc-f2f950d5bb59" containerName="revoke-keys"
Sep 10 14:29:26.716283 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:26.716265    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf"
Sep 10 14:29:26.719068 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:26.719050    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-ba183c-dockercfg-6tvqg\""
Sep 10 14:29:26.719278 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:26.719263    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-ba183c\""
Sep 10 14:29:26.732025 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:26.732004    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf"]
Sep 10 14:29:26.739346 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:26.739326    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-ba183c-657c59d649-lq27q"]
Sep 10 14:29:26.742704 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:26.742687    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-ba183c-657c59d649-lq27q"
Sep 10 14:29:26.756747 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:26.756727    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-ba183c-657c59d649-lq27q"]
Sep 10 14:29:26.852925 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:26.852885    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab3b0c3b-7db0-4d32-b97c-f0594ab010be-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf\" (UID: \"ab3b0c3b-7db0-4d32-b97c-f0594ab010be\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf"
Sep 10 14:29:26.853118 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:26.853031    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpknf\" (UniqueName: \"kubernetes.io/projected/ab3b0c3b-7db0-4d32-b97c-f0594ab010be-kube-api-access-lpknf\") pod \"payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf\" (UID: \"ab3b0c3b-7db0-4d32-b97c-f0594ab010be\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf"
Sep 10 14:29:26.853118 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:26.853065    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl9qv\" (UniqueName: \"kubernetes.io/projected/c82f77e5-71f4-4820-8d8f-860103e499bf-kube-api-access-fl9qv\") pod \"payload-processing-e2e-explicit-ba183c-657c59d649-lq27q\" (UID: \"c82f77e5-71f4-4820-8d8f-860103e499bf\") " pod="openshift-ingress/payload-processing-e2e-explicit-ba183c-657c59d649-lq27q"
Sep 10 14:29:26.853118 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:26.853093    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c82f77e5-71f4-4820-8d8f-860103e499bf-plugins-config-volume\") pod \"payload-processing-e2e-explicit-ba183c-657c59d649-lq27q\" (UID: \"c82f77e5-71f4-4820-8d8f-860103e499bf\") " pod="openshift-ingress/payload-processing-e2e-explicit-ba183c-657c59d649-lq27q"
Sep 10 14:29:26.954602 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:26.954574    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpknf\" (UniqueName: \"kubernetes.io/projected/ab3b0c3b-7db0-4d32-b97c-f0594ab010be-kube-api-access-lpknf\") pod \"payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf\" (UID: \"ab3b0c3b-7db0-4d32-b97c-f0594ab010be\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf"
Sep 10 14:29:26.954602 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:26.954609    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl9qv\" (UniqueName: \"kubernetes.io/projected/c82f77e5-71f4-4820-8d8f-860103e499bf-kube-api-access-fl9qv\") pod \"payload-processing-e2e-explicit-ba183c-657c59d649-lq27q\" (UID: \"c82f77e5-71f4-4820-8d8f-860103e499bf\") " pod="openshift-ingress/payload-processing-e2e-explicit-ba183c-657c59d649-lq27q"
Sep 10 14:29:26.954845 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:26.954627    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c82f77e5-71f4-4820-8d8f-860103e499bf-plugins-config-volume\") pod \"payload-processing-e2e-explicit-ba183c-657c59d649-lq27q\" (UID: \"c82f77e5-71f4-4820-8d8f-860103e499bf\") " pod="openshift-ingress/payload-processing-e2e-explicit-ba183c-657c59d649-lq27q"
Sep 10 14:29:26.954845 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:26.954669    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab3b0c3b-7db0-4d32-b97c-f0594ab010be-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf\" (UID: \"ab3b0c3b-7db0-4d32-b97c-f0594ab010be\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf"
Sep 10 14:29:26.955324 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:26.955302    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab3b0c3b-7db0-4d32-b97c-f0594ab010be-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf\" (UID: \"ab3b0c3b-7db0-4d32-b97c-f0594ab010be\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf"
Sep 10 14:29:26.955420 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:26.955362    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c82f77e5-71f4-4820-8d8f-860103e499bf-plugins-config-volume\") pod \"payload-processing-e2e-explicit-ba183c-657c59d649-lq27q\" (UID: \"c82f77e5-71f4-4820-8d8f-860103e499bf\") " pod="openshift-ingress/payload-processing-e2e-explicit-ba183c-657c59d649-lq27q"
Sep 10 14:29:26.962323 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:26.962268    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl9qv\" (UniqueName: \"kubernetes.io/projected/c82f77e5-71f4-4820-8d8f-860103e499bf-kube-api-access-fl9qv\") pod \"payload-processing-e2e-explicit-ba183c-657c59d649-lq27q\" (UID: \"c82f77e5-71f4-4820-8d8f-860103e499bf\") " pod="openshift-ingress/payload-processing-e2e-explicit-ba183c-657c59d649-lq27q"
Sep 10 14:29:26.962731 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:26.962715    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpknf\" (UniqueName: \"kubernetes.io/projected/ab3b0c3b-7db0-4d32-b97c-f0594ab010be-kube-api-access-lpknf\") pod \"payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf\" (UID: \"ab3b0c3b-7db0-4d32-b97c-f0594ab010be\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf"
Sep 10 14:29:27.026563 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:27.026538    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf"
Sep 10 14:29:27.053259 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:27.053230    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-ba183c-657c59d649-lq27q"
Sep 10 14:29:27.302067 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:27.302037    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf"]
Sep 10 14:29:27.302995 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:29:27.302971    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab3b0c3b_7db0_4d32_b97c_f0594ab010be.slice/crio-42c86d258713d2ece4daddbe36a7ea8d89d75e9c2e957fbe09163dae69f2f7f5 WatchSource:0}: Error finding container 42c86d258713d2ece4daddbe36a7ea8d89d75e9c2e957fbe09163dae69f2f7f5: Status 404 returned error can't find the container with id 42c86d258713d2ece4daddbe36a7ea8d89d75e9c2e957fbe09163dae69f2f7f5
Sep 10 14:29:27.333973 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:27.333950    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-ba183c-657c59d649-lq27q"]
Sep 10 14:29:27.335549 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:29:27.335520    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc82f77e5_71f4_4820_8d8f_860103e499bf.slice/crio-9cf9d99cb0e44d434b251b3ed8f0ec3a29e6caef99cd5dcdff5cf631803b201b WatchSource:0}: Error finding container 9cf9d99cb0e44d434b251b3ed8f0ec3a29e6caef99cd5dcdff5cf631803b201b: Status 404 returned error can't find the container with id 9cf9d99cb0e44d434b251b3ed8f0ec3a29e6caef99cd5dcdff5cf631803b201b
Sep 10 14:29:27.962097 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:27.962060    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-ba183c-657c59d649-lq27q" event={"ID":"c82f77e5-71f4-4820-8d8f-860103e499bf","Type":"ContainerStarted","Data":"216bd85b18526b670009c894beb5dcfcc25fb3e1db4f4ddf0e922a22ab803f15"}
Sep 10 14:29:27.962584 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:27.962125    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-ba183c-657c59d649-lq27q" event={"ID":"c82f77e5-71f4-4820-8d8f-860103e499bf","Type":"ContainerStarted","Data":"9cf9d99cb0e44d434b251b3ed8f0ec3a29e6caef99cd5dcdff5cf631803b201b"}
Sep 10 14:29:27.962584 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:27.962185    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-ba183c-657c59d649-lq27q"
Sep 10 14:29:27.964034 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:27.964000    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf" event={"ID":"ab3b0c3b-7db0-4d32-b97c-f0594ab010be","Type":"ContainerStarted","Data":"b37d08c1b48a1d7a60eac22835ec6a6319cc1f6e02f4e9db69eb0313ce035100"}
Sep 10 14:29:27.964172 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:27.964043    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf" event={"ID":"ab3b0c3b-7db0-4d32-b97c-f0594ab010be","Type":"ContainerStarted","Data":"42c86d258713d2ece4daddbe36a7ea8d89d75e9c2e957fbe09163dae69f2f7f5"}
Sep 10 14:29:27.964172 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:27.964075    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf"
Sep 10 14:29:27.979598 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:27.979553    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-ba183c-657c59d649-lq27q" podStartSLOduration=1.9795357359999999 podStartE2EDuration="1.979535736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:29:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:29:27.977436262 +0000 UTC m=+1066.094977765" watchObservedRunningTime="2026-09-10 14:29:27.979535736 +0000 UTC m=+1066.097077210"
Sep 10 14:29:27.993260 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:27.993219    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf" podStartSLOduration=1.993206676 podStartE2EDuration="1.993206676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:29:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:29:27.991725696 +0000 UTC m=+1066.109267172" watchObservedRunningTime="2026-09-10 14:29:27.993206676 +0000 UTC m=+1066.110748151"
Sep 10 14:29:38.973679 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:38.973604    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-ba183c-657c59d649-lq27q"
Sep 10 14:29:38.974110 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:29:38.973684    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf"
Sep 10 14:30:00.143955 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:00.143919    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-ba183c-29817510-sbbvm"]
Sep 10 14:30:00.149104 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:00.149084    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-bb42d5-29817510-gtwqs"]
Sep 10 14:30:00.149216 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:00.149197    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-ba183c-29817510-sbbvm"
Sep 10 14:30:00.152043 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:00.152020    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pj254\""
Sep 10 14:30:00.152730 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:00.152707    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8f0c5f-29817510-hxw7z"]
Sep 10 14:30:00.152853 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:00.152804    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-bb42d5-29817510-gtwqs"
Sep 10 14:30:00.156678 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:00.156656    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8f0c5f-29817510-hxw7z"]
Sep 10 14:30:00.156907 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:00.156889    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8f0c5f-29817510-hxw7z"
Sep 10 14:30:00.158701 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:00.158630    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-ba183c-29817510-sbbvm"]
Sep 10 14:30:00.162349 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:00.162325    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-bb42d5-29817510-gtwqs"]
Sep 10 14:30:00.165665 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:00.165645    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-ba183c-29817510-sbbvm"
Sep 10 14:30:00.177883 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:00.177864    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-bb42d5-29817510-gtwqs"
Sep 10 14:30:00.213712 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:00.213684    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8f0c5f-29817510-hxw7z"
Sep 10 14:30:00.449179 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:00.449154    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-ba183c-29817510-sbbvm"]
Sep 10 14:30:00.455055 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:30:00.454943    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d62521b_381f_4e6a_aa60_d93eec322b34.slice/crio-8959760ee4dcf0419f4b4afd1ffe6dfb007d5d3f15e331e80aa797ea3ab22062 WatchSource:0}: Error finding container 8959760ee4dcf0419f4b4afd1ffe6dfb007d5d3f15e331e80aa797ea3ab22062: Status 404 returned error can't find the container with id 8959760ee4dcf0419f4b4afd1ffe6dfb007d5d3f15e331e80aa797ea3ab22062
Sep 10 14:30:00.460798 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:00.460774    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-bb42d5-29817510-gtwqs"]
Sep 10 14:30:00.462233 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:30:00.462202    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod922d15a6_4888_4bcc_9030_730981d32c0f.slice/crio-7f328c91cb4ad8adee809981b5175d8360f3e8ae6b3c3da5042708a12bac591c WatchSource:0}: Error finding container 7f328c91cb4ad8adee809981b5175d8360f3e8ae6b3c3da5042708a12bac591c: Status 404 returned error can't find the container with id 7f328c91cb4ad8adee809981b5175d8360f3e8ae6b3c3da5042708a12bac591c
Sep 10 14:30:00.508371 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:00.508348    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8f0c5f-29817510-hxw7z"]
Sep 10 14:30:00.508652 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:30:00.508632    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40bcbf40_ee69_4755_a4a7_b4a838c85790.slice/crio-82b76220e425c5356afada7cb0ea1db5357c481879e2c6701b687adc3e21ae09 WatchSource:0}: Error finding container 82b76220e425c5356afada7cb0ea1db5357c481879e2c6701b687adc3e21ae09: Status 404 returned error can't find the container with id 82b76220e425c5356afada7cb0ea1db5357c481879e2c6701b687adc3e21ae09
Sep 10 14:30:01.177459 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:01.177365    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-ba183c-29817510-sbbvm" event={"ID":"4d62521b-381f-4e6a-aa60-d93eec322b34","Type":"ContainerStarted","Data":"88a16dd20be7cb6197cd1d60bb2df76e6c66fef7b8df000195a51d425fc31c4a"}
Sep 10 14:30:01.177459 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:01.177426    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-ba183c-29817510-sbbvm" event={"ID":"4d62521b-381f-4e6a-aa60-d93eec322b34","Type":"ContainerStarted","Data":"8959760ee4dcf0419f4b4afd1ffe6dfb007d5d3f15e331e80aa797ea3ab22062"}
Sep 10 14:30:01.179079 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:01.179050    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-bb42d5-29817510-gtwqs" event={"ID":"922d15a6-4888-4bcc-9030-730981d32c0f","Type":"ContainerStarted","Data":"25d27dc0b4e6ce3d9227972e56d1a36ea6809d0b28c55d8f5958f8d65bc884f0"}
Sep 10 14:30:01.179187 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:01.179100    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-bb42d5-29817510-gtwqs" event={"ID":"922d15a6-4888-4bcc-9030-730981d32c0f","Type":"ContainerStarted","Data":"7f328c91cb4ad8adee809981b5175d8360f3e8ae6b3c3da5042708a12bac591c"}
Sep 10 14:30:01.180632 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:01.180606    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8f0c5f-29817510-hxw7z" event={"ID":"40bcbf40-ee69-4755-a4a7-b4a838c85790","Type":"ContainerStarted","Data":"f0348e5534e5b2e10199f4525aab1565b3cbc6e1f5cfd21398b7e4f254749744"}
Sep 10 14:30:01.180726 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:01.180655    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8f0c5f-29817510-hxw7z" event={"ID":"40bcbf40-ee69-4755-a4a7-b4a838c85790","Type":"ContainerStarted","Data":"82b76220e425c5356afada7cb0ea1db5357c481879e2c6701b687adc3e21ae09"}
Sep 10 14:30:01.191838 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:01.191787    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-ba183c-29817510-sbbvm" podStartSLOduration=1.191768744 podStartE2EDuration="1.191768744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:30:01.191453302 +0000 UTC m=+1099.308994781" watchObservedRunningTime="2026-09-10 14:30:01.191768744 +0000 UTC m=+1099.309310219"
Sep 10 14:30:01.209832 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:01.209790    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-bb42d5-29817510-gtwqs" podStartSLOduration=1.209777077 podStartE2EDuration="1.209777077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:30:01.206763222 +0000 UTC m=+1099.324304697" watchObservedRunningTime="2026-09-10 14:30:01.209777077 +0000 UTC m=+1099.327318553"
Sep 10 14:30:01.220532 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:01.220467    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8f0c5f-29817510-hxw7z" podStartSLOduration=1.220454353 podStartE2EDuration="1.220454353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:30:01.219795966 +0000 UTC m=+1099.337337441" watchObservedRunningTime="2026-09-10 14:30:01.220454353 +0000 UTC m=+1099.337995841"
Sep 10 14:30:02.188864 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:02.188826    2545 generic.go:356] "Generic (PLEG): container finished" podID="40bcbf40-ee69-4755-a4a7-b4a838c85790" containerID="f0348e5534e5b2e10199f4525aab1565b3cbc6e1f5cfd21398b7e4f254749744" exitCode=0
Sep 10 14:30:02.189307 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:02.188920    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8f0c5f-29817510-hxw7z" event={"ID":"40bcbf40-ee69-4755-a4a7-b4a838c85790","Type":"ContainerDied","Data":"f0348e5534e5b2e10199f4525aab1565b3cbc6e1f5cfd21398b7e4f254749744"}
Sep 10 14:30:02.190585 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:02.190559    2545 generic.go:356] "Generic (PLEG): container finished" podID="4d62521b-381f-4e6a-aa60-d93eec322b34" containerID="88a16dd20be7cb6197cd1d60bb2df76e6c66fef7b8df000195a51d425fc31c4a" exitCode=0
Sep 10 14:30:02.190694 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:02.190645    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-ba183c-29817510-sbbvm" event={"ID":"4d62521b-381f-4e6a-aa60-d93eec322b34","Type":"ContainerDied","Data":"88a16dd20be7cb6197cd1d60bb2df76e6c66fef7b8df000195a51d425fc31c4a"}
Sep 10 14:30:02.192065 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:02.192045    2545 generic.go:356] "Generic (PLEG): container finished" podID="922d15a6-4888-4bcc-9030-730981d32c0f" containerID="25d27dc0b4e6ce3d9227972e56d1a36ea6809d0b28c55d8f5958f8d65bc884f0" exitCode=0
Sep 10 14:30:02.192119 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:02.192078    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-bb42d5-29817510-gtwqs" event={"ID":"922d15a6-4888-4bcc-9030-730981d32c0f","Type":"ContainerDied","Data":"25d27dc0b4e6ce3d9227972e56d1a36ea6809d0b28c55d8f5958f8d65bc884f0"}
Sep 10 14:30:03.336972 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:03.336935    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8f0c5f-29817510-hxw7z"
Sep 10 14:30:03.377982 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:03.377959    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-bb42d5-29817510-gtwqs"
Sep 10 14:30:03.391407 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:03.391387    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-ba183c-29817510-sbbvm"
Sep 10 14:30:04.204901 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:04.204875    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-bb42d5-29817510-gtwqs"
Sep 10 14:30:04.205085 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:04.204871    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-bb42d5-29817510-gtwqs" event={"ID":"922d15a6-4888-4bcc-9030-730981d32c0f","Type":"ContainerDied","Data":"7f328c91cb4ad8adee809981b5175d8360f3e8ae6b3c3da5042708a12bac591c"}
Sep 10 14:30:04.205085 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:04.205000    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f328c91cb4ad8adee809981b5175d8360f3e8ae6b3c3da5042708a12bac591c"
Sep 10 14:30:04.206358 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:04.206336    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8f0c5f-29817510-hxw7z"
Sep 10 14:30:04.206460 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:04.206382    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8f0c5f-29817510-hxw7z" event={"ID":"40bcbf40-ee69-4755-a4a7-b4a838c85790","Type":"ContainerDied","Data":"82b76220e425c5356afada7cb0ea1db5357c481879e2c6701b687adc3e21ae09"}
Sep 10 14:30:04.206460 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:04.206418    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82b76220e425c5356afada7cb0ea1db5357c481879e2c6701b687adc3e21ae09"
Sep 10 14:30:04.207971 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:04.207949    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-ba183c-29817510-sbbvm" event={"ID":"4d62521b-381f-4e6a-aa60-d93eec322b34","Type":"ContainerDied","Data":"8959760ee4dcf0419f4b4afd1ffe6dfb007d5d3f15e331e80aa797ea3ab22062"}
Sep 10 14:30:04.207971 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:04.207966    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-ba183c-29817510-sbbvm"
Sep 10 14:30:04.208099 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:04.207989    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8959760ee4dcf0419f4b4afd1ffe6dfb007d5d3f15e331e80aa797ea3ab22062"
Sep 10 14:30:07.302568 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:07.302530    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ba183c-q8zpz"]
Sep 10 14:30:07.302984 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:07.302971    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40bcbf40-ee69-4755-a4a7-b4a838c85790" containerName="cleanup"
Sep 10 14:30:07.302984 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:07.302985    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="40bcbf40-ee69-4755-a4a7-b4a838c85790" containerName="cleanup"
Sep 10 14:30:07.303066 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:07.302996    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="922d15a6-4888-4bcc-9030-730981d32c0f" containerName="cleanup"
Sep 10 14:30:07.303066 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:07.303002    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="922d15a6-4888-4bcc-9030-730981d32c0f" containerName="cleanup"
Sep 10 14:30:07.303066 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:07.303017    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d62521b-381f-4e6a-aa60-d93eec322b34" containerName="cleanup"
Sep 10 14:30:07.303066 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:07.303023    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d62521b-381f-4e6a-aa60-d93eec322b34" containerName="cleanup"
Sep 10 14:30:07.303202 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:07.303081    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="922d15a6-4888-4bcc-9030-730981d32c0f" containerName="cleanup"
Sep 10 14:30:07.303202 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:07.303092    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="40bcbf40-ee69-4755-a4a7-b4a838c85790" containerName="cleanup"
Sep 10 14:30:07.303202 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:07.303097    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d62521b-381f-4e6a-aa60-d93eec322b34" containerName="cleanup"
Sep 10 14:30:07.306309 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:07.306288    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ba183c-q8zpz"
Sep 10 14:30:07.309870 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:07.309846    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pj254\""
Sep 10 14:30:07.310413 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:07.310390    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:30:07.315873 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:07.315848    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ba183c-q8zpz"]
Sep 10 14:30:07.428858 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:07.428812    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c2de515-815f-4044-bdde-57a3b82524f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-ba183c-q8zpz\" (UID: \"8c2de515-815f-4044-bdde-57a3b82524f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ba183c-q8zpz"
Sep 10 14:30:07.529987 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:07.529944    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c2de515-815f-4044-bdde-57a3b82524f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-ba183c-q8zpz\" (UID: \"8c2de515-815f-4044-bdde-57a3b82524f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ba183c-q8zpz"
Sep 10 14:30:07.530641 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:07.530619    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c2de515-815f-4044-bdde-57a3b82524f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-ba183c-q8zpz\" (UID: \"8c2de515-815f-4044-bdde-57a3b82524f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ba183c-q8zpz"
Sep 10 14:30:07.618883 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:07.618778    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ba183c-q8zpz"
Sep 10 14:30:07.890676 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:07.890643    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ba183c-q8zpz"]
Sep 10 14:30:07.891147 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:30:07.891125    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c2de515_815f_4044_bdde_57a3b82524f2.slice/crio-7268a7068fa4ba8482000cb629ca43c7cb5a22a899bb31e33f88273511cb7105 WatchSource:0}: Error finding container 7268a7068fa4ba8482000cb629ca43c7cb5a22a899bb31e33f88273511cb7105: Status 404 returned error can't find the container with id 7268a7068fa4ba8482000cb629ca43c7cb5a22a899bb31e33f88273511cb7105
Sep 10 14:30:08.239152 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:08.239117    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ba183c-q8zpz" event={"ID":"8c2de515-815f-4044-bdde-57a3b82524f2","Type":"ContainerStarted","Data":"24d2478c5e6f67596e1559a81576918b66a26715a24be837e1e9ac5fe350cfa9"}
Sep 10 14:30:08.239281 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:08.239173    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ba183c-q8zpz" event={"ID":"8c2de515-815f-4044-bdde-57a3b82524f2","Type":"ContainerStarted","Data":"7268a7068fa4ba8482000cb629ca43c7cb5a22a899bb31e33f88273511cb7105"}
Sep 10 14:30:08.254953 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:08.254910    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ba183c-q8zpz" podStartSLOduration=1.254894695 podStartE2EDuration="1.254894695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:30:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:30:08.253387699 +0000 UTC m=+1106.370929173" watchObservedRunningTime="2026-09-10 14:30:08.254894695 +0000 UTC m=+1106.372436222"
Sep 10 14:30:09.247925 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:09.247886    2545 generic.go:356] "Generic (PLEG): container finished" podID="8c2de515-815f-4044-bdde-57a3b82524f2" containerID="24d2478c5e6f67596e1559a81576918b66a26715a24be837e1e9ac5fe350cfa9" exitCode=0
Sep 10 14:30:09.248276 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:09.247931    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ba183c-q8zpz" event={"ID":"8c2de515-815f-4044-bdde-57a3b82524f2","Type":"ContainerDied","Data":"24d2478c5e6f67596e1559a81576918b66a26715a24be837e1e9ac5fe350cfa9"}
Sep 10 14:30:10.386274 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:10.386245    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ba183c-q8zpz"
Sep 10 14:30:10.559627 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:10.559523    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c2de515-815f-4044-bdde-57a3b82524f2-maas-api-service-ca\") pod \"8c2de515-815f-4044-bdde-57a3b82524f2\" (UID: \"8c2de515-815f-4044-bdde-57a3b82524f2\") "
Sep 10 14:30:10.559939 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:10.559912    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c2de515-815f-4044-bdde-57a3b82524f2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8c2de515-815f-4044-bdde-57a3b82524f2" (UID: "8c2de515-815f-4044-bdde-57a3b82524f2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:30:10.660991 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:10.660955    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c2de515-815f-4044-bdde-57a3b82524f2-maas-api-service-ca\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:30:11.263999 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:11.263970    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ba183c-q8zpz"
Sep 10 14:30:11.264170 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:11.264016    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ba183c-q8zpz" event={"ID":"8c2de515-815f-4044-bdde-57a3b82524f2","Type":"ContainerDied","Data":"7268a7068fa4ba8482000cb629ca43c7cb5a22a899bb31e33f88273511cb7105"}
Sep 10 14:30:11.264170 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:11.264069    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7268a7068fa4ba8482000cb629ca43c7cb5a22a899bb31e33f88273511cb7105"
Sep 10 14:30:17.794735 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:17.794683    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-ba183c-29817510-sbbvm"]
Sep 10 14:30:17.797709 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:17.797670    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-ba183c-29817510-sbbvm"]
Sep 10 14:30:17.815991 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:17.815963    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-ba183c-657c59d649-lq27q"]
Sep 10 14:30:17.816320 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:17.816242    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-ba183c-657c59d649-lq27q" podUID="c82f77e5-71f4-4820-8d8f-860103e499bf" containerName="payload-processing" containerID="cri-o://216bd85b18526b670009c894beb5dcfcc25fb3e1db4f4ddf0e922a22ab803f15" gracePeriod=30
Sep 10 14:30:17.820457 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:17.820430    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf"]
Sep 10 14:30:17.820676 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:17.820647    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf" podUID="ab3b0c3b-7db0-4d32-b97c-f0594ab010be" containerName="payload-pre-processing" containerID="cri-o://b37d08c1b48a1d7a60eac22835ec6a6319cc1f6e02f4e9db69eb0313ce035100" gracePeriod=30
Sep 10 14:30:17.935571 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:17.935540    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ba183c-q8zpz"]
Sep 10 14:30:17.938104 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:17.938076    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ba183c-q8zpz"]
Sep 10 14:30:18.120786 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.120754    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-ba183c-657c59d649-lq27q"
Sep 10 14:30:18.132877 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.132854    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c82f77e5-71f4-4820-8d8f-860103e499bf-plugins-config-volume\") pod \"c82f77e5-71f4-4820-8d8f-860103e499bf\" (UID: \"c82f77e5-71f4-4820-8d8f-860103e499bf\") "
Sep 10 14:30:18.132973 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.132900    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fl9qv\" (UniqueName: \"kubernetes.io/projected/c82f77e5-71f4-4820-8d8f-860103e499bf-kube-api-access-fl9qv\") pod \"c82f77e5-71f4-4820-8d8f-860103e499bf\" (UID: \"c82f77e5-71f4-4820-8d8f-860103e499bf\") "
Sep 10 14:30:18.133200 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.133181    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c82f77e5-71f4-4820-8d8f-860103e499bf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c82f77e5-71f4-4820-8d8f-860103e499bf" (UID: "c82f77e5-71f4-4820-8d8f-860103e499bf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:30:18.134909 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.134876    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c82f77e5-71f4-4820-8d8f-860103e499bf-kube-api-access-fl9qv" (OuterVolumeSpecName: "kube-api-access-fl9qv") pod "c82f77e5-71f4-4820-8d8f-860103e499bf" (UID: "c82f77e5-71f4-4820-8d8f-860103e499bf"). InnerVolumeSpecName "kube-api-access-fl9qv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:30:18.141326 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.141169    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf"
Sep 10 14:30:18.233795 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.233766    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpknf\" (UniqueName: \"kubernetes.io/projected/ab3b0c3b-7db0-4d32-b97c-f0594ab010be-kube-api-access-lpknf\") pod \"ab3b0c3b-7db0-4d32-b97c-f0594ab010be\" (UID: \"ab3b0c3b-7db0-4d32-b97c-f0594ab010be\") "
Sep 10 14:30:18.233951 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.233885    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab3b0c3b-7db0-4d32-b97c-f0594ab010be-plugins-config-volume\") pod \"ab3b0c3b-7db0-4d32-b97c-f0594ab010be\" (UID: \"ab3b0c3b-7db0-4d32-b97c-f0594ab010be\") "
Sep 10 14:30:18.234219 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.234198    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab3b0c3b-7db0-4d32-b97c-f0594ab010be-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ab3b0c3b-7db0-4d32-b97c-f0594ab010be" (UID: "ab3b0c3b-7db0-4d32-b97c-f0594ab010be"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:30:18.234272 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.234236    2545 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c82f77e5-71f4-4820-8d8f-860103e499bf-plugins-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:30:18.234272 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.234254    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fl9qv\" (UniqueName: \"kubernetes.io/projected/c82f77e5-71f4-4820-8d8f-860103e499bf-kube-api-access-fl9qv\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:30:18.235852 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.235833    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab3b0c3b-7db0-4d32-b97c-f0594ab010be-kube-api-access-lpknf" (OuterVolumeSpecName: "kube-api-access-lpknf") pod "ab3b0c3b-7db0-4d32-b97c-f0594ab010be" (UID: "ab3b0c3b-7db0-4d32-b97c-f0594ab010be"). InnerVolumeSpecName "kube-api-access-lpknf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:30:18.307733 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.307700    2545 generic.go:356] "Generic (PLEG): container finished" podID="c82f77e5-71f4-4820-8d8f-860103e499bf" containerID="216bd85b18526b670009c894beb5dcfcc25fb3e1db4f4ddf0e922a22ab803f15" exitCode=0
Sep 10 14:30:18.307865 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.307744    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-ba183c-657c59d649-lq27q"
Sep 10 14:30:18.307865 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.307791    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-ba183c-657c59d649-lq27q" event={"ID":"c82f77e5-71f4-4820-8d8f-860103e499bf","Type":"ContainerDied","Data":"216bd85b18526b670009c894beb5dcfcc25fb3e1db4f4ddf0e922a22ab803f15"}
Sep 10 14:30:18.307940 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.307865    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-ba183c-657c59d649-lq27q" event={"ID":"c82f77e5-71f4-4820-8d8f-860103e499bf","Type":"ContainerDied","Data":"9cf9d99cb0e44d434b251b3ed8f0ec3a29e6caef99cd5dcdff5cf631803b201b"}
Sep 10 14:30:18.307940 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.307895    2545 scope.go:117] "RemoveContainer" containerID="216bd85b18526b670009c894beb5dcfcc25fb3e1db4f4ddf0e922a22ab803f15"
Sep 10 14:30:18.309184 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.309163    2545 generic.go:356] "Generic (PLEG): container finished" podID="ab3b0c3b-7db0-4d32-b97c-f0594ab010be" containerID="b37d08c1b48a1d7a60eac22835ec6a6319cc1f6e02f4e9db69eb0313ce035100" exitCode=0
Sep 10 14:30:18.309275 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.309220    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf"
Sep 10 14:30:18.309275 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.309249    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf" event={"ID":"ab3b0c3b-7db0-4d32-b97c-f0594ab010be","Type":"ContainerDied","Data":"b37d08c1b48a1d7a60eac22835ec6a6319cc1f6e02f4e9db69eb0313ce035100"}
Sep 10 14:30:18.309362 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.309297    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf" event={"ID":"ab3b0c3b-7db0-4d32-b97c-f0594ab010be","Type":"ContainerDied","Data":"42c86d258713d2ece4daddbe36a7ea8d89d75e9c2e957fbe09163dae69f2f7f5"}
Sep 10 14:30:18.317584 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.317566    2545 scope.go:117] "RemoveContainer" containerID="216bd85b18526b670009c894beb5dcfcc25fb3e1db4f4ddf0e922a22ab803f15"
Sep 10 14:30:18.317893 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:30:18.317867    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"216bd85b18526b670009c894beb5dcfcc25fb3e1db4f4ddf0e922a22ab803f15\": container with ID starting with 216bd85b18526b670009c894beb5dcfcc25fb3e1db4f4ddf0e922a22ab803f15 not found: ID does not exist" containerID="216bd85b18526b670009c894beb5dcfcc25fb3e1db4f4ddf0e922a22ab803f15"
Sep 10 14:30:18.317995 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.317903    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"216bd85b18526b670009c894beb5dcfcc25fb3e1db4f4ddf0e922a22ab803f15"} err="failed to get container status \"216bd85b18526b670009c894beb5dcfcc25fb3e1db4f4ddf0e922a22ab803f15\": rpc error: code = NotFound desc = could not find container \"216bd85b18526b670009c894beb5dcfcc25fb3e1db4f4ddf0e922a22ab803f15\": container with ID starting with 216bd85b18526b670009c894beb5dcfcc25fb3e1db4f4ddf0e922a22ab803f15 not found: ID does not exist"
Sep 10 14:30:18.317995 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.317921    2545 scope.go:117] "RemoveContainer" containerID="b37d08c1b48a1d7a60eac22835ec6a6319cc1f6e02f4e9db69eb0313ce035100"
Sep 10 14:30:18.326593 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.326577    2545 scope.go:117] "RemoveContainer" containerID="b37d08c1b48a1d7a60eac22835ec6a6319cc1f6e02f4e9db69eb0313ce035100"
Sep 10 14:30:18.326865 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:30:18.326846    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b37d08c1b48a1d7a60eac22835ec6a6319cc1f6e02f4e9db69eb0313ce035100\": container with ID starting with b37d08c1b48a1d7a60eac22835ec6a6319cc1f6e02f4e9db69eb0313ce035100 not found: ID does not exist" containerID="b37d08c1b48a1d7a60eac22835ec6a6319cc1f6e02f4e9db69eb0313ce035100"
Sep 10 14:30:18.326955 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.326868    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b37d08c1b48a1d7a60eac22835ec6a6319cc1f6e02f4e9db69eb0313ce035100"} err="failed to get container status \"b37d08c1b48a1d7a60eac22835ec6a6319cc1f6e02f4e9db69eb0313ce035100\": rpc error: code = NotFound desc = could not find container \"b37d08c1b48a1d7a60eac22835ec6a6319cc1f6e02f4e9db69eb0313ce035100\": container with ID starting with b37d08c1b48a1d7a60eac22835ec6a6319cc1f6e02f4e9db69eb0313ce035100 not found: ID does not exist"
Sep 10 14:30:18.333454 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.333434    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf"]
Sep 10 14:30:18.334913 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.334840    2545 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab3b0c3b-7db0-4d32-b97c-f0594ab010be-plugins-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:30:18.334913 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.334866    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpknf\" (UniqueName: \"kubernetes.io/projected/ab3b0c3b-7db0-4d32-b97c-f0594ab010be-kube-api-access-lpknf\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:30:18.337344 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.337325    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-ba183c-6594887946-47tvf"]
Sep 10 14:30:18.346340 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.346321    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-ba183c-657c59d649-lq27q"]
Sep 10 14:30:18.349832 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.349813    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-ba183c-657c59d649-lq27q"]
Sep 10 14:30:18.366666 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.366613    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d62521b-381f-4e6a-aa60-d93eec322b34" path="/var/lib/kubelet/pods/4d62521b-381f-4e6a-aa60-d93eec322b34/volumes"
Sep 10 14:30:18.366895 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.366882    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c2de515-815f-4044-bdde-57a3b82524f2" path="/var/lib/kubelet/pods/8c2de515-815f-4044-bdde-57a3b82524f2/volumes"
Sep 10 14:30:18.367191 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.367179    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab3b0c3b-7db0-4d32-b97c-f0594ab010be" path="/var/lib/kubelet/pods/ab3b0c3b-7db0-4d32-b97c-f0594ab010be/volumes"
Sep 10 14:30:18.367513 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:18.367478    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c82f77e5-71f4-4820-8d8f-860103e499bf" path="/var/lib/kubelet/pods/c82f77e5-71f4-4820-8d8f-860103e499bf/volumes"
Sep 10 14:30:30.125735 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.125695    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"]
Sep 10 14:30:30.126144 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.126131    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c2de515-815f-4044-bdde-57a3b82524f2" containerName="revoke-keys"
Sep 10 14:30:30.126200 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.126146    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c2de515-815f-4044-bdde-57a3b82524f2" containerName="revoke-keys"
Sep 10 14:30:30.126200 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.126169    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c82f77e5-71f4-4820-8d8f-860103e499bf" containerName="payload-processing"
Sep 10 14:30:30.126200 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.126175    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="c82f77e5-71f4-4820-8d8f-860103e499bf" containerName="payload-processing"
Sep 10 14:30:30.126200 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.126187    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab3b0c3b-7db0-4d32-b97c-f0594ab010be" containerName="payload-pre-processing"
Sep 10 14:30:30.126200 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.126193    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab3b0c3b-7db0-4d32-b97c-f0594ab010be" containerName="payload-pre-processing"
Sep 10 14:30:30.126363 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.126259    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab3b0c3b-7db0-4d32-b97c-f0594ab010be" containerName="payload-pre-processing"
Sep 10 14:30:30.126363 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.126268    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c2de515-815f-4044-bdde-57a3b82524f2" containerName="revoke-keys"
Sep 10 14:30:30.126363 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.126276    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="c82f77e5-71f4-4820-8d8f-860103e499bf" containerName="payload-processing"
Sep 10 14:30:30.131115 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.131100    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.134685 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.134667    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-215950-openshift-default-dockercfg-b5v2w\""
Sep 10 14:30:30.151070 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.151044    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"]
Sep 10 14:30:30.252042 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.252003    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-credential-socket\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.252042 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.252041    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/345d37f5-0456-4430-b4fb-a157b6a36c54-istiod-ca-cert\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.252243 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.252074    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-workload-socket\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.252243 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.252191    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-istio-data\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.252243 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.252231    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-workload-certs\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.252397 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.252246    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/345d37f5-0456-4430-b4fb-a157b6a36c54-istio-token\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.252397 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.252282    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdp8x\" (UniqueName: \"kubernetes.io/projected/345d37f5-0456-4430-b4fb-a157b6a36c54-kube-api-access-pdp8x\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.252397 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.252300    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/345d37f5-0456-4430-b4fb-a157b6a36c54-istio-podinfo\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.252397 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.252344    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-istio-envoy\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.353549 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.353511    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-workload-socket\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.353725 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.353661    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-istio-data\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.353725 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.353690    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-workload-certs\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.353725 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.353706    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/345d37f5-0456-4430-b4fb-a157b6a36c54-istio-token\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.353905 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.353727    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdp8x\" (UniqueName: \"kubernetes.io/projected/345d37f5-0456-4430-b4fb-a157b6a36c54-kube-api-access-pdp8x\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.353905 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.353752    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/345d37f5-0456-4430-b4fb-a157b6a36c54-istio-podinfo\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.353905 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.353825    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-istio-envoy\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.353905 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.353860    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-credential-socket\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.353905 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.353884    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/345d37f5-0456-4430-b4fb-a157b6a36c54-istiod-ca-cert\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.354168 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.353963    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-workload-socket\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.354168 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.353988    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-istio-data\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.354168 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.354035    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-workload-certs\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.354340 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.354303    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-credential-socket\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.354476 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.354456    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/345d37f5-0456-4430-b4fb-a157b6a36c54-istiod-ca-cert\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.355970 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.355947    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-istio-envoy\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.356189 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.356171    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/345d37f5-0456-4430-b4fb-a157b6a36c54-istio-podinfo\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.361246 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.361219    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdp8x\" (UniqueName: \"kubernetes.io/projected/345d37f5-0456-4430-b4fb-a157b6a36c54-kube-api-access-pdp8x\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.361614 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.361595    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/345d37f5-0456-4430-b4fb-a157b6a36c54-istio-token\") pod \"e2e-noten-215950-openshift-default-795896b8d8-6qm5t\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") " pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.441787 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.441718    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:30.722831 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.722805    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"]
Sep 10 14:30:30.724859 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:30:30.724831    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod345d37f5_0456_4430_b4fb_a157b6a36c54.slice/crio-6b5f167dd224549426abb9d6c5fd7fd897b381c7f9a54e4043c157ce6fab5ae4 WatchSource:0}: Error finding container 6b5f167dd224549426abb9d6c5fd7fd897b381c7f9a54e4043c157ce6fab5ae4: Status 404 returned error can't find the container with id 6b5f167dd224549426abb9d6c5fd7fd897b381c7f9a54e4043c157ce6fab5ae4
Sep 10 14:30:30.727186 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.727155    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:30:30.727256 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.727222    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:30:30.727256 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:30.727251    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:30:31.390457 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:31.390418    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t" event={"ID":"345d37f5-0456-4430-b4fb-a157b6a36c54","Type":"ContainerStarted","Data":"51470a8a73d4563dcbbf940136b9477273d00fe8a3fec572d6b732b711dd950d"}
Sep 10 14:30:31.390834 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:31.390472    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t" event={"ID":"345d37f5-0456-4430-b4fb-a157b6a36c54","Type":"ContainerStarted","Data":"6b5f167dd224549426abb9d6c5fd7fd897b381c7f9a54e4043c157ce6fab5ae4"}
Sep 10 14:30:31.412459 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:31.412397    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t" podStartSLOduration=1.412376788 podStartE2EDuration="1.412376788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:30:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:30:31.410954213 +0000 UTC m=+1129.528495688" watchObservedRunningTime="2026-09-10 14:30:31.412376788 +0000 UTC m=+1129.529918266"
Sep 10 14:30:31.442177 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:31.442145    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:31.443886 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:31.443857    2545 patch_prober.go:28] interesting pod/e2e-noten-215950-openshift-default-795896b8d8-6qm5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 10 14:30:31.444008 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:31.443904    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t" podUID="345d37f5-0456-4430-b4fb-a157b6a36c54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 10 14:30:32.445969 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:32.445940    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:33.402537 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:33.402480    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:33.403301 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:33.403279    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:30:42.045919 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:42.045881    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k"]
Sep 10 14:30:42.049265 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:42.049247    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k"
Sep 10 14:30:42.051819 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:42.051801    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-7c910967-dockercfg-95jr8\""
Sep 10 14:30:42.051931 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:42.051805    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-7c910967\""
Sep 10 14:30:42.060288 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:42.060266    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k"]
Sep 10 14:30:42.174513 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:42.172198    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c55t5\" (UniqueName: \"kubernetes.io/projected/cf442f83-afca-44c6-b62d-14121e34e5cb-kube-api-access-c55t5\") pod \"payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k\" (UID: \"cf442f83-afca-44c6-b62d-14121e34e5cb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k"
Sep 10 14:30:42.174513 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:42.172253    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf442f83-afca-44c6-b62d-14121e34e5cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k\" (UID: \"cf442f83-afca-44c6-b62d-14121e34e5cb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k"
Sep 10 14:30:42.273368 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:42.273335    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf442f83-afca-44c6-b62d-14121e34e5cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k\" (UID: \"cf442f83-afca-44c6-b62d-14121e34e5cb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k"
Sep 10 14:30:42.273551 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:42.273464    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c55t5\" (UniqueName: \"kubernetes.io/projected/cf442f83-afca-44c6-b62d-14121e34e5cb-kube-api-access-c55t5\") pod \"payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k\" (UID: \"cf442f83-afca-44c6-b62d-14121e34e5cb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k"
Sep 10 14:30:42.275936 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:42.275915    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-7c910967\""
Sep 10 14:30:42.281053 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:42.281030    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c55t5\" (UniqueName: \"kubernetes.io/projected/cf442f83-afca-44c6-b62d-14121e34e5cb-kube-api-access-c55t5\") pod \"payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k\" (UID: \"cf442f83-afca-44c6-b62d-14121e34e5cb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k"
Sep 10 14:30:42.284312 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:42.284291    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf442f83-afca-44c6-b62d-14121e34e5cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k\" (UID: \"cf442f83-afca-44c6-b62d-14121e34e5cb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k"
Sep 10 14:30:42.365638 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:42.365571    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-7c910967-dockercfg-95jr8\""
Sep 10 14:30:42.373553 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:42.373537    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k"
Sep 10 14:30:42.647730 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:42.647052    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k"]
Sep 10 14:30:42.650076 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:30:42.650046    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf442f83_afca_44c6_b62d_14121e34e5cb.slice/crio-4a8cbf3f5c06d29850504f1661f9a8b625f1ff1f0ca433b575a464787c00dcbe WatchSource:0}: Error finding container 4a8cbf3f5c06d29850504f1661f9a8b625f1ff1f0ca433b575a464787c00dcbe: Status 404 returned error can't find the container with id 4a8cbf3f5c06d29850504f1661f9a8b625f1ff1f0ca433b575a464787c00dcbe
Sep 10 14:30:43.468972 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:43.468937    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k" event={"ID":"cf442f83-afca-44c6-b62d-14121e34e5cb","Type":"ContainerStarted","Data":"d6bae06dd4ea288d9f403b2edcb39d2084861bd92e41701b351db191cd04578a"}
Sep 10 14:30:43.469395 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:43.468994    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k" event={"ID":"cf442f83-afca-44c6-b62d-14121e34e5cb","Type":"ContainerStarted","Data":"4a8cbf3f5c06d29850504f1661f9a8b625f1ff1f0ca433b575a464787c00dcbe"}
Sep 10 14:30:43.469395 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:43.469025    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k"
Sep 10 14:30:43.487858 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:43.487809    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k" podStartSLOduration=1.487794393 podStartE2EDuration="1.487794393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:30:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:30:43.484133112 +0000 UTC m=+1141.601674586" watchObservedRunningTime="2026-09-10 14:30:43.487794393 +0000 UTC m=+1141.605335912"
Sep 10 14:30:54.477147 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:54.477109    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k"
Sep 10 14:30:57.849502 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:57.849457    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"]
Sep 10 14:30:57.849953 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:30:57.849680    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t" podUID="345d37f5-0456-4430-b4fb-a157b6a36c54" containerName="istio-proxy" containerID="cri-o://51470a8a73d4563dcbbf940136b9477273d00fe8a3fec572d6b732b711dd950d" gracePeriod=30
Sep 10 14:31:03.118375 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.118317    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:31:03.152237 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.152208    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bb42d5-wrcz4"]
Sep 10 14:31:03.152631 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.152617    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="345d37f5-0456-4430-b4fb-a157b6a36c54" containerName="istio-proxy"
Sep 10 14:31:03.152681 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.152632    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="345d37f5-0456-4430-b4fb-a157b6a36c54" containerName="istio-proxy"
Sep 10 14:31:03.152714 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.152696    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="345d37f5-0456-4430-b4fb-a157b6a36c54" containerName="istio-proxy"
Sep 10 14:31:03.155784 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.155768    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bb42d5-wrcz4"
Sep 10 14:31:03.158333 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.158306    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:31:03.158457 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.158380    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pj254\""
Sep 10 14:31:03.162077 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.162049    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bb42d5-wrcz4"]
Sep 10 14:31:03.174681 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.174655    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-workload-socket\") pod \"345d37f5-0456-4430-b4fb-a157b6a36c54\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") "
Sep 10 14:31:03.174776 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.174694    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-credential-socket\") pod \"345d37f5-0456-4430-b4fb-a157b6a36c54\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") "
Sep 10 14:31:03.174776 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.174738    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-istio-envoy\") pod \"345d37f5-0456-4430-b4fb-a157b6a36c54\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") "
Sep 10 14:31:03.174869 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.174828    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/345d37f5-0456-4430-b4fb-a157b6a36c54-istio-podinfo\") pod \"345d37f5-0456-4430-b4fb-a157b6a36c54\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") "
Sep 10 14:31:03.174869 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.174860    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-istio-data\") pod \"345d37f5-0456-4430-b4fb-a157b6a36c54\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") "
Sep 10 14:31:03.174961 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.174899    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-workload-certs\") pod \"345d37f5-0456-4430-b4fb-a157b6a36c54\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") "
Sep 10 14:31:03.174961 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.174899    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "345d37f5-0456-4430-b4fb-a157b6a36c54" (UID: "345d37f5-0456-4430-b4fb-a157b6a36c54"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:31:03.175069 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.174995    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdp8x\" (UniqueName: \"kubernetes.io/projected/345d37f5-0456-4430-b4fb-a157b6a36c54-kube-api-access-pdp8x\") pod \"345d37f5-0456-4430-b4fb-a157b6a36c54\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") "
Sep 10 14:31:03.175069 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.175029    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "345d37f5-0456-4430-b4fb-a157b6a36c54" (UID: "345d37f5-0456-4430-b4fb-a157b6a36c54"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:31:03.175069 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.175048    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/345d37f5-0456-4430-b4fb-a157b6a36c54-istio-token\") pod \"345d37f5-0456-4430-b4fb-a157b6a36c54\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") "
Sep 10 14:31:03.175218 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.175081    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/345d37f5-0456-4430-b4fb-a157b6a36c54-istiod-ca-cert\") pod \"345d37f5-0456-4430-b4fb-a157b6a36c54\" (UID: \"345d37f5-0456-4430-b4fb-a157b6a36c54\") "
Sep 10 14:31:03.175218 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.175115    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-istio-data" (OuterVolumeSpecName: "istio-data") pod "345d37f5-0456-4430-b4fb-a157b6a36c54" (UID: "345d37f5-0456-4430-b4fb-a157b6a36c54"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:31:03.175218 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.175131    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "345d37f5-0456-4430-b4fb-a157b6a36c54" (UID: "345d37f5-0456-4430-b4fb-a157b6a36c54"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:31:03.175515 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.175464    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-istio-data\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:03.175592 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.175525    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-workload-certs\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:03.175592 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.175541    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-workload-socket\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:03.175592 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.175555    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-credential-socket\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:03.175592 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.175556    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/345d37f5-0456-4430-b4fb-a157b6a36c54-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "345d37f5-0456-4430-b4fb-a157b6a36c54" (UID: "345d37f5-0456-4430-b4fb-a157b6a36c54"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:31:03.177183 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.177156    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/345d37f5-0456-4430-b4fb-a157b6a36c54-kube-api-access-pdp8x" (OuterVolumeSpecName: "kube-api-access-pdp8x") pod "345d37f5-0456-4430-b4fb-a157b6a36c54" (UID: "345d37f5-0456-4430-b4fb-a157b6a36c54"). InnerVolumeSpecName "kube-api-access-pdp8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:31:03.177183 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.177164    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/345d37f5-0456-4430-b4fb-a157b6a36c54-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "345d37f5-0456-4430-b4fb-a157b6a36c54" (UID: "345d37f5-0456-4430-b4fb-a157b6a36c54"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:31:03.177311 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.177167    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/345d37f5-0456-4430-b4fb-a157b6a36c54-istio-token" (OuterVolumeSpecName: "istio-token") pod "345d37f5-0456-4430-b4fb-a157b6a36c54" (UID: "345d37f5-0456-4430-b4fb-a157b6a36c54"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:31:03.177540 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.177522    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "345d37f5-0456-4430-b4fb-a157b6a36c54" (UID: "345d37f5-0456-4430-b4fb-a157b6a36c54"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:31:03.276881 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.276852    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0219a266-3e7c-49f3-85f7-78f1cf4c0eaf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-bb42d5-wrcz4\" (UID: \"0219a266-3e7c-49f3-85f7-78f1cf4c0eaf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bb42d5-wrcz4"
Sep 10 14:31:03.277052 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.276947    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/345d37f5-0456-4430-b4fb-a157b6a36c54-istio-podinfo\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:03.277052 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.276959    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdp8x\" (UniqueName: \"kubernetes.io/projected/345d37f5-0456-4430-b4fb-a157b6a36c54-kube-api-access-pdp8x\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:03.277052 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.276968    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/345d37f5-0456-4430-b4fb-a157b6a36c54-istio-token\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:03.277052 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.276978    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/345d37f5-0456-4430-b4fb-a157b6a36c54-istiod-ca-cert\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:03.277052 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.276986    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/345d37f5-0456-4430-b4fb-a157b6a36c54-istio-envoy\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:03.378459 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.378372    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0219a266-3e7c-49f3-85f7-78f1cf4c0eaf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-bb42d5-wrcz4\" (UID: \"0219a266-3e7c-49f3-85f7-78f1cf4c0eaf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bb42d5-wrcz4"
Sep 10 14:31:03.378995 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.378974    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0219a266-3e7c-49f3-85f7-78f1cf4c0eaf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-bb42d5-wrcz4\" (UID: \"0219a266-3e7c-49f3-85f7-78f1cf4c0eaf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bb42d5-wrcz4"
Sep 10 14:31:03.469321 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.469281    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bb42d5-wrcz4"
Sep 10 14:31:03.590272 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.590235    2545 generic.go:356] "Generic (PLEG): container finished" podID="345d37f5-0456-4430-b4fb-a157b6a36c54" containerID="51470a8a73d4563dcbbf940136b9477273d00fe8a3fec572d6b732b711dd950d" exitCode=0
Sep 10 14:31:03.590454 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.590283    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"
Sep 10 14:31:03.590454 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.590327    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t" event={"ID":"345d37f5-0456-4430-b4fb-a157b6a36c54","Type":"ContainerDied","Data":"51470a8a73d4563dcbbf940136b9477273d00fe8a3fec572d6b732b711dd950d"}
Sep 10 14:31:03.590454 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.590386    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t" event={"ID":"345d37f5-0456-4430-b4fb-a157b6a36c54","Type":"ContainerDied","Data":"6b5f167dd224549426abb9d6c5fd7fd897b381c7f9a54e4043c157ce6fab5ae4"}
Sep 10 14:31:03.590454 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.590416    2545 scope.go:117] "RemoveContainer" containerID="51470a8a73d4563dcbbf940136b9477273d00fe8a3fec572d6b732b711dd950d"
Sep 10 14:31:03.602386 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.600383    2545 scope.go:117] "RemoveContainer" containerID="51470a8a73d4563dcbbf940136b9477273d00fe8a3fec572d6b732b711dd950d"
Sep 10 14:31:03.602386 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:31:03.600712    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51470a8a73d4563dcbbf940136b9477273d00fe8a3fec572d6b732b711dd950d\": container with ID starting with 51470a8a73d4563dcbbf940136b9477273d00fe8a3fec572d6b732b711dd950d not found: ID does not exist" containerID="51470a8a73d4563dcbbf940136b9477273d00fe8a3fec572d6b732b711dd950d"
Sep 10 14:31:03.602386 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.600742    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51470a8a73d4563dcbbf940136b9477273d00fe8a3fec572d6b732b711dd950d"} err="failed to get container status \"51470a8a73d4563dcbbf940136b9477273d00fe8a3fec572d6b732b711dd950d\": rpc error: code = NotFound desc = could not find container \"51470a8a73d4563dcbbf940136b9477273d00fe8a3fec572d6b732b711dd950d\": container with ID starting with 51470a8a73d4563dcbbf940136b9477273d00fe8a3fec572d6b732b711dd950d not found: ID does not exist"
Sep 10 14:31:03.619612 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.619533    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"]
Sep 10 14:31:03.623667 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.623640    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-215950-openshift-default-795896b8d8-6qm5t"]
Sep 10 14:31:03.742024 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:03.741982    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bb42d5-wrcz4"]
Sep 10 14:31:03.743171 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:31:03.743146    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0219a266_3e7c_49f3_85f7_78f1cf4c0eaf.slice/crio-cf3ffb487c22d03ce1001e9b24309732e9b1f932b4c82e1fa437bd4067e174c9 WatchSource:0}: Error finding container cf3ffb487c22d03ce1001e9b24309732e9b1f932b4c82e1fa437bd4067e174c9: Status 404 returned error can't find the container with id cf3ffb487c22d03ce1001e9b24309732e9b1f932b4c82e1fa437bd4067e174c9
Sep 10 14:31:04.366812 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:04.366777    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="345d37f5-0456-4430-b4fb-a157b6a36c54" path="/var/lib/kubelet/pods/345d37f5-0456-4430-b4fb-a157b6a36c54/volumes"
Sep 10 14:31:04.599114 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:04.599082    2545 generic.go:356] "Generic (PLEG): container finished" podID="0219a266-3e7c-49f3-85f7-78f1cf4c0eaf" containerID="6b5f7c69f902a28a9eb52b85ed6b48fa3a3c7a1df21853c488c80696785dfe41" exitCode=0
Sep 10 14:31:04.599274 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:04.599172    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bb42d5-wrcz4" event={"ID":"0219a266-3e7c-49f3-85f7-78f1cf4c0eaf","Type":"ContainerDied","Data":"6b5f7c69f902a28a9eb52b85ed6b48fa3a3c7a1df21853c488c80696785dfe41"}
Sep 10 14:31:04.599274 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:04.599227    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bb42d5-wrcz4" event={"ID":"0219a266-3e7c-49f3-85f7-78f1cf4c0eaf","Type":"ContainerStarted","Data":"cf3ffb487c22d03ce1001e9b24309732e9b1f932b4c82e1fa437bd4067e174c9"}
Sep 10 14:31:05.738156 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:05.738129    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bb42d5-wrcz4"
Sep 10 14:31:05.801672 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:05.801639    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0219a266-3e7c-49f3-85f7-78f1cf4c0eaf-maas-api-service-ca\") pod \"0219a266-3e7c-49f3-85f7-78f1cf4c0eaf\" (UID: \"0219a266-3e7c-49f3-85f7-78f1cf4c0eaf\") "
Sep 10 14:31:05.801991 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:05.801968    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0219a266-3e7c-49f3-85f7-78f1cf4c0eaf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0219a266-3e7c-49f3-85f7-78f1cf4c0eaf" (UID: "0219a266-3e7c-49f3-85f7-78f1cf4c0eaf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:31:05.903072 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:05.902993    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0219a266-3e7c-49f3-85f7-78f1cf4c0eaf-maas-api-service-ca\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:06.612301 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:06.612271    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bb42d5-wrcz4"
Sep 10 14:31:06.612472 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:06.612300    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bb42d5-wrcz4" event={"ID":"0219a266-3e7c-49f3-85f7-78f1cf4c0eaf","Type":"ContainerDied","Data":"cf3ffb487c22d03ce1001e9b24309732e9b1f932b4c82e1fa437bd4067e174c9"}
Sep 10 14:31:06.612472 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:06.612352    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf3ffb487c22d03ce1001e9b24309732e9b1f932b4c82e1fa437bd4067e174c9"
Sep 10 14:31:12.770145 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:12.770108    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7c910967-q2lgk"]
Sep 10 14:31:12.770590 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:12.770575    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0219a266-3e7c-49f3-85f7-78f1cf4c0eaf" containerName="revoke-keys"
Sep 10 14:31:12.770590 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:12.770591    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="0219a266-3e7c-49f3-85f7-78f1cf4c0eaf" containerName="revoke-keys"
Sep 10 14:31:12.770675 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:12.770668    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="0219a266-3e7c-49f3-85f7-78f1cf4c0eaf" containerName="revoke-keys"
Sep 10 14:31:12.773709 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:12.773691    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7c910967-q2lgk"
Sep 10 14:31:12.776434 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:12.776407    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:31:12.776578 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:12.776404    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pj254\""
Sep 10 14:31:12.782060 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:12.782034    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7c910967-q2lgk"]
Sep 10 14:31:12.873400 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:12.873357    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1cc8bdd-c81d-433e-bef8-e6f07174724a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7c910967-q2lgk\" (UID: \"d1cc8bdd-c81d-433e-bef8-e6f07174724a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7c910967-q2lgk"
Sep 10 14:31:12.974276 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:12.974231    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1cc8bdd-c81d-433e-bef8-e6f07174724a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7c910967-q2lgk\" (UID: \"d1cc8bdd-c81d-433e-bef8-e6f07174724a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7c910967-q2lgk"
Sep 10 14:31:12.974860 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:12.974840    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1cc8bdd-c81d-433e-bef8-e6f07174724a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7c910967-q2lgk\" (UID: \"d1cc8bdd-c81d-433e-bef8-e6f07174724a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7c910967-q2lgk"
Sep 10 14:31:13.086303 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:13.086219    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7c910967-q2lgk"
Sep 10 14:31:13.354318 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:13.354290    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7c910967-q2lgk"]
Sep 10 14:31:13.355159 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:31:13.355134    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1cc8bdd_c81d_433e_bef8_e6f07174724a.slice/crio-fc779d55b1a4e29602ad5241ed27f7406a05385ab900215df0946e180c90a0a5 WatchSource:0}: Error finding container fc779d55b1a4e29602ad5241ed27f7406a05385ab900215df0946e180c90a0a5: Status 404 returned error can't find the container with id fc779d55b1a4e29602ad5241ed27f7406a05385ab900215df0946e180c90a0a5
Sep 10 14:31:13.588738 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:13.588707    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-bb42d5-29817510-gtwqs"]
Sep 10 14:31:13.593855 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:13.593829    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-bb42d5-29817510-gtwqs"]
Sep 10 14:31:13.619601 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:13.619518    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94"]
Sep 10 14:31:13.619804 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:13.619776    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94" podUID="ed16bd4e-8aae-4164-a040-13bf73c10572" containerName="payload-processing" containerID="cri-o://d5b13f15109b63c49a228a481c6514ddaae6d088df52032249f9956b1c927365" gracePeriod=30
Sep 10 14:31:13.656191 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:13.656155    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7c910967-q2lgk" event={"ID":"d1cc8bdd-c81d-433e-bef8-e6f07174724a","Type":"ContainerStarted","Data":"fc779d55b1a4e29602ad5241ed27f7406a05385ab900215df0946e180c90a0a5"}
Sep 10 14:31:13.768700 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:13.768672    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bb42d5-wrcz4"]
Sep 10 14:31:13.771413 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:13.771385    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-bb42d5-wrcz4"]
Sep 10 14:31:13.874718 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:13.874650    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94"
Sep 10 14:31:13.986506 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:13.986460    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed16bd4e-8aae-4164-a040-13bf73c10572-plugins-config-volume\") pod \"ed16bd4e-8aae-4164-a040-13bf73c10572\" (UID: \"ed16bd4e-8aae-4164-a040-13bf73c10572\") "
Sep 10 14:31:13.986644 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:13.986616    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7bb5\" (UniqueName: \"kubernetes.io/projected/ed16bd4e-8aae-4164-a040-13bf73c10572-kube-api-access-x7bb5\") pod \"ed16bd4e-8aae-4164-a040-13bf73c10572\" (UID: \"ed16bd4e-8aae-4164-a040-13bf73c10572\") "
Sep 10 14:31:13.986833 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:13.986796    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed16bd4e-8aae-4164-a040-13bf73c10572-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ed16bd4e-8aae-4164-a040-13bf73c10572" (UID: "ed16bd4e-8aae-4164-a040-13bf73c10572"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:31:13.988507 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:13.988475    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed16bd4e-8aae-4164-a040-13bf73c10572-kube-api-access-x7bb5" (OuterVolumeSpecName: "kube-api-access-x7bb5") pod "ed16bd4e-8aae-4164-a040-13bf73c10572" (UID: "ed16bd4e-8aae-4164-a040-13bf73c10572"). InnerVolumeSpecName "kube-api-access-x7bb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:31:14.087728 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:14.087692    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7bb5\" (UniqueName: \"kubernetes.io/projected/ed16bd4e-8aae-4164-a040-13bf73c10572-kube-api-access-x7bb5\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:14.087728 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:14.087722    2545 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed16bd4e-8aae-4164-a040-13bf73c10572-plugins-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:14.366341 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:14.366305    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0219a266-3e7c-49f3-85f7-78f1cf4c0eaf" path="/var/lib/kubelet/pods/0219a266-3e7c-49f3-85f7-78f1cf4c0eaf/volumes"
Sep 10 14:31:14.366625 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:14.366610    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="922d15a6-4888-4bcc-9030-730981d32c0f" path="/var/lib/kubelet/pods/922d15a6-4888-4bcc-9030-730981d32c0f/volumes"
Sep 10 14:31:14.663789 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:14.663755    2545 generic.go:356] "Generic (PLEG): container finished" podID="d1cc8bdd-c81d-433e-bef8-e6f07174724a" containerID="545cd8a7d993aca1c2706ffc2bc1540be7cc7b89d1befb650ef33ddadff09a50" exitCode=0
Sep 10 14:31:14.663981 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:14.663843    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7c910967-q2lgk" event={"ID":"d1cc8bdd-c81d-433e-bef8-e6f07174724a","Type":"ContainerDied","Data":"545cd8a7d993aca1c2706ffc2bc1540be7cc7b89d1befb650ef33ddadff09a50"}
Sep 10 14:31:14.665350 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:14.665326    2545 generic.go:356] "Generic (PLEG): container finished" podID="ed16bd4e-8aae-4164-a040-13bf73c10572" containerID="d5b13f15109b63c49a228a481c6514ddaae6d088df52032249f9956b1c927365" exitCode=0
Sep 10 14:31:14.665479 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:14.665360    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94" event={"ID":"ed16bd4e-8aae-4164-a040-13bf73c10572","Type":"ContainerDied","Data":"d5b13f15109b63c49a228a481c6514ddaae6d088df52032249f9956b1c927365"}
Sep 10 14:31:14.665479 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:14.665361    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94"
Sep 10 14:31:14.665479 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:14.665406    2545 scope.go:117] "RemoveContainer" containerID="d5b13f15109b63c49a228a481c6514ddaae6d088df52032249f9956b1c927365"
Sep 10 14:31:14.665663 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:14.665394    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94" event={"ID":"ed16bd4e-8aae-4164-a040-13bf73c10572","Type":"ContainerDied","Data":"c4d615218f3041f4bfa7582b613457c748e64ff847d155b0136d3574a9d118a5"}
Sep 10 14:31:14.674496 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:14.674468    2545 scope.go:117] "RemoveContainer" containerID="d5b13f15109b63c49a228a481c6514ddaae6d088df52032249f9956b1c927365"
Sep 10 14:31:14.674748 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:31:14.674729    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5b13f15109b63c49a228a481c6514ddaae6d088df52032249f9956b1c927365\": container with ID starting with d5b13f15109b63c49a228a481c6514ddaae6d088df52032249f9956b1c927365 not found: ID does not exist" containerID="d5b13f15109b63c49a228a481c6514ddaae6d088df52032249f9956b1c927365"
Sep 10 14:31:14.674795 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:14.674755    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5b13f15109b63c49a228a481c6514ddaae6d088df52032249f9956b1c927365"} err="failed to get container status \"d5b13f15109b63c49a228a481c6514ddaae6d088df52032249f9956b1c927365\": rpc error: code = NotFound desc = could not find container \"d5b13f15109b63c49a228a481c6514ddaae6d088df52032249f9956b1c927365\": container with ID starting with d5b13f15109b63c49a228a481c6514ddaae6d088df52032249f9956b1c927365 not found: ID does not exist"
Sep 10 14:31:14.692227 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:14.692192    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94"]
Sep 10 14:31:14.695540 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:14.695520    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-bb42d5-b7594bcb7-4wr94"]
Sep 10 14:31:15.801653 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:15.801630    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7c910967-q2lgk"
Sep 10 14:31:15.905283 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:15.905245    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1cc8bdd-c81d-433e-bef8-e6f07174724a-maas-api-service-ca\") pod \"d1cc8bdd-c81d-433e-bef8-e6f07174724a\" (UID: \"d1cc8bdd-c81d-433e-bef8-e6f07174724a\") "
Sep 10 14:31:15.905626 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:15.905606    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1cc8bdd-c81d-433e-bef8-e6f07174724a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d1cc8bdd-c81d-433e-bef8-e6f07174724a" (UID: "d1cc8bdd-c81d-433e-bef8-e6f07174724a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:31:16.006348 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:16.006321    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1cc8bdd-c81d-433e-bef8-e6f07174724a-maas-api-service-ca\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:16.366612 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:16.366533    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed16bd4e-8aae-4164-a040-13bf73c10572" path="/var/lib/kubelet/pods/ed16bd4e-8aae-4164-a040-13bf73c10572/volumes"
Sep 10 14:31:16.698260 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:16.698152    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7c910967-q2lgk" event={"ID":"d1cc8bdd-c81d-433e-bef8-e6f07174724a","Type":"ContainerDied","Data":"fc779d55b1a4e29602ad5241ed27f7406a05385ab900215df0946e180c90a0a5"}
Sep 10 14:31:16.698400 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:16.698262    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc779d55b1a4e29602ad5241ed27f7406a05385ab900215df0946e180c90a0a5"
Sep 10 14:31:16.698400 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:16.698326    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7c910967-q2lgk"
Sep 10 14:31:20.788174 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:20.788141    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"]
Sep 10 14:31:20.788591 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:20.788345    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq" podUID="dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1" containerName="istio-proxy" containerID="cri-o://fab76399c632c96810913336082fea36908a7dd3e10afcf8f15c8bf132da844b" gracePeriod=30
Sep 10 14:31:21.113920 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:21.113839    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8f0c5f-sq4c8"]
Sep 10 14:31:21.114258 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:21.114245    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1cc8bdd-c81d-433e-bef8-e6f07174724a" containerName="revoke-keys"
Sep 10 14:31:21.114308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:21.114259    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1cc8bdd-c81d-433e-bef8-e6f07174724a" containerName="revoke-keys"
Sep 10 14:31:21.114308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:21.114276    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed16bd4e-8aae-4164-a040-13bf73c10572" containerName="payload-processing"
Sep 10 14:31:21.114308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:21.114281    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed16bd4e-8aae-4164-a040-13bf73c10572" containerName="payload-processing"
Sep 10 14:31:21.114413 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:21.114338    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed16bd4e-8aae-4164-a040-13bf73c10572" containerName="payload-processing"
Sep 10 14:31:21.114413 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:21.114347    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1cc8bdd-c81d-433e-bef8-e6f07174724a" containerName="revoke-keys"
Sep 10 14:31:21.117826 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:21.117801    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8f0c5f-sq4c8"
Sep 10 14:31:21.120557 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:21.120533    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:31:21.120658 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:21.120596    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pj254\""
Sep 10 14:31:21.128268 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:21.128246    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8f0c5f-sq4c8"]
Sep 10 14:31:21.256496 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:21.256444    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0939d8ca-3475-4f69-9d9b-d246eb9e86f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-8f0c5f-sq4c8\" (UID: \"0939d8ca-3475-4f69-9d9b-d246eb9e86f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8f0c5f-sq4c8"
Sep 10 14:31:21.357654 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:21.357614    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0939d8ca-3475-4f69-9d9b-d246eb9e86f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-8f0c5f-sq4c8\" (UID: \"0939d8ca-3475-4f69-9d9b-d246eb9e86f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8f0c5f-sq4c8"
Sep 10 14:31:21.358266 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:21.358243    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0939d8ca-3475-4f69-9d9b-d246eb9e86f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-8f0c5f-sq4c8\" (UID: \"0939d8ca-3475-4f69-9d9b-d246eb9e86f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8f0c5f-sq4c8"
Sep 10 14:31:21.430263 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:21.430168    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8f0c5f-sq4c8"
Sep 10 14:31:21.701962 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:21.701931    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8f0c5f-sq4c8"]
Sep 10 14:31:21.704002 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:31:21.703971    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0939d8ca_3475_4f69_9d9b_d246eb9e86f6.slice/crio-02b3bfed22ad677a0764a5c2c5f0e4676b6866532d93040d95fda2b1f0ef4f2a WatchSource:0}: Error finding container 02b3bfed22ad677a0764a5c2c5f0e4676b6866532d93040d95fda2b1f0ef4f2a: Status 404 returned error can't find the container with id 02b3bfed22ad677a0764a5c2c5f0e4676b6866532d93040d95fda2b1f0ef4f2a
Sep 10 14:31:21.729791 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:21.729757    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8f0c5f-sq4c8" event={"ID":"0939d8ca-3475-4f69-9d9b-d246eb9e86f6","Type":"ContainerStarted","Data":"02b3bfed22ad677a0764a5c2c5f0e4676b6866532d93040d95fda2b1f0ef4f2a"}
Sep 10 14:31:22.737443 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:22.737408    2545 generic.go:356] "Generic (PLEG): container finished" podID="0939d8ca-3475-4f69-9d9b-d246eb9e86f6" containerID="8c092452b0ea8b82d2561d6162fa32ad3c2f1fed2983c481f011340ed123c2e9" exitCode=0
Sep 10 14:31:22.737818 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:22.737477    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8f0c5f-sq4c8" event={"ID":"0939d8ca-3475-4f69-9d9b-d246eb9e86f6","Type":"ContainerDied","Data":"8c092452b0ea8b82d2561d6162fa32ad3c2f1fed2983c481f011340ed123c2e9"}
Sep 10 14:31:23.658752 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:23.658717    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k"]
Sep 10 14:31:23.658985 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:23.658957    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k" podUID="cf442f83-afca-44c6-b62d-14121e34e5cb" containerName="payload-pre-processing" containerID="cri-o://d6bae06dd4ea288d9f403b2edcb39d2084861bd92e41701b351db191cd04578a" gracePeriod=30
Sep 10 14:31:23.813870 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:23.813832    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7c910967-q2lgk"]
Sep 10 14:31:23.818162 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:23.818136    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7c910967-q2lgk"]
Sep 10 14:31:23.891627 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:23.891602    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8f0c5f-sq4c8"
Sep 10 14:31:23.929742 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:23.929714    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k"
Sep 10 14:31:24.086444 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:24.086408    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0939d8ca-3475-4f69-9d9b-d246eb9e86f6-maas-api-service-ca\") pod \"0939d8ca-3475-4f69-9d9b-d246eb9e86f6\" (UID: \"0939d8ca-3475-4f69-9d9b-d246eb9e86f6\") "
Sep 10 14:31:24.086444 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:24.086459    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c55t5\" (UniqueName: \"kubernetes.io/projected/cf442f83-afca-44c6-b62d-14121e34e5cb-kube-api-access-c55t5\") pod \"cf442f83-afca-44c6-b62d-14121e34e5cb\" (UID: \"cf442f83-afca-44c6-b62d-14121e34e5cb\") "
Sep 10 14:31:24.086729 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:24.086503    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf442f83-afca-44c6-b62d-14121e34e5cb-plugins-config-volume\") pod \"cf442f83-afca-44c6-b62d-14121e34e5cb\" (UID: \"cf442f83-afca-44c6-b62d-14121e34e5cb\") "
Sep 10 14:31:24.086872 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:24.086847    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0939d8ca-3475-4f69-9d9b-d246eb9e86f6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0939d8ca-3475-4f69-9d9b-d246eb9e86f6" (UID: "0939d8ca-3475-4f69-9d9b-d246eb9e86f6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:31:24.086937 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:24.086917    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf442f83-afca-44c6-b62d-14121e34e5cb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cf442f83-afca-44c6-b62d-14121e34e5cb" (UID: "cf442f83-afca-44c6-b62d-14121e34e5cb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:31:24.088529 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:24.088508    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf442f83-afca-44c6-b62d-14121e34e5cb-kube-api-access-c55t5" (OuterVolumeSpecName: "kube-api-access-c55t5") pod "cf442f83-afca-44c6-b62d-14121e34e5cb" (UID: "cf442f83-afca-44c6-b62d-14121e34e5cb"). InnerVolumeSpecName "kube-api-access-c55t5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:31:24.188035 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:24.187949    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0939d8ca-3475-4f69-9d9b-d246eb9e86f6-maas-api-service-ca\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:24.188035 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:24.187980    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c55t5\" (UniqueName: \"kubernetes.io/projected/cf442f83-afca-44c6-b62d-14121e34e5cb-kube-api-access-c55t5\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:24.188035 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:24.187990    2545 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf442f83-afca-44c6-b62d-14121e34e5cb-plugins-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:24.366551 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:24.366518    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1cc8bdd-c81d-433e-bef8-e6f07174724a" path="/var/lib/kubelet/pods/d1cc8bdd-c81d-433e-bef8-e6f07174724a/volumes"
Sep 10 14:31:24.752479 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:24.752448    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8f0c5f-sq4c8"
Sep 10 14:31:24.752666 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:24.752513    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8f0c5f-sq4c8" event={"ID":"0939d8ca-3475-4f69-9d9b-d246eb9e86f6","Type":"ContainerDied","Data":"02b3bfed22ad677a0764a5c2c5f0e4676b6866532d93040d95fda2b1f0ef4f2a"}
Sep 10 14:31:24.752666 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:24.752570    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02b3bfed22ad677a0764a5c2c5f0e4676b6866532d93040d95fda2b1f0ef4f2a"
Sep 10 14:31:24.753925 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:24.753902    2545 generic.go:356] "Generic (PLEG): container finished" podID="cf442f83-afca-44c6-b62d-14121e34e5cb" containerID="d6bae06dd4ea288d9f403b2edcb39d2084861bd92e41701b351db191cd04578a" exitCode=0
Sep 10 14:31:24.754057 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:24.753942    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k"
Sep 10 14:31:24.754057 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:24.753963    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k" event={"ID":"cf442f83-afca-44c6-b62d-14121e34e5cb","Type":"ContainerDied","Data":"d6bae06dd4ea288d9f403b2edcb39d2084861bd92e41701b351db191cd04578a"}
Sep 10 14:31:24.754057 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:24.754009    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k" event={"ID":"cf442f83-afca-44c6-b62d-14121e34e5cb","Type":"ContainerDied","Data":"4a8cbf3f5c06d29850504f1661f9a8b625f1ff1f0ca433b575a464787c00dcbe"}
Sep 10 14:31:24.754057 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:24.754038    2545 scope.go:117] "RemoveContainer" containerID="d6bae06dd4ea288d9f403b2edcb39d2084861bd92e41701b351db191cd04578a"
Sep 10 14:31:24.765275 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:24.765254    2545 scope.go:117] "RemoveContainer" containerID="d6bae06dd4ea288d9f403b2edcb39d2084861bd92e41701b351db191cd04578a"
Sep 10 14:31:24.765583 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:31:24.765562    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6bae06dd4ea288d9f403b2edcb39d2084861bd92e41701b351db191cd04578a\": container with ID starting with d6bae06dd4ea288d9f403b2edcb39d2084861bd92e41701b351db191cd04578a not found: ID does not exist" containerID="d6bae06dd4ea288d9f403b2edcb39d2084861bd92e41701b351db191cd04578a"
Sep 10 14:31:24.765642 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:24.765594    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6bae06dd4ea288d9f403b2edcb39d2084861bd92e41701b351db191cd04578a"} err="failed to get container status \"d6bae06dd4ea288d9f403b2edcb39d2084861bd92e41701b351db191cd04578a\": rpc error: code = NotFound desc = could not find container \"d6bae06dd4ea288d9f403b2edcb39d2084861bd92e41701b351db191cd04578a\": container with ID starting with d6bae06dd4ea288d9f403b2edcb39d2084861bd92e41701b351db191cd04578a not found: ID does not exist"
Sep 10 14:31:24.779126 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:24.779094    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k"]
Sep 10 14:31:24.785499 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:24.785462    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7c910967-7f955c78f4-5rn8k"]
Sep 10 14:31:26.033977 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.033947    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:31:26.104166 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.104064    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istio-token\") pod \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") "
Sep 10 14:31:26.104166 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.104110    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istio-data\") pod \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") "
Sep 10 14:31:26.104166 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.104144    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-workload-certs\") pod \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") "
Sep 10 14:31:26.104446 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.104269    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-credential-socket\") pod \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") "
Sep 10 14:31:26.104446 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.104330    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istiod-ca-cert\") pod \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") "
Sep 10 14:31:26.104446 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.104357    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-workload-socket\") pod \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") "
Sep 10 14:31:26.104446 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.104384    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istio-podinfo\") pod \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") "
Sep 10 14:31:26.104446 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.104426    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istio-data" (OuterVolumeSpecName: "istio-data") pod "dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1" (UID: "dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:31:26.104446 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.104439    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jhfd\" (UniqueName: \"kubernetes.io/projected/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-kube-api-access-9jhfd\") pod \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") "
Sep 10 14:31:26.104850 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.104442    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1" (UID: "dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:31:26.104850 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.104566    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1" (UID: "dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:31:26.104850 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.104655    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1" (UID: "dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:31:26.104850 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.104826    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1" (UID: "dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:31:26.105064 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.104897    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istio-data\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:26.105064 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.104917    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-workload-certs\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:26.105064 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.104931    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-credential-socket\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:26.105064 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.104945    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istiod-ca-cert\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:26.105064 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.104958    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-workload-socket\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:26.106646 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.106623    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1" (UID: "dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:31:26.106854 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.106832    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-kube-api-access-9jhfd" (OuterVolumeSpecName: "kube-api-access-9jhfd") pod "dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1" (UID: "dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1"). InnerVolumeSpecName "kube-api-access-9jhfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:31:26.106913 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.106832    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istio-token" (OuterVolumeSpecName: "istio-token") pod "dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1" (UID: "dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:31:26.205931 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.205897    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istio-envoy\") pod \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\" (UID: \"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1\") "
Sep 10 14:31:26.206108 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.206099    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istio-token\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:26.206169 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.206111    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istio-podinfo\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:26.206169 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.206120    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jhfd\" (UniqueName: \"kubernetes.io/projected/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-kube-api-access-9jhfd\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:26.208059 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.208028    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1" (UID: "dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:31:26.307265 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.307232    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1-istio-envoy\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:26.366225 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.366126    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf442f83-afca-44c6-b62d-14121e34e5cb" path="/var/lib/kubelet/pods/cf442f83-afca-44c6-b62d-14121e34e5cb/volumes"
Sep 10 14:31:26.768728 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.768698    2545 generic.go:356] "Generic (PLEG): container finished" podID="dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1" containerID="fab76399c632c96810913336082fea36908a7dd3e10afcf8f15c8bf132da844b" exitCode=0
Sep 10 14:31:26.768903 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.768751    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"
Sep 10 14:31:26.768903 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.768777    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq" event={"ID":"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1","Type":"ContainerDied","Data":"fab76399c632c96810913336082fea36908a7dd3e10afcf8f15c8bf132da844b"}
Sep 10 14:31:26.768903 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.768839    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq" event={"ID":"dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1","Type":"ContainerDied","Data":"799000f9f0957b82ce396edcccd0a1cecdbdae73771a274857aa52e62a24e762"}
Sep 10 14:31:26.768903 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.768871    2545 scope.go:117] "RemoveContainer" containerID="fab76399c632c96810913336082fea36908a7dd3e10afcf8f15c8bf132da844b"
Sep 10 14:31:26.785198 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.785167    2545 scope.go:117] "RemoveContainer" containerID="fbf4e0d60ebdc488e1a09a5aacdf1921267a247dc78eb160a013dea811336fc9"
Sep 10 14:31:26.794234 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.794200    2545 scope.go:117] "RemoveContainer" containerID="fab76399c632c96810913336082fea36908a7dd3e10afcf8f15c8bf132da844b"
Sep 10 14:31:26.794777 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:31:26.794733    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fab76399c632c96810913336082fea36908a7dd3e10afcf8f15c8bf132da844b\": container with ID starting with fab76399c632c96810913336082fea36908a7dd3e10afcf8f15c8bf132da844b not found: ID does not exist" containerID="fab76399c632c96810913336082fea36908a7dd3e10afcf8f15c8bf132da844b"
Sep 10 14:31:26.794896 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.794776    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fab76399c632c96810913336082fea36908a7dd3e10afcf8f15c8bf132da844b"} err="failed to get container status \"fab76399c632c96810913336082fea36908a7dd3e10afcf8f15c8bf132da844b\": rpc error: code = NotFound desc = could not find container \"fab76399c632c96810913336082fea36908a7dd3e10afcf8f15c8bf132da844b\": container with ID starting with fab76399c632c96810913336082fea36908a7dd3e10afcf8f15c8bf132da844b not found: ID does not exist"
Sep 10 14:31:26.794896 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.794802    2545 scope.go:117] "RemoveContainer" containerID="fbf4e0d60ebdc488e1a09a5aacdf1921267a247dc78eb160a013dea811336fc9"
Sep 10 14:31:26.795313 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:31:26.795288    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbf4e0d60ebdc488e1a09a5aacdf1921267a247dc78eb160a013dea811336fc9\": container with ID starting with fbf4e0d60ebdc488e1a09a5aacdf1921267a247dc78eb160a013dea811336fc9 not found: ID does not exist" containerID="fbf4e0d60ebdc488e1a09a5aacdf1921267a247dc78eb160a013dea811336fc9"
Sep 10 14:31:26.795416 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.795319    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbf4e0d60ebdc488e1a09a5aacdf1921267a247dc78eb160a013dea811336fc9"} err="failed to get container status \"fbf4e0d60ebdc488e1a09a5aacdf1921267a247dc78eb160a013dea811336fc9\": rpc error: code = NotFound desc = could not find container \"fbf4e0d60ebdc488e1a09a5aacdf1921267a247dc78eb160a013dea811336fc9\": container with ID starting with fbf4e0d60ebdc488e1a09a5aacdf1921267a247dc78eb160a013dea811336fc9 not found: ID does not exist"
Sep 10 14:31:26.797705 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.797681    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"]
Sep 10 14:31:26.805881 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:26.805857    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-bb42d5-openshift-default-64b5f4bd48-2twrq"]
Sep 10 14:31:28.367374 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:28.367330    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1" path="/var/lib/kubelet/pods/dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1/volumes"
Sep 10 14:31:31.860388 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:31.860342    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8f0c5f-29817510-hxw7z"]
Sep 10 14:31:31.862763 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:31.862736    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8f0c5f-29817510-hxw7z"]
Sep 10 14:31:32.054338 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:32.054301    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8f0c5f-sq4c8"]
Sep 10 14:31:32.056549 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:32.056527    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8f0c5f-sq4c8"]
Sep 10 14:31:32.366571 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:32.366534    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0939d8ca-3475-4f69-9d9b-d246eb9e86f6" path="/var/lib/kubelet/pods/0939d8ca-3475-4f69-9d9b-d246eb9e86f6/volumes"
Sep 10 14:31:32.366856 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:32.366843    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40bcbf40-ee69-4755-a4a7-b4a838c85790" path="/var/lib/kubelet/pods/40bcbf40-ee69-4755-a4a7-b4a838c85790/volumes"
Sep 10 14:31:39.258636 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:39.258597    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"]
Sep 10 14:31:39.259147 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:39.258916    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb" podUID="7801e222-3e47-4b5c-a09b-96a7be3a1ca4" containerName="istio-proxy" containerID="cri-o://8602f68255b4450fa4529cd0b921d0db66031a70257d2c0dfb63ccb677140c31" gracePeriod=30
Sep 10 14:31:44.514635 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.514607    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:31:44.582805 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.582725    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-workload-certs\") pod \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") "
Sep 10 14:31:44.582805 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.582763    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istio-podinfo\") pod \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") "
Sep 10 14:31:44.583035 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.582809    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-workload-socket\") pod \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") "
Sep 10 14:31:44.583035 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.582849    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istio-token\") pod \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") "
Sep 10 14:31:44.583035 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.582923    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-credential-socket\") pod \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") "
Sep 10 14:31:44.583035 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.582950    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvlhx\" (UniqueName: \"kubernetes.io/projected/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-kube-api-access-xvlhx\") pod \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") "
Sep 10 14:31:44.583035 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.582972    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istiod-ca-cert\") pod \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") "
Sep 10 14:31:44.583035 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.582998    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istio-data\") pod \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") "
Sep 10 14:31:44.583035 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.583021    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7801e222-3e47-4b5c-a09b-96a7be3a1ca4" (UID: "7801e222-3e47-4b5c-a09b-96a7be3a1ca4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:31:44.583367 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.583051    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istio-envoy\") pod \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\" (UID: \"7801e222-3e47-4b5c-a09b-96a7be3a1ca4\") "
Sep 10 14:31:44.583367 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.583155    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7801e222-3e47-4b5c-a09b-96a7be3a1ca4" (UID: "7801e222-3e47-4b5c-a09b-96a7be3a1ca4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:31:44.583367 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.583242    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7801e222-3e47-4b5c-a09b-96a7be3a1ca4" (UID: "7801e222-3e47-4b5c-a09b-96a7be3a1ca4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:31:44.583541 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.583377    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istio-data" (OuterVolumeSpecName: "istio-data") pod "7801e222-3e47-4b5c-a09b-96a7be3a1ca4" (UID: "7801e222-3e47-4b5c-a09b-96a7be3a1ca4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:31:44.583541 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.583415    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7801e222-3e47-4b5c-a09b-96a7be3a1ca4" (UID: "7801e222-3e47-4b5c-a09b-96a7be3a1ca4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:31:44.583541 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.583446    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-credential-socket\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:44.583541 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.583470    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-workload-certs\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:44.583541 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.583514    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-workload-socket\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:44.585103 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.585071    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istio-token" (OuterVolumeSpecName: "istio-token") pod "7801e222-3e47-4b5c-a09b-96a7be3a1ca4" (UID: "7801e222-3e47-4b5c-a09b-96a7be3a1ca4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:31:44.585215 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.585144    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7801e222-3e47-4b5c-a09b-96a7be3a1ca4" (UID: "7801e222-3e47-4b5c-a09b-96a7be3a1ca4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:31:44.585215 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.585161    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7801e222-3e47-4b5c-a09b-96a7be3a1ca4" (UID: "7801e222-3e47-4b5c-a09b-96a7be3a1ca4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:31:44.585297 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.585234    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-kube-api-access-xvlhx" (OuterVolumeSpecName: "kube-api-access-xvlhx") pod "7801e222-3e47-4b5c-a09b-96a7be3a1ca4" (UID: "7801e222-3e47-4b5c-a09b-96a7be3a1ca4"). InnerVolumeSpecName "kube-api-access-xvlhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:31:44.684629 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.684591    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvlhx\" (UniqueName: \"kubernetes.io/projected/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-kube-api-access-xvlhx\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:44.684629 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.684622    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istiod-ca-cert\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:44.684629 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.684636    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istio-data\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:44.684872 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.684647    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istio-envoy\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:44.684872 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.684659    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istio-podinfo\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:44.684872 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.684669    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7801e222-3e47-4b5c-a09b-96a7be3a1ca4-istio-token\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:31:44.824359 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.824322    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"]
Sep 10 14:31:44.824733 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.824720    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0939d8ca-3475-4f69-9d9b-d246eb9e86f6" containerName="revoke-keys"
Sep 10 14:31:44.824796 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.824737    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="0939d8ca-3475-4f69-9d9b-d246eb9e86f6" containerName="revoke-keys"
Sep 10 14:31:44.824796 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.824751    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7801e222-3e47-4b5c-a09b-96a7be3a1ca4" containerName="istio-proxy"
Sep 10 14:31:44.824796 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.824757    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="7801e222-3e47-4b5c-a09b-96a7be3a1ca4" containerName="istio-proxy"
Sep 10 14:31:44.824796 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.824771    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1" containerName="istio-proxy"
Sep 10 14:31:44.824796 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.824776    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1" containerName="istio-proxy"
Sep 10 14:31:44.824796 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.824781    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7801e222-3e47-4b5c-a09b-96a7be3a1ca4" containerName="istio-proxy"
Sep 10 14:31:44.824796 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.824787    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="7801e222-3e47-4b5c-a09b-96a7be3a1ca4" containerName="istio-proxy"
Sep 10 14:31:44.824796 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.824794    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf442f83-afca-44c6-b62d-14121e34e5cb" containerName="payload-pre-processing"
Sep 10 14:31:44.825037 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.824799    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf442f83-afca-44c6-b62d-14121e34e5cb" containerName="payload-pre-processing"
Sep 10 14:31:44.825037 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.824877    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="7801e222-3e47-4b5c-a09b-96a7be3a1ca4" containerName="istio-proxy"
Sep 10 14:31:44.825037 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.824885    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1" containerName="istio-proxy"
Sep 10 14:31:44.825037 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.824894    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="0939d8ca-3475-4f69-9d9b-d246eb9e86f6" containerName="revoke-keys"
Sep 10 14:31:44.825037 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.824904    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="7801e222-3e47-4b5c-a09b-96a7be3a1ca4" containerName="istio-proxy"
Sep 10 14:31:44.825037 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.824910    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf442f83-afca-44c6-b62d-14121e34e5cb" containerName="payload-pre-processing"
Sep 10 14:31:44.825037 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.824918    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1" containerName="istio-proxy"
Sep 10 14:31:44.829090 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.829065    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.831848 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.831827    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-9e5db6-openshift-default-dockercfg-j5zx6\""
Sep 10 14:31:44.842478 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.842451    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"]
Sep 10 14:31:44.884791 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.884756    2545 generic.go:356] "Generic (PLEG): container finished" podID="7801e222-3e47-4b5c-a09b-96a7be3a1ca4" containerID="8602f68255b4450fa4529cd0b921d0db66031a70257d2c0dfb63ccb677140c31" exitCode=0
Sep 10 14:31:44.884976 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.884810    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"
Sep 10 14:31:44.884976 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.884840    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb" event={"ID":"7801e222-3e47-4b5c-a09b-96a7be3a1ca4","Type":"ContainerDied","Data":"8602f68255b4450fa4529cd0b921d0db66031a70257d2c0dfb63ccb677140c31"}
Sep 10 14:31:44.884976 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.884901    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb" event={"ID":"7801e222-3e47-4b5c-a09b-96a7be3a1ca4","Type":"ContainerDied","Data":"ad3b04196f42de8c4668a26572af4017eb7ab3d7c415df35ff8303b3236ba330"}
Sep 10 14:31:44.884976 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.884932    2545 scope.go:117] "RemoveContainer" containerID="8602f68255b4450fa4529cd0b921d0db66031a70257d2c0dfb63ccb677140c31"
Sep 10 14:31:44.886362 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.886340    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d181be50-3398-451b-849e-d6d1b8cdeaf7-istio-podinfo\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.886433 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.886416    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-credential-socket\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.886499 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.886475    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-workload-certs\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.886548 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.886516    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-istio-data\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.886599 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.886559    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d181be50-3398-451b-849e-d6d1b8cdeaf7-istio-token\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.886662 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.886640    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-workload-socket\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.886708 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.886679    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d181be50-3398-451b-849e-d6d1b8cdeaf7-istiod-ca-cert\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.886760 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.886719    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-istio-envoy\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.886823 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.886806    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdlxl\" (UniqueName: \"kubernetes.io/projected/d181be50-3398-451b-849e-d6d1b8cdeaf7-kube-api-access-xdlxl\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.897256 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.897238    2545 scope.go:117] "RemoveContainer" containerID="b1769ce552c71a85c876f7ce63ff77931c7d5e8a0842db014221fb4ba5d2d1d4"
Sep 10 14:31:44.905861 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.905844    2545 scope.go:117] "RemoveContainer" containerID="8602f68255b4450fa4529cd0b921d0db66031a70257d2c0dfb63ccb677140c31"
Sep 10 14:31:44.906186 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:31:44.906167    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8602f68255b4450fa4529cd0b921d0db66031a70257d2c0dfb63ccb677140c31\": container with ID starting with 8602f68255b4450fa4529cd0b921d0db66031a70257d2c0dfb63ccb677140c31 not found: ID does not exist" containerID="8602f68255b4450fa4529cd0b921d0db66031a70257d2c0dfb63ccb677140c31"
Sep 10 14:31:44.906266 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.906193    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8602f68255b4450fa4529cd0b921d0db66031a70257d2c0dfb63ccb677140c31"} err="failed to get container status \"8602f68255b4450fa4529cd0b921d0db66031a70257d2c0dfb63ccb677140c31\": rpc error: code = NotFound desc = could not find container \"8602f68255b4450fa4529cd0b921d0db66031a70257d2c0dfb63ccb677140c31\": container with ID starting with 8602f68255b4450fa4529cd0b921d0db66031a70257d2c0dfb63ccb677140c31 not found: ID does not exist"
Sep 10 14:31:44.906266 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.906219    2545 scope.go:117] "RemoveContainer" containerID="b1769ce552c71a85c876f7ce63ff77931c7d5e8a0842db014221fb4ba5d2d1d4"
Sep 10 14:31:44.906465 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:31:44.906448    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1769ce552c71a85c876f7ce63ff77931c7d5e8a0842db014221fb4ba5d2d1d4\": container with ID starting with b1769ce552c71a85c876f7ce63ff77931c7d5e8a0842db014221fb4ba5d2d1d4 not found: ID does not exist" containerID="b1769ce552c71a85c876f7ce63ff77931c7d5e8a0842db014221fb4ba5d2d1d4"
Sep 10 14:31:44.906536 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.906472    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1769ce552c71a85c876f7ce63ff77931c7d5e8a0842db014221fb4ba5d2d1d4"} err="failed to get container status \"b1769ce552c71a85c876f7ce63ff77931c7d5e8a0842db014221fb4ba5d2d1d4\": rpc error: code = NotFound desc = could not find container \"b1769ce552c71a85c876f7ce63ff77931c7d5e8a0842db014221fb4ba5d2d1d4\": container with ID starting with b1769ce552c71a85c876f7ce63ff77931c7d5e8a0842db014221fb4ba5d2d1d4 not found: ID does not exist"
Sep 10 14:31:44.911236 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.911216    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"]
Sep 10 14:31:44.916324 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.916304    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-8f0c5f-openshift-default-779b97dbb4-qstxb"]
Sep 10 14:31:44.987998 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.987964    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdlxl\" (UniqueName: \"kubernetes.io/projected/d181be50-3398-451b-849e-d6d1b8cdeaf7-kube-api-access-xdlxl\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.988192 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.988013    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d181be50-3398-451b-849e-d6d1b8cdeaf7-istio-podinfo\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.988192 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.988051    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-credential-socket\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.988192 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.988079    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-workload-certs\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.988192 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.988104    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-istio-data\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.988192 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.988156    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d181be50-3398-451b-849e-d6d1b8cdeaf7-istio-token\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.988451 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.988206    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-workload-socket\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.988451 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.988232    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d181be50-3398-451b-849e-d6d1b8cdeaf7-istiod-ca-cert\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.988451 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.988266    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-istio-envoy\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.988628 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.988539    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-credential-socket\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.988628 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.988599    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-workload-certs\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.988722 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.988648    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-istio-data\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.988722 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.988704    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-workload-socket\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.989099 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.989077    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d181be50-3398-451b-849e-d6d1b8cdeaf7-istiod-ca-cert\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.990456 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.990435    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-istio-envoy\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.990718 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.990700    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d181be50-3398-451b-849e-d6d1b8cdeaf7-istio-podinfo\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.996084 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.996064    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d181be50-3398-451b-849e-d6d1b8cdeaf7-istio-token\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:44.996161 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:44.996149    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdlxl\" (UniqueName: \"kubernetes.io/projected/d181be50-3398-451b-849e-d6d1b8cdeaf7-kube-api-access-xdlxl\") pod \"e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") " pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:45.141435 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:45.141342    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:45.416547 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:45.416520    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"]
Sep 10 14:31:45.418438 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:31:45.418407    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd181be50_3398_451b_849e_d6d1b8cdeaf7.slice/crio-2a7c49a7e46ea8c42d10e00020cfca8d34d66de72772f61c632c05b7b5ba5ea7 WatchSource:0}: Error finding container 2a7c49a7e46ea8c42d10e00020cfca8d34d66de72772f61c632c05b7b5ba5ea7: Status 404 returned error can't find the container with id 2a7c49a7e46ea8c42d10e00020cfca8d34d66de72772f61c632c05b7b5ba5ea7
Sep 10 14:31:45.421069 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:45.421032    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:31:45.421145 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:45.421117    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:31:45.421185 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:45.421157    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:31:45.448994 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:45.448964    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5"]
Sep 10 14:31:45.449388 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:45.449373    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1" containerName="istio-proxy"
Sep 10 14:31:45.449431 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:45.449390    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc78cf1e-be0a-4c65-89fd-2dbb01c93dd1" containerName="istio-proxy"
Sep 10 14:31:45.453551 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:45.453534    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5"
Sep 10 14:31:45.456454 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:45.456418    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-586826\""
Sep 10 14:31:45.456578 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:45.456557    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-586826-dockercfg-2mq9c\""
Sep 10 14:31:45.461773 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:45.461692    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5"]
Sep 10 14:31:45.594307 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:45.594270    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d9d7073-e0f7-43c3-be62-f72d36a74e43-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5\" (UID: \"0d9d7073-e0f7-43c3-be62-f72d36a74e43\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5"
Sep 10 14:31:45.594761 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:45.594323    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42hdl\" (UniqueName: \"kubernetes.io/projected/0d9d7073-e0f7-43c3-be62-f72d36a74e43-kube-api-access-42hdl\") pod \"payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5\" (UID: \"0d9d7073-e0f7-43c3-be62-f72d36a74e43\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5"
Sep 10 14:31:45.695536 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:45.695428    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d9d7073-e0f7-43c3-be62-f72d36a74e43-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5\" (UID: \"0d9d7073-e0f7-43c3-be62-f72d36a74e43\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5"
Sep 10 14:31:45.695536 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:45.695475    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42hdl\" (UniqueName: \"kubernetes.io/projected/0d9d7073-e0f7-43c3-be62-f72d36a74e43-kube-api-access-42hdl\") pod \"payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5\" (UID: \"0d9d7073-e0f7-43c3-be62-f72d36a74e43\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5"
Sep 10 14:31:45.696364 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:45.696341    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d9d7073-e0f7-43c3-be62-f72d36a74e43-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5\" (UID: \"0d9d7073-e0f7-43c3-be62-f72d36a74e43\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5"
Sep 10 14:31:45.703274 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:45.703248    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42hdl\" (UniqueName: \"kubernetes.io/projected/0d9d7073-e0f7-43c3-be62-f72d36a74e43-kube-api-access-42hdl\") pod \"payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5\" (UID: \"0d9d7073-e0f7-43c3-be62-f72d36a74e43\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5"
Sep 10 14:31:45.784428 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:45.784379    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5"
Sep 10 14:31:45.894880 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:45.894840    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg" event={"ID":"d181be50-3398-451b-849e-d6d1b8cdeaf7","Type":"ContainerStarted","Data":"3885cd9db4c3fbf456835203a419546cb6aa8efe9f275c11429e06c4e0fb15d1"}
Sep 10 14:31:45.895043 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:45.894892    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg" event={"ID":"d181be50-3398-451b-849e-d6d1b8cdeaf7","Type":"ContainerStarted","Data":"2a7c49a7e46ea8c42d10e00020cfca8d34d66de72772f61c632c05b7b5ba5ea7"}
Sep 10 14:31:45.915061 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:45.915010    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg" podStartSLOduration=1.9149933030000001 podStartE2EDuration="1.914993303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:31:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:31:45.912036343 +0000 UTC m=+1204.029577819" watchObservedRunningTime="2026-09-10 14:31:45.914993303 +0000 UTC m=+1204.032534778"
Sep 10 14:31:46.056996 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:46.056970    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5"]
Sep 10 14:31:46.058362 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:31:46.058329    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d9d7073_e0f7_43c3_be62_f72d36a74e43.slice/crio-4caf33bcddadb34c924a32ffdbccdf5f3617d886b7c72b5b43c45d8a54eed61d WatchSource:0}: Error finding container 4caf33bcddadb34c924a32ffdbccdf5f3617d886b7c72b5b43c45d8a54eed61d: Status 404 returned error can't find the container with id 4caf33bcddadb34c924a32ffdbccdf5f3617d886b7c72b5b43c45d8a54eed61d
Sep 10 14:31:46.142212 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:46.142178    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:46.147461 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:46.147436    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:46.366610 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:46.366530    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7801e222-3e47-4b5c-a09b-96a7be3a1ca4" path="/var/lib/kubelet/pods/7801e222-3e47-4b5c-a09b-96a7be3a1ca4/volumes"
Sep 10 14:31:46.910151 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:46.910112    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5" event={"ID":"0d9d7073-e0f7-43c3-be62-f72d36a74e43","Type":"ContainerStarted","Data":"5cf124d0ddd03cf9b7414a74808e13cb50b07b2e2b2100c04aa750b4f536582d"}
Sep 10 14:31:46.910588 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:46.910316    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:46.910588 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:46.910349    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5" event={"ID":"0d9d7073-e0f7-43c3-be62-f72d36a74e43","Type":"ContainerStarted","Data":"4caf33bcddadb34c924a32ffdbccdf5f3617d886b7c72b5b43c45d8a54eed61d"}
Sep 10 14:31:46.910588 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:46.910374    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5"
Sep 10 14:31:46.911148 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:46.911127    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:31:46.928842 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:46.928796    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5" podStartSLOduration=1.9287832809999998 podStartE2EDuration="1.928783281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:31:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:31:46.925817117 +0000 UTC m=+1205.043358595" watchObservedRunningTime="2026-09-10 14:31:46.928783281 +0000 UTC m=+1205.046324755"
Sep 10 14:31:49.673068 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:49.673031    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg"]
Sep 10 14:31:49.677623 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:49.677603    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg"
Sep 10 14:31:49.680905 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:49.680877    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-9e5db6\""
Sep 10 14:31:49.681021 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:49.680885    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-9e5db6-dockercfg-fxdmt\""
Sep 10 14:31:49.689191 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:49.689163    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg"]
Sep 10 14:31:49.698979 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:49.698953    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr"]
Sep 10 14:31:49.702871 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:49.702849    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr"
Sep 10 14:31:49.714854 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:49.714828    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr"]
Sep 10 14:31:49.837359 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:49.837320    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89q89\" (UniqueName: \"kubernetes.io/projected/3c527da4-0e54-4184-a09a-20d87448dd46-kube-api-access-89q89\") pod \"payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg\" (UID: \"3c527da4-0e54-4184-a09a-20d87448dd46\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg"
Sep 10 14:31:49.837359 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:49.837366    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f2cc\" (UniqueName: \"kubernetes.io/projected/ccc50cb5-b205-4ece-8489-a24c341a66df-kube-api-access-8f2cc\") pod \"payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr\" (UID: \"ccc50cb5-b205-4ece-8489-a24c341a66df\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr"
Sep 10 14:31:49.837606 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:49.837437    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccc50cb5-b205-4ece-8489-a24c341a66df-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr\" (UID: \"ccc50cb5-b205-4ece-8489-a24c341a66df\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr"
Sep 10 14:31:49.837606 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:49.837476    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c527da4-0e54-4184-a09a-20d87448dd46-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg\" (UID: \"3c527da4-0e54-4184-a09a-20d87448dd46\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg"
Sep 10 14:31:49.938624 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:49.938534    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89q89\" (UniqueName: \"kubernetes.io/projected/3c527da4-0e54-4184-a09a-20d87448dd46-kube-api-access-89q89\") pod \"payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg\" (UID: \"3c527da4-0e54-4184-a09a-20d87448dd46\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg"
Sep 10 14:31:49.938624 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:49.938584    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f2cc\" (UniqueName: \"kubernetes.io/projected/ccc50cb5-b205-4ece-8489-a24c341a66df-kube-api-access-8f2cc\") pod \"payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr\" (UID: \"ccc50cb5-b205-4ece-8489-a24c341a66df\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr"
Sep 10 14:31:49.938816 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:49.938648    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccc50cb5-b205-4ece-8489-a24c341a66df-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr\" (UID: \"ccc50cb5-b205-4ece-8489-a24c341a66df\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr"
Sep 10 14:31:49.938816 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:49.938713    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c527da4-0e54-4184-a09a-20d87448dd46-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg\" (UID: \"3c527da4-0e54-4184-a09a-20d87448dd46\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg"
Sep 10 14:31:49.939614 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:49.939592    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccc50cb5-b205-4ece-8489-a24c341a66df-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr\" (UID: \"ccc50cb5-b205-4ece-8489-a24c341a66df\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr"
Sep 10 14:31:49.939664 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:49.939596    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c527da4-0e54-4184-a09a-20d87448dd46-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg\" (UID: \"3c527da4-0e54-4184-a09a-20d87448dd46\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg"
Sep 10 14:31:49.947186 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:49.947156    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89q89\" (UniqueName: \"kubernetes.io/projected/3c527da4-0e54-4184-a09a-20d87448dd46-kube-api-access-89q89\") pod \"payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg\" (UID: \"3c527da4-0e54-4184-a09a-20d87448dd46\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg"
Sep 10 14:31:49.947294 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:49.947224    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f2cc\" (UniqueName: \"kubernetes.io/projected/ccc50cb5-b205-4ece-8489-a24c341a66df-kube-api-access-8f2cc\") pod \"payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr\" (UID: \"ccc50cb5-b205-4ece-8489-a24c341a66df\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr"
Sep 10 14:31:49.989610 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:49.989575    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg"
Sep 10 14:31:50.014903 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:50.014857    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr"
Sep 10 14:31:50.266858 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:50.266823    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg"]
Sep 10 14:31:50.267667 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:31:50.267640    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c527da4_0e54_4184_a09a_20d87448dd46.slice/crio-9656ca3c76c071e489b3e17b038bac2e0d1d48ac53ee3a1de0ccddcaa8438fd9 WatchSource:0}: Error finding container 9656ca3c76c071e489b3e17b038bac2e0d1d48ac53ee3a1de0ccddcaa8438fd9: Status 404 returned error can't find the container with id 9656ca3c76c071e489b3e17b038bac2e0d1d48ac53ee3a1de0ccddcaa8438fd9
Sep 10 14:31:50.303789 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:50.303757    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr"]
Sep 10 14:31:50.304919 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:31:50.304894    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccc50cb5_b205_4ece_8489_a24c341a66df.slice/crio-23dc7f5eeb95f2cbd9fecca65613f30d7c97b594b0c0ec433f0e025162ce6d06 WatchSource:0}: Error finding container 23dc7f5eeb95f2cbd9fecca65613f30d7c97b594b0c0ec433f0e025162ce6d06: Status 404 returned error can't find the container with id 23dc7f5eeb95f2cbd9fecca65613f30d7c97b594b0c0ec433f0e025162ce6d06
Sep 10 14:31:50.939321 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:50.939281    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr" event={"ID":"ccc50cb5-b205-4ece-8489-a24c341a66df","Type":"ContainerStarted","Data":"4479fd27ab7066dd3ec48f0a212192f1d924426c6790a452d73b3be81c4b8026"}
Sep 10 14:31:50.939832 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:50.939352    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr" event={"ID":"ccc50cb5-b205-4ece-8489-a24c341a66df","Type":"ContainerStarted","Data":"23dc7f5eeb95f2cbd9fecca65613f30d7c97b594b0c0ec433f0e025162ce6d06"}
Sep 10 14:31:50.939832 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:50.939475    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr"
Sep 10 14:31:50.940995 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:50.940973    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg" event={"ID":"3c527da4-0e54-4184-a09a-20d87448dd46","Type":"ContainerStarted","Data":"a7e81876044a6f76c200b97ca6b05f6f81108cbfa931937d247d6782111389d3"}
Sep 10 14:31:50.941110 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:50.941012    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg" event={"ID":"3c527da4-0e54-4184-a09a-20d87448dd46","Type":"ContainerStarted","Data":"9656ca3c76c071e489b3e17b038bac2e0d1d48ac53ee3a1de0ccddcaa8438fd9"}
Sep 10 14:31:50.941110 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:50.941060    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg"
Sep 10 14:31:50.958764 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:50.958709    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr" podStartSLOduration=1.9586924620000001 podStartE2EDuration="1.958692462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:31:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:31:50.95679296 +0000 UTC m=+1209.074334436" watchObservedRunningTime="2026-09-10 14:31:50.958692462 +0000 UTC m=+1209.076233936"
Sep 10 14:31:50.975769 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:50.975720    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg" podStartSLOduration=1.97570546 podStartE2EDuration="1.97570546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:31:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:31:50.97459333 +0000 UTC m=+1209.092134805" watchObservedRunningTime="2026-09-10 14:31:50.97570546 +0000 UTC m=+1209.093246935"
Sep 10 14:31:57.918674 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:31:57.918642    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5"
Sep 10 14:32:01.950290 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:01.950246    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr"
Sep 10 14:32:01.950816 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:01.950619    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg"
Sep 10 14:32:06.051632 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:06.051595    2545 generic.go:356] "Generic (PLEG): container finished" podID="d181be50-3398-451b-849e-d6d1b8cdeaf7" containerID="3885cd9db4c3fbf456835203a419546cb6aa8efe9f275c11429e06c4e0fb15d1" exitCode=0
Sep 10 14:32:06.052172 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:06.051671    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg" event={"ID":"d181be50-3398-451b-849e-d6d1b8cdeaf7","Type":"ContainerDied","Data":"3885cd9db4c3fbf456835203a419546cb6aa8efe9f275c11429e06c4e0fb15d1"}
Sep 10 14:32:06.052260 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:06.052241    2545 scope.go:117] "RemoveContainer" containerID="3885cd9db4c3fbf456835203a419546cb6aa8efe9f275c11429e06c4e0fb15d1"
Sep 10 14:32:06.053388 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:06.053355    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:32:06.053450 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:06.053429    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:32:06.053511 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:06.053458    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:32:07.067977 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:07.067927    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg" event={"ID":"d181be50-3398-451b-849e-d6d1b8cdeaf7","Type":"ContainerStarted","Data":"16748c18b0543592c7574500fcb298442f2c7c915b20d28d51d8cb4399e3c379"}
Sep 10 14:32:07.141943 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:07.141907    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:32:07.142198 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:07.142171    2545 patch_prober.go:28] interesting pod/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 10 14:32:07.142288 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:07.142240    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg" podUID="d181be50-3398-451b-849e-d6d1b8cdeaf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 10 14:32:08.141695 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:08.141657    2545 patch_prober.go:28] interesting pod/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 10 14:32:08.142155 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:08.141724    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg" podUID="d181be50-3398-451b-849e-d6d1b8cdeaf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 10 14:32:09.142119 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:09.142080    2545 patch_prober.go:28] interesting pod/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 10 14:32:09.142606 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:09.142136    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg" podUID="d181be50-3398-451b-849e-d6d1b8cdeaf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 10 14:32:10.142564 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:10.142526    2545 patch_prober.go:28] interesting pod/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 10 14:32:10.142964 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:10.142588    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg" podUID="d181be50-3398-451b-849e-d6d1b8cdeaf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 10 14:32:11.142281 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:11.142244    2545 patch_prober.go:28] interesting pod/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 10 14:32:11.142570 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:11.142300    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg" podUID="d181be50-3398-451b-849e-d6d1b8cdeaf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 10 14:32:12.308111 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:12.308036    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:32:12.308736 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:12.308711    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:32:12.309722 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:12.309699    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:32:13.339266 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.339234    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"]
Sep 10 14:32:13.342875 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.342852    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.345546 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.345524    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-54c040-openshift-default-dockercfg-wsds4\""
Sep 10 14:32:13.354074 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.354053    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"]
Sep 10 14:32:13.388859 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.388830    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-istio-envoy\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.389022 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.388882    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-istio-data\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.389022 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.388936    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-workload-certs\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.389022 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.388976    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdfwx\" (UniqueName: \"kubernetes.io/projected/7afa8372-b33a-4f4e-a435-2c1792f1575b-kube-api-access-cdfwx\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.389142 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.389021    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7afa8372-b33a-4f4e-a435-2c1792f1575b-istio-podinfo\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.389142 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.389051    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-workload-socket\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.389142 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.389109    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-credential-socket\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.389239 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.389150    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7afa8372-b33a-4f4e-a435-2c1792f1575b-istiod-ca-cert\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.389239 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.389176    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7afa8372-b33a-4f4e-a435-2c1792f1575b-istio-token\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.489834 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.489800    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-credential-socket\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.489996 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.489852    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7afa8372-b33a-4f4e-a435-2c1792f1575b-istiod-ca-cert\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.489996 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.489880    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7afa8372-b33a-4f4e-a435-2c1792f1575b-istio-token\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.489996 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.489901    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-istio-envoy\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.490573 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.490139    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-istio-data\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.490573 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.490204    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-workload-certs\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.490573 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.490222    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-credential-socket\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.490573 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.490232    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdfwx\" (UniqueName: \"kubernetes.io/projected/7afa8372-b33a-4f4e-a435-2c1792f1575b-kube-api-access-cdfwx\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.490573 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.490295    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7afa8372-b33a-4f4e-a435-2c1792f1575b-istio-podinfo\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.490573 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.490356    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-workload-socket\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.491093 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.491055    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-istio-data\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.491218 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.491098    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7afa8372-b33a-4f4e-a435-2c1792f1575b-istiod-ca-cert\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.491435 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.491410    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-workload-certs\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.491706 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.491685    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-workload-socket\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.499618 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.494719    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-istio-envoy\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.499618 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.496620    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7afa8372-b33a-4f4e-a435-2c1792f1575b-istio-podinfo\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.499618 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.498438    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdfwx\" (UniqueName: \"kubernetes.io/projected/7afa8372-b33a-4f4e-a435-2c1792f1575b-kube-api-access-cdfwx\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.501431 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.501408    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7afa8372-b33a-4f4e-a435-2c1792f1575b-istio-token\") pod \"e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") " pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.654332 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.654234    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:13.839166 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.839123    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk"]
Sep 10 14:32:13.842962 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.842940    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk"
Sep 10 14:32:13.845943 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.845920    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-9dcc39\""
Sep 10 14:32:13.846053 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.845941    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-9dcc39-dockercfg-q9qms\""
Sep 10 14:32:13.852891 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.852866    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk"]
Sep 10 14:32:13.893384 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.893350    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44594bd8-4672-485f-9d83-5ffe478fb19a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk\" (UID: \"44594bd8-4672-485f-9d83-5ffe478fb19a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk"
Sep 10 14:32:13.893584 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.893404    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6d8z\" (UniqueName: \"kubernetes.io/projected/44594bd8-4672-485f-9d83-5ffe478fb19a-kube-api-access-n6d8z\") pod \"payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk\" (UID: \"44594bd8-4672-485f-9d83-5ffe478fb19a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk"
Sep 10 14:32:13.941968 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.941935    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"]
Sep 10 14:32:13.943723 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:32:13.943687    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7afa8372_b33a_4f4e_a435_2c1792f1575b.slice/crio-52aba099a523f9ad490dc6994cd0f6ae5cd4017c90fbaff349cb97938b23a70f WatchSource:0}: Error finding container 52aba099a523f9ad490dc6994cd0f6ae5cd4017c90fbaff349cb97938b23a70f: Status 404 returned error can't find the container with id 52aba099a523f9ad490dc6994cd0f6ae5cd4017c90fbaff349cb97938b23a70f
Sep 10 14:32:13.946190 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.946158    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:32:13.946263 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.946228    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:32:13.946307 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.946263    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:32:13.994477 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.994448    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44594bd8-4672-485f-9d83-5ffe478fb19a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk\" (UID: \"44594bd8-4672-485f-9d83-5ffe478fb19a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk"
Sep 10 14:32:13.994619 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.994561    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6d8z\" (UniqueName: \"kubernetes.io/projected/44594bd8-4672-485f-9d83-5ffe478fb19a-kube-api-access-n6d8z\") pod \"payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk\" (UID: \"44594bd8-4672-485f-9d83-5ffe478fb19a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk"
Sep 10 14:32:13.995170 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:13.995146    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44594bd8-4672-485f-9d83-5ffe478fb19a-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk\" (UID: \"44594bd8-4672-485f-9d83-5ffe478fb19a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk"
Sep 10 14:32:14.003074 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:14.003048    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6d8z\" (UniqueName: \"kubernetes.io/projected/44594bd8-4672-485f-9d83-5ffe478fb19a-kube-api-access-n6d8z\") pod \"payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk\" (UID: \"44594bd8-4672-485f-9d83-5ffe478fb19a\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk"
Sep 10 14:32:14.118102 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:14.118060    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w" event={"ID":"7afa8372-b33a-4f4e-a435-2c1792f1575b","Type":"ContainerStarted","Data":"b428aa354e03016ed4fc10179b8a6fcfdd3f8912b79d8bb0f00d309f89904bb1"}
Sep 10 14:32:14.118301 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:14.118135    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w" event={"ID":"7afa8372-b33a-4f4e-a435-2c1792f1575b","Type":"ContainerStarted","Data":"52aba099a523f9ad490dc6994cd0f6ae5cd4017c90fbaff349cb97938b23a70f"}
Sep 10 14:32:14.147911 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:14.147855    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w" podStartSLOduration=1.147834431 podStartE2EDuration="1.147834431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:32:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:32:14.14547943 +0000 UTC m=+1232.263020905" watchObservedRunningTime="2026-09-10 14:32:14.147834431 +0000 UTC m=+1232.265375907"
Sep 10 14:32:14.154965 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:14.154939    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk"
Sep 10 14:32:14.448397 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:14.448373    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk"]
Sep 10 14:32:14.449703 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:32:14.449675    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44594bd8_4672_485f_9d83_5ffe478fb19a.slice/crio-1ba1c8071bc6b67a7ade585dde77bbfacefeda67782259dde61aebf2ffafad39 WatchSource:0}: Error finding container 1ba1c8071bc6b67a7ade585dde77bbfacefeda67782259dde61aebf2ffafad39: Status 404 returned error can't find the container with id 1ba1c8071bc6b67a7ade585dde77bbfacefeda67782259dde61aebf2ffafad39
Sep 10 14:32:14.654984 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:14.654940    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:15.127217 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:15.127175    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk" event={"ID":"44594bd8-4672-485f-9d83-5ffe478fb19a","Type":"ContainerStarted","Data":"7e822e4a5902f2a1442a2b07b2d78ccfef4b107d09e65808e1ac2e85715bca5d"}
Sep 10 14:32:15.127402 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:15.127236    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk" event={"ID":"44594bd8-4672-485f-9d83-5ffe478fb19a","Type":"ContainerStarted","Data":"1ba1c8071bc6b67a7ade585dde77bbfacefeda67782259dde61aebf2ffafad39"}
Sep 10 14:32:15.127449 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:15.127428    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk"
Sep 10 14:32:15.152584 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:15.152518    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk" podStartSLOduration=2.152498644 podStartE2EDuration="2.152498644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:32:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:32:15.149237613 +0000 UTC m=+1233.266779100" watchObservedRunningTime="2026-09-10 14:32:15.152498644 +0000 UTC m=+1233.270040113"
Sep 10 14:32:15.660478 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:15.660447    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:16.133759 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:16.133718    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:16.134628 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:16.134608    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:18.065584 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:18.065543    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz"]
Sep 10 14:32:18.070718 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:18.070692    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz"
Sep 10 14:32:18.073517 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:18.073479    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-54c040\""
Sep 10 14:32:18.073945 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:18.073926    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-54c040-dockercfg-ghj55\""
Sep 10 14:32:18.082807 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:18.082783    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz"]
Sep 10 14:32:18.139511 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:18.138289    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad20178e-1fac-4824-8d4f-af27e7628c5c-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz\" (UID: \"ad20178e-1fac-4824-8d4f-af27e7628c5c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz"
Sep 10 14:32:18.139511 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:18.138350    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvq95\" (UniqueName: \"kubernetes.io/projected/ad20178e-1fac-4824-8d4f-af27e7628c5c-kube-api-access-gvq95\") pod \"payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz\" (UID: \"ad20178e-1fac-4824-8d4f-af27e7628c5c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz"
Sep 10 14:32:18.239190 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:18.239139    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad20178e-1fac-4824-8d4f-af27e7628c5c-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz\" (UID: \"ad20178e-1fac-4824-8d4f-af27e7628c5c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz"
Sep 10 14:32:18.239190 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:18.239197    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvq95\" (UniqueName: \"kubernetes.io/projected/ad20178e-1fac-4824-8d4f-af27e7628c5c-kube-api-access-gvq95\") pod \"payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz\" (UID: \"ad20178e-1fac-4824-8d4f-af27e7628c5c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz"
Sep 10 14:32:18.239881 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:18.239859    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad20178e-1fac-4824-8d4f-af27e7628c5c-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz\" (UID: \"ad20178e-1fac-4824-8d4f-af27e7628c5c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz"
Sep 10 14:32:18.247857 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:18.247827    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvq95\" (UniqueName: \"kubernetes.io/projected/ad20178e-1fac-4824-8d4f-af27e7628c5c-kube-api-access-gvq95\") pod \"payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz\" (UID: \"ad20178e-1fac-4824-8d4f-af27e7628c5c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz"
Sep 10 14:32:18.384676 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:18.384586    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz"
Sep 10 14:32:18.665026 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:18.665002    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz"]
Sep 10 14:32:18.666606 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:32:18.666578    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad20178e_1fac_4824_8d4f_af27e7628c5c.slice/crio-a56eddf5725feaa749903d5cec7235eba1e7f10e7c0c55f9c1ef7bb2fe135e47 WatchSource:0}: Error finding container a56eddf5725feaa749903d5cec7235eba1e7f10e7c0c55f9c1ef7bb2fe135e47: Status 404 returned error can't find the container with id a56eddf5725feaa749903d5cec7235eba1e7f10e7c0c55f9c1ef7bb2fe135e47
Sep 10 14:32:19.164017 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:19.163975    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz" event={"ID":"ad20178e-1fac-4824-8d4f-af27e7628c5c","Type":"ContainerStarted","Data":"b3a8bf6acc88c4e1ae93f9958503f5bf77c8e671fff6def7677132a75dac0264"}
Sep 10 14:32:19.164466 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:19.164038    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz" event={"ID":"ad20178e-1fac-4824-8d4f-af27e7628c5c","Type":"ContainerStarted","Data":"a56eddf5725feaa749903d5cec7235eba1e7f10e7c0c55f9c1ef7bb2fe135e47"}
Sep 10 14:32:19.164466 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:19.164070    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz"
Sep 10 14:32:19.191073 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:19.191011    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz" podStartSLOduration=1.190992898 podStartE2EDuration="1.190992898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:32:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:32:19.188450918 +0000 UTC m=+1237.305992394" watchObservedRunningTime="2026-09-10 14:32:19.190992898 +0000 UTC m=+1237.308534372"
Sep 10 14:32:26.136345 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:26.136309    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk"
Sep 10 14:32:30.173703 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:30.173669    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz"
Sep 10 14:32:35.272826 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:35.272795    2545 generic.go:356] "Generic (PLEG): container finished" podID="7afa8372-b33a-4f4e-a435-2c1792f1575b" containerID="b428aa354e03016ed4fc10179b8a6fcfdd3f8912b79d8bb0f00d309f89904bb1" exitCode=0
Sep 10 14:32:35.273239 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:35.272870    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w" event={"ID":"7afa8372-b33a-4f4e-a435-2c1792f1575b","Type":"ContainerDied","Data":"b428aa354e03016ed4fc10179b8a6fcfdd3f8912b79d8bb0f00d309f89904bb1"}
Sep 10 14:32:35.273294 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:35.273277    2545 scope.go:117] "RemoveContainer" containerID="b428aa354e03016ed4fc10179b8a6fcfdd3f8912b79d8bb0f00d309f89904bb1"
Sep 10 14:32:35.274358 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:35.274331    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:32:35.274423 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:35.274398    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:32:35.274461 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:35.274425    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:32:36.282119 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:36.282080    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w" event={"ID":"7afa8372-b33a-4f4e-a435-2c1792f1575b","Type":"ContainerStarted","Data":"8f800a141078d018f950b82742ff0454ba03d9134bda8904e8b045bc729ba63d"}
Sep 10 14:32:36.656168 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:36.655653    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:36.656168 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:36.655789    2545 patch_prober.go:28] interesting pod/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 10 14:32:36.656168 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:36.655836    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w" podUID="7afa8372-b33a-4f4e-a435-2c1792f1575b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 10 14:32:37.655516 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:37.655456    2545 patch_prober.go:28] interesting pod/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 10 14:32:37.656128 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:37.656094    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w" podUID="7afa8372-b33a-4f4e-a435-2c1792f1575b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 10 14:32:38.655670 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:38.655619    2545 patch_prober.go:28] interesting pod/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 10 14:32:38.656225 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:38.655710    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w" podUID="7afa8372-b33a-4f4e-a435-2c1792f1575b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 10 14:32:39.655250 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:39.655201    2545 patch_prober.go:28] interesting pod/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 10 14:32:39.655470 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:39.655272    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w" podUID="7afa8372-b33a-4f4e-a435-2c1792f1575b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 10 14:32:40.655595 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:40.655112    2545 patch_prober.go:28] interesting pod/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 10 14:32:40.655595 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:40.655178    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w" podUID="7afa8372-b33a-4f4e-a435-2c1792f1575b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 10 14:32:41.655519 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:41.655445    2545 patch_prober.go:28] interesting pod/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Sep 10 14:32:41.655713 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:41.655541    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w" podUID="7afa8372-b33a-4f4e-a435-2c1792f1575b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Sep 10 14:32:42.659383 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:42.659351    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:42.659873 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:42.659743    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:42.660478 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:42.660455    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:32:55.788154 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:55.788120    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt"]
Sep 10 14:32:55.791705 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:55.791683    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt"
Sep 10 14:32:55.794375 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:55.794355    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-e96075f7-dockercfg-jqjpw\""
Sep 10 14:32:55.794611 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:55.794597    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-e96075f7\""
Sep 10 14:32:55.806134 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:55.806110    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt"]
Sep 10 14:32:55.928503 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:55.928456    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxw9t\" (UniqueName: \"kubernetes.io/projected/1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39-kube-api-access-hxw9t\") pod \"payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt\" (UID: \"1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt"
Sep 10 14:32:55.928689 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:55.928620    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt\" (UID: \"1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt"
Sep 10 14:32:56.029705 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:56.029672    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt\" (UID: \"1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt"
Sep 10 14:32:56.029879 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:56.029737    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxw9t\" (UniqueName: \"kubernetes.io/projected/1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39-kube-api-access-hxw9t\") pod \"payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt\" (UID: \"1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt"
Sep 10 14:32:56.030409 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:56.030383    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt\" (UID: \"1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt"
Sep 10 14:32:56.038687 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:56.038623    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxw9t\" (UniqueName: \"kubernetes.io/projected/1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39-kube-api-access-hxw9t\") pod \"payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt\" (UID: \"1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt"
Sep 10 14:32:56.103797 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:56.103765    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt"
Sep 10 14:32:56.376831 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:56.376804    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt"]
Sep 10 14:32:56.377735 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:32:56.377703    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dbbbdeb_9ee6_454c_adfc_d2ebf4c0ad39.slice/crio-2835c879926e13574265a221abee57ac708044129f69afa1c50ff5c537b2731d WatchSource:0}: Error finding container 2835c879926e13574265a221abee57ac708044129f69afa1c50ff5c537b2731d: Status 404 returned error can't find the container with id 2835c879926e13574265a221abee57ac708044129f69afa1c50ff5c537b2731d
Sep 10 14:32:56.409928 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:56.409900    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt" event={"ID":"1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39","Type":"ContainerStarted","Data":"2835c879926e13574265a221abee57ac708044129f69afa1c50ff5c537b2731d"}
Sep 10 14:32:57.418168 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:57.418126    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt" event={"ID":"1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39","Type":"ContainerStarted","Data":"2b01cdafec1bd0fcc4b34e002c8eff31beaf0d058b228ff4e861b9f4d0fdd911"}
Sep 10 14:32:57.418629 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:57.418326    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt"
Sep 10 14:32:57.436182 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:32:57.436133    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt" podStartSLOduration=2.436119219 podStartE2EDuration="2.436119219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:32:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:32:57.433955602 +0000 UTC m=+1275.551497080" watchObservedRunningTime="2026-09-10 14:32:57.436119219 +0000 UTC m=+1275.553660693"
Sep 10 14:33:08.426145 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:33:08.426113    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt"
Sep 10 14:33:42.533663 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:33:42.533622    2545 scope.go:117] "RemoveContainer" containerID="75163c678a92adeb01bbaaf9f636e2ff779821b00fc74e1ca20b40c5f802a9a0"
Sep 10 14:34:29.165474 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:29.165441    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e96075f7-6ktmz"]
Sep 10 14:34:29.169278 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:29.169256    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e96075f7-6ktmz"
Sep 10 14:34:29.173267 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:29.173246    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:34:29.174028 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:29.174008    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pj254\""
Sep 10 14:34:29.193914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:29.193890    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e96075f7-6ktmz"]
Sep 10 14:34:29.317076 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:29.317041    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34059054-676a-4889-990c-8dd9bae51e20-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e96075f7-6ktmz\" (UID: \"34059054-676a-4889-990c-8dd9bae51e20\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e96075f7-6ktmz"
Sep 10 14:34:29.417950 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:29.417864    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34059054-676a-4889-990c-8dd9bae51e20-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e96075f7-6ktmz\" (UID: \"34059054-676a-4889-990c-8dd9bae51e20\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e96075f7-6ktmz"
Sep 10 14:34:29.418536 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:29.418507    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34059054-676a-4889-990c-8dd9bae51e20-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e96075f7-6ktmz\" (UID: \"34059054-676a-4889-990c-8dd9bae51e20\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e96075f7-6ktmz"
Sep 10 14:34:29.479863 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:29.479834    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e96075f7-6ktmz"
Sep 10 14:34:29.754190 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:29.754163    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e96075f7-6ktmz"]
Sep 10 14:34:29.755724 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:34:29.755699    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34059054_676a_4889_990c_8dd9bae51e20.slice/crio-2688d9d643dadfbc6edc6dd296d22562cf145a7403c425524e87479f70afd22f WatchSource:0}: Error finding container 2688d9d643dadfbc6edc6dd296d22562cf145a7403c425524e87479f70afd22f: Status 404 returned error can't find the container with id 2688d9d643dadfbc6edc6dd296d22562cf145a7403c425524e87479f70afd22f
Sep 10 14:34:29.997548 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:29.997515    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e96075f7-6ktmz" event={"ID":"34059054-676a-4889-990c-8dd9bae51e20","Type":"ContainerStarted","Data":"2688d9d643dadfbc6edc6dd296d22562cf145a7403c425524e87479f70afd22f"}
Sep 10 14:34:31.005613 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:31.005576    2545 generic.go:356] "Generic (PLEG): container finished" podID="34059054-676a-4889-990c-8dd9bae51e20" containerID="8064b8896e43f06b81188882ab384d89a0cd27c028cbcf4a2d6278dacaf30479" exitCode=0
Sep 10 14:34:31.005964 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:31.005663    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e96075f7-6ktmz" event={"ID":"34059054-676a-4889-990c-8dd9bae51e20","Type":"ContainerDied","Data":"8064b8896e43f06b81188882ab384d89a0cd27c028cbcf4a2d6278dacaf30479"}
Sep 10 14:34:32.139787 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:32.139764    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e96075f7-6ktmz"
Sep 10 14:34:32.246383 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:32.246358    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34059054-676a-4889-990c-8dd9bae51e20-maas-api-service-ca\") pod \"34059054-676a-4889-990c-8dd9bae51e20\" (UID: \"34059054-676a-4889-990c-8dd9bae51e20\") "
Sep 10 14:34:32.246707 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:32.246687    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34059054-676a-4889-990c-8dd9bae51e20-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "34059054-676a-4889-990c-8dd9bae51e20" (UID: "34059054-676a-4889-990c-8dd9bae51e20"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:34:32.347178 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:32.347110    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/34059054-676a-4889-990c-8dd9bae51e20-maas-api-service-ca\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:34:33.019241 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:33.019209    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e96075f7-6ktmz"
Sep 10 14:34:33.019241 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:33.019219    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e96075f7-6ktmz" event={"ID":"34059054-676a-4889-990c-8dd9bae51e20","Type":"ContainerDied","Data":"2688d9d643dadfbc6edc6dd296d22562cf145a7403c425524e87479f70afd22f"}
Sep 10 14:34:33.019461 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:33.019306    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2688d9d643dadfbc6edc6dd296d22562cf145a7403c425524e87479f70afd22f"
Sep 10 14:34:42.557439 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:42.557407    2545 scope.go:117] "RemoveContainer" containerID="1dc67d7e7e7cf858cadbde5f6038f2af01ff8183431089b975df6eab91926cc2"
Sep 10 14:34:42.566393 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:42.566374    2545 scope.go:117] "RemoveContainer" containerID="6c7f91042f03bb4b18ea25166d70cf297efc1ccbd80156e9959db23598af13b0"
Sep 10 14:34:44.606927 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:44.606892    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt"]
Sep 10 14:34:44.607399 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:44.607144    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt" podUID="1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39" containerName="payload-pre-processing" containerID="cri-o://2b01cdafec1bd0fcc4b34e002c8eff31beaf0d058b228ff4e861b9f4d0fdd911" gracePeriod=30
Sep 10 14:34:44.883288 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:44.883263    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt"
Sep 10 14:34:44.917794 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:44.917766    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e96075f7-6ktmz"]
Sep 10 14:34:44.925532 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:44.925499    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e96075f7-6ktmz"]
Sep 10 14:34:44.973014 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:44.972984    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39-plugins-config-volume\") pod \"1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39\" (UID: \"1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39\") "
Sep 10 14:34:44.973155 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:44.973024    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxw9t\" (UniqueName: \"kubernetes.io/projected/1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39-kube-api-access-hxw9t\") pod \"1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39\" (UID: \"1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39\") "
Sep 10 14:34:44.973407 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:44.973386    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39" (UID: "1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:34:44.975109 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:44.975062    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39-kube-api-access-hxw9t" (OuterVolumeSpecName: "kube-api-access-hxw9t") pod "1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39" (UID: "1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39"). InnerVolumeSpecName "kube-api-access-hxw9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:34:45.074319 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:45.074284    2545 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39-plugins-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:34:45.074319 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:45.074312    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxw9t\" (UniqueName: \"kubernetes.io/projected/1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39-kube-api-access-hxw9t\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:34:45.097244 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:45.097208    2545 generic.go:356] "Generic (PLEG): container finished" podID="1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39" containerID="2b01cdafec1bd0fcc4b34e002c8eff31beaf0d058b228ff4e861b9f4d0fdd911" exitCode=0
Sep 10 14:34:45.097366 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:45.097252    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt"
Sep 10 14:34:45.097366 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:45.097299    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt" event={"ID":"1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39","Type":"ContainerDied","Data":"2b01cdafec1bd0fcc4b34e002c8eff31beaf0d058b228ff4e861b9f4d0fdd911"}
Sep 10 14:34:45.097366 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:45.097348    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt" event={"ID":"1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39","Type":"ContainerDied","Data":"2835c879926e13574265a221abee57ac708044129f69afa1c50ff5c537b2731d"}
Sep 10 14:34:45.097483 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:45.097376    2545 scope.go:117] "RemoveContainer" containerID="2b01cdafec1bd0fcc4b34e002c8eff31beaf0d058b228ff4e861b9f4d0fdd911"
Sep 10 14:34:45.108173 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:45.108153    2545 scope.go:117] "RemoveContainer" containerID="2b01cdafec1bd0fcc4b34e002c8eff31beaf0d058b228ff4e861b9f4d0fdd911"
Sep 10 14:34:45.108433 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:34:45.108412    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b01cdafec1bd0fcc4b34e002c8eff31beaf0d058b228ff4e861b9f4d0fdd911\": container with ID starting with 2b01cdafec1bd0fcc4b34e002c8eff31beaf0d058b228ff4e861b9f4d0fdd911 not found: ID does not exist" containerID="2b01cdafec1bd0fcc4b34e002c8eff31beaf0d058b228ff4e861b9f4d0fdd911"
Sep 10 14:34:45.108521 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:45.108439    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b01cdafec1bd0fcc4b34e002c8eff31beaf0d058b228ff4e861b9f4d0fdd911"} err="failed to get container status \"2b01cdafec1bd0fcc4b34e002c8eff31beaf0d058b228ff4e861b9f4d0fdd911\": rpc error: code = NotFound desc = could not find container \"2b01cdafec1bd0fcc4b34e002c8eff31beaf0d058b228ff4e861b9f4d0fdd911\": container with ID starting with 2b01cdafec1bd0fcc4b34e002c8eff31beaf0d058b228ff4e861b9f4d0fdd911 not found: ID does not exist"
Sep 10 14:34:45.126436 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:45.126381    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt"]
Sep 10 14:34:45.131887 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:45.131867    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e96075f7-54f694958-46kzt"]
Sep 10 14:34:46.366817 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:46.366783    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39" path="/var/lib/kubelet/pods/1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39/volumes"
Sep 10 14:34:46.367181 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:34:46.367126    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34059054-676a-4889-990c-8dd9bae51e20" path="/var/lib/kubelet/pods/34059054-676a-4889-990c-8dd9bae51e20/volumes"
Sep 10 14:35:42.592059 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:35:42.591981    2545 scope.go:117] "RemoveContainer" containerID="a2c58e19cfb4dc172d6ca11411379135c00a4058f48bae87555d55957eb5a5d8"
Sep 10 14:35:42.601624 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:35:42.601596    2545 scope.go:117] "RemoveContainer" containerID="86e2a18acdcd88902a55070116cd3cc93d8fefceed7f5b0717ce31ff9e54a1ba"
Sep 10 14:36:30.542583 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.542547    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"]
Sep 10 14:36:30.543283 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.543262    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34059054-676a-4889-990c-8dd9bae51e20" containerName="revoke-keys"
Sep 10 14:36:30.543328 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.543287    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="34059054-676a-4889-990c-8dd9bae51e20" containerName="revoke-keys"
Sep 10 14:36:30.543328 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.543302    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39" containerName="payload-pre-processing"
Sep 10 14:36:30.543328 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.543312    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39" containerName="payload-pre-processing"
Sep 10 14:36:30.543459 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.543447    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="34059054-676a-4889-990c-8dd9bae51e20" containerName="revoke-keys"
Sep 10 14:36:30.543508 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.543464    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dbbbdeb-9ee6-454c-adfc-d2ebf4c0ad39" containerName="payload-pre-processing"
Sep 10 14:36:30.547141 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.547123    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.549799 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.549782    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-53471f-openshift-default-dockercfg-cdr6z\""
Sep 10 14:36:30.556900 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.556870    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"]
Sep 10 14:36:30.587935 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.587909    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-istio-data\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.588077 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.587963    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhqcc\" (UniqueName: \"kubernetes.io/projected/d70644ec-94c2-4584-b124-7ddc69149c4c-kube-api-access-nhqcc\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.588077 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.588007    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d70644ec-94c2-4584-b124-7ddc69149c4c-istio-podinfo\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.588077 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.588047    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-workload-socket\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.588077 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.588065    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-istio-envoy\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.588291 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.588094    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d70644ec-94c2-4584-b124-7ddc69149c4c-istiod-ca-cert\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.588291 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.588113    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-credential-socket\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.588291 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.588187    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d70644ec-94c2-4584-b124-7ddc69149c4c-istio-token\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.588291 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.588224    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-workload-certs\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.689745 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.689706    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhqcc\" (UniqueName: \"kubernetes.io/projected/d70644ec-94c2-4584-b124-7ddc69149c4c-kube-api-access-nhqcc\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.689745 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.689747    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d70644ec-94c2-4584-b124-7ddc69149c4c-istio-podinfo\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.690014 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.689770    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-workload-socket\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.690014 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.689785    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-istio-envoy\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.690014 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.689837    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d70644ec-94c2-4584-b124-7ddc69149c4c-istiod-ca-cert\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.690014 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.689875    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-credential-socket\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.690014 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.689908    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d70644ec-94c2-4584-b124-7ddc69149c4c-istio-token\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.690014 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.689927    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-workload-certs\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.690402 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.690035    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-istio-data\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.690402 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.690280    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-workload-socket\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.690402 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.690314    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-credential-socket\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.690402 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.690384    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-workload-certs\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.690599 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.690475    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-istio-data\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.690739 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.690720    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d70644ec-94c2-4584-b124-7ddc69149c4c-istiod-ca-cert\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.692025 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.692004    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-istio-envoy\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.692253 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.692235    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d70644ec-94c2-4584-b124-7ddc69149c4c-istio-podinfo\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.701266 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.701245    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d70644ec-94c2-4584-b124-7ddc69149c4c-istio-token\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.701418 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.701401    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhqcc\" (UniqueName: \"kubernetes.io/projected/d70644ec-94c2-4584-b124-7ddc69149c4c-kube-api-access-nhqcc\") pod \"e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") " pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:30.859005 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:30.858922    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:31.136914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:31.136887    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"]
Sep 10 14:36:31.138597 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:36:31.138570    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd70644ec_94c2_4584_b124_7ddc69149c4c.slice/crio-5089512f0f932a6767196096ac1139f1ae22558c0dc9f7fbf98fb83c41b01a56 WatchSource:0}: Error finding container 5089512f0f932a6767196096ac1139f1ae22558c0dc9f7fbf98fb83c41b01a56: Status 404 returned error can't find the container with id 5089512f0f932a6767196096ac1139f1ae22558c0dc9f7fbf98fb83c41b01a56
Sep 10 14:36:31.140808 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:31.140777    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:36:31.140907 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:31.140838    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:36:31.140907 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:31.140865    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:36:31.787201 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:31.787165    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55" event={"ID":"d70644ec-94c2-4584-b124-7ddc69149c4c","Type":"ContainerStarted","Data":"3d76f51ecdb1d406859b6778eae836a75a423523d20a9790443696f52b366303"}
Sep 10 14:36:31.787608 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:31.787224    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55" event={"ID":"d70644ec-94c2-4584-b124-7ddc69149c4c","Type":"ContainerStarted","Data":"5089512f0f932a6767196096ac1139f1ae22558c0dc9f7fbf98fb83c41b01a56"}
Sep 10 14:36:31.808276 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:31.808231    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55" podStartSLOduration=1.808215984 podStartE2EDuration="1.808215984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:36:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:36:31.807081049 +0000 UTC m=+1489.924622515" watchObservedRunningTime="2026-09-10 14:36:31.808215984 +0000 UTC m=+1489.925757455"
Sep 10 14:36:31.859859 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:31.859836    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:32.864470 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:32.864440    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:33.799312 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:33.799282    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:33.800317 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:33.800294    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:35.485424 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:35.485389    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc"]
Sep 10 14:36:35.489079 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:35.489062    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc"
Sep 10 14:36:35.491752 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:35.491728    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-53471f\""
Sep 10 14:36:35.492006 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:35.491988    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-53471f-dockercfg-qhwnb\""
Sep 10 14:36:35.499356 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:35.499335    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc"]
Sep 10 14:36:35.535901 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:35.535875    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7whl7\" (UniqueName: \"kubernetes.io/projected/ce6485ef-a481-49bc-88f1-7c3cc5bb672b-kube-api-access-7whl7\") pod \"payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc\" (UID: \"ce6485ef-a481-49bc-88f1-7c3cc5bb672b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc"
Sep 10 14:36:35.536022 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:35.535936    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce6485ef-a481-49bc-88f1-7c3cc5bb672b-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc\" (UID: \"ce6485ef-a481-49bc-88f1-7c3cc5bb672b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc"
Sep 10 14:36:35.636951 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:35.636911    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7whl7\" (UniqueName: \"kubernetes.io/projected/ce6485ef-a481-49bc-88f1-7c3cc5bb672b-kube-api-access-7whl7\") pod \"payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc\" (UID: \"ce6485ef-a481-49bc-88f1-7c3cc5bb672b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc"
Sep 10 14:36:35.637145 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:35.636960    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce6485ef-a481-49bc-88f1-7c3cc5bb672b-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc\" (UID: \"ce6485ef-a481-49bc-88f1-7c3cc5bb672b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc"
Sep 10 14:36:35.637655 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:35.637636    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce6485ef-a481-49bc-88f1-7c3cc5bb672b-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc\" (UID: \"ce6485ef-a481-49bc-88f1-7c3cc5bb672b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc"
Sep 10 14:36:35.644995 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:35.644972    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7whl7\" (UniqueName: \"kubernetes.io/projected/ce6485ef-a481-49bc-88f1-7c3cc5bb672b-kube-api-access-7whl7\") pod \"payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc\" (UID: \"ce6485ef-a481-49bc-88f1-7c3cc5bb672b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc"
Sep 10 14:36:35.800778 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:35.800748    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc"
Sep 10 14:36:36.079085 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:36.079051    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc"]
Sep 10 14:36:36.081074 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:36:36.081026    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce6485ef_a481_49bc_88f1_7c3cc5bb672b.slice/crio-0f34b316a01516c667b61ebb2396b6d4f18454b237354ae15d9bff54adfec105 WatchSource:0}: Error finding container 0f34b316a01516c667b61ebb2396b6d4f18454b237354ae15d9bff54adfec105: Status 404 returned error can't find the container with id 0f34b316a01516c667b61ebb2396b6d4f18454b237354ae15d9bff54adfec105
Sep 10 14:36:36.822914 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:36.822876    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc" event={"ID":"ce6485ef-a481-49bc-88f1-7c3cc5bb672b","Type":"ContainerStarted","Data":"e80483c4977ff70153809adebb9d2f7eb7804bb087ecbf7c9a25916ef05b877a"}
Sep 10 14:36:36.823329 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:36.823022    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc"
Sep 10 14:36:36.823329 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:36.823047    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc" event={"ID":"ce6485ef-a481-49bc-88f1-7c3cc5bb672b","Type":"ContainerStarted","Data":"0f34b316a01516c667b61ebb2396b6d4f18454b237354ae15d9bff54adfec105"}
Sep 10 14:36:36.843683 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:36.843636    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc" podStartSLOduration=1.843622736 podStartE2EDuration="1.843622736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:36:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:36:36.840381926 +0000 UTC m=+1494.957923400" watchObservedRunningTime="2026-09-10 14:36:36.843622736 +0000 UTC m=+1494.961164266"
Sep 10 14:36:42.631997 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:42.631961    2545 scope.go:117] "RemoveContainer" containerID="24d2478c5e6f67596e1559a81576918b66a26715a24be837e1e9ac5fe350cfa9"
Sep 10 14:36:42.641363 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:42.641333    2545 scope.go:117] "RemoveContainer" containerID="25d27dc0b4e6ce3d9227972e56d1a36ea6809d0b28c55d8f5958f8d65bc884f0"
Sep 10 14:36:42.669576 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:42.669438    2545 scope.go:117] "RemoveContainer" containerID="f0348e5534e5b2e10199f4525aab1565b3cbc6e1f5cfd21398b7e4f254749744"
Sep 10 14:36:42.681399 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:42.681379    2545 scope.go:117] "RemoveContainer" containerID="88a16dd20be7cb6197cd1d60bb2df76e6c66fef7b8df000195a51d425fc31c4a"
Sep 10 14:36:47.831424 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:47.831391    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc"
Sep 10 14:36:49.194523 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:49.193453    2545 patch_prober.go:28] interesting pod/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": read tcp 10.133.0.2:52766->10.133.0.83:15021: read: connection reset by peer" start-of-body=
Sep 10 14:36:49.194523 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:49.193566    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55" podUID="d70644ec-94c2-4584-b124-7ddc69149c4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": read tcp 10.133.0.2:52766->10.133.0.83:15021: read: connection reset by peer"
Sep 10 14:36:49.915382 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:49.915350    2545 generic.go:356] "Generic (PLEG): container finished" podID="d70644ec-94c2-4584-b124-7ddc69149c4c" containerID="3d76f51ecdb1d406859b6778eae836a75a423523d20a9790443696f52b366303" exitCode=0
Sep 10 14:36:49.915592 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:49.915418    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55" event={"ID":"d70644ec-94c2-4584-b124-7ddc69149c4c","Type":"ContainerDied","Data":"3d76f51ecdb1d406859b6778eae836a75a423523d20a9790443696f52b366303"}
Sep 10 14:36:49.915854 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:49.915840    2545 scope.go:117] "RemoveContainer" containerID="3d76f51ecdb1d406859b6778eae836a75a423523d20a9790443696f52b366303"
Sep 10 14:36:49.916927 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:49.916902    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:36:49.916984 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:49.916972    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:36:49.917024 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:49.917005    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:36:50.923402 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:50.923366    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55" event={"ID":"d70644ec-94c2-4584-b124-7ddc69149c4c","Type":"ContainerStarted","Data":"4f70e5061f8506d2c63f761212e32604bbc15e7de3768a76436ee0a0bb84b059"}
Sep 10 14:36:51.859399 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:51.859364    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:51.859695 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:51.859603    2545 patch_prober.go:28] interesting pod/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 10 14:36:51.859851 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:51.859827    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55" podUID="d70644ec-94c2-4584-b124-7ddc69149c4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 10 14:36:52.860294 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:52.860259    2545 patch_prober.go:28] interesting pod/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 10 14:36:52.860893 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:52.860862    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55" podUID="d70644ec-94c2-4584-b124-7ddc69149c4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 10 14:36:53.859781 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:53.859740    2545 patch_prober.go:28] interesting pod/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 10 14:36:53.859999 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:53.859805    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55" podUID="d70644ec-94c2-4584-b124-7ddc69149c4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 10 14:36:54.860404 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:54.860363    2545 patch_prober.go:28] interesting pod/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 10 14:36:54.861504 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:54.861456    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55" podUID="d70644ec-94c2-4584-b124-7ddc69149c4c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 10 14:36:55.890394 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:55.890360    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:55.891033 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:55.891002    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:36:55.891988 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:36:55.891956    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:37:04.130124 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:04.130087    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk"]
Sep 10 14:37:04.135397 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:04.135375    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk"
Sep 10 14:37:04.138533 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:04.138505    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-7ae247-dockercfg-78r7z\""
Sep 10 14:37:04.138618 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:04.138505    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-7ae247\""
Sep 10 14:37:04.146749 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:04.146727    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk"]
Sep 10 14:37:04.174352 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:04.174325    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k"]
Sep 10 14:37:04.178149 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:04.178134    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k"
Sep 10 14:37:04.189964 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:04.189942    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k"]
Sep 10 14:37:04.215030 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:04.215003    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cad125ec-49a5-4981-acc7-b114c27aebef-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk\" (UID: \"cad125ec-49a5-4981-acc7-b114c27aebef\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk"
Sep 10 14:37:04.215126 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:04.215048    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzrjj\" (UniqueName: \"kubernetes.io/projected/cad125ec-49a5-4981-acc7-b114c27aebef-kube-api-access-wzrjj\") pod \"payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk\" (UID: \"cad125ec-49a5-4981-acc7-b114c27aebef\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk"
Sep 10 14:37:04.316378 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:04.316335    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cad125ec-49a5-4981-acc7-b114c27aebef-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk\" (UID: \"cad125ec-49a5-4981-acc7-b114c27aebef\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk"
Sep 10 14:37:04.316593 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:04.316398    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzrjj\" (UniqueName: \"kubernetes.io/projected/cad125ec-49a5-4981-acc7-b114c27aebef-kube-api-access-wzrjj\") pod \"payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk\" (UID: \"cad125ec-49a5-4981-acc7-b114c27aebef\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk"
Sep 10 14:37:04.316593 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:04.316429    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bf03bda-741e-43fc-bbeb-5b620c829dfb-plugins-config-volume\") pod \"payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k\" (UID: \"2bf03bda-741e-43fc-bbeb-5b620c829dfb\") " pod="openshift-ingress/payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k"
Sep 10 14:37:04.316593 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:04.316472    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwvnx\" (UniqueName: \"kubernetes.io/projected/2bf03bda-741e-43fc-bbeb-5b620c829dfb-kube-api-access-xwvnx\") pod \"payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k\" (UID: \"2bf03bda-741e-43fc-bbeb-5b620c829dfb\") " pod="openshift-ingress/payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k"
Sep 10 14:37:04.317180 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:04.317160    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cad125ec-49a5-4981-acc7-b114c27aebef-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk\" (UID: \"cad125ec-49a5-4981-acc7-b114c27aebef\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk"
Sep 10 14:37:04.324788 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:04.324765    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzrjj\" (UniqueName: \"kubernetes.io/projected/cad125ec-49a5-4981-acc7-b114c27aebef-kube-api-access-wzrjj\") pod \"payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk\" (UID: \"cad125ec-49a5-4981-acc7-b114c27aebef\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk"
Sep 10 14:37:04.417466 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:04.417381    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bf03bda-741e-43fc-bbeb-5b620c829dfb-plugins-config-volume\") pod \"payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k\" (UID: \"2bf03bda-741e-43fc-bbeb-5b620c829dfb\") " pod="openshift-ingress/payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k"
Sep 10 14:37:04.417466 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:04.417433    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwvnx\" (UniqueName: \"kubernetes.io/projected/2bf03bda-741e-43fc-bbeb-5b620c829dfb-kube-api-access-xwvnx\") pod \"payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k\" (UID: \"2bf03bda-741e-43fc-bbeb-5b620c829dfb\") " pod="openshift-ingress/payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k"
Sep 10 14:37:04.418072 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:04.418051    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bf03bda-741e-43fc-bbeb-5b620c829dfb-plugins-config-volume\") pod \"payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k\" (UID: \"2bf03bda-741e-43fc-bbeb-5b620c829dfb\") " pod="openshift-ingress/payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k"
Sep 10 14:37:04.426191 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:04.426158    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwvnx\" (UniqueName: \"kubernetes.io/projected/2bf03bda-741e-43fc-bbeb-5b620c829dfb-kube-api-access-xwvnx\") pod \"payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k\" (UID: \"2bf03bda-741e-43fc-bbeb-5b620c829dfb\") " pod="openshift-ingress/payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k"
Sep 10 14:37:04.446020 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:04.446000    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk"
Sep 10 14:37:04.489346 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:04.489312    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k"
Sep 10 14:37:04.722542 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:04.722513    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk"]
Sep 10 14:37:04.723937 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:37:04.723909    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad125ec_49a5_4981_acc7_b114c27aebef.slice/crio-45b8a9762c9befbbb68c18b0072e94eead81303e9455ed3dbe34408286b5ec04 WatchSource:0}: Error finding container 45b8a9762c9befbbb68c18b0072e94eead81303e9455ed3dbe34408286b5ec04: Status 404 returned error can't find the container with id 45b8a9762c9befbbb68c18b0072e94eead81303e9455ed3dbe34408286b5ec04
Sep 10 14:37:04.776816 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:04.776792    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k"]
Sep 10 14:37:04.779680 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:37:04.779651    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bf03bda_741e_43fc_bbeb_5b620c829dfb.slice/crio-af4b932df93bfb57bd5877e5b4401ab502b59491859c6fa7bbe6620ce0bcf712 WatchSource:0}: Error finding container af4b932df93bfb57bd5877e5b4401ab502b59491859c6fa7bbe6620ce0bcf712: Status 404 returned error can't find the container with id af4b932df93bfb57bd5877e5b4401ab502b59491859c6fa7bbe6620ce0bcf712
Sep 10 14:37:05.017186 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:05.017150    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k" event={"ID":"2bf03bda-741e-43fc-bbeb-5b620c829dfb","Type":"ContainerStarted","Data":"21d6f3f405c144cdecec5b1a4c9aa249188506321da977e1316cdca4c549b5c3"}
Sep 10 14:37:05.017433 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:05.017216    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k" event={"ID":"2bf03bda-741e-43fc-bbeb-5b620c829dfb","Type":"ContainerStarted","Data":"af4b932df93bfb57bd5877e5b4401ab502b59491859c6fa7bbe6620ce0bcf712"}
Sep 10 14:37:05.017433 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:05.017270    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k"
Sep 10 14:37:05.018807 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:05.018784    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk" event={"ID":"cad125ec-49a5-4981-acc7-b114c27aebef","Type":"ContainerStarted","Data":"8b82e877d3e858c07ca896895cf493b93777add4abb0dbafc0894a15bcc19ec6"}
Sep 10 14:37:05.018915 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:05.018822    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk"
Sep 10 14:37:05.018915 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:05.018838    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk" event={"ID":"cad125ec-49a5-4981-acc7-b114c27aebef","Type":"ContainerStarted","Data":"45b8a9762c9befbbb68c18b0072e94eead81303e9455ed3dbe34408286b5ec04"}
Sep 10 14:37:05.035977 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:05.035934    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k" podStartSLOduration=1.035922087 podStartE2EDuration="1.035922087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:37:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:37:05.034548409 +0000 UTC m=+1523.152089884" watchObservedRunningTime="2026-09-10 14:37:05.035922087 +0000 UTC m=+1523.153463621"
Sep 10 14:37:05.050779 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:05.050727    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk" podStartSLOduration=1.05070977 podStartE2EDuration="1.05070977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:37:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:37:05.050323978 +0000 UTC m=+1523.167865455" watchObservedRunningTime="2026-09-10 14:37:05.05070977 +0000 UTC m=+1523.168251278"
Sep 10 14:37:16.027253 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:16.027217    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk"
Sep 10 14:37:16.027704 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:16.027299    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k"
Sep 10 14:37:30.096666 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:30.096625    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53471f-s998t"]
Sep 10 14:37:30.100464 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:30.100447    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53471f-s998t"
Sep 10 14:37:30.103135 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:30.103114    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:37:30.103234 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:30.103209    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pj254\""
Sep 10 14:37:30.108227 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:30.108203    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53471f-s998t"]
Sep 10 14:37:30.164114 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:30.164078    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb11ac45-116e-4d48-b02c-090c2448d30a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-53471f-s998t\" (UID: \"bb11ac45-116e-4d48-b02c-090c2448d30a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53471f-s998t"
Sep 10 14:37:30.264958 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:30.264916    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb11ac45-116e-4d48-b02c-090c2448d30a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-53471f-s998t\" (UID: \"bb11ac45-116e-4d48-b02c-090c2448d30a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53471f-s998t"
Sep 10 14:37:30.265602 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:30.265583    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb11ac45-116e-4d48-b02c-090c2448d30a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-53471f-s998t\" (UID: \"bb11ac45-116e-4d48-b02c-090c2448d30a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53471f-s998t"
Sep 10 14:37:30.412627 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:30.412544    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53471f-s998t"
Sep 10 14:37:30.684975 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:30.684941    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53471f-s998t"]
Sep 10 14:37:30.690014 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:37:30.689987    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb11ac45_116e_4d48_b02c_090c2448d30a.slice/crio-f4cb5d82f5a4fb22216b8ee9b379b494383ba2463f1bd6f6b6b3501b591e1e8d WatchSource:0}: Error finding container f4cb5d82f5a4fb22216b8ee9b379b494383ba2463f1bd6f6b6b3501b591e1e8d: Status 404 returned error can't find the container with id f4cb5d82f5a4fb22216b8ee9b379b494383ba2463f1bd6f6b6b3501b591e1e8d
Sep 10 14:37:31.181100 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:31.181064    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53471f-s998t" event={"ID":"bb11ac45-116e-4d48-b02c-090c2448d30a","Type":"ContainerStarted","Data":"d9f3ca9fbeadf07a7f12fc72d4c789e40bf65879bceb3bdfc48bfbfa3314ca63"}
Sep 10 14:37:31.181501 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:31.181128    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53471f-s998t" event={"ID":"bb11ac45-116e-4d48-b02c-090c2448d30a","Type":"ContainerStarted","Data":"f4cb5d82f5a4fb22216b8ee9b379b494383ba2463f1bd6f6b6b3501b591e1e8d"}
Sep 10 14:37:31.200209 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:31.200161    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53471f-s998t" podStartSLOduration=1.200146428 podStartE2EDuration="1.200146428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:37:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:37:31.197949352 +0000 UTC m=+1549.315490823" watchObservedRunningTime="2026-09-10 14:37:31.200146428 +0000 UTC m=+1549.317687903"
Sep 10 14:37:32.189243 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:32.189205    2545 generic.go:356] "Generic (PLEG): container finished" podID="bb11ac45-116e-4d48-b02c-090c2448d30a" containerID="d9f3ca9fbeadf07a7f12fc72d4c789e40bf65879bceb3bdfc48bfbfa3314ca63" exitCode=0
Sep 10 14:37:32.189715 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:32.189288    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53471f-s998t" event={"ID":"bb11ac45-116e-4d48-b02c-090c2448d30a","Type":"ContainerDied","Data":"d9f3ca9fbeadf07a7f12fc72d4c789e40bf65879bceb3bdfc48bfbfa3314ca63"}
Sep 10 14:37:33.334348 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:33.334320    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53471f-s998t"
Sep 10 14:37:33.398565 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:33.398533    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb11ac45-116e-4d48-b02c-090c2448d30a-maas-api-service-ca\") pod \"bb11ac45-116e-4d48-b02c-090c2448d30a\" (UID: \"bb11ac45-116e-4d48-b02c-090c2448d30a\") "
Sep 10 14:37:33.398867 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:33.398845    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb11ac45-116e-4d48-b02c-090c2448d30a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bb11ac45-116e-4d48-b02c-090c2448d30a" (UID: "bb11ac45-116e-4d48-b02c-090c2448d30a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:37:33.500128 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:33.500091    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb11ac45-116e-4d48-b02c-090c2448d30a-maas-api-service-ca\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:37:34.202950 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:34.202920    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53471f-s998t"
Sep 10 14:37:34.203131 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:34.202960    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53471f-s998t" event={"ID":"bb11ac45-116e-4d48-b02c-090c2448d30a","Type":"ContainerDied","Data":"f4cb5d82f5a4fb22216b8ee9b379b494383ba2463f1bd6f6b6b3501b591e1e8d"}
Sep 10 14:37:34.203131 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:34.203040    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4cb5d82f5a4fb22216b8ee9b379b494383ba2463f1bd6f6b6b3501b591e1e8d"
Sep 10 14:37:42.715433 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:42.715402    2545 scope.go:117] "RemoveContainer" containerID="6b5f7c69f902a28a9eb52b85ed6b48fa3a3c7a1df21853c488c80696785dfe41"
Sep 10 14:37:42.724658 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:42.724640    2545 scope.go:117] "RemoveContainer" containerID="8c092452b0ea8b82d2561d6162fa32ad3c2f1fed2983c481f011340ed123c2e9"
Sep 10 14:37:42.732747 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:42.732728    2545 scope.go:117] "RemoveContainer" containerID="545cd8a7d993aca1c2706ffc2bc1540be7cc7b89d1befb650ef33ddadff09a50"
Sep 10 14:37:45.795710 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:45.795677    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc"]
Sep 10 14:37:45.796109 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:45.795886    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc" podUID="ce6485ef-a481-49bc-88f1-7c3cc5bb672b" containerName="payload-pre-processing" containerID="cri-o://e80483c4977ff70153809adebb9d2f7eb7804bb087ecbf7c9a25916ef05b877a" gracePeriod=30
Sep 10 14:37:46.028277 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:46.028247    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53471f-s998t"]
Sep 10 14:37:46.033873 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:46.033847    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53471f-s998t"]
Sep 10 14:37:46.053132 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:46.053080    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc"
Sep 10 14:37:46.123037 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:46.123006    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce6485ef-a481-49bc-88f1-7c3cc5bb672b-plugins-config-volume\") pod \"ce6485ef-a481-49bc-88f1-7c3cc5bb672b\" (UID: \"ce6485ef-a481-49bc-88f1-7c3cc5bb672b\") "
Sep 10 14:37:46.123201 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:46.123089    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7whl7\" (UniqueName: \"kubernetes.io/projected/ce6485ef-a481-49bc-88f1-7c3cc5bb672b-kube-api-access-7whl7\") pod \"ce6485ef-a481-49bc-88f1-7c3cc5bb672b\" (UID: \"ce6485ef-a481-49bc-88f1-7c3cc5bb672b\") "
Sep 10 14:37:46.123369 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:46.123346    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce6485ef-a481-49bc-88f1-7c3cc5bb672b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ce6485ef-a481-49bc-88f1-7c3cc5bb672b" (UID: "ce6485ef-a481-49bc-88f1-7c3cc5bb672b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:37:46.125106 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:46.125075    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce6485ef-a481-49bc-88f1-7c3cc5bb672b-kube-api-access-7whl7" (OuterVolumeSpecName: "kube-api-access-7whl7") pod "ce6485ef-a481-49bc-88f1-7c3cc5bb672b" (UID: "ce6485ef-a481-49bc-88f1-7c3cc5bb672b"). InnerVolumeSpecName "kube-api-access-7whl7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:37:46.224804 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:46.224767    2545 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce6485ef-a481-49bc-88f1-7c3cc5bb672b-plugins-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:37:46.224804 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:46.224797    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7whl7\" (UniqueName: \"kubernetes.io/projected/ce6485ef-a481-49bc-88f1-7c3cc5bb672b-kube-api-access-7whl7\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:37:46.279639 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:46.279600    2545 generic.go:356] "Generic (PLEG): container finished" podID="ce6485ef-a481-49bc-88f1-7c3cc5bb672b" containerID="e80483c4977ff70153809adebb9d2f7eb7804bb087ecbf7c9a25916ef05b877a" exitCode=0
Sep 10 14:37:46.279809 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:46.279652    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc"
Sep 10 14:37:46.279809 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:46.279655    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc" event={"ID":"ce6485ef-a481-49bc-88f1-7c3cc5bb672b","Type":"ContainerDied","Data":"e80483c4977ff70153809adebb9d2f7eb7804bb087ecbf7c9a25916ef05b877a"}
Sep 10 14:37:46.279809 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:46.279710    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc" event={"ID":"ce6485ef-a481-49bc-88f1-7c3cc5bb672b","Type":"ContainerDied","Data":"0f34b316a01516c667b61ebb2396b6d4f18454b237354ae15d9bff54adfec105"}
Sep 10 14:37:46.279809 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:46.279741    2545 scope.go:117] "RemoveContainer" containerID="e80483c4977ff70153809adebb9d2f7eb7804bb087ecbf7c9a25916ef05b877a"
Sep 10 14:37:46.289588 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:46.289565    2545 scope.go:117] "RemoveContainer" containerID="e80483c4977ff70153809adebb9d2f7eb7804bb087ecbf7c9a25916ef05b877a"
Sep 10 14:37:46.289891 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:37:46.289868    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e80483c4977ff70153809adebb9d2f7eb7804bb087ecbf7c9a25916ef05b877a\": container with ID starting with e80483c4977ff70153809adebb9d2f7eb7804bb087ecbf7c9a25916ef05b877a not found: ID does not exist" containerID="e80483c4977ff70153809adebb9d2f7eb7804bb087ecbf7c9a25916ef05b877a"
Sep 10 14:37:46.289953 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:46.289899    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e80483c4977ff70153809adebb9d2f7eb7804bb087ecbf7c9a25916ef05b877a"} err="failed to get container status \"e80483c4977ff70153809adebb9d2f7eb7804bb087ecbf7c9a25916ef05b877a\": rpc error: code = NotFound desc = could not find container \"e80483c4977ff70153809adebb9d2f7eb7804bb087ecbf7c9a25916ef05b877a\": container with ID starting with e80483c4977ff70153809adebb9d2f7eb7804bb087ecbf7c9a25916ef05b877a not found: ID does not exist"
Sep 10 14:37:46.302316 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:46.302286    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc"]
Sep 10 14:37:46.304975 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:46.304928    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-53471f-754cc8cc86-dhwgc"]
Sep 10 14:37:46.367823 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:46.367796    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb11ac45-116e-4d48-b02c-090c2448d30a" path="/var/lib/kubelet/pods/bb11ac45-116e-4d48-b02c-090c2448d30a/volumes"
Sep 10 14:37:46.368174 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:46.368161    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce6485ef-a481-49bc-88f1-7c3cc5bb672b" path="/var/lib/kubelet/pods/ce6485ef-a481-49bc-88f1-7c3cc5bb672b/volumes"
Sep 10 14:37:52.326803 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:52.326767    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"]
Sep 10 14:37:52.327260 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:52.327015    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55" podUID="d70644ec-94c2-4584-b124-7ddc69149c4c" containerName="istio-proxy" containerID="cri-o://4f70e5061f8506d2c63f761212e32604bbc15e7de3768a76436ee0a0bb84b059" gracePeriod=30
Sep 10 14:37:52.678961 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:52.678883    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7ae247-gbt2k"]
Sep 10 14:37:52.679325 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:52.679312    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb11ac45-116e-4d48-b02c-090c2448d30a" containerName="revoke-keys"
Sep 10 14:37:52.679364 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:52.679326    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb11ac45-116e-4d48-b02c-090c2448d30a" containerName="revoke-keys"
Sep 10 14:37:52.679364 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:52.679346    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce6485ef-a481-49bc-88f1-7c3cc5bb672b" containerName="payload-pre-processing"
Sep 10 14:37:52.679364 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:52.679352    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce6485ef-a481-49bc-88f1-7c3cc5bb672b" containerName="payload-pre-processing"
Sep 10 14:37:52.679465 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:52.679427    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce6485ef-a481-49bc-88f1-7c3cc5bb672b" containerName="payload-pre-processing"
Sep 10 14:37:52.679465 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:52.679437    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb11ac45-116e-4d48-b02c-090c2448d30a" containerName="revoke-keys"
Sep 10 14:37:52.683734 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:52.683718    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7ae247-gbt2k"
Sep 10 14:37:52.686279 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:52.686254    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:37:52.686415 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:52.686350    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pj254\""
Sep 10 14:37:52.694685 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:52.694662    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7ae247-gbt2k"]
Sep 10 14:37:52.787159 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:52.787132    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cc03d7d-fd64-4a53-8289-dbcbc0f51fb1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-7ae247-gbt2k\" (UID: \"7cc03d7d-fd64-4a53-8289-dbcbc0f51fb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7ae247-gbt2k"
Sep 10 14:37:52.888231 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:52.888199    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cc03d7d-fd64-4a53-8289-dbcbc0f51fb1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-7ae247-gbt2k\" (UID: \"7cc03d7d-fd64-4a53-8289-dbcbc0f51fb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7ae247-gbt2k"
Sep 10 14:37:52.888857 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:52.888827    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cc03d7d-fd64-4a53-8289-dbcbc0f51fb1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-7ae247-gbt2k\" (UID: \"7cc03d7d-fd64-4a53-8289-dbcbc0f51fb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7ae247-gbt2k"
Sep 10 14:37:52.994587 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:52.994559    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7ae247-gbt2k"
Sep 10 14:37:53.264289 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:53.264257    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7ae247-gbt2k"]
Sep 10 14:37:53.265960 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:37:53.265928    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cc03d7d_fd64_4a53_8289_dbcbc0f51fb1.slice/crio-08c89b5086ca1a58efc6409e2fbefd069a122595945ff152a1b7c42bbdb8839b WatchSource:0}: Error finding container 08c89b5086ca1a58efc6409e2fbefd069a122595945ff152a1b7c42bbdb8839b: Status 404 returned error can't find the container with id 08c89b5086ca1a58efc6409e2fbefd069a122595945ff152a1b7c42bbdb8839b
Sep 10 14:37:53.326851 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:53.326822    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7ae247-gbt2k" event={"ID":"7cc03d7d-fd64-4a53-8289-dbcbc0f51fb1","Type":"ContainerStarted","Data":"08c89b5086ca1a58efc6409e2fbefd069a122595945ff152a1b7c42bbdb8839b"}
Sep 10 14:37:54.337812 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:54.337781    2545 generic.go:356] "Generic (PLEG): container finished" podID="7cc03d7d-fd64-4a53-8289-dbcbc0f51fb1" containerID="dba96096f3cc0248be5699899d8966c0a1209db29861ff000607514752309630" exitCode=0
Sep 10 14:37:54.338195 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:54.337859    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7ae247-gbt2k" event={"ID":"7cc03d7d-fd64-4a53-8289-dbcbc0f51fb1","Type":"ContainerDied","Data":"dba96096f3cc0248be5699899d8966c0a1209db29861ff000607514752309630"}
Sep 10 14:37:55.482218 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:55.482195    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7ae247-gbt2k"
Sep 10 14:37:55.614920 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:55.614810    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cc03d7d-fd64-4a53-8289-dbcbc0f51fb1-maas-api-service-ca\") pod \"7cc03d7d-fd64-4a53-8289-dbcbc0f51fb1\" (UID: \"7cc03d7d-fd64-4a53-8289-dbcbc0f51fb1\") "
Sep 10 14:37:55.615172 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:55.615148    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cc03d7d-fd64-4a53-8289-dbcbc0f51fb1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7cc03d7d-fd64-4a53-8289-dbcbc0f51fb1" (UID: "7cc03d7d-fd64-4a53-8289-dbcbc0f51fb1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:37:55.715760 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:55.715730    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cc03d7d-fd64-4a53-8289-dbcbc0f51fb1-maas-api-service-ca\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:37:55.893348 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:55.893262    2545 patch_prober.go:28] interesting pod/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 14:37:55.893478 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:55.893346    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55" podUID="d70644ec-94c2-4584-b124-7ddc69149c4c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 14:37:56.353002 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:56.352973    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7ae247-gbt2k"
Sep 10 14:37:56.353148 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:56.352968    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7ae247-gbt2k" event={"ID":"7cc03d7d-fd64-4a53-8289-dbcbc0f51fb1","Type":"ContainerDied","Data":"08c89b5086ca1a58efc6409e2fbefd069a122595945ff152a1b7c42bbdb8839b"}
Sep 10 14:37:56.353148 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:56.353121    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08c89b5086ca1a58efc6409e2fbefd069a122595945ff152a1b7c42bbdb8839b"
Sep 10 14:37:57.588118 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.588060    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:37:57.641217 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.641184    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-istio-data\") pod \"d70644ec-94c2-4584-b124-7ddc69149c4c\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") "
Sep 10 14:37:57.641374 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.641224    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-workload-socket\") pod \"d70644ec-94c2-4584-b124-7ddc69149c4c\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") "
Sep 10 14:37:57.641374 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.641243    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d70644ec-94c2-4584-b124-7ddc69149c4c-istio-podinfo\") pod \"d70644ec-94c2-4584-b124-7ddc69149c4c\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") "
Sep 10 14:37:57.641374 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.641290    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-workload-certs\") pod \"d70644ec-94c2-4584-b124-7ddc69149c4c\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") "
Sep 10 14:37:57.641374 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.641315    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhqcc\" (UniqueName: \"kubernetes.io/projected/d70644ec-94c2-4584-b124-7ddc69149c4c-kube-api-access-nhqcc\") pod \"d70644ec-94c2-4584-b124-7ddc69149c4c\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") "
Sep 10 14:37:57.641374 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.641342    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d70644ec-94c2-4584-b124-7ddc69149c4c-istiod-ca-cert\") pod \"d70644ec-94c2-4584-b124-7ddc69149c4c\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") "
Sep 10 14:37:57.641663 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.641469    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-istio-envoy\") pod \"d70644ec-94c2-4584-b124-7ddc69149c4c\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") "
Sep 10 14:37:57.641663 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.641512    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-credential-socket\") pod \"d70644ec-94c2-4584-b124-7ddc69149c4c\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") "
Sep 10 14:37:57.641663 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.641520    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d70644ec-94c2-4584-b124-7ddc69149c4c" (UID: "d70644ec-94c2-4584-b124-7ddc69149c4c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:37:57.641663 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.641529    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-istio-data" (OuterVolumeSpecName: "istio-data") pod "d70644ec-94c2-4584-b124-7ddc69149c4c" (UID: "d70644ec-94c2-4584-b124-7ddc69149c4c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:37:57.641663 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.641556    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d70644ec-94c2-4584-b124-7ddc69149c4c-istio-token\") pod \"d70644ec-94c2-4584-b124-7ddc69149c4c\" (UID: \"d70644ec-94c2-4584-b124-7ddc69149c4c\") "
Sep 10 14:37:57.641663 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.641600    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d70644ec-94c2-4584-b124-7ddc69149c4c" (UID: "d70644ec-94c2-4584-b124-7ddc69149c4c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:37:57.641948 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.641754    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d70644ec-94c2-4584-b124-7ddc69149c4c" (UID: "d70644ec-94c2-4584-b124-7ddc69149c4c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:37:57.642007 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.641964    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-credential-socket\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:37:57.642007 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.641986    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-istio-data\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:37:57.642007 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.642000    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-workload-socket\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:37:57.642168 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.642016    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-workload-certs\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:37:57.642168 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.642064    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d70644ec-94c2-4584-b124-7ddc69149c4c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d70644ec-94c2-4584-b124-7ddc69149c4c" (UID: "d70644ec-94c2-4584-b124-7ddc69149c4c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:37:57.643586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.643560    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d70644ec-94c2-4584-b124-7ddc69149c4c-istio-token" (OuterVolumeSpecName: "istio-token") pod "d70644ec-94c2-4584-b124-7ddc69149c4c" (UID: "d70644ec-94c2-4584-b124-7ddc69149c4c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:37:57.643674 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.643638    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d70644ec-94c2-4584-b124-7ddc69149c4c-kube-api-access-nhqcc" (OuterVolumeSpecName: "kube-api-access-nhqcc") pod "d70644ec-94c2-4584-b124-7ddc69149c4c" (UID: "d70644ec-94c2-4584-b124-7ddc69149c4c"). InnerVolumeSpecName "kube-api-access-nhqcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:37:57.643674 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.643641    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d70644ec-94c2-4584-b124-7ddc69149c4c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d70644ec-94c2-4584-b124-7ddc69149c4c" (UID: "d70644ec-94c2-4584-b124-7ddc69149c4c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:37:57.643761 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.643688    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d70644ec-94c2-4584-b124-7ddc69149c4c" (UID: "d70644ec-94c2-4584-b124-7ddc69149c4c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:37:57.743099 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.743069    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d70644ec-94c2-4584-b124-7ddc69149c4c-istio-envoy\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:37:57.743099 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.743095    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d70644ec-94c2-4584-b124-7ddc69149c4c-istio-token\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:37:57.743099 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.743104    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d70644ec-94c2-4584-b124-7ddc69149c4c-istio-podinfo\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:37:57.743315 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.743113    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhqcc\" (UniqueName: \"kubernetes.io/projected/d70644ec-94c2-4584-b124-7ddc69149c4c-kube-api-access-nhqcc\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:37:57.743315 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:57.743124    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d70644ec-94c2-4584-b124-7ddc69149c4c-istiod-ca-cert\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:37:58.368851 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:58.368814    2545 generic.go:356] "Generic (PLEG): container finished" podID="d70644ec-94c2-4584-b124-7ddc69149c4c" containerID="4f70e5061f8506d2c63f761212e32604bbc15e7de3768a76436ee0a0bb84b059" exitCode=0
Sep 10 14:37:58.369020 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:58.368863    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"
Sep 10 14:37:58.369020 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:58.368897    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55" event={"ID":"d70644ec-94c2-4584-b124-7ddc69149c4c","Type":"ContainerDied","Data":"4f70e5061f8506d2c63f761212e32604bbc15e7de3768a76436ee0a0bb84b059"}
Sep 10 14:37:58.369020 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:58.368952    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55" event={"ID":"d70644ec-94c2-4584-b124-7ddc69149c4c","Type":"ContainerDied","Data":"5089512f0f932a6767196096ac1139f1ae22558c0dc9f7fbf98fb83c41b01a56"}
Sep 10 14:37:58.369020 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:58.368978    2545 scope.go:117] "RemoveContainer" containerID="4f70e5061f8506d2c63f761212e32604bbc15e7de3768a76436ee0a0bb84b059"
Sep 10 14:37:58.379545 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:58.379530    2545 scope.go:117] "RemoveContainer" containerID="3d76f51ecdb1d406859b6778eae836a75a423523d20a9790443696f52b366303"
Sep 10 14:37:58.387659 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:58.387641    2545 scope.go:117] "RemoveContainer" containerID="4f70e5061f8506d2c63f761212e32604bbc15e7de3768a76436ee0a0bb84b059"
Sep 10 14:37:58.387907 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:37:58.387889    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f70e5061f8506d2c63f761212e32604bbc15e7de3768a76436ee0a0bb84b059\": container with ID starting with 4f70e5061f8506d2c63f761212e32604bbc15e7de3768a76436ee0a0bb84b059 not found: ID does not exist" containerID="4f70e5061f8506d2c63f761212e32604bbc15e7de3768a76436ee0a0bb84b059"
Sep 10 14:37:58.387953 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:58.387915    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f70e5061f8506d2c63f761212e32604bbc15e7de3768a76436ee0a0bb84b059"} err="failed to get container status \"4f70e5061f8506d2c63f761212e32604bbc15e7de3768a76436ee0a0bb84b059\": rpc error: code = NotFound desc = could not find container \"4f70e5061f8506d2c63f761212e32604bbc15e7de3768a76436ee0a0bb84b059\": container with ID starting with 4f70e5061f8506d2c63f761212e32604bbc15e7de3768a76436ee0a0bb84b059 not found: ID does not exist"
Sep 10 14:37:58.387953 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:58.387932    2545 scope.go:117] "RemoveContainer" containerID="3d76f51ecdb1d406859b6778eae836a75a423523d20a9790443696f52b366303"
Sep 10 14:37:58.388149 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:37:58.388131    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d76f51ecdb1d406859b6778eae836a75a423523d20a9790443696f52b366303\": container with ID starting with 3d76f51ecdb1d406859b6778eae836a75a423523d20a9790443696f52b366303 not found: ID does not exist" containerID="3d76f51ecdb1d406859b6778eae836a75a423523d20a9790443696f52b366303"
Sep 10 14:37:58.388186 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:58.388155    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d76f51ecdb1d406859b6778eae836a75a423523d20a9790443696f52b366303"} err="failed to get container status \"3d76f51ecdb1d406859b6778eae836a75a423523d20a9790443696f52b366303\": rpc error: code = NotFound desc = could not find container \"3d76f51ecdb1d406859b6778eae836a75a423523d20a9790443696f52b366303\": container with ID starting with 3d76f51ecdb1d406859b6778eae836a75a423523d20a9790443696f52b366303 not found: ID does not exist"
Sep 10 14:37:58.393530 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:58.393507    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"]
Sep 10 14:37:58.397133 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:37:58.397111    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-53471f-openshift-default-55ffd9f55b-7nb55"]
Sep 10 14:38:00.366887 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:00.366849    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d70644ec-94c2-4584-b124-7ddc69149c4c" path="/var/lib/kubelet/pods/d70644ec-94c2-4584-b124-7ddc69149c4c/volumes"
Sep 10 14:38:08.131030 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.130994    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k"]
Sep 10 14:38:08.131578 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.131261    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k" podUID="2bf03bda-741e-43fc-bbeb-5b620c829dfb" containerName="payload-processing" containerID="cri-o://21d6f3f405c144cdecec5b1a4c9aa249188506321da977e1316cdca4c549b5c3" gracePeriod=30
Sep 10 14:38:08.141935 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.141904    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk"]
Sep 10 14:38:08.142183 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.142129    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk" podUID="cad125ec-49a5-4981-acc7-b114c27aebef" containerName="payload-pre-processing" containerID="cri-o://8b82e877d3e858c07ca896895cf493b93777add4abb0dbafc0894a15bcc19ec6" gracePeriod=30
Sep 10 14:38:08.280305 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.280268    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7ae247-gbt2k"]
Sep 10 14:38:08.283665 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.283635    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7ae247-gbt2k"]
Sep 10 14:38:08.370041 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.370008    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cc03d7d-fd64-4a53-8289-dbcbc0f51fb1" path="/var/lib/kubelet/pods/7cc03d7d-fd64-4a53-8289-dbcbc0f51fb1/volumes"
Sep 10 14:38:08.427605 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.427580    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k"
Sep 10 14:38:08.428666 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.428635    2545 generic.go:356] "Generic (PLEG): container finished" podID="2bf03bda-741e-43fc-bbeb-5b620c829dfb" containerID="21d6f3f405c144cdecec5b1a4c9aa249188506321da977e1316cdca4c549b5c3" exitCode=0
Sep 10 14:38:08.428780 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.428667    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k" event={"ID":"2bf03bda-741e-43fc-bbeb-5b620c829dfb","Type":"ContainerDied","Data":"21d6f3f405c144cdecec5b1a4c9aa249188506321da977e1316cdca4c549b5c3"}
Sep 10 14:38:08.428780 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.428723    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k" event={"ID":"2bf03bda-741e-43fc-bbeb-5b620c829dfb","Type":"ContainerDied","Data":"af4b932df93bfb57bd5877e5b4401ab502b59491859c6fa7bbe6620ce0bcf712"}
Sep 10 14:38:08.428780 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.428751    2545 scope.go:117] "RemoveContainer" containerID="21d6f3f405c144cdecec5b1a4c9aa249188506321da977e1316cdca4c549b5c3"
Sep 10 14:38:08.430075 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.430054    2545 generic.go:356] "Generic (PLEG): container finished" podID="cad125ec-49a5-4981-acc7-b114c27aebef" containerID="8b82e877d3e858c07ca896895cf493b93777add4abb0dbafc0894a15bcc19ec6" exitCode=0
Sep 10 14:38:08.430154 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.430084    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk" event={"ID":"cad125ec-49a5-4981-acc7-b114c27aebef","Type":"ContainerDied","Data":"8b82e877d3e858c07ca896895cf493b93777add4abb0dbafc0894a15bcc19ec6"}
Sep 10 14:38:08.430154 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.430116    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk" event={"ID":"cad125ec-49a5-4981-acc7-b114c27aebef","Type":"ContainerDied","Data":"45b8a9762c9befbbb68c18b0072e94eead81303e9455ed3dbe34408286b5ec04"}
Sep 10 14:38:08.430154 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.430140    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45b8a9762c9befbbb68c18b0072e94eead81303e9455ed3dbe34408286b5ec04"
Sep 10 14:38:08.430900 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.430874    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk"
Sep 10 14:38:08.439052 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.439037    2545 scope.go:117] "RemoveContainer" containerID="21d6f3f405c144cdecec5b1a4c9aa249188506321da977e1316cdca4c549b5c3"
Sep 10 14:38:08.439304 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:38:08.439286    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21d6f3f405c144cdecec5b1a4c9aa249188506321da977e1316cdca4c549b5c3\": container with ID starting with 21d6f3f405c144cdecec5b1a4c9aa249188506321da977e1316cdca4c549b5c3 not found: ID does not exist" containerID="21d6f3f405c144cdecec5b1a4c9aa249188506321da977e1316cdca4c549b5c3"
Sep 10 14:38:08.439357 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.439317    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21d6f3f405c144cdecec5b1a4c9aa249188506321da977e1316cdca4c549b5c3"} err="failed to get container status \"21d6f3f405c144cdecec5b1a4c9aa249188506321da977e1316cdca4c549b5c3\": rpc error: code = NotFound desc = could not find container \"21d6f3f405c144cdecec5b1a4c9aa249188506321da977e1316cdca4c549b5c3\": container with ID starting with 21d6f3f405c144cdecec5b1a4c9aa249188506321da977e1316cdca4c549b5c3 not found: ID does not exist"
Sep 10 14:38:08.543301 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.543271    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwvnx\" (UniqueName: \"kubernetes.io/projected/2bf03bda-741e-43fc-bbeb-5b620c829dfb-kube-api-access-xwvnx\") pod \"2bf03bda-741e-43fc-bbeb-5b620c829dfb\" (UID: \"2bf03bda-741e-43fc-bbeb-5b620c829dfb\") "
Sep 10 14:38:08.543474 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.543336    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cad125ec-49a5-4981-acc7-b114c27aebef-plugins-config-volume\") pod \"cad125ec-49a5-4981-acc7-b114c27aebef\" (UID: \"cad125ec-49a5-4981-acc7-b114c27aebef\") "
Sep 10 14:38:08.543474 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.543363    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzrjj\" (UniqueName: \"kubernetes.io/projected/cad125ec-49a5-4981-acc7-b114c27aebef-kube-api-access-wzrjj\") pod \"cad125ec-49a5-4981-acc7-b114c27aebef\" (UID: \"cad125ec-49a5-4981-acc7-b114c27aebef\") "
Sep 10 14:38:08.543474 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.543431    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bf03bda-741e-43fc-bbeb-5b620c829dfb-plugins-config-volume\") pod \"2bf03bda-741e-43fc-bbeb-5b620c829dfb\" (UID: \"2bf03bda-741e-43fc-bbeb-5b620c829dfb\") "
Sep 10 14:38:08.543771 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.543736    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cad125ec-49a5-4981-acc7-b114c27aebef-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cad125ec-49a5-4981-acc7-b114c27aebef" (UID: "cad125ec-49a5-4981-acc7-b114c27aebef"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:38:08.543907 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.543831    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bf03bda-741e-43fc-bbeb-5b620c829dfb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2bf03bda-741e-43fc-bbeb-5b620c829dfb" (UID: "2bf03bda-741e-43fc-bbeb-5b620c829dfb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:38:08.543907 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.543840    2545 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cad125ec-49a5-4981-acc7-b114c27aebef-plugins-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:08.545414 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.545388    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bf03bda-741e-43fc-bbeb-5b620c829dfb-kube-api-access-xwvnx" (OuterVolumeSpecName: "kube-api-access-xwvnx") pod "2bf03bda-741e-43fc-bbeb-5b620c829dfb" (UID: "2bf03bda-741e-43fc-bbeb-5b620c829dfb"). InnerVolumeSpecName "kube-api-access-xwvnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:38:08.545666 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.545507    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cad125ec-49a5-4981-acc7-b114c27aebef-kube-api-access-wzrjj" (OuterVolumeSpecName: "kube-api-access-wzrjj") pod "cad125ec-49a5-4981-acc7-b114c27aebef" (UID: "cad125ec-49a5-4981-acc7-b114c27aebef"). InnerVolumeSpecName "kube-api-access-wzrjj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:38:08.645184 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.645156    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwvnx\" (UniqueName: \"kubernetes.io/projected/2bf03bda-741e-43fc-bbeb-5b620c829dfb-kube-api-access-xwvnx\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:08.645184 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.645180    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzrjj\" (UniqueName: \"kubernetes.io/projected/cad125ec-49a5-4981-acc7-b114c27aebef-kube-api-access-wzrjj\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:08.645332 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:08.645191    2545 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bf03bda-741e-43fc-bbeb-5b620c829dfb-plugins-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:09.437805 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:09.437776    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k"
Sep 10 14:38:09.438202 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:09.437783    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk"
Sep 10 14:38:09.463421 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:09.463395    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk"]
Sep 10 14:38:09.467495 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:09.467461    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-7ae247-66d69b6fbb-qjwnk"]
Sep 10 14:38:09.477099 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:09.477077    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k"]
Sep 10 14:38:09.480615 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:09.480594    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-7ae247-f7c66dbb9-nq25k"]
Sep 10 14:38:10.366664 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:10.366634    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bf03bda-741e-43fc-bbeb-5b620c829dfb" path="/var/lib/kubelet/pods/2bf03bda-741e-43fc-bbeb-5b620c829dfb/volumes"
Sep 10 14:38:10.367012 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:10.366999    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cad125ec-49a5-4981-acc7-b114c27aebef" path="/var/lib/kubelet/pods/cad125ec-49a5-4981-acc7-b114c27aebef/volumes"
Sep 10 14:38:14.861583 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:14.861534    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9e5db6-7c488"]
Sep 10 14:38:14.861988 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:14.861975    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d70644ec-94c2-4584-b124-7ddc69149c4c" containerName="istio-proxy"
Sep 10 14:38:14.861988 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:14.861988    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="d70644ec-94c2-4584-b124-7ddc69149c4c" containerName="istio-proxy"
Sep 10 14:38:14.862064 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:14.861995    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cad125ec-49a5-4981-acc7-b114c27aebef" containerName="payload-pre-processing"
Sep 10 14:38:14.862064 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:14.862001    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="cad125ec-49a5-4981-acc7-b114c27aebef" containerName="payload-pre-processing"
Sep 10 14:38:14.862064 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:14.862017    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bf03bda-741e-43fc-bbeb-5b620c829dfb" containerName="payload-processing"
Sep 10 14:38:14.862064 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:14.862023    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bf03bda-741e-43fc-bbeb-5b620c829dfb" containerName="payload-processing"
Sep 10 14:38:14.862064 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:14.862034    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cc03d7d-fd64-4a53-8289-dbcbc0f51fb1" containerName="revoke-keys"
Sep 10 14:38:14.862064 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:14.862039    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cc03d7d-fd64-4a53-8289-dbcbc0f51fb1" containerName="revoke-keys"
Sep 10 14:38:14.862261 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:14.862099    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="d70644ec-94c2-4584-b124-7ddc69149c4c" containerName="istio-proxy"
Sep 10 14:38:14.862261 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:14.862107    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bf03bda-741e-43fc-bbeb-5b620c829dfb" containerName="payload-processing"
Sep 10 14:38:14.862261 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:14.862112    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="cad125ec-49a5-4981-acc7-b114c27aebef" containerName="payload-pre-processing"
Sep 10 14:38:14.862261 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:14.862123    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cc03d7d-fd64-4a53-8289-dbcbc0f51fb1" containerName="revoke-keys"
Sep 10 14:38:14.865201 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:14.865183    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9e5db6-7c488"
Sep 10 14:38:14.867666 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:14.867645    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:38:14.867961 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:14.867948    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pj254\""
Sep 10 14:38:14.872813 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:14.872787    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9e5db6-7c488"]
Sep 10 14:38:14.901303 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:14.901271    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfca7059-fe06-40df-bbcf-73c15908813e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-9e5db6-7c488\" (UID: \"cfca7059-fe06-40df-bbcf-73c15908813e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9e5db6-7c488"
Sep 10 14:38:15.001922 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:15.001886    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfca7059-fe06-40df-bbcf-73c15908813e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-9e5db6-7c488\" (UID: \"cfca7059-fe06-40df-bbcf-73c15908813e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9e5db6-7c488"
Sep 10 14:38:15.002527 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:15.002479    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfca7059-fe06-40df-bbcf-73c15908813e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-9e5db6-7c488\" (UID: \"cfca7059-fe06-40df-bbcf-73c15908813e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9e5db6-7c488"
Sep 10 14:38:15.177293 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:15.177205    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9e5db6-7c488"
Sep 10 14:38:15.449800 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:15.449774    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9e5db6-7c488"]
Sep 10 14:38:15.451982 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:38:15.451945    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfca7059_fe06_40df_bbcf_73c15908813e.slice/crio-084439f3ffca35a209406b3cebb74f8e349178444e28b884e7cf6c1f775478a2 WatchSource:0}: Error finding container 084439f3ffca35a209406b3cebb74f8e349178444e28b884e7cf6c1f775478a2: Status 404 returned error can't find the container with id 084439f3ffca35a209406b3cebb74f8e349178444e28b884e7cf6c1f775478a2
Sep 10 14:38:15.478724 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:15.478695    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9e5db6-7c488" event={"ID":"cfca7059-fe06-40df-bbcf-73c15908813e","Type":"ContainerStarted","Data":"084439f3ffca35a209406b3cebb74f8e349178444e28b884e7cf6c1f775478a2"}
Sep 10 14:38:16.490320 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:16.490283    2545 generic.go:356] "Generic (PLEG): container finished" podID="cfca7059-fe06-40df-bbcf-73c15908813e" containerID="8c80f01ac13b849848a8a9fd651b0283cfaba0a6d4191ecb3e05cb8d2c38751c" exitCode=0
Sep 10 14:38:16.490702 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:16.490361    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9e5db6-7c488" event={"ID":"cfca7059-fe06-40df-bbcf-73c15908813e","Type":"ContainerDied","Data":"8c80f01ac13b849848a8a9fd651b0283cfaba0a6d4191ecb3e05cb8d2c38751c"}
Sep 10 14:38:17.633636 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:17.633612    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9e5db6-7c488"
Sep 10 14:38:17.729013 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:17.728970    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfca7059-fe06-40df-bbcf-73c15908813e-maas-api-service-ca\") pod \"cfca7059-fe06-40df-bbcf-73c15908813e\" (UID: \"cfca7059-fe06-40df-bbcf-73c15908813e\") "
Sep 10 14:38:17.729398 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:17.729377    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfca7059-fe06-40df-bbcf-73c15908813e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cfca7059-fe06-40df-bbcf-73c15908813e" (UID: "cfca7059-fe06-40df-bbcf-73c15908813e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:38:17.830584 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:17.830472    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfca7059-fe06-40df-bbcf-73c15908813e-maas-api-service-ca\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:18.504653 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:18.504618    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9e5db6-7c488" event={"ID":"cfca7059-fe06-40df-bbcf-73c15908813e","Type":"ContainerDied","Data":"084439f3ffca35a209406b3cebb74f8e349178444e28b884e7cf6c1f775478a2"}
Sep 10 14:38:18.504793 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:18.504664    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="084439f3ffca35a209406b3cebb74f8e349178444e28b884e7cf6c1f775478a2"
Sep 10 14:38:18.504793 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:18.504627    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9e5db6-7c488"
Sep 10 14:38:25.459199 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:25.459164    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr"]
Sep 10 14:38:25.459690 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:25.459422    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr" podUID="ccc50cb5-b205-4ece-8489-a24c341a66df" containerName="payload-processing" containerID="cri-o://4479fd27ab7066dd3ec48f0a212192f1d924426c6790a452d73b3be81c4b8026" gracePeriod=30
Sep 10 14:38:25.463461 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:25.463166    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg"]
Sep 10 14:38:25.463461 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:25.463380    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg" podUID="3c527da4-0e54-4184-a09a-20d87448dd46" containerName="payload-pre-processing" containerID="cri-o://a7e81876044a6f76c200b97ca6b05f6f81108cbfa931937d247d6782111389d3" gracePeriod=30
Sep 10 14:38:25.607209 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:25.607146    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9e5db6-7c488"]
Sep 10 14:38:25.611141 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:25.611112    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-9e5db6-7c488"]
Sep 10 14:38:25.744011 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:25.743980    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr"
Sep 10 14:38:25.747509 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:25.747475    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg"
Sep 10 14:38:25.804974 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:25.804940    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c527da4-0e54-4184-a09a-20d87448dd46-plugins-config-volume\") pod \"3c527da4-0e54-4184-a09a-20d87448dd46\" (UID: \"3c527da4-0e54-4184-a09a-20d87448dd46\") "
Sep 10 14:38:25.805236 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:25.805010    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccc50cb5-b205-4ece-8489-a24c341a66df-plugins-config-volume\") pod \"ccc50cb5-b205-4ece-8489-a24c341a66df\" (UID: \"ccc50cb5-b205-4ece-8489-a24c341a66df\") "
Sep 10 14:38:25.805236 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:25.805112    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89q89\" (UniqueName: \"kubernetes.io/projected/3c527da4-0e54-4184-a09a-20d87448dd46-kube-api-access-89q89\") pod \"3c527da4-0e54-4184-a09a-20d87448dd46\" (UID: \"3c527da4-0e54-4184-a09a-20d87448dd46\") "
Sep 10 14:38:25.805236 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:25.805147    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8f2cc\" (UniqueName: \"kubernetes.io/projected/ccc50cb5-b205-4ece-8489-a24c341a66df-kube-api-access-8f2cc\") pod \"ccc50cb5-b205-4ece-8489-a24c341a66df\" (UID: \"ccc50cb5-b205-4ece-8489-a24c341a66df\") "
Sep 10 14:38:25.805818 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:25.805759    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c527da4-0e54-4184-a09a-20d87448dd46-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3c527da4-0e54-4184-a09a-20d87448dd46" (UID: "3c527da4-0e54-4184-a09a-20d87448dd46"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:38:25.805818 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:25.805778    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccc50cb5-b205-4ece-8489-a24c341a66df-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ccc50cb5-b205-4ece-8489-a24c341a66df" (UID: "ccc50cb5-b205-4ece-8489-a24c341a66df"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:38:25.808598 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:25.808555    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c527da4-0e54-4184-a09a-20d87448dd46-kube-api-access-89q89" (OuterVolumeSpecName: "kube-api-access-89q89") pod "3c527da4-0e54-4184-a09a-20d87448dd46" (UID: "3c527da4-0e54-4184-a09a-20d87448dd46"). InnerVolumeSpecName "kube-api-access-89q89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:38:25.811269 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:25.811213    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccc50cb5-b205-4ece-8489-a24c341a66df-kube-api-access-8f2cc" (OuterVolumeSpecName: "kube-api-access-8f2cc") pod "ccc50cb5-b205-4ece-8489-a24c341a66df" (UID: "ccc50cb5-b205-4ece-8489-a24c341a66df"). InnerVolumeSpecName "kube-api-access-8f2cc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:38:25.905974 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:25.905938    2545 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccc50cb5-b205-4ece-8489-a24c341a66df-plugins-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:25.905974 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:25.905970    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89q89\" (UniqueName: \"kubernetes.io/projected/3c527da4-0e54-4184-a09a-20d87448dd46-kube-api-access-89q89\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:25.905974 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:25.905980    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8f2cc\" (UniqueName: \"kubernetes.io/projected/ccc50cb5-b205-4ece-8489-a24c341a66df-kube-api-access-8f2cc\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:25.906204 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:25.905989    2545 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c527da4-0e54-4184-a09a-20d87448dd46-plugins-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:26.367610 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:26.367575    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfca7059-fe06-40df-bbcf-73c15908813e" path="/var/lib/kubelet/pods/cfca7059-fe06-40df-bbcf-73c15908813e/volumes"
Sep 10 14:38:26.553442 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:26.553408    2545 generic.go:356] "Generic (PLEG): container finished" podID="ccc50cb5-b205-4ece-8489-a24c341a66df" containerID="4479fd27ab7066dd3ec48f0a212192f1d924426c6790a452d73b3be81c4b8026" exitCode=0
Sep 10 14:38:26.553809 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:26.553461    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr"
Sep 10 14:38:26.553809 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:26.553503    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr" event={"ID":"ccc50cb5-b205-4ece-8489-a24c341a66df","Type":"ContainerDied","Data":"4479fd27ab7066dd3ec48f0a212192f1d924426c6790a452d73b3be81c4b8026"}
Sep 10 14:38:26.553809 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:26.553574    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr" event={"ID":"ccc50cb5-b205-4ece-8489-a24c341a66df","Type":"ContainerDied","Data":"23dc7f5eeb95f2cbd9fecca65613f30d7c97b594b0c0ec433f0e025162ce6d06"}
Sep 10 14:38:26.553809 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:26.553613    2545 scope.go:117] "RemoveContainer" containerID="4479fd27ab7066dd3ec48f0a212192f1d924426c6790a452d73b3be81c4b8026"
Sep 10 14:38:26.555017 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:26.554940    2545 generic.go:356] "Generic (PLEG): container finished" podID="3c527da4-0e54-4184-a09a-20d87448dd46" containerID="a7e81876044a6f76c200b97ca6b05f6f81108cbfa931937d247d6782111389d3" exitCode=0
Sep 10 14:38:26.555017 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:26.554988    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg"
Sep 10 14:38:26.555122 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:26.555040    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg" event={"ID":"3c527da4-0e54-4184-a09a-20d87448dd46","Type":"ContainerDied","Data":"a7e81876044a6f76c200b97ca6b05f6f81108cbfa931937d247d6782111389d3"}
Sep 10 14:38:26.555122 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:26.555088    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg" event={"ID":"3c527da4-0e54-4184-a09a-20d87448dd46","Type":"ContainerDied","Data":"9656ca3c76c071e489b3e17b038bac2e0d1d48ac53ee3a1de0ccddcaa8438fd9"}
Sep 10 14:38:26.569818 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:26.569800    2545 scope.go:117] "RemoveContainer" containerID="4479fd27ab7066dd3ec48f0a212192f1d924426c6790a452d73b3be81c4b8026"
Sep 10 14:38:26.570075 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:38:26.570054    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4479fd27ab7066dd3ec48f0a212192f1d924426c6790a452d73b3be81c4b8026\": container with ID starting with 4479fd27ab7066dd3ec48f0a212192f1d924426c6790a452d73b3be81c4b8026 not found: ID does not exist" containerID="4479fd27ab7066dd3ec48f0a212192f1d924426c6790a452d73b3be81c4b8026"
Sep 10 14:38:26.570122 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:26.570082    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4479fd27ab7066dd3ec48f0a212192f1d924426c6790a452d73b3be81c4b8026"} err="failed to get container status \"4479fd27ab7066dd3ec48f0a212192f1d924426c6790a452d73b3be81c4b8026\": rpc error: code = NotFound desc = could not find container \"4479fd27ab7066dd3ec48f0a212192f1d924426c6790a452d73b3be81c4b8026\": container with ID starting with 4479fd27ab7066dd3ec48f0a212192f1d924426c6790a452d73b3be81c4b8026 not found: ID does not exist"
Sep 10 14:38:26.570122 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:26.570097    2545 scope.go:117] "RemoveContainer" containerID="a7e81876044a6f76c200b97ca6b05f6f81108cbfa931937d247d6782111389d3"
Sep 10 14:38:26.578388 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:26.578370    2545 scope.go:117] "RemoveContainer" containerID="a7e81876044a6f76c200b97ca6b05f6f81108cbfa931937d247d6782111389d3"
Sep 10 14:38:26.578683 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:38:26.578664    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7e81876044a6f76c200b97ca6b05f6f81108cbfa931937d247d6782111389d3\": container with ID starting with a7e81876044a6f76c200b97ca6b05f6f81108cbfa931937d247d6782111389d3 not found: ID does not exist" containerID="a7e81876044a6f76c200b97ca6b05f6f81108cbfa931937d247d6782111389d3"
Sep 10 14:38:26.578761 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:26.578689    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7e81876044a6f76c200b97ca6b05f6f81108cbfa931937d247d6782111389d3"} err="failed to get container status \"a7e81876044a6f76c200b97ca6b05f6f81108cbfa931937d247d6782111389d3\": rpc error: code = NotFound desc = could not find container \"a7e81876044a6f76c200b97ca6b05f6f81108cbfa931937d247d6782111389d3\": container with ID starting with a7e81876044a6f76c200b97ca6b05f6f81108cbfa931937d247d6782111389d3 not found: ID does not exist"
Sep 10 14:38:26.579002 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:26.578982    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg"]
Sep 10 14:38:26.582479 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:26.582449    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9e5db6-f9dfcf7cd-dhcqg"]
Sep 10 14:38:26.591583 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:26.591565    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr"]
Sep 10 14:38:26.595412 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:26.595393    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-9e5db6-5ccf588c4c-fcqlr"]
Sep 10 14:38:28.366705 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:28.366670    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c527da4-0e54-4184-a09a-20d87448dd46" path="/var/lib/kubelet/pods/3c527da4-0e54-4184-a09a-20d87448dd46/volumes"
Sep 10 14:38:28.367071 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:28.367059    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccc50cb5-b205-4ece-8489-a24c341a66df" path="/var/lib/kubelet/pods/ccc50cb5-b205-4ece-8489-a24c341a66df/volumes"
Sep 10 14:38:32.050699 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:32.050664    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"]
Sep 10 14:38:32.051129 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:32.050877    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg" podUID="d181be50-3398-451b-849e-d6d1b8cdeaf7" containerName="istio-proxy" containerID="cri-o://16748c18b0543592c7574500fcb298442f2c7c915b20d28d51d8cb4399e3c379" gracePeriod=30
Sep 10 14:38:32.422568 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:32.422482    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-54c040-rh7cb"]
Sep 10 14:38:32.422887 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:32.422875    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccc50cb5-b205-4ece-8489-a24c341a66df" containerName="payload-processing"
Sep 10 14:38:32.422930 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:32.422888    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccc50cb5-b205-4ece-8489-a24c341a66df" containerName="payload-processing"
Sep 10 14:38:32.422930 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:32.422903    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c527da4-0e54-4184-a09a-20d87448dd46" containerName="payload-pre-processing"
Sep 10 14:38:32.422930 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:32.422909    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c527da4-0e54-4184-a09a-20d87448dd46" containerName="payload-pre-processing"
Sep 10 14:38:32.422930 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:32.422916    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfca7059-fe06-40df-bbcf-73c15908813e" containerName="revoke-keys"
Sep 10 14:38:32.422930 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:32.422923    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfca7059-fe06-40df-bbcf-73c15908813e" containerName="revoke-keys"
Sep 10 14:38:32.423074 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:32.422941    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d70644ec-94c2-4584-b124-7ddc69149c4c" containerName="istio-proxy"
Sep 10 14:38:32.423074 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:32.422946    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="d70644ec-94c2-4584-b124-7ddc69149c4c" containerName="istio-proxy"
Sep 10 14:38:32.423074 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:32.423009    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c527da4-0e54-4184-a09a-20d87448dd46" containerName="payload-pre-processing"
Sep 10 14:38:32.423074 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:32.423015    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccc50cb5-b205-4ece-8489-a24c341a66df" containerName="payload-processing"
Sep 10 14:38:32.423074 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:32.423022    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfca7059-fe06-40df-bbcf-73c15908813e" containerName="revoke-keys"
Sep 10 14:38:32.423074 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:32.423030    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="d70644ec-94c2-4584-b124-7ddc69149c4c" containerName="istio-proxy"
Sep 10 14:38:32.427556 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:32.427540    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-54c040-rh7cb"
Sep 10 14:38:32.430027 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:32.430000    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:38:32.430144 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:32.430050    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pj254\""
Sep 10 14:38:32.435611 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:32.435377    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-54c040-rh7cb"]
Sep 10 14:38:32.568342 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:32.568304    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ddd1095-4b9e-4b9d-8567-211bf06f96c5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-54c040-rh7cb\" (UID: \"4ddd1095-4b9e-4b9d-8567-211bf06f96c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-54c040-rh7cb"
Sep 10 14:38:32.669127 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:32.669089    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ddd1095-4b9e-4b9d-8567-211bf06f96c5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-54c040-rh7cb\" (UID: \"4ddd1095-4b9e-4b9d-8567-211bf06f96c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-54c040-rh7cb"
Sep 10 14:38:32.669710 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:32.669687    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ddd1095-4b9e-4b9d-8567-211bf06f96c5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-54c040-rh7cb\" (UID: \"4ddd1095-4b9e-4b9d-8567-211bf06f96c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-54c040-rh7cb"
Sep 10 14:38:32.740429 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:32.740401    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-54c040-rh7cb"
Sep 10 14:38:33.018428 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:33.018402    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-54c040-rh7cb"]
Sep 10 14:38:33.019457 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:38:33.019430    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ddd1095_4b9e_4b9d_8567_211bf06f96c5.slice/crio-ffcaa0b773b6423ef3d3e889a670d1114661d60dd8bfc06327db8ef71449205e WatchSource:0}: Error finding container ffcaa0b773b6423ef3d3e889a670d1114661d60dd8bfc06327db8ef71449205e: Status 404 returned error can't find the container with id ffcaa0b773b6423ef3d3e889a670d1114661d60dd8bfc06327db8ef71449205e
Sep 10 14:38:33.601932 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:33.601890    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-54c040-rh7cb" event={"ID":"4ddd1095-4b9e-4b9d-8567-211bf06f96c5","Type":"ContainerStarted","Data":"752d3cfcae1605013f3dd72ff631a97856cfdf99cab7fea240980d143ea9c9cb"}
Sep 10 14:38:33.602375 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:33.601966    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-54c040-rh7cb" event={"ID":"4ddd1095-4b9e-4b9d-8567-211bf06f96c5","Type":"ContainerStarted","Data":"ffcaa0b773b6423ef3d3e889a670d1114661d60dd8bfc06327db8ef71449205e"}
Sep 10 14:38:33.617959 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:33.617907    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-54c040-rh7cb" podStartSLOduration=1.61789301 podStartE2EDuration="1.61789301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:38:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:38:33.61654052 +0000 UTC m=+1611.734081997" watchObservedRunningTime="2026-09-10 14:38:33.61789301 +0000 UTC m=+1611.735434484"
Sep 10 14:38:34.609611 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:34.609576    2545 generic.go:356] "Generic (PLEG): container finished" podID="4ddd1095-4b9e-4b9d-8567-211bf06f96c5" containerID="752d3cfcae1605013f3dd72ff631a97856cfdf99cab7fea240980d143ea9c9cb" exitCode=0
Sep 10 14:38:34.609958 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:34.609658    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-54c040-rh7cb" event={"ID":"4ddd1095-4b9e-4b9d-8567-211bf06f96c5","Type":"ContainerDied","Data":"752d3cfcae1605013f3dd72ff631a97856cfdf99cab7fea240980d143ea9c9cb"}
Sep 10 14:38:35.751460 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:35.751438    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-54c040-rh7cb"
Sep 10 14:38:35.899375 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:35.899287    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ddd1095-4b9e-4b9d-8567-211bf06f96c5-maas-api-service-ca\") pod \"4ddd1095-4b9e-4b9d-8567-211bf06f96c5\" (UID: \"4ddd1095-4b9e-4b9d-8567-211bf06f96c5\") "
Sep 10 14:38:35.899694 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:35.899666    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ddd1095-4b9e-4b9d-8567-211bf06f96c5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4ddd1095-4b9e-4b9d-8567-211bf06f96c5" (UID: "4ddd1095-4b9e-4b9d-8567-211bf06f96c5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:38:36.000240 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:36.000203    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ddd1095-4b9e-4b9d-8567-211bf06f96c5-maas-api-service-ca\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:36.622942 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:36.622914    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-54c040-rh7cb"
Sep 10 14:38:36.623108 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:36.622948    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-54c040-rh7cb" event={"ID":"4ddd1095-4b9e-4b9d-8567-211bf06f96c5","Type":"ContainerDied","Data":"ffcaa0b773b6423ef3d3e889a670d1114661d60dd8bfc06327db8ef71449205e"}
Sep 10 14:38:36.623108 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:36.623021    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffcaa0b773b6423ef3d3e889a670d1114661d60dd8bfc06327db8ef71449205e"
Sep 10 14:38:37.312466 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.312413    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:38:37.413483 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.413450    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d181be50-3398-451b-849e-d6d1b8cdeaf7-istio-podinfo\") pod \"d181be50-3398-451b-849e-d6d1b8cdeaf7\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") "
Sep 10 14:38:37.413666 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.413514    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-istio-envoy\") pod \"d181be50-3398-451b-849e-d6d1b8cdeaf7\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") "
Sep 10 14:38:37.413666 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.413542    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdlxl\" (UniqueName: \"kubernetes.io/projected/d181be50-3398-451b-849e-d6d1b8cdeaf7-kube-api-access-xdlxl\") pod \"d181be50-3398-451b-849e-d6d1b8cdeaf7\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") "
Sep 10 14:38:37.413666 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.413638    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-istio-data\") pod \"d181be50-3398-451b-849e-d6d1b8cdeaf7\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") "
Sep 10 14:38:37.413830 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.413698    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-workload-socket\") pod \"d181be50-3398-451b-849e-d6d1b8cdeaf7\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") "
Sep 10 14:38:37.413830 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.413809    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d181be50-3398-451b-849e-d6d1b8cdeaf7-istio-token\") pod \"d181be50-3398-451b-849e-d6d1b8cdeaf7\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") "
Sep 10 14:38:37.413938 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.413842    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d181be50-3398-451b-849e-d6d1b8cdeaf7-istiod-ca-cert\") pod \"d181be50-3398-451b-849e-d6d1b8cdeaf7\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") "
Sep 10 14:38:37.413938 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.413879    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-workload-certs\") pod \"d181be50-3398-451b-849e-d6d1b8cdeaf7\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") "
Sep 10 14:38:37.414043 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.413941    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-istio-data" (OuterVolumeSpecName: "istio-data") pod "d181be50-3398-451b-849e-d6d1b8cdeaf7" (UID: "d181be50-3398-451b-849e-d6d1b8cdeaf7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:38:37.414043 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.413957    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-credential-socket\") pod \"d181be50-3398-451b-849e-d6d1b8cdeaf7\" (UID: \"d181be50-3398-451b-849e-d6d1b8cdeaf7\") "
Sep 10 14:38:37.414043 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.413993    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d181be50-3398-451b-849e-d6d1b8cdeaf7" (UID: "d181be50-3398-451b-849e-d6d1b8cdeaf7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:38:37.414201 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.414153    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d181be50-3398-451b-849e-d6d1b8cdeaf7" (UID: "d181be50-3398-451b-849e-d6d1b8cdeaf7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:38:37.414266 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.414239    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d181be50-3398-451b-849e-d6d1b8cdeaf7" (UID: "d181be50-3398-451b-849e-d6d1b8cdeaf7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:38:37.414312 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.414265    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d181be50-3398-451b-849e-d6d1b8cdeaf7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d181be50-3398-451b-849e-d6d1b8cdeaf7" (UID: "d181be50-3398-451b-849e-d6d1b8cdeaf7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:38:37.414373 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.414354    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-credential-socket\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:37.414444 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.414375    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-istio-data\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:37.414444 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.414389    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-workload-socket\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:37.414444 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.414403    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d181be50-3398-451b-849e-d6d1b8cdeaf7-istiod-ca-cert\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:37.414444 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.414413    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-workload-certs\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:37.415854 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.415824    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d181be50-3398-451b-849e-d6d1b8cdeaf7" (UID: "d181be50-3398-451b-849e-d6d1b8cdeaf7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:38:37.416080 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.416056    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d181be50-3398-451b-849e-d6d1b8cdeaf7-kube-api-access-xdlxl" (OuterVolumeSpecName: "kube-api-access-xdlxl") pod "d181be50-3398-451b-849e-d6d1b8cdeaf7" (UID: "d181be50-3398-451b-849e-d6d1b8cdeaf7"). InnerVolumeSpecName "kube-api-access-xdlxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:38:37.416080 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.416067    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d181be50-3398-451b-849e-d6d1b8cdeaf7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d181be50-3398-451b-849e-d6d1b8cdeaf7" (UID: "d181be50-3398-451b-849e-d6d1b8cdeaf7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:38:37.416182 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.416154    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d181be50-3398-451b-849e-d6d1b8cdeaf7-istio-token" (OuterVolumeSpecName: "istio-token") pod "d181be50-3398-451b-849e-d6d1b8cdeaf7" (UID: "d181be50-3398-451b-849e-d6d1b8cdeaf7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:38:37.515508 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.515463    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d181be50-3398-451b-849e-d6d1b8cdeaf7-istio-token\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:37.515508 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.515500    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d181be50-3398-451b-849e-d6d1b8cdeaf7-istio-podinfo\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:37.515674 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.515514    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d181be50-3398-451b-849e-d6d1b8cdeaf7-istio-envoy\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:37.515674 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.515526    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdlxl\" (UniqueName: \"kubernetes.io/projected/d181be50-3398-451b-849e-d6d1b8cdeaf7-kube-api-access-xdlxl\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:37.630594 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.630523    2545 generic.go:356] "Generic (PLEG): container finished" podID="d181be50-3398-451b-849e-d6d1b8cdeaf7" containerID="16748c18b0543592c7574500fcb298442f2c7c915b20d28d51d8cb4399e3c379" exitCode=0
Sep 10 14:38:37.630708 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.630605    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg" event={"ID":"d181be50-3398-451b-849e-d6d1b8cdeaf7","Type":"ContainerDied","Data":"16748c18b0543592c7574500fcb298442f2c7c915b20d28d51d8cb4399e3c379"}
Sep 10 14:38:37.630708 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.630617    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"
Sep 10 14:38:37.630708 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.630658    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg" event={"ID":"d181be50-3398-451b-849e-d6d1b8cdeaf7","Type":"ContainerDied","Data":"2a7c49a7e46ea8c42d10e00020cfca8d34d66de72772f61c632c05b7b5ba5ea7"}
Sep 10 14:38:37.630708 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.630688    2545 scope.go:117] "RemoveContainer" containerID="16748c18b0543592c7574500fcb298442f2c7c915b20d28d51d8cb4399e3c379"
Sep 10 14:38:37.640504 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.640468    2545 scope.go:117] "RemoveContainer" containerID="3885cd9db4c3fbf456835203a419546cb6aa8efe9f275c11429e06c4e0fb15d1"
Sep 10 14:38:37.649160 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.649143    2545 scope.go:117] "RemoveContainer" containerID="16748c18b0543592c7574500fcb298442f2c7c915b20d28d51d8cb4399e3c379"
Sep 10 14:38:37.649432 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:38:37.649415    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16748c18b0543592c7574500fcb298442f2c7c915b20d28d51d8cb4399e3c379\": container with ID starting with 16748c18b0543592c7574500fcb298442f2c7c915b20d28d51d8cb4399e3c379 not found: ID does not exist" containerID="16748c18b0543592c7574500fcb298442f2c7c915b20d28d51d8cb4399e3c379"
Sep 10 14:38:37.649539 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.649442    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16748c18b0543592c7574500fcb298442f2c7c915b20d28d51d8cb4399e3c379"} err="failed to get container status \"16748c18b0543592c7574500fcb298442f2c7c915b20d28d51d8cb4399e3c379\": rpc error: code = NotFound desc = could not find container \"16748c18b0543592c7574500fcb298442f2c7c915b20d28d51d8cb4399e3c379\": container with ID starting with 16748c18b0543592c7574500fcb298442f2c7c915b20d28d51d8cb4399e3c379 not found: ID does not exist"
Sep 10 14:38:37.649539 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.649462    2545 scope.go:117] "RemoveContainer" containerID="3885cd9db4c3fbf456835203a419546cb6aa8efe9f275c11429e06c4e0fb15d1"
Sep 10 14:38:37.650149 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:38:37.649984    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3885cd9db4c3fbf456835203a419546cb6aa8efe9f275c11429e06c4e0fb15d1\": container with ID starting with 3885cd9db4c3fbf456835203a419546cb6aa8efe9f275c11429e06c4e0fb15d1 not found: ID does not exist" containerID="3885cd9db4c3fbf456835203a419546cb6aa8efe9f275c11429e06c4e0fb15d1"
Sep 10 14:38:37.650149 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.650019    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3885cd9db4c3fbf456835203a419546cb6aa8efe9f275c11429e06c4e0fb15d1"} err="failed to get container status \"3885cd9db4c3fbf456835203a419546cb6aa8efe9f275c11429e06c4e0fb15d1\": rpc error: code = NotFound desc = could not find container \"3885cd9db4c3fbf456835203a419546cb6aa8efe9f275c11429e06c4e0fb15d1\": container with ID starting with 3885cd9db4c3fbf456835203a419546cb6aa8efe9f275c11429e06c4e0fb15d1 not found: ID does not exist"
Sep 10 14:38:37.652899 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.652881    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"]
Sep 10 14:38:37.657121 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:37.657103    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-9e5db6-openshift-default-7c8d677f6d-rbvqg"]
Sep 10 14:38:38.366353 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:38.366313    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d181be50-3398-451b-849e-d6d1b8cdeaf7" path="/var/lib/kubelet/pods/d181be50-3398-451b-849e-d6d1b8cdeaf7/volumes"
Sep 10 14:38:43.155597 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:43.155514    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz"]
Sep 10 14:38:43.156072 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:43.155713    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz" podUID="ad20178e-1fac-4824-8d4f-af27e7628c5c" containerName="payload-processing" containerID="cri-o://b3a8bf6acc88c4e1ae93f9958503f5bf77c8e671fff6def7677132a75dac0264" gracePeriod=30
Sep 10 14:38:43.297796 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:43.297753    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-54c040-rh7cb"]
Sep 10 14:38:43.300215 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:43.300186    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-54c040-rh7cb"]
Sep 10 14:38:43.427472 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:43.427447    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz"
Sep 10 14:38:43.473343 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:43.473313    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvq95\" (UniqueName: \"kubernetes.io/projected/ad20178e-1fac-4824-8d4f-af27e7628c5c-kube-api-access-gvq95\") pod \"ad20178e-1fac-4824-8d4f-af27e7628c5c\" (UID: \"ad20178e-1fac-4824-8d4f-af27e7628c5c\") "
Sep 10 14:38:43.473511 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:43.473369    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad20178e-1fac-4824-8d4f-af27e7628c5c-plugins-config-volume\") pod \"ad20178e-1fac-4824-8d4f-af27e7628c5c\" (UID: \"ad20178e-1fac-4824-8d4f-af27e7628c5c\") "
Sep 10 14:38:43.473819 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:43.473791    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad20178e-1fac-4824-8d4f-af27e7628c5c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ad20178e-1fac-4824-8d4f-af27e7628c5c" (UID: "ad20178e-1fac-4824-8d4f-af27e7628c5c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:38:43.475371 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:43.475346    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad20178e-1fac-4824-8d4f-af27e7628c5c-kube-api-access-gvq95" (OuterVolumeSpecName: "kube-api-access-gvq95") pod "ad20178e-1fac-4824-8d4f-af27e7628c5c" (UID: "ad20178e-1fac-4824-8d4f-af27e7628c5c"). InnerVolumeSpecName "kube-api-access-gvq95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:38:43.574150 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:43.574119    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvq95\" (UniqueName: \"kubernetes.io/projected/ad20178e-1fac-4824-8d4f-af27e7628c5c-kube-api-access-gvq95\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:43.574150 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:43.574146    2545 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad20178e-1fac-4824-8d4f-af27e7628c5c-plugins-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:43.670304 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:43.670227    2545 generic.go:356] "Generic (PLEG): container finished" podID="ad20178e-1fac-4824-8d4f-af27e7628c5c" containerID="b3a8bf6acc88c4e1ae93f9958503f5bf77c8e671fff6def7677132a75dac0264" exitCode=0
Sep 10 14:38:43.670304 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:43.670274    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz"
Sep 10 14:38:43.670304 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:43.670284    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz" event={"ID":"ad20178e-1fac-4824-8d4f-af27e7628c5c","Type":"ContainerDied","Data":"b3a8bf6acc88c4e1ae93f9958503f5bf77c8e671fff6def7677132a75dac0264"}
Sep 10 14:38:43.670533 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:43.670340    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz" event={"ID":"ad20178e-1fac-4824-8d4f-af27e7628c5c","Type":"ContainerDied","Data":"a56eddf5725feaa749903d5cec7235eba1e7f10e7c0c55f9c1ef7bb2fe135e47"}
Sep 10 14:38:43.670533 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:43.670368    2545 scope.go:117] "RemoveContainer" containerID="b3a8bf6acc88c4e1ae93f9958503f5bf77c8e671fff6def7677132a75dac0264"
Sep 10 14:38:43.679989 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:43.679971    2545 scope.go:117] "RemoveContainer" containerID="b3a8bf6acc88c4e1ae93f9958503f5bf77c8e671fff6def7677132a75dac0264"
Sep 10 14:38:43.680265 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:38:43.680245    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3a8bf6acc88c4e1ae93f9958503f5bf77c8e671fff6def7677132a75dac0264\": container with ID starting with b3a8bf6acc88c4e1ae93f9958503f5bf77c8e671fff6def7677132a75dac0264 not found: ID does not exist" containerID="b3a8bf6acc88c4e1ae93f9958503f5bf77c8e671fff6def7677132a75dac0264"
Sep 10 14:38:43.680313 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:43.680272    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3a8bf6acc88c4e1ae93f9958503f5bf77c8e671fff6def7677132a75dac0264"} err="failed to get container status \"b3a8bf6acc88c4e1ae93f9958503f5bf77c8e671fff6def7677132a75dac0264\": rpc error: code = NotFound desc = could not find container \"b3a8bf6acc88c4e1ae93f9958503f5bf77c8e671fff6def7677132a75dac0264\": container with ID starting with b3a8bf6acc88c4e1ae93f9958503f5bf77c8e671fff6def7677132a75dac0264 not found: ID does not exist"
Sep 10 14:38:43.695924 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:43.695901    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz"]
Sep 10 14:38:43.702892 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:43.702869    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-54c040-5d8d4dcc4c-6nqtz"]
Sep 10 14:38:44.366755 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:44.366725    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ddd1095-4b9e-4b9d-8567-211bf06f96c5" path="/var/lib/kubelet/pods/4ddd1095-4b9e-4b9d-8567-211bf06f96c5/volumes"
Sep 10 14:38:44.367151 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:44.367081    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad20178e-1fac-4824-8d4f-af27e7628c5c" path="/var/lib/kubelet/pods/ad20178e-1fac-4824-8d4f-af27e7628c5c/volumes"
Sep 10 14:38:49.572304 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:49.572268    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"]
Sep 10 14:38:49.572801 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:49.572470    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w" podUID="7afa8372-b33a-4f4e-a435-2c1792f1575b" containerName="istio-proxy" containerID="cri-o://8f800a141078d018f950b82742ff0454ba03d9134bda8904e8b045bc729ba63d" gracePeriod=30
Sep 10 14:38:54.736508 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.736458    2545 generic.go:356] "Generic (PLEG): container finished" podID="7afa8372-b33a-4f4e-a435-2c1792f1575b" containerID="8f800a141078d018f950b82742ff0454ba03d9134bda8904e8b045bc729ba63d" exitCode=0
Sep 10 14:38:54.736901 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.736527    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w" event={"ID":"7afa8372-b33a-4f4e-a435-2c1792f1575b","Type":"ContainerDied","Data":"8f800a141078d018f950b82742ff0454ba03d9134bda8904e8b045bc729ba63d"}
Sep 10 14:38:54.736901 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.736605    2545 scope.go:117] "RemoveContainer" containerID="b428aa354e03016ed4fc10179b8a6fcfdd3f8912b79d8bb0f00d309f89904bb1"
Sep 10 14:38:54.828030 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.828002    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:38:54.872780 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.872715    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdfwx\" (UniqueName: \"kubernetes.io/projected/7afa8372-b33a-4f4e-a435-2c1792f1575b-kube-api-access-cdfwx\") pod \"7afa8372-b33a-4f4e-a435-2c1792f1575b\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") "
Sep 10 14:38:54.872780 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.872761    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-workload-certs\") pod \"7afa8372-b33a-4f4e-a435-2c1792f1575b\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") "
Sep 10 14:38:54.872967 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.872785    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-istio-data\") pod \"7afa8372-b33a-4f4e-a435-2c1792f1575b\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") "
Sep 10 14:38:54.872967 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.872915    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-credential-socket\") pod \"7afa8372-b33a-4f4e-a435-2c1792f1575b\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") "
Sep 10 14:38:54.873083 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.872969    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-istio-envoy\") pod \"7afa8372-b33a-4f4e-a435-2c1792f1575b\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") "
Sep 10 14:38:54.873083 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.873021    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7afa8372-b33a-4f4e-a435-2c1792f1575b-istio-token\") pod \"7afa8372-b33a-4f4e-a435-2c1792f1575b\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") "
Sep 10 14:38:54.873083 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.873050    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-istio-data" (OuterVolumeSpecName: "istio-data") pod "7afa8372-b33a-4f4e-a435-2c1792f1575b" (UID: "7afa8372-b33a-4f4e-a435-2c1792f1575b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:38:54.873083 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.873061    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7afa8372-b33a-4f4e-a435-2c1792f1575b" (UID: "7afa8372-b33a-4f4e-a435-2c1792f1575b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:38:54.873083 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.873056    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-workload-socket\") pod \"7afa8372-b33a-4f4e-a435-2c1792f1575b\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") "
Sep 10 14:38:54.873346 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.873149    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7afa8372-b33a-4f4e-a435-2c1792f1575b-istiod-ca-cert\") pod \"7afa8372-b33a-4f4e-a435-2c1792f1575b\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") "
Sep 10 14:38:54.873346 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.873186    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7afa8372-b33a-4f4e-a435-2c1792f1575b" (UID: "7afa8372-b33a-4f4e-a435-2c1792f1575b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:38:54.873346 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.873196    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7afa8372-b33a-4f4e-a435-2c1792f1575b-istio-podinfo\") pod \"7afa8372-b33a-4f4e-a435-2c1792f1575b\" (UID: \"7afa8372-b33a-4f4e-a435-2c1792f1575b\") "
Sep 10 14:38:54.873346 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.873282    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7afa8372-b33a-4f4e-a435-2c1792f1575b" (UID: "7afa8372-b33a-4f4e-a435-2c1792f1575b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:38:54.873663 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.873629    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7afa8372-b33a-4f4e-a435-2c1792f1575b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7afa8372-b33a-4f4e-a435-2c1792f1575b" (UID: "7afa8372-b33a-4f4e-a435-2c1792f1575b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:38:54.873818 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.873646    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-workload-certs\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:54.873929 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.873830    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-istio-data\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:54.873929 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.873847    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-credential-socket\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:54.873929 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.873862    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-workload-socket\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:54.875024 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.875003    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7afa8372-b33a-4f4e-a435-2c1792f1575b-kube-api-access-cdfwx" (OuterVolumeSpecName: "kube-api-access-cdfwx") pod "7afa8372-b33a-4f4e-a435-2c1792f1575b" (UID: "7afa8372-b33a-4f4e-a435-2c1792f1575b"). InnerVolumeSpecName "kube-api-access-cdfwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:38:54.875230 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.875204    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7afa8372-b33a-4f4e-a435-2c1792f1575b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7afa8372-b33a-4f4e-a435-2c1792f1575b" (UID: "7afa8372-b33a-4f4e-a435-2c1792f1575b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:38:54.875505 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.875473    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7afa8372-b33a-4f4e-a435-2c1792f1575b-istio-token" (OuterVolumeSpecName: "istio-token") pod "7afa8372-b33a-4f4e-a435-2c1792f1575b" (UID: "7afa8372-b33a-4f4e-a435-2c1792f1575b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:38:54.875586 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.875472    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7afa8372-b33a-4f4e-a435-2c1792f1575b" (UID: "7afa8372-b33a-4f4e-a435-2c1792f1575b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:38:54.974660 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.974633    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7afa8372-b33a-4f4e-a435-2c1792f1575b-istio-podinfo\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:54.974660 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.974655    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdfwx\" (UniqueName: \"kubernetes.io/projected/7afa8372-b33a-4f4e-a435-2c1792f1575b-kube-api-access-cdfwx\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:54.974797 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.974665    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7afa8372-b33a-4f4e-a435-2c1792f1575b-istio-envoy\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:54.974797 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.974673    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7afa8372-b33a-4f4e-a435-2c1792f1575b-istio-token\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:54.974797 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:54.974680    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7afa8372-b33a-4f4e-a435-2c1792f1575b-istiod-ca-cert\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:38:55.744800 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:55.744765    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w" event={"ID":"7afa8372-b33a-4f4e-a435-2c1792f1575b","Type":"ContainerDied","Data":"52aba099a523f9ad490dc6994cd0f6ae5cd4017c90fbaff349cb97938b23a70f"}
Sep 10 14:38:55.745232 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:55.744824    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"
Sep 10 14:38:55.745232 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:55.744850    2545 scope.go:117] "RemoveContainer" containerID="8f800a141078d018f950b82742ff0454ba03d9134bda8904e8b045bc729ba63d"
Sep 10 14:38:55.768111 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:55.768083    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"]
Sep 10 14:38:55.772200 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:55.772167    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-54c040-openshift-default-5f8848f484-2wt7w"]
Sep 10 14:38:56.366895 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:38:56.366861    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7afa8372-b33a-4f4e-a435-2c1792f1575b" path="/var/lib/kubelet/pods/7afa8372-b33a-4f4e-a435-2c1792f1575b/volumes"
Sep 10 14:39:02.134655 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.134627    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"]
Sep 10 14:39:02.135060 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.135007    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ddd1095-4b9e-4b9d-8567-211bf06f96c5" containerName="revoke-keys"
Sep 10 14:39:02.135060 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.135019    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ddd1095-4b9e-4b9d-8567-211bf06f96c5" containerName="revoke-keys"
Sep 10 14:39:02.135060 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.135030    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7afa8372-b33a-4f4e-a435-2c1792f1575b" containerName="istio-proxy"
Sep 10 14:39:02.135060 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.135036    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="7afa8372-b33a-4f4e-a435-2c1792f1575b" containerName="istio-proxy"
Sep 10 14:39:02.135060 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.135048    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7afa8372-b33a-4f4e-a435-2c1792f1575b" containerName="istio-proxy"
Sep 10 14:39:02.135060 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.135054    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="7afa8372-b33a-4f4e-a435-2c1792f1575b" containerName="istio-proxy"
Sep 10 14:39:02.135060 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.135062    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d181be50-3398-451b-849e-d6d1b8cdeaf7" containerName="istio-proxy"
Sep 10 14:39:02.135320 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.135067    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="d181be50-3398-451b-849e-d6d1b8cdeaf7" containerName="istio-proxy"
Sep 10 14:39:02.135320 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.135074    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad20178e-1fac-4824-8d4f-af27e7628c5c" containerName="payload-processing"
Sep 10 14:39:02.135320 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.135080    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad20178e-1fac-4824-8d4f-af27e7628c5c" containerName="payload-processing"
Sep 10 14:39:02.135320 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.135100    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d181be50-3398-451b-849e-d6d1b8cdeaf7" containerName="istio-proxy"
Sep 10 14:39:02.135320 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.135109    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="d181be50-3398-451b-849e-d6d1b8cdeaf7" containerName="istio-proxy"
Sep 10 14:39:02.135320 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.135164    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad20178e-1fac-4824-8d4f-af27e7628c5c" containerName="payload-processing"
Sep 10 14:39:02.135320 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.135173    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="7afa8372-b33a-4f4e-a435-2c1792f1575b" containerName="istio-proxy"
Sep 10 14:39:02.135320 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.135180    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="7afa8372-b33a-4f4e-a435-2c1792f1575b" containerName="istio-proxy"
Sep 10 14:39:02.135320 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.135186    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ddd1095-4b9e-4b9d-8567-211bf06f96c5" containerName="revoke-keys"
Sep 10 14:39:02.135320 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.135192    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="d181be50-3398-451b-849e-d6d1b8cdeaf7" containerName="istio-proxy"
Sep 10 14:39:02.135320 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.135200    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="d181be50-3398-451b-849e-d6d1b8cdeaf7" containerName="istio-proxy"
Sep 10 14:39:02.139763 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.139741    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.142632 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.142610    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-90366e-openshift-default-dockercfg-g7k8f\""
Sep 10 14:39:02.153927 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.153901    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"]
Sep 10 14:39:02.241457 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.241412    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-credential-socket\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.241662 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.241537    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istiod-ca-cert\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.241662 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.241586    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk2nw\" (UniqueName: \"kubernetes.io/projected/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-kube-api-access-jk2nw\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.241788 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.241654    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-workload-certs\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.241788 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.241746    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istio-token\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.241788 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.241777    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-workload-socket\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.241955 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.241815    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istio-envoy\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.242017 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.241947    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istio-podinfo\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.242017 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.241988    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istio-data\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.343229 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.343200    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-workload-certs\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.343406 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.343238    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istio-token\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.343406 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.343255    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-workload-socket\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.343406 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.343278    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istio-envoy\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.343406 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.343315    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istio-podinfo\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.343406 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.343333    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istio-data\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.343406 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.343356    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-credential-socket\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.343406 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.343383    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istiod-ca-cert\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.343804 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.343416    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk2nw\" (UniqueName: \"kubernetes.io/projected/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-kube-api-access-jk2nw\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.343804 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.343699    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-workload-socket\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.343804 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.343728    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-workload-certs\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.343804 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.343768    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istio-data\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.343984 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.343965    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-credential-socket\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.344218 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.344201    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istiod-ca-cert\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.345621 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.345604    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istio-envoy\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.345756 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.345740    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istio-podinfo\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.351661 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.351634    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk2nw\" (UniqueName: \"kubernetes.io/projected/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-kube-api-access-jk2nw\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.351758 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.351695    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istio-token\") pod \"e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") " pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.449585 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.449506    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:02.734002 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.733975    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"]
Sep 10 14:39:02.735826 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:39:02.735795    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb6a7bca_75b0_4aa4_9ed7_686b17078a8a.slice/crio-1563d2205eff6f543cc8e436d40268ec8c60759781d37f6062780f049c22b5d9 WatchSource:0}: Error finding container 1563d2205eff6f543cc8e436d40268ec8c60759781d37f6062780f049c22b5d9: Status 404 returned error can't find the container with id 1563d2205eff6f543cc8e436d40268ec8c60759781d37f6062780f049c22b5d9
Sep 10 14:39:02.738459 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.738416    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:39:02.738578 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.738558    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:39:02.738625 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.738607    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:39:02.789032 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:02.789009    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c" event={"ID":"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a","Type":"ContainerStarted","Data":"1563d2205eff6f543cc8e436d40268ec8c60759781d37f6062780f049c22b5d9"}
Sep 10 14:39:03.796618 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:03.796582    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c" event={"ID":"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a","Type":"ContainerStarted","Data":"a264c46dddd98353bc8e83effdef0390acf63ae8e868a35491fea1d0d14ae4c9"}
Sep 10 14:39:03.819416 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:03.819359    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c" podStartSLOduration=1.819341891 podStartE2EDuration="1.819341891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:39:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:39:03.815881787 +0000 UTC m=+1641.933423263" watchObservedRunningTime="2026-09-10 14:39:03.819341891 +0000 UTC m=+1641.936883366"
Sep 10 14:39:04.450618 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:04.450583    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:04.455413 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:04.455387    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:04.803630 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:04.803598    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:04.804647 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:04.804627    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:07.603866 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:07.603828    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm"]
Sep 10 14:39:07.607424 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:07.607406    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm"
Sep 10 14:39:07.610167 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:07.610145    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-90366e\""
Sep 10 14:39:07.610283 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:07.610243    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-90366e-dockercfg-57xst\""
Sep 10 14:39:07.621371 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:07.621347    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm"]
Sep 10 14:39:07.643293 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:07.643272    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw"]
Sep 10 14:39:07.646662 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:07.646646    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw"
Sep 10 14:39:07.654859 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:07.654837    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw"]
Sep 10 14:39:07.694022 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:07.693992    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8n5g\" (UniqueName: \"kubernetes.io/projected/4aed7387-1df6-4f3b-9ce8-98fe2eb45629-kube-api-access-r8n5g\") pod \"payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm\" (UID: \"4aed7387-1df6-4f3b-9ce8-98fe2eb45629\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm"
Sep 10 14:39:07.694172 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:07.694057    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4aed7387-1df6-4f3b-9ce8-98fe2eb45629-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm\" (UID: \"4aed7387-1df6-4f3b-9ce8-98fe2eb45629\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm"
Sep 10 14:39:07.794781 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:07.794747    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxgpt\" (UniqueName: \"kubernetes.io/projected/fe018286-6aa8-4a36-8a6b-f8e7a01ef72c-kube-api-access-fxgpt\") pod \"payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw\" (UID: \"fe018286-6aa8-4a36-8a6b-f8e7a01ef72c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw"
Sep 10 14:39:07.794945 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:07.794857    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8n5g\" (UniqueName: \"kubernetes.io/projected/4aed7387-1df6-4f3b-9ce8-98fe2eb45629-kube-api-access-r8n5g\") pod \"payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm\" (UID: \"4aed7387-1df6-4f3b-9ce8-98fe2eb45629\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm"
Sep 10 14:39:07.794945 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:07.794917    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe018286-6aa8-4a36-8a6b-f8e7a01ef72c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw\" (UID: \"fe018286-6aa8-4a36-8a6b-f8e7a01ef72c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw"
Sep 10 14:39:07.795029 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:07.794960    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4aed7387-1df6-4f3b-9ce8-98fe2eb45629-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm\" (UID: \"4aed7387-1df6-4f3b-9ce8-98fe2eb45629\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm"
Sep 10 14:39:07.795695 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:07.795678    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4aed7387-1df6-4f3b-9ce8-98fe2eb45629-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm\" (UID: \"4aed7387-1df6-4f3b-9ce8-98fe2eb45629\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm"
Sep 10 14:39:07.802982 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:07.802954    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8n5g\" (UniqueName: \"kubernetes.io/projected/4aed7387-1df6-4f3b-9ce8-98fe2eb45629-kube-api-access-r8n5g\") pod \"payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm\" (UID: \"4aed7387-1df6-4f3b-9ce8-98fe2eb45629\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm"
Sep 10 14:39:07.895623 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:07.895552    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe018286-6aa8-4a36-8a6b-f8e7a01ef72c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw\" (UID: \"fe018286-6aa8-4a36-8a6b-f8e7a01ef72c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw"
Sep 10 14:39:07.895754 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:07.895629    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxgpt\" (UniqueName: \"kubernetes.io/projected/fe018286-6aa8-4a36-8a6b-f8e7a01ef72c-kube-api-access-fxgpt\") pod \"payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw\" (UID: \"fe018286-6aa8-4a36-8a6b-f8e7a01ef72c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw"
Sep 10 14:39:07.896181 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:07.896164    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe018286-6aa8-4a36-8a6b-f8e7a01ef72c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw\" (UID: \"fe018286-6aa8-4a36-8a6b-f8e7a01ef72c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw"
Sep 10 14:39:07.907110 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:07.907084    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxgpt\" (UniqueName: \"kubernetes.io/projected/fe018286-6aa8-4a36-8a6b-f8e7a01ef72c-kube-api-access-fxgpt\") pod \"payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw\" (UID: \"fe018286-6aa8-4a36-8a6b-f8e7a01ef72c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw"
Sep 10 14:39:07.918186 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:07.918156    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm"
Sep 10 14:39:07.957234 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:07.957202    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw"
Sep 10 14:39:08.190589 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:08.190558    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm"]
Sep 10 14:39:08.191103 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:39:08.191077    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aed7387_1df6_4f3b_9ce8_98fe2eb45629.slice/crio-ce0d056c0ab55b633f9aa8bf061f64fb15377f9b4fe74313ec73739adb53799b WatchSource:0}: Error finding container ce0d056c0ab55b633f9aa8bf061f64fb15377f9b4fe74313ec73739adb53799b: Status 404 returned error can't find the container with id ce0d056c0ab55b633f9aa8bf061f64fb15377f9b4fe74313ec73739adb53799b
Sep 10 14:39:08.242084 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:08.242061    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw"]
Sep 10 14:39:08.254566 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:39:08.254543    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe018286_6aa8_4a36_8a6b_f8e7a01ef72c.slice/crio-e363c90460a55c7d460a67dd5a8997cf473392d4d6e554ceac1dcc37a9eb3d1c WatchSource:0}: Error finding container e363c90460a55c7d460a67dd5a8997cf473392d4d6e554ceac1dcc37a9eb3d1c: Status 404 returned error can't find the container with id e363c90460a55c7d460a67dd5a8997cf473392d4d6e554ceac1dcc37a9eb3d1c
Sep 10 14:39:08.828386 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:08.828345    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw" event={"ID":"fe018286-6aa8-4a36-8a6b-f8e7a01ef72c","Type":"ContainerStarted","Data":"ca6b6fd0c273cbc8b3fbdbc3affccd2e22c23fec73caa6ad01bbe4dd74202ed2"}
Sep 10 14:39:08.828840 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:08.828409    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw" event={"ID":"fe018286-6aa8-4a36-8a6b-f8e7a01ef72c","Type":"ContainerStarted","Data":"e363c90460a55c7d460a67dd5a8997cf473392d4d6e554ceac1dcc37a9eb3d1c"}
Sep 10 14:39:08.828840 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:08.828525    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw"
Sep 10 14:39:08.830167 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:08.830142    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm" event={"ID":"4aed7387-1df6-4f3b-9ce8-98fe2eb45629","Type":"ContainerStarted","Data":"8b9e56ee679f53359f23832be4e92e2550c6dbd11bff7c095ad61f3782e75b21"}
Sep 10 14:39:08.830251 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:08.830192    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm" event={"ID":"4aed7387-1df6-4f3b-9ce8-98fe2eb45629","Type":"ContainerStarted","Data":"ce0d056c0ab55b633f9aa8bf061f64fb15377f9b4fe74313ec73739adb53799b"}
Sep 10 14:39:08.830251 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:08.830220    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm"
Sep 10 14:39:08.845781 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:08.845742    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw" podStartSLOduration=1.845728875 podStartE2EDuration="1.845728875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:39:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:39:08.843968494 +0000 UTC m=+1646.961509970" watchObservedRunningTime="2026-09-10 14:39:08.845728875 +0000 UTC m=+1646.963270347"
Sep 10 14:39:08.861203 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:08.861151    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm" podStartSLOduration=1.861133548 podStartE2EDuration="1.861133548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:39:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:39:08.858131369 +0000 UTC m=+1646.975672845" watchObservedRunningTime="2026-09-10 14:39:08.861133548 +0000 UTC m=+1646.978675025"
Sep 10 14:39:19.839135 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:19.839098    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm"
Sep 10 14:39:19.839659 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:19.839441    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw"
Sep 10 14:39:20.845644 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:20.845606    2545 patch_prober.go:28] interesting pod/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 14:39:20.846120 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:20.845666    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c" podUID="fb6a7bca-75b0-4aa4-9ed7-686b17078a8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 14:39:21.917878 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:21.917850    2545 generic.go:356] "Generic (PLEG): container finished" podID="fb6a7bca-75b0-4aa4-9ed7-686b17078a8a" containerID="a264c46dddd98353bc8e83effdef0390acf63ae8e868a35491fea1d0d14ae4c9" exitCode=0
Sep 10 14:39:21.918245 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:21.917902    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c" event={"ID":"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a","Type":"ContainerDied","Data":"a264c46dddd98353bc8e83effdef0390acf63ae8e868a35491fea1d0d14ae4c9"}
Sep 10 14:39:21.918313 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:21.918298    2545 scope.go:117] "RemoveContainer" containerID="a264c46dddd98353bc8e83effdef0390acf63ae8e868a35491fea1d0d14ae4c9"
Sep 10 14:39:21.919425 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:21.919397    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:39:21.919481 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:21.919468    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:39:21.919539 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:21.919518    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:39:22.925460 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:22.925422    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c" event={"ID":"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a","Type":"ContainerStarted","Data":"4fe20a5ef04d72fda52cf5b01fbe62f8ec066f492565b5b7f56a113a5ec801b4"}
Sep 10 14:39:23.450575 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:23.450534    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:23.451201 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:23.450875    2545 patch_prober.go:28] interesting pod/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 10 14:39:23.451201 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:23.450931    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c" podUID="fb6a7bca-75b0-4aa4-9ed7-686b17078a8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 10 14:39:24.450444 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:24.450400    2545 patch_prober.go:28] interesting pod/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 10 14:39:24.451066 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:24.451027    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c" podUID="fb6a7bca-75b0-4aa4-9ed7-686b17078a8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 10 14:39:25.450836 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:25.450770    2545 patch_prober.go:28] interesting pod/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 10 14:39:25.451303 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:25.450835    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c" podUID="fb6a7bca-75b0-4aa4-9ed7-686b17078a8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 10 14:39:26.450864 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:26.450826    2545 patch_prober.go:28] interesting pod/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 10 14:39:26.451342 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:26.450896    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c" podUID="fb6a7bca-75b0-4aa4-9ed7-686b17078a8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 10 14:39:27.452543 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:27.452504    2545 patch_prober.go:28] interesting pod/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 10 14:39:27.453110 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:27.453077    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c" podUID="fb6a7bca-75b0-4aa4-9ed7-686b17078a8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 10 14:39:28.454460 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:28.454427    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:28.454860 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:28.454687    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:28.455356 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:28.455339    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:39:31.547218 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.547185    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"]
Sep 10 14:39:31.550006 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.549987    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.552785 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.552758    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-6b9e31-openshift-default-dockercfg-dqmvk\""
Sep 10 14:39:31.563614 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.563591    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"]
Sep 10 14:39:31.629602 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.629577    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-istio-envoy\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.629706 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.629606    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-workload-certs\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.629706 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.629627    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aaca653a-70aa-4235-ada2-97ee410b16de-istiod-ca-cert\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.629706 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.629643    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-istio-data\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.629815 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.629723    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4mf5\" (UniqueName: \"kubernetes.io/projected/aaca653a-70aa-4235-ada2-97ee410b16de-kube-api-access-w4mf5\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.629815 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.629772    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aaca653a-70aa-4235-ada2-97ee410b16de-istio-token\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.629888 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.629835    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-credential-socket\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.629888 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.629865    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-workload-socket\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.629888 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.629879    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aaca653a-70aa-4235-ada2-97ee410b16de-istio-podinfo\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.731204 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.731153    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4mf5\" (UniqueName: \"kubernetes.io/projected/aaca653a-70aa-4235-ada2-97ee410b16de-kube-api-access-w4mf5\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.731414 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.731232    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aaca653a-70aa-4235-ada2-97ee410b16de-istio-token\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.731414 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.731260    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-credential-socket\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.731414 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.731282    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-workload-socket\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.731414 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.731305    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aaca653a-70aa-4235-ada2-97ee410b16de-istio-podinfo\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.731414 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.731405    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-istio-envoy\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.731742 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.731433    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-workload-certs\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.731742 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.731464    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aaca653a-70aa-4235-ada2-97ee410b16de-istiod-ca-cert\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.731742 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.731527    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-istio-data\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.731895 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.731763    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-workload-socket\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.731895 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.731792    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-credential-socket\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.731895 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.731832    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-workload-certs\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.732042 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.731925    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-istio-data\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.732139 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.732118    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aaca653a-70aa-4235-ada2-97ee410b16de-istiod-ca-cert\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.733657 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.733634    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-istio-envoy\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.733990 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.733967    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aaca653a-70aa-4235-ada2-97ee410b16de-istio-podinfo\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.739619 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.739596    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4mf5\" (UniqueName: \"kubernetes.io/projected/aaca653a-70aa-4235-ada2-97ee410b16de-kube-api-access-w4mf5\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.739908 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.739891    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aaca653a-70aa-4235-ada2-97ee410b16de-istio-token\") pod \"e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") " pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:31.861773 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:31.861694    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:32.136600 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:32.136567    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"]
Sep 10 14:39:32.143064 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:32.143031    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:39:32.143164 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:32.143095    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:39:32.143164 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:32.143128    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:39:32.995072 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:32.995030    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt" event={"ID":"aaca653a-70aa-4235-ada2-97ee410b16de","Type":"ContainerStarted","Data":"357fd74b14aae4e292016259c9ef641861b69f4eb1673bab80679c3b5f655af7"}
Sep 10 14:39:32.995412 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:32.995084    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt" event={"ID":"aaca653a-70aa-4235-ada2-97ee410b16de","Type":"ContainerStarted","Data":"877d4d99474ddbd92378031d64263141e71131a9fffc8e0592aad2d35392adfd"}
Sep 10 14:39:33.015971 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:33.015923    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt" podStartSLOduration=2.015908113 podStartE2EDuration="2.015908113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:39:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:39:33.013858343 +0000 UTC m=+1671.131399830" watchObservedRunningTime="2026-09-10 14:39:33.015908113 +0000 UTC m=+1671.133449587"
Sep 10 14:39:33.862131 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:33.862101    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:33.867240 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:33.867212    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:34.001861 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:34.001834    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:34.002799 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:34.002781    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:36.645790 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:36.645757    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr"]
Sep 10 14:39:36.648616 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:36.648595    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr"
Sep 10 14:39:36.651341 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:36.651298    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-6b9e31\""
Sep 10 14:39:36.651441 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:36.651344    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-6b9e31-dockercfg-d8g4b\""
Sep 10 14:39:36.659306 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:36.659277    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr"]
Sep 10 14:39:36.677797 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:36.677765    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csx4v\" (UniqueName: \"kubernetes.io/projected/da5ab46d-1371-4f10-ae31-39338adec3f6-kube-api-access-csx4v\") pod \"payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr\" (UID: \"da5ab46d-1371-4f10-ae31-39338adec3f6\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr"
Sep 10 14:39:36.677940 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:36.677826    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da5ab46d-1371-4f10-ae31-39338adec3f6-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr\" (UID: \"da5ab46d-1371-4f10-ae31-39338adec3f6\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr"
Sep 10 14:39:36.778849 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:36.778806    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csx4v\" (UniqueName: \"kubernetes.io/projected/da5ab46d-1371-4f10-ae31-39338adec3f6-kube-api-access-csx4v\") pod \"payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr\" (UID: \"da5ab46d-1371-4f10-ae31-39338adec3f6\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr"
Sep 10 14:39:36.779031 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:36.778874    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da5ab46d-1371-4f10-ae31-39338adec3f6-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr\" (UID: \"da5ab46d-1371-4f10-ae31-39338adec3f6\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr"
Sep 10 14:39:36.779553 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:36.779533    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da5ab46d-1371-4f10-ae31-39338adec3f6-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr\" (UID: \"da5ab46d-1371-4f10-ae31-39338adec3f6\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr"
Sep 10 14:39:36.788528 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:36.788480    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csx4v\" (UniqueName: \"kubernetes.io/projected/da5ab46d-1371-4f10-ae31-39338adec3f6-kube-api-access-csx4v\") pod \"payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr\" (UID: \"da5ab46d-1371-4f10-ae31-39338adec3f6\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr"
Sep 10 14:39:36.961413 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:36.961311    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr"
Sep 10 14:39:37.232653 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:37.232620    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr"]
Sep 10 14:39:37.233755 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:39:37.233728    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda5ab46d_1371_4f10_ae31_39338adec3f6.slice/crio-908140b3287d0e3bb9584d57e3a37b233bee1ad5056aa60e9400a71c95a17612 WatchSource:0}: Error finding container 908140b3287d0e3bb9584d57e3a37b233bee1ad5056aa60e9400a71c95a17612: Status 404 returned error can't find the container with id 908140b3287d0e3bb9584d57e3a37b233bee1ad5056aa60e9400a71c95a17612
Sep 10 14:39:38.035894 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:38.035861    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr" event={"ID":"da5ab46d-1371-4f10-ae31-39338adec3f6","Type":"ContainerStarted","Data":"5015c45376862269e2bb595c06c9d820d4b44a58dd7ce37fb0a55a33699bb07b"}
Sep 10 14:39:38.036320 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:38.035910    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr" event={"ID":"da5ab46d-1371-4f10-ae31-39338adec3f6","Type":"ContainerStarted","Data":"908140b3287d0e3bb9584d57e3a37b233bee1ad5056aa60e9400a71c95a17612"}
Sep 10 14:39:38.036320 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:38.035954    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr"
Sep 10 14:39:38.052837 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:38.052788    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr" podStartSLOduration=2.052774442 podStartE2EDuration="2.052774442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:39:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:39:38.050988499 +0000 UTC m=+1676.168529974" watchObservedRunningTime="2026-09-10 14:39:38.052774442 +0000 UTC m=+1676.170315981"
Sep 10 14:39:49.043633 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:49.043597    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr"
Sep 10 14:39:53.131757 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:53.131723    2545 generic.go:356] "Generic (PLEG): container finished" podID="aaca653a-70aa-4235-ada2-97ee410b16de" containerID="357fd74b14aae4e292016259c9ef641861b69f4eb1673bab80679c3b5f655af7" exitCode=0
Sep 10 14:39:53.132168 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:53.131795    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt" event={"ID":"aaca653a-70aa-4235-ada2-97ee410b16de","Type":"ContainerDied","Data":"357fd74b14aae4e292016259c9ef641861b69f4eb1673bab80679c3b5f655af7"}
Sep 10 14:39:53.132214 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:53.132186    2545 scope.go:117] "RemoveContainer" containerID="357fd74b14aae4e292016259c9ef641861b69f4eb1673bab80679c3b5f655af7"
Sep 10 14:39:53.133229 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:53.133204    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:39:53.133292 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:53.133284    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:39:53.133331 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:53.133316    2545 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 14:39:54.140401 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:54.140364    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt" event={"ID":"aaca653a-70aa-4235-ada2-97ee410b16de","Type":"ContainerStarted","Data":"d8f1b5f50ee5522d1aa64fd0f7623b6f139d3bc3698cfde401e0003a78a16ecd"}
Sep 10 14:39:54.862460 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:54.862413    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:54.862736 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:54.862707    2545 patch_prober.go:28] interesting pod/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 10 14:39:54.862818 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:54.862783    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt" podUID="aaca653a-70aa-4235-ada2-97ee410b16de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 10 14:39:55.871655 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:55.871608    2545 patch_prober.go:28] interesting pod/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 10 14:39:55.872145 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:55.871686    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt" podUID="aaca653a-70aa-4235-ada2-97ee410b16de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 10 14:39:56.863090 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:56.863044    2545 patch_prober.go:28] interesting pod/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 10 14:39:56.863297 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:56.863190    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt" podUID="aaca653a-70aa-4235-ada2-97ee410b16de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 10 14:39:57.862690 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:57.862649    2545 patch_prober.go:28] interesting pod/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 10 14:39:57.863164 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:57.862712    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt" podUID="aaca653a-70aa-4235-ada2-97ee410b16de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 10 14:39:58.862903 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:58.862859    2545 patch_prober.go:28] interesting pod/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 10 14:39:58.863507 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:58.863454    2545 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt" podUID="aaca653a-70aa-4235-ada2-97ee410b16de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 10 14:39:59.866261 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:59.866229    2545 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:59.866691 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:59.866531    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:39:59.867197 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:39:59.867178    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:40:04.870237 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:40:04.870145    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-bbcvl_bbf1ec85-8ba1-4185-b9f4-e8ac8b82464d/payload-processing/0.log"
Sep 10 14:40:04.986741 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:40:04.986708    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr_da5ab46d-1371-4f10-ae31-39338adec3f6/payload-processing/0.log"
Sep 10 14:40:42.825958 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:40:42.825930    2545 scope.go:117] "RemoveContainer" containerID="8064b8896e43f06b81188882ab384d89a0cd27c028cbcf4a2d6278dacaf30479"
Sep 10 14:40:45.608678 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:40:45.608646    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw_fe018286-6aa8-4a36-8a6b-f8e7a01ef72c/payload-processing/0.log"
Sep 10 14:40:45.731398 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:40:45.731365    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-bbcvl_bbf1ec85-8ba1-4185-b9f4-e8ac8b82464d/payload-processing/0.log"
Sep 10 14:40:45.849675 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:40:45.849649    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr_da5ab46d-1371-4f10-ae31-39338adec3f6/payload-processing/0.log"
Sep 10 14:40:51.317693 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:40:51.317662    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh"]
Sep 10 14:40:51.321195 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:40:51.321175    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh"
Sep 10 14:40:51.323976 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:40:51.323956    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-652186\""
Sep 10 14:40:51.336519 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:40:51.336482    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh"]
Sep 10 14:40:51.400340 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:40:51.400302    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smltt\" (UniqueName: \"kubernetes.io/projected/8a400b1b-fa23-4b57-8fbc-68c12f91c5dd-kube-api-access-smltt\") pod \"payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh\" (UID: \"8a400b1b-fa23-4b57-8fbc-68c12f91c5dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh"
Sep 10 14:40:51.400530 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:40:51.400382    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a400b1b-fa23-4b57-8fbc-68c12f91c5dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh\" (UID: \"8a400b1b-fa23-4b57-8fbc-68c12f91c5dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh"
Sep 10 14:40:51.501574 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:40:51.501533    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a400b1b-fa23-4b57-8fbc-68c12f91c5dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh\" (UID: \"8a400b1b-fa23-4b57-8fbc-68c12f91c5dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh"
Sep 10 14:40:51.501783 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:40:51.501630    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smltt\" (UniqueName: \"kubernetes.io/projected/8a400b1b-fa23-4b57-8fbc-68c12f91c5dd-kube-api-access-smltt\") pod \"payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh\" (UID: \"8a400b1b-fa23-4b57-8fbc-68c12f91c5dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh"
Sep 10 14:40:51.502289 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:40:51.502264    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a400b1b-fa23-4b57-8fbc-68c12f91c5dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh\" (UID: \"8a400b1b-fa23-4b57-8fbc-68c12f91c5dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh"
Sep 10 14:40:51.512664 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:40:51.512637    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smltt\" (UniqueName: \"kubernetes.io/projected/8a400b1b-fa23-4b57-8fbc-68c12f91c5dd-kube-api-access-smltt\") pod \"payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh\" (UID: \"8a400b1b-fa23-4b57-8fbc-68c12f91c5dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh"
Sep 10 14:40:51.631655 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:40:51.631566    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh"
Sep 10 14:40:51.907469 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:40:51.907440    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh"]
Sep 10 14:40:51.909090 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:40:51.909061    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a400b1b_fa23_4b57_8fbc_68c12f91c5dd.slice/crio-109b3526f3ccf5df67209928f2e9b34dbe575108a752656269504fe74cc35414 WatchSource:0}: Error finding container 109b3526f3ccf5df67209928f2e9b34dbe575108a752656269504fe74cc35414: Status 404 returned error can't find the container with id 109b3526f3ccf5df67209928f2e9b34dbe575108a752656269504fe74cc35414
Sep 10 14:40:52.523655 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:40:52.523613    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh" event={"ID":"8a400b1b-fa23-4b57-8fbc-68c12f91c5dd","Type":"ContainerStarted","Data":"ffc9dac6fbf75a96d50f21c575fca2638bcd52d893d194435e88c5e341e484c6"}
Sep 10 14:40:52.524062 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:40:52.523678    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh" event={"ID":"8a400b1b-fa23-4b57-8fbc-68c12f91c5dd","Type":"ContainerStarted","Data":"109b3526f3ccf5df67209928f2e9b34dbe575108a752656269504fe74cc35414"}
Sep 10 14:40:52.524062 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:40:52.523705    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh"
Sep 10 14:40:52.543858 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:40:52.543803    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh" podStartSLOduration=1.5437873359999998 podStartE2EDuration="1.543787336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:40:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:40:52.54206261 +0000 UTC m=+1750.659604099" watchObservedRunningTime="2026-09-10 14:40:52.543787336 +0000 UTC m=+1750.661328811"
Sep 10 14:41:03.531632 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:03.531601    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh"
Sep 10 14:41:15.168557 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:15.168525    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-652186-27282"]
Sep 10 14:41:15.171930 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:15.171909    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-652186-27282"
Sep 10 14:41:15.174387 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:15.174369    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:41:15.174505 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:15.174372    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pj254\""
Sep 10 14:41:15.179332 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:15.179309    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-652186-27282"]
Sep 10 14:41:15.238665 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:15.238634    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e694d13d-b3ad-41f6-ba80-f08f0ccc9894-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-652186-27282\" (UID: \"e694d13d-b3ad-41f6-ba80-f08f0ccc9894\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-652186-27282"
Sep 10 14:41:15.339699 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:15.339669    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e694d13d-b3ad-41f6-ba80-f08f0ccc9894-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-652186-27282\" (UID: \"e694d13d-b3ad-41f6-ba80-f08f0ccc9894\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-652186-27282"
Sep 10 14:41:15.340294 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:15.340275    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e694d13d-b3ad-41f6-ba80-f08f0ccc9894-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-652186-27282\" (UID: \"e694d13d-b3ad-41f6-ba80-f08f0ccc9894\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-652186-27282"
Sep 10 14:41:15.484517 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:15.484433    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-652186-27282"
Sep 10 14:41:15.757173 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:15.757140    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-652186-27282"]
Sep 10 14:41:15.758565 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:41:15.758529    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode694d13d_b3ad_41f6_ba80_f08f0ccc9894.slice/crio-84ccee1e3f648eb95ab5d92431d00da3549157b9e9d8e720eb42d1bbe105b16f WatchSource:0}: Error finding container 84ccee1e3f648eb95ab5d92431d00da3549157b9e9d8e720eb42d1bbe105b16f: Status 404 returned error can't find the container with id 84ccee1e3f648eb95ab5d92431d00da3549157b9e9d8e720eb42d1bbe105b16f
Sep 10 14:41:16.676950 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:16.676911    2545 generic.go:356] "Generic (PLEG): container finished" podID="e694d13d-b3ad-41f6-ba80-f08f0ccc9894" containerID="18031e29acf16da11829fbcab713414371a9470c26e29b91530fd1cc65b0f2ed" exitCode=0
Sep 10 14:41:16.677313 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:16.676982    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-652186-27282" event={"ID":"e694d13d-b3ad-41f6-ba80-f08f0ccc9894","Type":"ContainerDied","Data":"18031e29acf16da11829fbcab713414371a9470c26e29b91530fd1cc65b0f2ed"}
Sep 10 14:41:16.677313 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:16.677025    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-652186-27282" event={"ID":"e694d13d-b3ad-41f6-ba80-f08f0ccc9894","Type":"ContainerStarted","Data":"84ccee1e3f648eb95ab5d92431d00da3549157b9e9d8e720eb42d1bbe105b16f"}
Sep 10 14:41:17.815263 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:17.815239    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-652186-27282"
Sep 10 14:41:17.860038 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:17.860009    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e694d13d-b3ad-41f6-ba80-f08f0ccc9894-maas-api-service-ca\") pod \"e694d13d-b3ad-41f6-ba80-f08f0ccc9894\" (UID: \"e694d13d-b3ad-41f6-ba80-f08f0ccc9894\") "
Sep 10 14:41:17.860422 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:17.860397    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e694d13d-b3ad-41f6-ba80-f08f0ccc9894-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e694d13d-b3ad-41f6-ba80-f08f0ccc9894" (UID: "e694d13d-b3ad-41f6-ba80-f08f0ccc9894"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:41:17.961404 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:17.961317    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e694d13d-b3ad-41f6-ba80-f08f0ccc9894-maas-api-service-ca\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:41:18.690286 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:18.690188    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-652186-27282"
Sep 10 14:41:18.690286 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:18.690231    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-652186-27282" event={"ID":"e694d13d-b3ad-41f6-ba80-f08f0ccc9894","Type":"ContainerDied","Data":"84ccee1e3f648eb95ab5d92431d00da3549157b9e9d8e720eb42d1bbe105b16f"}
Sep 10 14:41:18.690465 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:18.690313    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84ccee1e3f648eb95ab5d92431d00da3549157b9e9d8e720eb42d1bbe105b16f"
Sep 10 14:41:21.424041 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:21.424007    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh"]
Sep 10 14:41:21.424524 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:21.424252    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh" podUID="8a400b1b-fa23-4b57-8fbc-68c12f91c5dd" containerName="payload-pre-processing" containerID="cri-o://ffc9dac6fbf75a96d50f21c575fca2638bcd52d893d194435e88c5e341e484c6" gracePeriod=30
Sep 10 14:41:21.606122 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:21.606091    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-652186-27282"]
Sep 10 14:41:21.608789 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:21.608762    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-652186-27282"]
Sep 10 14:41:21.671689 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:21.671660    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh"
Sep 10 14:41:21.696613 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:21.695562    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a400b1b-fa23-4b57-8fbc-68c12f91c5dd-plugins-config-volume\") pod \"8a400b1b-fa23-4b57-8fbc-68c12f91c5dd\" (UID: \"8a400b1b-fa23-4b57-8fbc-68c12f91c5dd\") "
Sep 10 14:41:21.696613 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:21.695678    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smltt\" (UniqueName: \"kubernetes.io/projected/8a400b1b-fa23-4b57-8fbc-68c12f91c5dd-kube-api-access-smltt\") pod \"8a400b1b-fa23-4b57-8fbc-68c12f91c5dd\" (UID: \"8a400b1b-fa23-4b57-8fbc-68c12f91c5dd\") "
Sep 10 14:41:21.696834 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:21.696742    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a400b1b-fa23-4b57-8fbc-68c12f91c5dd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8a400b1b-fa23-4b57-8fbc-68c12f91c5dd" (UID: "8a400b1b-fa23-4b57-8fbc-68c12f91c5dd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:41:21.697156 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:21.697118    2545 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a400b1b-fa23-4b57-8fbc-68c12f91c5dd-plugins-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:41:21.704409 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:21.704342    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a400b1b-fa23-4b57-8fbc-68c12f91c5dd-kube-api-access-smltt" (OuterVolumeSpecName: "kube-api-access-smltt") pod "8a400b1b-fa23-4b57-8fbc-68c12f91c5dd" (UID: "8a400b1b-fa23-4b57-8fbc-68c12f91c5dd"). InnerVolumeSpecName "kube-api-access-smltt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:41:21.720759 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:21.718066    2545 generic.go:356] "Generic (PLEG): container finished" podID="8a400b1b-fa23-4b57-8fbc-68c12f91c5dd" containerID="ffc9dac6fbf75a96d50f21c575fca2638bcd52d893d194435e88c5e341e484c6" exitCode=0
Sep 10 14:41:21.720759 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:21.718314    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh" event={"ID":"8a400b1b-fa23-4b57-8fbc-68c12f91c5dd","Type":"ContainerDied","Data":"ffc9dac6fbf75a96d50f21c575fca2638bcd52d893d194435e88c5e341e484c6"}
Sep 10 14:41:21.720759 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:21.718373    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh" event={"ID":"8a400b1b-fa23-4b57-8fbc-68c12f91c5dd","Type":"ContainerDied","Data":"109b3526f3ccf5df67209928f2e9b34dbe575108a752656269504fe74cc35414"}
Sep 10 14:41:21.720759 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:21.718405    2545 scope.go:117] "RemoveContainer" containerID="ffc9dac6fbf75a96d50f21c575fca2638bcd52d893d194435e88c5e341e484c6"
Sep 10 14:41:21.720759 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:21.718654    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh"
Sep 10 14:41:21.733019 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:21.732992    2545 scope.go:117] "RemoveContainer" containerID="ffc9dac6fbf75a96d50f21c575fca2638bcd52d893d194435e88c5e341e484c6"
Sep 10 14:41:21.733362 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:41:21.733334    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffc9dac6fbf75a96d50f21c575fca2638bcd52d893d194435e88c5e341e484c6\": container with ID starting with ffc9dac6fbf75a96d50f21c575fca2638bcd52d893d194435e88c5e341e484c6 not found: ID does not exist" containerID="ffc9dac6fbf75a96d50f21c575fca2638bcd52d893d194435e88c5e341e484c6"
Sep 10 14:41:21.733433 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:21.733377    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffc9dac6fbf75a96d50f21c575fca2638bcd52d893d194435e88c5e341e484c6"} err="failed to get container status \"ffc9dac6fbf75a96d50f21c575fca2638bcd52d893d194435e88c5e341e484c6\": rpc error: code = NotFound desc = could not find container \"ffc9dac6fbf75a96d50f21c575fca2638bcd52d893d194435e88c5e341e484c6\": container with ID starting with ffc9dac6fbf75a96d50f21c575fca2638bcd52d893d194435e88c5e341e484c6 not found: ID does not exist"
Sep 10 14:41:21.743129 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:21.743093    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh"]
Sep 10 14:41:21.745664 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:21.745642    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-652186-fc65544f8-79gjh"]
Sep 10 14:41:21.797699 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:21.797659    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smltt\" (UniqueName: \"kubernetes.io/projected/8a400b1b-fa23-4b57-8fbc-68c12f91c5dd-kube-api-access-smltt\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:41:22.366991 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:22.366956    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a400b1b-fa23-4b57-8fbc-68c12f91c5dd" path="/var/lib/kubelet/pods/8a400b1b-fa23-4b57-8fbc-68c12f91c5dd/volumes"
Sep 10 14:41:22.367308 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:22.367295    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e694d13d-b3ad-41f6-ba80-f08f0ccc9894" path="/var/lib/kubelet/pods/e694d13d-b3ad-41f6-ba80-f08f0ccc9894/volumes"
Sep 10 14:41:31.429974 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:31.429935    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-90366e-qkj22"]
Sep 10 14:41:31.430381 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:31.430367    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a400b1b-fa23-4b57-8fbc-68c12f91c5dd" containerName="payload-pre-processing"
Sep 10 14:41:31.430381 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:31.430382    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a400b1b-fa23-4b57-8fbc-68c12f91c5dd" containerName="payload-pre-processing"
Sep 10 14:41:31.430476 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:31.430397    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e694d13d-b3ad-41f6-ba80-f08f0ccc9894" containerName="revoke-keys"
Sep 10 14:41:31.430476 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:31.430403    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="e694d13d-b3ad-41f6-ba80-f08f0ccc9894" containerName="revoke-keys"
Sep 10 14:41:31.430566 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:31.430474    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="e694d13d-b3ad-41f6-ba80-f08f0ccc9894" containerName="revoke-keys"
Sep 10 14:41:31.430566 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:31.430497    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a400b1b-fa23-4b57-8fbc-68c12f91c5dd" containerName="payload-pre-processing"
Sep 10 14:41:31.434818 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:31.434801    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-90366e-qkj22"
Sep 10 14:41:31.438117 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:31.438095    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:41:31.438297 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:31.438095    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pj254\""
Sep 10 14:41:31.441381 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:31.441356    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-90366e-qkj22"]
Sep 10 14:41:31.493629 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:31.493593    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d36a262-c226-43df-b65f-014441e0ce62-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-90366e-qkj22\" (UID: \"7d36a262-c226-43df-b65f-014441e0ce62\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-90366e-qkj22"
Sep 10 14:41:31.594593 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:31.594561    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d36a262-c226-43df-b65f-014441e0ce62-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-90366e-qkj22\" (UID: \"7d36a262-c226-43df-b65f-014441e0ce62\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-90366e-qkj22"
Sep 10 14:41:31.595195 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:31.595173    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d36a262-c226-43df-b65f-014441e0ce62-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-90366e-qkj22\" (UID: \"7d36a262-c226-43df-b65f-014441e0ce62\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-90366e-qkj22"
Sep 10 14:41:31.746173 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:31.746138    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-90366e-qkj22"
Sep 10 14:41:32.022780 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:32.022752    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-90366e-qkj22"]
Sep 10 14:41:32.024343 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:41:32.024318    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d36a262_c226_43df_b65f_014441e0ce62.slice/crio-9a0e4da6a85a60e4c8edb17576fd97f825c47748e9eff4080b63382f99874e1e WatchSource:0}: Error finding container 9a0e4da6a85a60e4c8edb17576fd97f825c47748e9eff4080b63382f99874e1e: Status 404 returned error can't find the container with id 9a0e4da6a85a60e4c8edb17576fd97f825c47748e9eff4080b63382f99874e1e
Sep 10 14:41:32.789894 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:32.789860    2545 generic.go:356] "Generic (PLEG): container finished" podID="7d36a262-c226-43df-b65f-014441e0ce62" containerID="9ad0363963d0b0cc0134bc15698f3eaae54c78cf7670ec6551eaafe74f5ca478" exitCode=0
Sep 10 14:41:32.790228 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:32.789937    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-90366e-qkj22" event={"ID":"7d36a262-c226-43df-b65f-014441e0ce62","Type":"ContainerDied","Data":"9ad0363963d0b0cc0134bc15698f3eaae54c78cf7670ec6551eaafe74f5ca478"}
Sep 10 14:41:32.790228 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:32.789996    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-90366e-qkj22" event={"ID":"7d36a262-c226-43df-b65f-014441e0ce62","Type":"ContainerStarted","Data":"9a0e4da6a85a60e4c8edb17576fd97f825c47748e9eff4080b63382f99874e1e"}
Sep 10 14:41:33.933128 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:33.933099    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-90366e-qkj22"
Sep 10 14:41:34.017879 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:34.017851    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d36a262-c226-43df-b65f-014441e0ce62-maas-api-service-ca\") pod \"7d36a262-c226-43df-b65f-014441e0ce62\" (UID: \"7d36a262-c226-43df-b65f-014441e0ce62\") "
Sep 10 14:41:34.018236 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:34.018206    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d36a262-c226-43df-b65f-014441e0ce62-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7d36a262-c226-43df-b65f-014441e0ce62" (UID: "7d36a262-c226-43df-b65f-014441e0ce62"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:41:34.118702 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:34.118630    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d36a262-c226-43df-b65f-014441e0ce62-maas-api-service-ca\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:41:34.803755 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:34.803717    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-90366e-qkj22" event={"ID":"7d36a262-c226-43df-b65f-014441e0ce62","Type":"ContainerDied","Data":"9a0e4da6a85a60e4c8edb17576fd97f825c47748e9eff4080b63382f99874e1e"}
Sep 10 14:41:34.803755 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:34.803750    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-90366e-qkj22"
Sep 10 14:41:34.803983 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:34.803781    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a0e4da6a85a60e4c8edb17576fd97f825c47748e9eff4080b63382f99874e1e"
Sep 10 14:41:46.882090 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:46.882053    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw"]
Sep 10 14:41:46.883746 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:46.882303    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw" podUID="fe018286-6aa8-4a36-8a6b-f8e7a01ef72c" containerName="payload-processing" containerID="cri-o://ca6b6fd0c273cbc8b3fbdbc3affccd2e22c23fec73caa6ad01bbe4dd74202ed2" gracePeriod=30
Sep 10 14:41:46.885518 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:46.885476    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm"]
Sep 10 14:41:46.885775 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:46.885715    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm" podUID="4aed7387-1df6-4f3b-9ce8-98fe2eb45629" containerName="payload-pre-processing" containerID="cri-o://8b9e56ee679f53359f23832be4e92e2550c6dbd11bff7c095ad61f3782e75b21" gracePeriod=30
Sep 10 14:41:47.035269 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.035204    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-90366e-qkj22"]
Sep 10 14:41:47.038224 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.038190    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-90366e-qkj22"]
Sep 10 14:41:47.187974 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.187948    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw"
Sep 10 14:41:47.190975 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.190953    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm"
Sep 10 14:41:47.347332 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.347285    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8n5g\" (UniqueName: \"kubernetes.io/projected/4aed7387-1df6-4f3b-9ce8-98fe2eb45629-kube-api-access-r8n5g\") pod \"4aed7387-1df6-4f3b-9ce8-98fe2eb45629\" (UID: \"4aed7387-1df6-4f3b-9ce8-98fe2eb45629\") "
Sep 10 14:41:47.347578 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.347372    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4aed7387-1df6-4f3b-9ce8-98fe2eb45629-plugins-config-volume\") pod \"4aed7387-1df6-4f3b-9ce8-98fe2eb45629\" (UID: \"4aed7387-1df6-4f3b-9ce8-98fe2eb45629\") "
Sep 10 14:41:47.347578 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.347396    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxgpt\" (UniqueName: \"kubernetes.io/projected/fe018286-6aa8-4a36-8a6b-f8e7a01ef72c-kube-api-access-fxgpt\") pod \"fe018286-6aa8-4a36-8a6b-f8e7a01ef72c\" (UID: \"fe018286-6aa8-4a36-8a6b-f8e7a01ef72c\") "
Sep 10 14:41:47.347578 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.347443    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe018286-6aa8-4a36-8a6b-f8e7a01ef72c-plugins-config-volume\") pod \"fe018286-6aa8-4a36-8a6b-f8e7a01ef72c\" (UID: \"fe018286-6aa8-4a36-8a6b-f8e7a01ef72c\") "
Sep 10 14:41:47.347889 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.347862    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4aed7387-1df6-4f3b-9ce8-98fe2eb45629-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4aed7387-1df6-4f3b-9ce8-98fe2eb45629" (UID: "4aed7387-1df6-4f3b-9ce8-98fe2eb45629"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:41:47.347938 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.347862    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe018286-6aa8-4a36-8a6b-f8e7a01ef72c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fe018286-6aa8-4a36-8a6b-f8e7a01ef72c" (UID: "fe018286-6aa8-4a36-8a6b-f8e7a01ef72c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:41:47.349565 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.349543    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4aed7387-1df6-4f3b-9ce8-98fe2eb45629-kube-api-access-r8n5g" (OuterVolumeSpecName: "kube-api-access-r8n5g") pod "4aed7387-1df6-4f3b-9ce8-98fe2eb45629" (UID: "4aed7387-1df6-4f3b-9ce8-98fe2eb45629"). InnerVolumeSpecName "kube-api-access-r8n5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:41:47.349619 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.349562    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe018286-6aa8-4a36-8a6b-f8e7a01ef72c-kube-api-access-fxgpt" (OuterVolumeSpecName: "kube-api-access-fxgpt") pod "fe018286-6aa8-4a36-8a6b-f8e7a01ef72c" (UID: "fe018286-6aa8-4a36-8a6b-f8e7a01ef72c"). InnerVolumeSpecName "kube-api-access-fxgpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:41:47.449023 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.448909    2545 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe018286-6aa8-4a36-8a6b-f8e7a01ef72c-plugins-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:41:47.449023 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.448959    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8n5g\" (UniqueName: \"kubernetes.io/projected/4aed7387-1df6-4f3b-9ce8-98fe2eb45629-kube-api-access-r8n5g\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:41:47.449023 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.448970    2545 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4aed7387-1df6-4f3b-9ce8-98fe2eb45629-plugins-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:41:47.449023 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.448980    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxgpt\" (UniqueName: \"kubernetes.io/projected/fe018286-6aa8-4a36-8a6b-f8e7a01ef72c-kube-api-access-fxgpt\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:41:47.887618 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.887576    2545 generic.go:356] "Generic (PLEG): container finished" podID="fe018286-6aa8-4a36-8a6b-f8e7a01ef72c" containerID="ca6b6fd0c273cbc8b3fbdbc3affccd2e22c23fec73caa6ad01bbe4dd74202ed2" exitCode=0
Sep 10 14:41:47.888055 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.887631    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw"
Sep 10 14:41:47.888055 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.887670    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw" event={"ID":"fe018286-6aa8-4a36-8a6b-f8e7a01ef72c","Type":"ContainerDied","Data":"ca6b6fd0c273cbc8b3fbdbc3affccd2e22c23fec73caa6ad01bbe4dd74202ed2"}
Sep 10 14:41:47.888055 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.887731    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw" event={"ID":"fe018286-6aa8-4a36-8a6b-f8e7a01ef72c","Type":"ContainerDied","Data":"e363c90460a55c7d460a67dd5a8997cf473392d4d6e554ceac1dcc37a9eb3d1c"}
Sep 10 14:41:47.888055 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.887763    2545 scope.go:117] "RemoveContainer" containerID="ca6b6fd0c273cbc8b3fbdbc3affccd2e22c23fec73caa6ad01bbe4dd74202ed2"
Sep 10 14:41:47.889289 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.889115    2545 generic.go:356] "Generic (PLEG): container finished" podID="4aed7387-1df6-4f3b-9ce8-98fe2eb45629" containerID="8b9e56ee679f53359f23832be4e92e2550c6dbd11bff7c095ad61f3782e75b21" exitCode=0
Sep 10 14:41:47.889289 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.889160    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm"
Sep 10 14:41:47.889289 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.889197    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm" event={"ID":"4aed7387-1df6-4f3b-9ce8-98fe2eb45629","Type":"ContainerDied","Data":"8b9e56ee679f53359f23832be4e92e2550c6dbd11bff7c095ad61f3782e75b21"}
Sep 10 14:41:47.889289 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.889255    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm" event={"ID":"4aed7387-1df6-4f3b-9ce8-98fe2eb45629","Type":"ContainerDied","Data":"ce0d056c0ab55b633f9aa8bf061f64fb15377f9b4fe74313ec73739adb53799b"}
Sep 10 14:41:47.899826 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.899426    2545 scope.go:117] "RemoveContainer" containerID="ca6b6fd0c273cbc8b3fbdbc3affccd2e22c23fec73caa6ad01bbe4dd74202ed2"
Sep 10 14:41:47.899826 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:41:47.899737    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca6b6fd0c273cbc8b3fbdbc3affccd2e22c23fec73caa6ad01bbe4dd74202ed2\": container with ID starting with ca6b6fd0c273cbc8b3fbdbc3affccd2e22c23fec73caa6ad01bbe4dd74202ed2 not found: ID does not exist" containerID="ca6b6fd0c273cbc8b3fbdbc3affccd2e22c23fec73caa6ad01bbe4dd74202ed2"
Sep 10 14:41:47.899826 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.899767    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca6b6fd0c273cbc8b3fbdbc3affccd2e22c23fec73caa6ad01bbe4dd74202ed2"} err="failed to get container status \"ca6b6fd0c273cbc8b3fbdbc3affccd2e22c23fec73caa6ad01bbe4dd74202ed2\": rpc error: code = NotFound desc = could not find container \"ca6b6fd0c273cbc8b3fbdbc3affccd2e22c23fec73caa6ad01bbe4dd74202ed2\": container with ID starting with ca6b6fd0c273cbc8b3fbdbc3affccd2e22c23fec73caa6ad01bbe4dd74202ed2 not found: ID does not exist"
Sep 10 14:41:47.899826 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.899784    2545 scope.go:117] "RemoveContainer" containerID="8b9e56ee679f53359f23832be4e92e2550c6dbd11bff7c095ad61f3782e75b21"
Sep 10 14:41:47.909209 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.909190    2545 scope.go:117] "RemoveContainer" containerID="8b9e56ee679f53359f23832be4e92e2550c6dbd11bff7c095ad61f3782e75b21"
Sep 10 14:41:47.909536 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:41:47.909515    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b9e56ee679f53359f23832be4e92e2550c6dbd11bff7c095ad61f3782e75b21\": container with ID starting with 8b9e56ee679f53359f23832be4e92e2550c6dbd11bff7c095ad61f3782e75b21 not found: ID does not exist" containerID="8b9e56ee679f53359f23832be4e92e2550c6dbd11bff7c095ad61f3782e75b21"
Sep 10 14:41:47.909591 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.909544    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b9e56ee679f53359f23832be4e92e2550c6dbd11bff7c095ad61f3782e75b21"} err="failed to get container status \"8b9e56ee679f53359f23832be4e92e2550c6dbd11bff7c095ad61f3782e75b21\": rpc error: code = NotFound desc = could not find container \"8b9e56ee679f53359f23832be4e92e2550c6dbd11bff7c095ad61f3782e75b21\": container with ID starting with 8b9e56ee679f53359f23832be4e92e2550c6dbd11bff7c095ad61f3782e75b21 not found: ID does not exist"
Sep 10 14:41:47.920268 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.920232    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw"]
Sep 10 14:41:47.923269 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.923246    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-90366e-68cb4b4967-84hvw"]
Sep 10 14:41:47.934734 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.934712    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm"]
Sep 10 14:41:47.938293 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:47.938269    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-90366e-8448c57f58-25hmm"]
Sep 10 14:41:48.367827 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:48.367795    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4aed7387-1df6-4f3b-9ce8-98fe2eb45629" path="/var/lib/kubelet/pods/4aed7387-1df6-4f3b-9ce8-98fe2eb45629/volumes"
Sep 10 14:41:48.368153 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:48.368139    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d36a262-c226-43df-b65f-014441e0ce62" path="/var/lib/kubelet/pods/7d36a262-c226-43df-b65f-014441e0ce62/volumes"
Sep 10 14:41:48.368461 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:41:48.368449    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe018286-6aa8-4a36-8a6b-f8e7a01ef72c" path="/var/lib/kubelet/pods/fe018286-6aa8-4a36-8a6b-f8e7a01ef72c/volumes"
Sep 10 14:42:40.908097 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:40.908053    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"]
Sep 10 14:42:40.908673 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:40.908314    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c" podUID="fb6a7bca-75b0-4aa4-9ed7-686b17078a8a" containerName="istio-proxy" containerID="cri-o://4fe20a5ef04d72fda52cf5b01fbe62f8ec066f492565b5b7f56a113a5ec801b4" gracePeriod=30
Sep 10 14:42:41.276677 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:41.276642    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6b9e31-xjnjj"]
Sep 10 14:42:41.277099 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:41.277084    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe018286-6aa8-4a36-8a6b-f8e7a01ef72c" containerName="payload-processing"
Sep 10 14:42:41.277153 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:41.277100    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe018286-6aa8-4a36-8a6b-f8e7a01ef72c" containerName="payload-processing"
Sep 10 14:42:41.277153 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:41.277122    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4aed7387-1df6-4f3b-9ce8-98fe2eb45629" containerName="payload-pre-processing"
Sep 10 14:42:41.277153 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:41.277128    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aed7387-1df6-4f3b-9ce8-98fe2eb45629" containerName="payload-pre-processing"
Sep 10 14:42:41.277153 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:41.277136    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d36a262-c226-43df-b65f-014441e0ce62" containerName="revoke-keys"
Sep 10 14:42:41.277153 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:41.277143    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d36a262-c226-43df-b65f-014441e0ce62" containerName="revoke-keys"
Sep 10 14:42:41.277314 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:41.277212    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d36a262-c226-43df-b65f-014441e0ce62" containerName="revoke-keys"
Sep 10 14:42:41.277314 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:41.277222    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="4aed7387-1df6-4f3b-9ce8-98fe2eb45629" containerName="payload-pre-processing"
Sep 10 14:42:41.277314 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:41.277231    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe018286-6aa8-4a36-8a6b-f8e7a01ef72c" containerName="payload-processing"
Sep 10 14:42:41.280563 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:41.280547    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6b9e31-xjnjj"
Sep 10 14:42:41.283271 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:41.283243    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:42:41.283437 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:41.283316    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pj254\""
Sep 10 14:42:41.289659 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:41.289634    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6b9e31-xjnjj"]
Sep 10 14:42:41.384541 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:41.384474    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec5476b7-2e75-40f1-b71c-a90601c58667-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-6b9e31-xjnjj\" (UID: \"ec5476b7-2e75-40f1-b71c-a90601c58667\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6b9e31-xjnjj"
Sep 10 14:42:41.486039 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:41.485998    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec5476b7-2e75-40f1-b71c-a90601c58667-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-6b9e31-xjnjj\" (UID: \"ec5476b7-2e75-40f1-b71c-a90601c58667\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6b9e31-xjnjj"
Sep 10 14:42:41.486643 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:41.486621    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec5476b7-2e75-40f1-b71c-a90601c58667-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-6b9e31-xjnjj\" (UID: \"ec5476b7-2e75-40f1-b71c-a90601c58667\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6b9e31-xjnjj"
Sep 10 14:42:41.592684 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:41.592597    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6b9e31-xjnjj"
Sep 10 14:42:41.869875 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:41.869845    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6b9e31-xjnjj"]
Sep 10 14:42:41.871218 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:42:41.871191    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec5476b7_2e75_40f1_b71c_a90601c58667.slice/crio-1e6a6ead3b5e0a6302a79569299c11decf64506988a2c3a0f66f7d4f5bfe104a WatchSource:0}: Error finding container 1e6a6ead3b5e0a6302a79569299c11decf64506988a2c3a0f66f7d4f5bfe104a: Status 404 returned error can't find the container with id 1e6a6ead3b5e0a6302a79569299c11decf64506988a2c3a0f66f7d4f5bfe104a
Sep 10 14:42:42.219657 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:42.219566    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6b9e31-xjnjj" event={"ID":"ec5476b7-2e75-40f1-b71c-a90601c58667","Type":"ContainerStarted","Data":"3eb6639fe6bfa0bee5a7f96809a6da21b8a7ce0b3a9bc957eaeec3cc68a705c7"}
Sep 10 14:42:42.219657 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:42.219627    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6b9e31-xjnjj" event={"ID":"ec5476b7-2e75-40f1-b71c-a90601c58667","Type":"ContainerStarted","Data":"1e6a6ead3b5e0a6302a79569299c11decf64506988a2c3a0f66f7d4f5bfe104a"}
Sep 10 14:42:42.238449 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:42.238397    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6b9e31-xjnjj" podStartSLOduration=1.23838203 podStartE2EDuration="1.23838203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:42:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:42:42.235165788 +0000 UTC m=+1860.352707265" watchObservedRunningTime="2026-09-10 14:42:42.23838203 +0000 UTC m=+1860.355923505"
Sep 10 14:42:43.228114 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:43.228017    2545 generic.go:356] "Generic (PLEG): container finished" podID="ec5476b7-2e75-40f1-b71c-a90601c58667" containerID="3eb6639fe6bfa0bee5a7f96809a6da21b8a7ce0b3a9bc957eaeec3cc68a705c7" exitCode=0
Sep 10 14:42:43.228477 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:43.228104    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6b9e31-xjnjj" event={"ID":"ec5476b7-2e75-40f1-b71c-a90601c58667","Type":"ContainerDied","Data":"3eb6639fe6bfa0bee5a7f96809a6da21b8a7ce0b3a9bc957eaeec3cc68a705c7"}
Sep 10 14:42:43.457948 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:43.457912    2545 patch_prober.go:28] interesting pod/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 14:42:43.458090 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:43.457976    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c" podUID="fb6a7bca-75b0-4aa4-9ed7-686b17078a8a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 14:42:44.370947 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:44.370921    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6b9e31-xjnjj"
Sep 10 14:42:44.416328 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:44.416289    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec5476b7-2e75-40f1-b71c-a90601c58667-maas-api-service-ca\") pod \"ec5476b7-2e75-40f1-b71c-a90601c58667\" (UID: \"ec5476b7-2e75-40f1-b71c-a90601c58667\") "
Sep 10 14:42:44.416664 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:44.416638    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec5476b7-2e75-40f1-b71c-a90601c58667-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ec5476b7-2e75-40f1-b71c-a90601c58667" (UID: "ec5476b7-2e75-40f1-b71c-a90601c58667"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:42:44.416762 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:44.416748    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec5476b7-2e75-40f1-b71c-a90601c58667-maas-api-service-ca\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:42:45.241220 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:45.241186    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6b9e31-xjnjj"
Sep 10 14:42:45.241402 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:45.241222    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6b9e31-xjnjj" event={"ID":"ec5476b7-2e75-40f1-b71c-a90601c58667","Type":"ContainerDied","Data":"1e6a6ead3b5e0a6302a79569299c11decf64506988a2c3a0f66f7d4f5bfe104a"}
Sep 10 14:42:45.241402 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:45.241274    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e6a6ead3b5e0a6302a79569299c11decf64506988a2c3a0f66f7d4f5bfe104a"
Sep 10 14:42:46.162046 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.162019    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:42:46.232697 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.232602    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istio-podinfo\") pod \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") "
Sep 10 14:42:46.232697 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.232661    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-workload-socket\") pod \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") "
Sep 10 14:42:46.232697 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.232682    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-credential-socket\") pod \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") "
Sep 10 14:42:46.232989 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.232709    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-workload-certs\") pod \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") "
Sep 10 14:42:46.232989 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.232728    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istio-token\") pod \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") "
Sep 10 14:42:46.232989 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.232752    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istiod-ca-cert\") pod \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") "
Sep 10 14:42:46.232989 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.232806    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jk2nw\" (UniqueName: \"kubernetes.io/projected/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-kube-api-access-jk2nw\") pod \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") "
Sep 10 14:42:46.232989 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.232855    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istio-data\") pod \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") "
Sep 10 14:42:46.232989 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.232901    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istio-envoy\") pod \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\" (UID: \"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a\") "
Sep 10 14:42:46.233388 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.233040    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fb6a7bca-75b0-4aa4-9ed7-686b17078a8a" (UID: "fb6a7bca-75b0-4aa4-9ed7-686b17078a8a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:42:46.233388 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.233055    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fb6a7bca-75b0-4aa4-9ed7-686b17078a8a" (UID: "fb6a7bca-75b0-4aa4-9ed7-686b17078a8a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:42:46.233388 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.233062    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fb6a7bca-75b0-4aa4-9ed7-686b17078a8a" (UID: "fb6a7bca-75b0-4aa4-9ed7-686b17078a8a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:42:46.233388 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.233229    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istio-data" (OuterVolumeSpecName: "istio-data") pod "fb6a7bca-75b0-4aa4-9ed7-686b17078a8a" (UID: "fb6a7bca-75b0-4aa4-9ed7-686b17078a8a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:42:46.233388 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.233295    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-workload-socket\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:42:46.233388 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.233312    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-credential-socket\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:42:46.233388 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.233325    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-workload-certs\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:42:46.233388 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.233340    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istio-data\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:42:46.233834 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.233443    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fb6a7bca-75b0-4aa4-9ed7-686b17078a8a" (UID: "fb6a7bca-75b0-4aa4-9ed7-686b17078a8a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:42:46.235116 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.235092    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fb6a7bca-75b0-4aa4-9ed7-686b17078a8a" (UID: "fb6a7bca-75b0-4aa4-9ed7-686b17078a8a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:42:46.235116 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.235109    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fb6a7bca-75b0-4aa4-9ed7-686b17078a8a" (UID: "fb6a7bca-75b0-4aa4-9ed7-686b17078a8a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:42:46.235443 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.235424    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-kube-api-access-jk2nw" (OuterVolumeSpecName: "kube-api-access-jk2nw") pod "fb6a7bca-75b0-4aa4-9ed7-686b17078a8a" (UID: "fb6a7bca-75b0-4aa4-9ed7-686b17078a8a"). InnerVolumeSpecName "kube-api-access-jk2nw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:42:46.235443 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.235436    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istio-token" (OuterVolumeSpecName: "istio-token") pod "fb6a7bca-75b0-4aa4-9ed7-686b17078a8a" (UID: "fb6a7bca-75b0-4aa4-9ed7-686b17078a8a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:42:46.249439 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.249414    2545 generic.go:356] "Generic (PLEG): container finished" podID="fb6a7bca-75b0-4aa4-9ed7-686b17078a8a" containerID="4fe20a5ef04d72fda52cf5b01fbe62f8ec066f492565b5b7f56a113a5ec801b4" exitCode=0
Sep 10 14:42:46.249581 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.249460    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"
Sep 10 14:42:46.249581 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.249531    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c" event={"ID":"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a","Type":"ContainerDied","Data":"4fe20a5ef04d72fda52cf5b01fbe62f8ec066f492565b5b7f56a113a5ec801b4"}
Sep 10 14:42:46.249656 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.249594    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c" event={"ID":"fb6a7bca-75b0-4aa4-9ed7-686b17078a8a","Type":"ContainerDied","Data":"1563d2205eff6f543cc8e436d40268ec8c60759781d37f6062780f049c22b5d9"}
Sep 10 14:42:46.249656 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.249626    2545 scope.go:117] "RemoveContainer" containerID="4fe20a5ef04d72fda52cf5b01fbe62f8ec066f492565b5b7f56a113a5ec801b4"
Sep 10 14:42:46.260411 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.260394    2545 scope.go:117] "RemoveContainer" containerID="a264c46dddd98353bc8e83effdef0390acf63ae8e868a35491fea1d0d14ae4c9"
Sep 10 14:42:46.269157 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.269126    2545 scope.go:117] "RemoveContainer" containerID="4fe20a5ef04d72fda52cf5b01fbe62f8ec066f492565b5b7f56a113a5ec801b4"
Sep 10 14:42:46.269599 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:42:46.269580    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fe20a5ef04d72fda52cf5b01fbe62f8ec066f492565b5b7f56a113a5ec801b4\": container with ID starting with 4fe20a5ef04d72fda52cf5b01fbe62f8ec066f492565b5b7f56a113a5ec801b4 not found: ID does not exist" containerID="4fe20a5ef04d72fda52cf5b01fbe62f8ec066f492565b5b7f56a113a5ec801b4"
Sep 10 14:42:46.269674 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.269608    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fe20a5ef04d72fda52cf5b01fbe62f8ec066f492565b5b7f56a113a5ec801b4"} err="failed to get container status \"4fe20a5ef04d72fda52cf5b01fbe62f8ec066f492565b5b7f56a113a5ec801b4\": rpc error: code = NotFound desc = could not find container \"4fe20a5ef04d72fda52cf5b01fbe62f8ec066f492565b5b7f56a113a5ec801b4\": container with ID starting with 4fe20a5ef04d72fda52cf5b01fbe62f8ec066f492565b5b7f56a113a5ec801b4 not found: ID does not exist"
Sep 10 14:42:46.269674 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.269626    2545 scope.go:117] "RemoveContainer" containerID="a264c46dddd98353bc8e83effdef0390acf63ae8e868a35491fea1d0d14ae4c9"
Sep 10 14:42:46.269905 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:42:46.269869    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a264c46dddd98353bc8e83effdef0390acf63ae8e868a35491fea1d0d14ae4c9\": container with ID starting with a264c46dddd98353bc8e83effdef0390acf63ae8e868a35491fea1d0d14ae4c9 not found: ID does not exist" containerID="a264c46dddd98353bc8e83effdef0390acf63ae8e868a35491fea1d0d14ae4c9"
Sep 10 14:42:46.269954 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.269901    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a264c46dddd98353bc8e83effdef0390acf63ae8e868a35491fea1d0d14ae4c9"} err="failed to get container status \"a264c46dddd98353bc8e83effdef0390acf63ae8e868a35491fea1d0d14ae4c9\": rpc error: code = NotFound desc = could not find container \"a264c46dddd98353bc8e83effdef0390acf63ae8e868a35491fea1d0d14ae4c9\": container with ID starting with a264c46dddd98353bc8e83effdef0390acf63ae8e868a35491fea1d0d14ae4c9 not found: ID does not exist"
Sep 10 14:42:46.271956 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.271937    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"]
Sep 10 14:42:46.275956 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.275935    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-90366e-openshift-default-67db47f7b8-blb7c"]
Sep 10 14:42:46.334663 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.334628    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jk2nw\" (UniqueName: \"kubernetes.io/projected/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-kube-api-access-jk2nw\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:42:46.334663 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.334658    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istio-envoy\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:42:46.334663 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.334669    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istio-podinfo\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:42:46.334875 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.334677    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istio-token\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:42:46.334875 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.334685    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a-istiod-ca-cert\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:42:46.365796 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:46.365765    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb6a7bca-75b0-4aa4-9ed7-686b17078a8a" path="/var/lib/kubelet/pods/fb6a7bca-75b0-4aa4-9ed7-686b17078a8a/volumes"
Sep 10 14:42:51.711814 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:51.711774    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr"]
Sep 10 14:42:51.712347 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:51.712000    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr" podUID="da5ab46d-1371-4f10-ae31-39338adec3f6" containerName="payload-processing" containerID="cri-o://5015c45376862269e2bb595c06c9d820d4b44a58dd7ce37fb0a55a33699bb07b" gracePeriod=30
Sep 10 14:42:51.906801 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:51.906738    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6b9e31-xjnjj"]
Sep 10 14:42:51.909326 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:51.909298    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6b9e31-xjnjj"]
Sep 10 14:42:51.983340 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:51.983302    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr"
Sep 10 14:42:52.087325 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:52.087292    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csx4v\" (UniqueName: \"kubernetes.io/projected/da5ab46d-1371-4f10-ae31-39338adec3f6-kube-api-access-csx4v\") pod \"da5ab46d-1371-4f10-ae31-39338adec3f6\" (UID: \"da5ab46d-1371-4f10-ae31-39338adec3f6\") "
Sep 10 14:42:52.087535 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:52.087398    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da5ab46d-1371-4f10-ae31-39338adec3f6-plugins-config-volume\") pod \"da5ab46d-1371-4f10-ae31-39338adec3f6\" (UID: \"da5ab46d-1371-4f10-ae31-39338adec3f6\") "
Sep 10 14:42:52.087821 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:52.087800    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da5ab46d-1371-4f10-ae31-39338adec3f6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "da5ab46d-1371-4f10-ae31-39338adec3f6" (UID: "da5ab46d-1371-4f10-ae31-39338adec3f6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:42:52.089456 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:52.089429    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da5ab46d-1371-4f10-ae31-39338adec3f6-kube-api-access-csx4v" (OuterVolumeSpecName: "kube-api-access-csx4v") pod "da5ab46d-1371-4f10-ae31-39338adec3f6" (UID: "da5ab46d-1371-4f10-ae31-39338adec3f6"). InnerVolumeSpecName "kube-api-access-csx4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:42:52.188431 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:52.188388    2545 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da5ab46d-1371-4f10-ae31-39338adec3f6-plugins-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:42:52.188431 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:52.188423    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csx4v\" (UniqueName: \"kubernetes.io/projected/da5ab46d-1371-4f10-ae31-39338adec3f6-kube-api-access-csx4v\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:42:52.286951 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:52.286912    2545 generic.go:356] "Generic (PLEG): container finished" podID="da5ab46d-1371-4f10-ae31-39338adec3f6" containerID="5015c45376862269e2bb595c06c9d820d4b44a58dd7ce37fb0a55a33699bb07b" exitCode=0
Sep 10 14:42:52.287140 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:52.286961    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr"
Sep 10 14:42:52.287140 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:52.287003    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr" event={"ID":"da5ab46d-1371-4f10-ae31-39338adec3f6","Type":"ContainerDied","Data":"5015c45376862269e2bb595c06c9d820d4b44a58dd7ce37fb0a55a33699bb07b"}
Sep 10 14:42:52.287140 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:52.287061    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr" event={"ID":"da5ab46d-1371-4f10-ae31-39338adec3f6","Type":"ContainerDied","Data":"908140b3287d0e3bb9584d57e3a37b233bee1ad5056aa60e9400a71c95a17612"}
Sep 10 14:42:52.287140 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:52.287091    2545 scope.go:117] "RemoveContainer" containerID="5015c45376862269e2bb595c06c9d820d4b44a58dd7ce37fb0a55a33699bb07b"
Sep 10 14:42:52.296676 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:52.296655    2545 scope.go:117] "RemoveContainer" containerID="5015c45376862269e2bb595c06c9d820d4b44a58dd7ce37fb0a55a33699bb07b"
Sep 10 14:42:52.296973 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:42:52.296953    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5015c45376862269e2bb595c06c9d820d4b44a58dd7ce37fb0a55a33699bb07b\": container with ID starting with 5015c45376862269e2bb595c06c9d820d4b44a58dd7ce37fb0a55a33699bb07b not found: ID does not exist" containerID="5015c45376862269e2bb595c06c9d820d4b44a58dd7ce37fb0a55a33699bb07b"
Sep 10 14:42:52.297024 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:52.296977    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5015c45376862269e2bb595c06c9d820d4b44a58dd7ce37fb0a55a33699bb07b"} err="failed to get container status \"5015c45376862269e2bb595c06c9d820d4b44a58dd7ce37fb0a55a33699bb07b\": rpc error: code = NotFound desc = could not find container \"5015c45376862269e2bb595c06c9d820d4b44a58dd7ce37fb0a55a33699bb07b\": container with ID starting with 5015c45376862269e2bb595c06c9d820d4b44a58dd7ce37fb0a55a33699bb07b not found: ID does not exist"
Sep 10 14:42:52.311217 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:52.311186    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr"]
Sep 10 14:42:52.315191 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:52.315162    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-6b9e31-75d99575-kn4qr"]
Sep 10 14:42:52.373345 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:52.373301    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da5ab46d-1371-4f10-ae31-39338adec3f6" path="/var/lib/kubelet/pods/da5ab46d-1371-4f10-ae31-39338adec3f6/volumes"
Sep 10 14:42:52.373709 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:52.373694    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec5476b7-2e75-40f1-b71c-a90601c58667" path="/var/lib/kubelet/pods/ec5476b7-2e75-40f1-b71c-a90601c58667/volumes"
Sep 10 14:42:58.326292 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:58.326254    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"]
Sep 10 14:42:58.326700 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:58.326518    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt" podUID="aaca653a-70aa-4235-ada2-97ee410b16de" containerName="istio-proxy" containerID="cri-o://d8f1b5f50ee5522d1aa64fd0f7623b6f139d3bc3698cfde401e0003a78a16ecd" gracePeriod=30
Sep 10 14:42:58.684916 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:58.684814    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-586826-4fmks"]
Sep 10 14:42:58.685335 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:58.685317    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb6a7bca-75b0-4aa4-9ed7-686b17078a8a" containerName="istio-proxy"
Sep 10 14:42:58.685434 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:58.685338    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb6a7bca-75b0-4aa4-9ed7-686b17078a8a" containerName="istio-proxy"
Sep 10 14:42:58.685434 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:58.685353    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da5ab46d-1371-4f10-ae31-39338adec3f6" containerName="payload-processing"
Sep 10 14:42:58.685434 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:58.685361    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="da5ab46d-1371-4f10-ae31-39338adec3f6" containerName="payload-processing"
Sep 10 14:42:58.685434 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:58.685395    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec5476b7-2e75-40f1-b71c-a90601c58667" containerName="revoke-keys"
Sep 10 14:42:58.685434 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:58.685406    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec5476b7-2e75-40f1-b71c-a90601c58667" containerName="revoke-keys"
Sep 10 14:42:58.685713 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:58.685514    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb6a7bca-75b0-4aa4-9ed7-686b17078a8a" containerName="istio-proxy"
Sep 10 14:42:58.685713 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:58.685529    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec5476b7-2e75-40f1-b71c-a90601c58667" containerName="revoke-keys"
Sep 10 14:42:58.685713 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:58.685545    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="da5ab46d-1371-4f10-ae31-39338adec3f6" containerName="payload-processing"
Sep 10 14:42:58.690003 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:58.689982    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-586826-4fmks"
Sep 10 14:42:58.692717 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:58.692694    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pj254\""
Sep 10 14:42:58.692877 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:58.692697    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:42:58.695475 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:58.695451    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-586826-4fmks"]
Sep 10 14:42:58.750339 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:58.750298    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/427c31c1-c3d8-4810-b541-e63b5a124d7a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-586826-4fmks\" (UID: \"427c31c1-c3d8-4810-b541-e63b5a124d7a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-586826-4fmks"
Sep 10 14:42:58.851508 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:58.851436    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/427c31c1-c3d8-4810-b541-e63b5a124d7a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-586826-4fmks\" (UID: \"427c31c1-c3d8-4810-b541-e63b5a124d7a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-586826-4fmks"
Sep 10 14:42:58.852300 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:58.852268    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/427c31c1-c3d8-4810-b541-e63b5a124d7a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-586826-4fmks\" (UID: \"427c31c1-c3d8-4810-b541-e63b5a124d7a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-586826-4fmks"
Sep 10 14:42:59.003006 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:59.002975    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-586826-4fmks"
Sep 10 14:42:59.276568 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:59.276541    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-586826-4fmks"]
Sep 10 14:42:59.277842 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:42:59.277813    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod427c31c1_c3d8_4810_b541_e63b5a124d7a.slice/crio-93377e8edbe30f7f2109e9b5bf3f3b6a4d9dd4397aec5537ecc4a3bddbfe2f87 WatchSource:0}: Error finding container 93377e8edbe30f7f2109e9b5bf3f3b6a4d9dd4397aec5537ecc4a3bddbfe2f87: Status 404 returned error can't find the container with id 93377e8edbe30f7f2109e9b5bf3f3b6a4d9dd4397aec5537ecc4a3bddbfe2f87
Sep 10 14:42:59.334453 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:59.334418    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-586826-4fmks" event={"ID":"427c31c1-c3d8-4810-b541-e63b5a124d7a","Type":"ContainerStarted","Data":"93377e8edbe30f7f2109e9b5bf3f3b6a4d9dd4397aec5537ecc4a3bddbfe2f87"}
Sep 10 14:42:59.868662 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:59.868576    2545 patch_prober.go:28] interesting pod/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 14:42:59.868662 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:42:59.868633    2545 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt" podUID="aaca653a-70aa-4235-ada2-97ee410b16de" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 14:43:00.341927 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:00.341889    2545 generic.go:356] "Generic (PLEG): container finished" podID="427c31c1-c3d8-4810-b541-e63b5a124d7a" containerID="9b10328cac1131f51625f82d4d4232b3a97818d63bff2bab3cabccc6ab556c19" exitCode=0
Sep 10 14:43:00.342311 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:00.341950    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-586826-4fmks" event={"ID":"427c31c1-c3d8-4810-b541-e63b5a124d7a","Type":"ContainerDied","Data":"9b10328cac1131f51625f82d4d4232b3a97818d63bff2bab3cabccc6ab556c19"}
Sep 10 14:43:01.480596 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:01.480569    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-586826-4fmks"
Sep 10 14:43:01.579601 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:01.579564    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/427c31c1-c3d8-4810-b541-e63b5a124d7a-maas-api-service-ca\") pod \"427c31c1-c3d8-4810-b541-e63b5a124d7a\" (UID: \"427c31c1-c3d8-4810-b541-e63b5a124d7a\") "
Sep 10 14:43:01.579942 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:01.579920    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/427c31c1-c3d8-4810-b541-e63b5a124d7a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "427c31c1-c3d8-4810-b541-e63b5a124d7a" (UID: "427c31c1-c3d8-4810-b541-e63b5a124d7a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:43:01.681126 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:01.681031    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/427c31c1-c3d8-4810-b541-e63b5a124d7a-maas-api-service-ca\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:43:02.355652 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:02.355623    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-586826-4fmks"
Sep 10 14:43:02.355825 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:02.355622    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-586826-4fmks" event={"ID":"427c31c1-c3d8-4810-b541-e63b5a124d7a","Type":"ContainerDied","Data":"93377e8edbe30f7f2109e9b5bf3f3b6a4d9dd4397aec5537ecc4a3bddbfe2f87"}
Sep 10 14:43:02.355825 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:02.355750    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="93377e8edbe30f7f2109e9b5bf3f3b6a4d9dd4397aec5537ecc4a3bddbfe2f87"
Sep 10 14:43:03.584130 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.584107    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:43:03.701104 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.701029    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-istio-data\") pod \"aaca653a-70aa-4235-ada2-97ee410b16de\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") "
Sep 10 14:43:03.701104 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.701077    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-workload-certs\") pod \"aaca653a-70aa-4235-ada2-97ee410b16de\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") "
Sep 10 14:43:03.701313 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.701106    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-istio-envoy\") pod \"aaca653a-70aa-4235-ada2-97ee410b16de\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") "
Sep 10 14:43:03.701313 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.701133    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aaca653a-70aa-4235-ada2-97ee410b16de-istio-podinfo\") pod \"aaca653a-70aa-4235-ada2-97ee410b16de\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") "
Sep 10 14:43:03.701313 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.701163    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aaca653a-70aa-4235-ada2-97ee410b16de-istiod-ca-cert\") pod \"aaca653a-70aa-4235-ada2-97ee410b16de\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") "
Sep 10 14:43:03.701313 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.701182    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4mf5\" (UniqueName: \"kubernetes.io/projected/aaca653a-70aa-4235-ada2-97ee410b16de-kube-api-access-w4mf5\") pod \"aaca653a-70aa-4235-ada2-97ee410b16de\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") "
Sep 10 14:43:03.701313 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.701204    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aaca653a-70aa-4235-ada2-97ee410b16de-istio-token\") pod \"aaca653a-70aa-4235-ada2-97ee410b16de\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") "
Sep 10 14:43:03.701313 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.701306    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-credential-socket\") pod \"aaca653a-70aa-4235-ada2-97ee410b16de\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") "
Sep 10 14:43:03.701648 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.701348    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-workload-socket\") pod \"aaca653a-70aa-4235-ada2-97ee410b16de\" (UID: \"aaca653a-70aa-4235-ada2-97ee410b16de\") "
Sep 10 14:43:03.701648 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.701540    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aaca653a-70aa-4235-ada2-97ee410b16de" (UID: "aaca653a-70aa-4235-ada2-97ee410b16de"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:43:03.701772 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.701640    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaca653a-70aa-4235-ada2-97ee410b16de-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aaca653a-70aa-4235-ada2-97ee410b16de" (UID: "aaca653a-70aa-4235-ada2-97ee410b16de"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:43:03.701772 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.701728    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aaca653a-70aa-4235-ada2-97ee410b16de" (UID: "aaca653a-70aa-4235-ada2-97ee410b16de"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:43:03.701886 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.701788    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-istio-data" (OuterVolumeSpecName: "istio-data") pod "aaca653a-70aa-4235-ada2-97ee410b16de" (UID: "aaca653a-70aa-4235-ada2-97ee410b16de"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:43:03.701886 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.701819    2545 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aaca653a-70aa-4235-ada2-97ee410b16de-istiod-ca-cert\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:43:03.701886 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.701839    2545 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-workload-socket\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:43:03.701886 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.701850    2545 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-workload-certs\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:43:03.702042 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.701907    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aaca653a-70aa-4235-ada2-97ee410b16de" (UID: "aaca653a-70aa-4235-ada2-97ee410b16de"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:43:03.703793 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.703769    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aaca653a-70aa-4235-ada2-97ee410b16de-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aaca653a-70aa-4235-ada2-97ee410b16de" (UID: "aaca653a-70aa-4235-ada2-97ee410b16de"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:43:03.703853 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.703779    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aaca653a-70aa-4235-ada2-97ee410b16de" (UID: "aaca653a-70aa-4235-ada2-97ee410b16de"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:43:03.703853 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.703822    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaca653a-70aa-4235-ada2-97ee410b16de-istio-token" (OuterVolumeSpecName: "istio-token") pod "aaca653a-70aa-4235-ada2-97ee410b16de" (UID: "aaca653a-70aa-4235-ada2-97ee410b16de"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:43:03.703928 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.703882    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaca653a-70aa-4235-ada2-97ee410b16de-kube-api-access-w4mf5" (OuterVolumeSpecName: "kube-api-access-w4mf5") pod "aaca653a-70aa-4235-ada2-97ee410b16de" (UID: "aaca653a-70aa-4235-ada2-97ee410b16de"). InnerVolumeSpecName "kube-api-access-w4mf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:43:03.802734 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.802706    2545 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-credential-socket\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:43:03.802734 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.802735    2545 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-istio-data\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:43:03.802940 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.802749    2545 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aaca653a-70aa-4235-ada2-97ee410b16de-istio-envoy\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:43:03.802940 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.802761    2545 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aaca653a-70aa-4235-ada2-97ee410b16de-istio-podinfo\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:43:03.802940 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.802769    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4mf5\" (UniqueName: \"kubernetes.io/projected/aaca653a-70aa-4235-ada2-97ee410b16de-kube-api-access-w4mf5\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:43:03.802940 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:03.802784    2545 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aaca653a-70aa-4235-ada2-97ee410b16de-istio-token\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:43:04.373780 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:04.373745    2545 generic.go:356] "Generic (PLEG): container finished" podID="aaca653a-70aa-4235-ada2-97ee410b16de" containerID="d8f1b5f50ee5522d1aa64fd0f7623b6f139d3bc3698cfde401e0003a78a16ecd" exitCode=0
Sep 10 14:43:04.373984 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:04.373794    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"
Sep 10 14:43:04.373984 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:04.373820    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt" event={"ID":"aaca653a-70aa-4235-ada2-97ee410b16de","Type":"ContainerDied","Data":"d8f1b5f50ee5522d1aa64fd0f7623b6f139d3bc3698cfde401e0003a78a16ecd"}
Sep 10 14:43:04.373984 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:04.373883    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt" event={"ID":"aaca653a-70aa-4235-ada2-97ee410b16de","Type":"ContainerDied","Data":"877d4d99474ddbd92378031d64263141e71131a9fffc8e0592aad2d35392adfd"}
Sep 10 14:43:04.373984 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:04.373913    2545 scope.go:117] "RemoveContainer" containerID="d8f1b5f50ee5522d1aa64fd0f7623b6f139d3bc3698cfde401e0003a78a16ecd"
Sep 10 14:43:04.384220 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:04.384204    2545 scope.go:117] "RemoveContainer" containerID="357fd74b14aae4e292016259c9ef641861b69f4eb1673bab80679c3b5f655af7"
Sep 10 14:43:04.393724 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:04.393694    2545 scope.go:117] "RemoveContainer" containerID="d8f1b5f50ee5522d1aa64fd0f7623b6f139d3bc3698cfde401e0003a78a16ecd"
Sep 10 14:43:04.394113 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:43:04.394084    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8f1b5f50ee5522d1aa64fd0f7623b6f139d3bc3698cfde401e0003a78a16ecd\": container with ID starting with d8f1b5f50ee5522d1aa64fd0f7623b6f139d3bc3698cfde401e0003a78a16ecd not found: ID does not exist" containerID="d8f1b5f50ee5522d1aa64fd0f7623b6f139d3bc3698cfde401e0003a78a16ecd"
Sep 10 14:43:04.394205 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:04.394126    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8f1b5f50ee5522d1aa64fd0f7623b6f139d3bc3698cfde401e0003a78a16ecd"} err="failed to get container status \"d8f1b5f50ee5522d1aa64fd0f7623b6f139d3bc3698cfde401e0003a78a16ecd\": rpc error: code = NotFound desc = could not find container \"d8f1b5f50ee5522d1aa64fd0f7623b6f139d3bc3698cfde401e0003a78a16ecd\": container with ID starting with d8f1b5f50ee5522d1aa64fd0f7623b6f139d3bc3698cfde401e0003a78a16ecd not found: ID does not exist"
Sep 10 14:43:04.394205 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:04.394152    2545 scope.go:117] "RemoveContainer" containerID="357fd74b14aae4e292016259c9ef641861b69f4eb1673bab80679c3b5f655af7"
Sep 10 14:43:04.402263 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:04.402221    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"]
Sep 10 14:43:04.402475 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:04.402455    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-6b9e31-openshift-default-5b9bb844-rpnpt"]
Sep 10 14:43:04.402562 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:43:04.402536    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"357fd74b14aae4e292016259c9ef641861b69f4eb1673bab80679c3b5f655af7\": container with ID starting with 357fd74b14aae4e292016259c9ef641861b69f4eb1673bab80679c3b5f655af7 not found: ID does not exist" containerID="357fd74b14aae4e292016259c9ef641861b69f4eb1673bab80679c3b5f655af7"
Sep 10 14:43:04.402634 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:04.402576    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"357fd74b14aae4e292016259c9ef641861b69f4eb1673bab80679c3b5f655af7"} err="failed to get container status \"357fd74b14aae4e292016259c9ef641861b69f4eb1673bab80679c3b5f655af7\": rpc error: code = NotFound desc = could not find container \"357fd74b14aae4e292016259c9ef641861b69f4eb1673bab80679c3b5f655af7\": container with ID starting with 357fd74b14aae4e292016259c9ef641861b69f4eb1673bab80679c3b5f655af7 not found: ID does not exist"
Sep 10 14:43:06.366359 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:06.366322    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaca653a-70aa-4235-ada2-97ee410b16de" path="/var/lib/kubelet/pods/aaca653a-70aa-4235-ada2-97ee410b16de/volumes"
Sep 10 14:43:09.160467 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:09.160432    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5"]
Sep 10 14:43:09.160908 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:09.160724    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5" podUID="0d9d7073-e0f7-43c3-be62-f72d36a74e43" containerName="payload-pre-processing" containerID="cri-o://5cf124d0ddd03cf9b7414a74808e13cb50b07b2e2b2100c04aa750b4f536582d" gracePeriod=30
Sep 10 14:43:09.291625 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:09.291592    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-586826-4fmks"]
Sep 10 14:43:09.294083 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:09.294046    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-586826-4fmks"]
Sep 10 14:43:09.414296 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:09.414197    2545 generic.go:356] "Generic (PLEG): container finished" podID="0d9d7073-e0f7-43c3-be62-f72d36a74e43" containerID="5cf124d0ddd03cf9b7414a74808e13cb50b07b2e2b2100c04aa750b4f536582d" exitCode=0
Sep 10 14:43:09.414296 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:09.414270    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5" event={"ID":"0d9d7073-e0f7-43c3-be62-f72d36a74e43","Type":"ContainerDied","Data":"5cf124d0ddd03cf9b7414a74808e13cb50b07b2e2b2100c04aa750b4f536582d"}
Sep 10 14:43:09.436965 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:09.436940    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5"
Sep 10 14:43:09.559194 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:09.559159    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42hdl\" (UniqueName: \"kubernetes.io/projected/0d9d7073-e0f7-43c3-be62-f72d36a74e43-kube-api-access-42hdl\") pod \"0d9d7073-e0f7-43c3-be62-f72d36a74e43\" (UID: \"0d9d7073-e0f7-43c3-be62-f72d36a74e43\") "
Sep 10 14:43:09.559349 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:09.559237    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d9d7073-e0f7-43c3-be62-f72d36a74e43-plugins-config-volume\") pod \"0d9d7073-e0f7-43c3-be62-f72d36a74e43\" (UID: \"0d9d7073-e0f7-43c3-be62-f72d36a74e43\") "
Sep 10 14:43:09.559633 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:09.559604    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d9d7073-e0f7-43c3-be62-f72d36a74e43-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0d9d7073-e0f7-43c3-be62-f72d36a74e43" (UID: "0d9d7073-e0f7-43c3-be62-f72d36a74e43"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:43:09.561141 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:09.561116    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d9d7073-e0f7-43c3-be62-f72d36a74e43-kube-api-access-42hdl" (OuterVolumeSpecName: "kube-api-access-42hdl") pod "0d9d7073-e0f7-43c3-be62-f72d36a74e43" (UID: "0d9d7073-e0f7-43c3-be62-f72d36a74e43"). InnerVolumeSpecName "kube-api-access-42hdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:43:09.660559 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:09.660505    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42hdl\" (UniqueName: \"kubernetes.io/projected/0d9d7073-e0f7-43c3-be62-f72d36a74e43-kube-api-access-42hdl\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:43:09.660559 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:09.660533    2545 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d9d7073-e0f7-43c3-be62-f72d36a74e43-plugins-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:43:10.366703 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:10.366669    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="427c31c1-c3d8-4810-b541-e63b5a124d7a" path="/var/lib/kubelet/pods/427c31c1-c3d8-4810-b541-e63b5a124d7a/volumes"
Sep 10 14:43:10.421452 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:10.421424    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5"
Sep 10 14:43:10.421651 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:10.421420    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5" event={"ID":"0d9d7073-e0f7-43c3-be62-f72d36a74e43","Type":"ContainerDied","Data":"4caf33bcddadb34c924a32ffdbccdf5f3617d886b7c72b5b43c45d8a54eed61d"}
Sep 10 14:43:10.421651 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:10.421575    2545 scope.go:117] "RemoveContainer" containerID="5cf124d0ddd03cf9b7414a74808e13cb50b07b2e2b2100c04aa750b4f536582d"
Sep 10 14:43:10.440482 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:10.440450    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5"]
Sep 10 14:43:10.450210 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:10.450185    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-586826-698687fddb-k2bb5"]
Sep 10 14:43:12.365675 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:12.365640    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d9d7073-e0f7-43c3-be62-f72d36a74e43" path="/var/lib/kubelet/pods/0d9d7073-e0f7-43c3-be62-f72d36a74e43/volumes"
Sep 10 14:43:15.987412 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:15.987376    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-9dcc39-sh4j7"]
Sep 10 14:43:15.987801 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:15.987787    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="427c31c1-c3d8-4810-b541-e63b5a124d7a" containerName="revoke-keys"
Sep 10 14:43:15.987801 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:15.987801    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="427c31c1-c3d8-4810-b541-e63b5a124d7a" containerName="revoke-keys"
Sep 10 14:43:15.987890 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:15.987810    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d9d7073-e0f7-43c3-be62-f72d36a74e43" containerName="payload-pre-processing"
Sep 10 14:43:15.987890 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:15.987816    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d9d7073-e0f7-43c3-be62-f72d36a74e43" containerName="payload-pre-processing"
Sep 10 14:43:15.987890 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:15.987833    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaca653a-70aa-4235-ada2-97ee410b16de" containerName="istio-proxy"
Sep 10 14:43:15.987890 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:15.987839    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaca653a-70aa-4235-ada2-97ee410b16de" containerName="istio-proxy"
Sep 10 14:43:15.987890 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:15.987848    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb6a7bca-75b0-4aa4-9ed7-686b17078a8a" containerName="istio-proxy"
Sep 10 14:43:15.987890 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:15.987854    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb6a7bca-75b0-4aa4-9ed7-686b17078a8a" containerName="istio-proxy"
Sep 10 14:43:15.988071 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:15.987910    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb6a7bca-75b0-4aa4-9ed7-686b17078a8a" containerName="istio-proxy"
Sep 10 14:43:15.988071 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:15.987919    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d9d7073-e0f7-43c3-be62-f72d36a74e43" containerName="payload-pre-processing"
Sep 10 14:43:15.988071 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:15.987928    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaca653a-70aa-4235-ada2-97ee410b16de" containerName="istio-proxy"
Sep 10 14:43:15.988071 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:15.987934    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaca653a-70aa-4235-ada2-97ee410b16de" containerName="istio-proxy"
Sep 10 14:43:15.988071 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:15.987941    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="427c31c1-c3d8-4810-b541-e63b5a124d7a" containerName="revoke-keys"
Sep 10 14:43:15.990913 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:15.990897    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-9dcc39-sh4j7"
Sep 10 14:43:15.993536 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:15.993483    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:43:15.993677 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:15.993539    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pj254\""
Sep 10 14:43:15.998528 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:15.998503    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-9dcc39-sh4j7"]
Sep 10 14:43:16.121080 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:16.121044    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/445bf97b-28e8-494e-b311-71bdd8d82477-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-9dcc39-sh4j7\" (UID: \"445bf97b-28e8-494e-b311-71bdd8d82477\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-9dcc39-sh4j7"
Sep 10 14:43:16.222061 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:16.222009    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/445bf97b-28e8-494e-b311-71bdd8d82477-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-9dcc39-sh4j7\" (UID: \"445bf97b-28e8-494e-b311-71bdd8d82477\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-9dcc39-sh4j7"
Sep 10 14:43:16.222717 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:16.222694    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/445bf97b-28e8-494e-b311-71bdd8d82477-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-9dcc39-sh4j7\" (UID: \"445bf97b-28e8-494e-b311-71bdd8d82477\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-9dcc39-sh4j7"
Sep 10 14:43:16.303135 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:16.303042    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-9dcc39-sh4j7"
Sep 10 14:43:16.574933 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:16.574905    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-9dcc39-sh4j7"]
Sep 10 14:43:16.576050 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:43:16.576023    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod445bf97b_28e8_494e_b311_71bdd8d82477.slice/crio-e86755a99509909dff379fda5170f063c3fdad91fa539aaa46041e8eb5400dd2 WatchSource:0}: Error finding container e86755a99509909dff379fda5170f063c3fdad91fa539aaa46041e8eb5400dd2: Status 404 returned error can't find the container with id e86755a99509909dff379fda5170f063c3fdad91fa539aaa46041e8eb5400dd2
Sep 10 14:43:17.468224 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:17.468193    2545 generic.go:356] "Generic (PLEG): container finished" podID="445bf97b-28e8-494e-b311-71bdd8d82477" containerID="c8bb8ddfbcde576f1e84389e2fdba7b411802189ba352661007250148d309b52" exitCode=0
Sep 10 14:43:17.468630 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:17.468285    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-9dcc39-sh4j7" event={"ID":"445bf97b-28e8-494e-b311-71bdd8d82477","Type":"ContainerDied","Data":"c8bb8ddfbcde576f1e84389e2fdba7b411802189ba352661007250148d309b52"}
Sep 10 14:43:17.468630 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:17.468336    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-9dcc39-sh4j7" event={"ID":"445bf97b-28e8-494e-b311-71bdd8d82477","Type":"ContainerStarted","Data":"e86755a99509909dff379fda5170f063c3fdad91fa539aaa46041e8eb5400dd2"}
Sep 10 14:43:18.602410 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:18.602385    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-9dcc39-sh4j7"
Sep 10 14:43:18.642780 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:18.642748    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/445bf97b-28e8-494e-b311-71bdd8d82477-maas-api-service-ca\") pod \"445bf97b-28e8-494e-b311-71bdd8d82477\" (UID: \"445bf97b-28e8-494e-b311-71bdd8d82477\") "
Sep 10 14:43:18.643095 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:18.643076    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/445bf97b-28e8-494e-b311-71bdd8d82477-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "445bf97b-28e8-494e-b311-71bdd8d82477" (UID: "445bf97b-28e8-494e-b311-71bdd8d82477"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:43:18.743546 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:18.743521    2545 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/445bf97b-28e8-494e-b311-71bdd8d82477-maas-api-service-ca\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:43:19.481113 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:19.481079    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-9dcc39-sh4j7"
Sep 10 14:43:19.481276 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:19.481109    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-9dcc39-sh4j7" event={"ID":"445bf97b-28e8-494e-b311-71bdd8d82477","Type":"ContainerDied","Data":"e86755a99509909dff379fda5170f063c3fdad91fa539aaa46041e8eb5400dd2"}
Sep 10 14:43:19.481276 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:19.481158    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e86755a99509909dff379fda5170f063c3fdad91fa539aaa46041e8eb5400dd2"
Sep 10 14:43:26.435391 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:26.435342    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk"]
Sep 10 14:43:26.436067 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:26.435721    2545 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk" podUID="44594bd8-4672-485f-9d83-5ffe478fb19a" containerName="payload-pre-processing" containerID="cri-o://7e822e4a5902f2a1442a2b07b2d78ccfef4b107d09e65808e1ac2e85715bca5d" gracePeriod=30
Sep 10 14:43:26.589656 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:26.589497    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-9dcc39-sh4j7"]
Sep 10 14:43:26.592041 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:26.592018    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-9dcc39-sh4j7"]
Sep 10 14:43:26.695392 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:26.695328    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk"
Sep 10 14:43:26.714317 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:26.714288    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44594bd8-4672-485f-9d83-5ffe478fb19a-plugins-config-volume\") pod \"44594bd8-4672-485f-9d83-5ffe478fb19a\" (UID: \"44594bd8-4672-485f-9d83-5ffe478fb19a\") "
Sep 10 14:43:26.714503 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:26.714465    2545 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6d8z\" (UniqueName: \"kubernetes.io/projected/44594bd8-4672-485f-9d83-5ffe478fb19a-kube-api-access-n6d8z\") pod \"44594bd8-4672-485f-9d83-5ffe478fb19a\" (UID: \"44594bd8-4672-485f-9d83-5ffe478fb19a\") "
Sep 10 14:43:26.714734 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:26.714711    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44594bd8-4672-485f-9d83-5ffe478fb19a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "44594bd8-4672-485f-9d83-5ffe478fb19a" (UID: "44594bd8-4672-485f-9d83-5ffe478fb19a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:43:26.714825 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:26.714794    2545 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44594bd8-4672-485f-9d83-5ffe478fb19a-plugins-config-volume\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:43:26.717028 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:26.717003    2545 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44594bd8-4672-485f-9d83-5ffe478fb19a-kube-api-access-n6d8z" (OuterVolumeSpecName: "kube-api-access-n6d8z") pod "44594bd8-4672-485f-9d83-5ffe478fb19a" (UID: "44594bd8-4672-485f-9d83-5ffe478fb19a"). InnerVolumeSpecName "kube-api-access-n6d8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:43:26.816006 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:26.815975    2545 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6d8z\" (UniqueName: \"kubernetes.io/projected/44594bd8-4672-485f-9d83-5ffe478fb19a-kube-api-access-n6d8z\") on node \"ip-10-0-137-114.ec2.internal\" DevicePath \"\""
Sep 10 14:43:27.531589 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:27.531554    2545 generic.go:356] "Generic (PLEG): container finished" podID="44594bd8-4672-485f-9d83-5ffe478fb19a" containerID="7e822e4a5902f2a1442a2b07b2d78ccfef4b107d09e65808e1ac2e85715bca5d" exitCode=0
Sep 10 14:43:27.532010 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:27.531600    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk"
Sep 10 14:43:27.532010 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:27.531648    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk" event={"ID":"44594bd8-4672-485f-9d83-5ffe478fb19a","Type":"ContainerDied","Data":"7e822e4a5902f2a1442a2b07b2d78ccfef4b107d09e65808e1ac2e85715bca5d"}
Sep 10 14:43:27.532010 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:27.531705    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk" event={"ID":"44594bd8-4672-485f-9d83-5ffe478fb19a","Type":"ContainerDied","Data":"1ba1c8071bc6b67a7ade585dde77bbfacefeda67782259dde61aebf2ffafad39"}
Sep 10 14:43:27.532010 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:27.531731    2545 scope.go:117] "RemoveContainer" containerID="7e822e4a5902f2a1442a2b07b2d78ccfef4b107d09e65808e1ac2e85715bca5d"
Sep 10 14:43:27.541577 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:27.541563    2545 scope.go:117] "RemoveContainer" containerID="7e822e4a5902f2a1442a2b07b2d78ccfef4b107d09e65808e1ac2e85715bca5d"
Sep 10 14:43:27.541839 ip-10-0-137-114 kubenswrapper[2545]: E0910 14:43:27.541821    2545 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e822e4a5902f2a1442a2b07b2d78ccfef4b107d09e65808e1ac2e85715bca5d\": container with ID starting with 7e822e4a5902f2a1442a2b07b2d78ccfef4b107d09e65808e1ac2e85715bca5d not found: ID does not exist" containerID="7e822e4a5902f2a1442a2b07b2d78ccfef4b107d09e65808e1ac2e85715bca5d"
Sep 10 14:43:27.541883 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:27.541848    2545 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e822e4a5902f2a1442a2b07b2d78ccfef4b107d09e65808e1ac2e85715bca5d"} err="failed to get container status \"7e822e4a5902f2a1442a2b07b2d78ccfef4b107d09e65808e1ac2e85715bca5d\": rpc error: code = NotFound desc = could not find container \"7e822e4a5902f2a1442a2b07b2d78ccfef4b107d09e65808e1ac2e85715bca5d\": container with ID starting with 7e822e4a5902f2a1442a2b07b2d78ccfef4b107d09e65808e1ac2e85715bca5d not found: ID does not exist"
Sep 10 14:43:27.557574 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:27.557545    2545 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk"]
Sep 10 14:43:27.560087 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:27.560065    2545 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9dcc39-5d4bf5d65d-2tzvk"]
Sep 10 14:43:28.365857 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:28.365782    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44594bd8-4672-485f-9d83-5ffe478fb19a" path="/var/lib/kubelet/pods/44594bd8-4672-485f-9d83-5ffe478fb19a/volumes"
Sep 10 14:43:28.366204 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:28.366189    2545 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="445bf97b-28e8-494e-b311-71bdd8d82477" path="/var/lib/kubelet/pods/445bf97b-28e8-494e-b311-71bdd8d82477/volumes"
Sep 10 14:43:42.889093 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:42.889061    2545 scope.go:117] "RemoveContainer" containerID="8b82e877d3e858c07ca896895cf493b93777add4abb0dbafc0894a15bcc19ec6"
Sep 10 14:43:42.901187 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:43:42.901165    2545 scope.go:117] "RemoveContainer" containerID="d9f3ca9fbeadf07a7f12fc72d4c789e40bf65879bceb3bdfc48bfbfa3314ca63"
Sep 10 14:44:42.946674 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:44:42.946602    2545 scope.go:117] "RemoveContainer" containerID="8c80f01ac13b849848a8a9fd651b0283cfaba0a6d4191ecb3e05cb8d2c38751c"
Sep 10 14:44:42.955350 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:44:42.955331    2545 scope.go:117] "RemoveContainer" containerID="752d3cfcae1605013f3dd72ff631a97856cfdf99cab7fea240980d143ea9c9cb"
Sep 10 14:44:42.963269 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:44:42.963251    2545 scope.go:117] "RemoveContainer" containerID="dba96096f3cc0248be5699899d8966c0a1209db29861ff000607514752309630"
Sep 10 14:45:00.137676 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:45:00.137637    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817525-482kt"]
Sep 10 14:45:00.140003 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:45:00.138013    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaca653a-70aa-4235-ada2-97ee410b16de" containerName="istio-proxy"
Sep 10 14:45:00.140003 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:45:00.138024    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaca653a-70aa-4235-ada2-97ee410b16de" containerName="istio-proxy"
Sep 10 14:45:00.140003 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:45:00.138041    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="445bf97b-28e8-494e-b311-71bdd8d82477" containerName="revoke-keys"
Sep 10 14:45:00.140003 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:45:00.138048    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="445bf97b-28e8-494e-b311-71bdd8d82477" containerName="revoke-keys"
Sep 10 14:45:00.140003 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:45:00.138058    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44594bd8-4672-485f-9d83-5ffe478fb19a" containerName="payload-pre-processing"
Sep 10 14:45:00.140003 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:45:00.138063    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="44594bd8-4672-485f-9d83-5ffe478fb19a" containerName="payload-pre-processing"
Sep 10 14:45:00.140003 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:45:00.138118    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="44594bd8-4672-485f-9d83-5ffe478fb19a" containerName="payload-pre-processing"
Sep 10 14:45:00.140003 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:45:00.138125    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="445bf97b-28e8-494e-b311-71bdd8d82477" containerName="revoke-keys"
Sep 10 14:45:00.141048 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:45:00.141032    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817525-482kt"
Sep 10 14:45:00.144657 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:45:00.144635    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pj254\""
Sep 10 14:45:00.150273 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:45:00.150256    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817525-482kt"
Sep 10 14:45:00.158939 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:45:00.158911    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817525-482kt"]
Sep 10 14:45:00.432462 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:45:00.432432    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817525-482kt"]
Sep 10 14:45:00.433978 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:45:00.433951    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3b49759_b7cf_4d36_a379_23fbc4e99523.slice/crio-2e012972fceb63427796064eaeb0c3326c28379e34399c36f691e4af886914cf WatchSource:0}: Error finding container 2e012972fceb63427796064eaeb0c3326c28379e34399c36f691e4af886914cf: Status 404 returned error can't find the container with id 2e012972fceb63427796064eaeb0c3326c28379e34399c36f691e4af886914cf
Sep 10 14:45:01.081501 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:45:01.081447    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817525-482kt" event={"ID":"c3b49759-b7cf-4d36-a379-23fbc4e99523","Type":"ContainerStarted","Data":"bca474cd3409c26ca9f4188464c57f27395569dcf4cbcc00511589dd3394c836"}
Sep 10 14:45:01.081708 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:45:01.081529    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817525-482kt" event={"ID":"c3b49759-b7cf-4d36-a379-23fbc4e99523","Type":"ContainerStarted","Data":"2e012972fceb63427796064eaeb0c3326c28379e34399c36f691e4af886914cf"}
Sep 10 14:45:01.104727 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:45:01.100474    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817525-482kt" podStartSLOduration=1.100456195 podStartE2EDuration="1.100456195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:45:01.097213906 +0000 UTC m=+1999.214755383" watchObservedRunningTime="2026-09-10 14:45:01.100456195 +0000 UTC m=+1999.217997670"
Sep 10 14:45:02.088837 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:45:02.088797    2545 generic.go:356] "Generic (PLEG): container finished" podID="c3b49759-b7cf-4d36-a379-23fbc4e99523" containerID="bca474cd3409c26ca9f4188464c57f27395569dcf4cbcc00511589dd3394c836" exitCode=0
Sep 10 14:45:02.089219 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:45:02.088886    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817525-482kt" event={"ID":"c3b49759-b7cf-4d36-a379-23fbc4e99523","Type":"ContainerDied","Data":"bca474cd3409c26ca9f4188464c57f27395569dcf4cbcc00511589dd3394c836"}
Sep 10 14:45:03.221443 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:45:03.221415    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817525-482kt"
Sep 10 14:45:04.101496 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:45:04.101464    2545 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817525-482kt"
Sep 10 14:45:04.101674 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:45:04.101529    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817525-482kt" event={"ID":"c3b49759-b7cf-4d36-a379-23fbc4e99523","Type":"ContainerDied","Data":"2e012972fceb63427796064eaeb0c3326c28379e34399c36f691e4af886914cf"}
Sep 10 14:45:04.101674 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:45:04.101577    2545 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e012972fceb63427796064eaeb0c3326c28379e34399c36f691e4af886914cf"
Sep 10 14:47:43.008505 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:47:43.008415    2545 scope.go:117] "RemoveContainer" containerID="9ad0363963d0b0cc0134bc15698f3eaae54c78cf7670ec6551eaafe74f5ca478"
Sep 10 14:47:43.017684 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:47:43.017660    2545 scope.go:117] "RemoveContainer" containerID="18031e29acf16da11829fbcab713414371a9470c26e29b91530fd1cc65b0f2ed"
Sep 10 14:48:43.047222 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:48:43.047188    2545 scope.go:117] "RemoveContainer" containerID="3eb6639fe6bfa0bee5a7f96809a6da21b8a7ce0b3a9bc957eaeec3cc68a705c7"
Sep 10 14:49:04.987597 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:04.987565    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hfbhz_85337035-a698-4b91-b90e-ce7f70677d0e/manager/0.log"
Sep 10 14:49:05.335761 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:05.335684    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55f59f54dd-stpts_4066b4c7-3deb-416f-a03d-417d4e016898/copy-manifests/0.log"
Sep 10 14:49:05.342102 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:05.342076    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55f59f54dd-stpts_4066b4c7-3deb-416f-a03d-417d4e016898/manager/0.log"
Sep 10 14:49:05.990125 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:05.990095    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29817525-482kt_c3b49759-b7cf-4d36-a379-23fbc4e99523/cleanup/0.log"
Sep 10 14:49:07.815367 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:07.815333    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5_567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7/istio-proxy/0.log"
Sep 10 14:49:07.927012 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:07.926979    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zzg9d_c899a529-91d7-4bd5-a0f5-0dfba4d6cea7/discovery/0.log"
Sep 10 14:49:08.262179 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:08.262148    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-7sjh4_f081950b-a0fa-45fd-a638-7672785e5170/istio-proxy/1.log"
Sep 10 14:49:08.502461 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:08.502430    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-bbcvl_bbf1ec85-8ba1-4185-b9f4-e8ac8b82464d/payload-processing/0.log"
Sep 10 14:49:08.615643 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:08.615563    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58d678bf84-6skhd_b9ef0e19-99ad-4e56-b12a-e21a168b04b9/router/0.log"
Sep 10 14:49:08.948311 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:08.948235    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-m6w69_18db6c81-c322-4059-99b4-38efea583db7/main/0.log"
Sep 10 14:49:14.855454 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:14.855412    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cvj6w/must-gather-66dzw"]
Sep 10 14:49:14.856092 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:14.856065    2545 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3b49759-b7cf-4d36-a379-23fbc4e99523" containerName="cleanup"
Sep 10 14:49:14.856092 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:14.856093    2545 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3b49759-b7cf-4d36-a379-23fbc4e99523" containerName="cleanup"
Sep 10 14:49:14.856264 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:14.856196    2545 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3b49759-b7cf-4d36-a379-23fbc4e99523" containerName="cleanup"
Sep 10 14:49:14.858977 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:14.858956    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cvj6w/must-gather-66dzw"
Sep 10 14:49:14.861566 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:14.861541    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cvj6w\"/\"openshift-service-ca.crt\""
Sep 10 14:49:14.861684 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:14.861545    2545 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cvj6w\"/\"kube-root-ca.crt\""
Sep 10 14:49:14.862621 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:14.862606    2545 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cvj6w\"/\"default-dockercfg-k2q7n\""
Sep 10 14:49:14.868056 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:14.868035    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cvj6w/must-gather-66dzw"]
Sep 10 14:49:14.999385 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:14.999351    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb9xb\" (UniqueName: \"kubernetes.io/projected/b1746bfe-1cab-45fc-a503-b6f15a195b1e-kube-api-access-mb9xb\") pod \"must-gather-66dzw\" (UID: \"b1746bfe-1cab-45fc-a503-b6f15a195b1e\") " pod="openshift-must-gather-cvj6w/must-gather-66dzw"
Sep 10 14:49:14.999581 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:14.999476    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b1746bfe-1cab-45fc-a503-b6f15a195b1e-must-gather-output\") pod \"must-gather-66dzw\" (UID: \"b1746bfe-1cab-45fc-a503-b6f15a195b1e\") " pod="openshift-must-gather-cvj6w/must-gather-66dzw"
Sep 10 14:49:15.100746 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:15.100707    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b1746bfe-1cab-45fc-a503-b6f15a195b1e-must-gather-output\") pod \"must-gather-66dzw\" (UID: \"b1746bfe-1cab-45fc-a503-b6f15a195b1e\") " pod="openshift-must-gather-cvj6w/must-gather-66dzw"
Sep 10 14:49:15.100921 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:15.100785    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb9xb\" (UniqueName: \"kubernetes.io/projected/b1746bfe-1cab-45fc-a503-b6f15a195b1e-kube-api-access-mb9xb\") pod \"must-gather-66dzw\" (UID: \"b1746bfe-1cab-45fc-a503-b6f15a195b1e\") " pod="openshift-must-gather-cvj6w/must-gather-66dzw"
Sep 10 14:49:15.101071 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:15.101046    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b1746bfe-1cab-45fc-a503-b6f15a195b1e-must-gather-output\") pod \"must-gather-66dzw\" (UID: \"b1746bfe-1cab-45fc-a503-b6f15a195b1e\") " pod="openshift-must-gather-cvj6w/must-gather-66dzw"
Sep 10 14:49:15.109207 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:15.109127    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb9xb\" (UniqueName: \"kubernetes.io/projected/b1746bfe-1cab-45fc-a503-b6f15a195b1e-kube-api-access-mb9xb\") pod \"must-gather-66dzw\" (UID: \"b1746bfe-1cab-45fc-a503-b6f15a195b1e\") " pod="openshift-must-gather-cvj6w/must-gather-66dzw"
Sep 10 14:49:15.169814 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:15.169780    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cvj6w/must-gather-66dzw"
Sep 10 14:49:15.443301 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:15.443272    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cvj6w/must-gather-66dzw"]
Sep 10 14:49:15.444482 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:49:15.444455    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1746bfe_1cab_45fc_a503_b6f15a195b1e.slice/crio-7b8229137e5f640cbc062b179840219918bf20f20a4aa02f6155206558f87900 WatchSource:0}: Error finding container 7b8229137e5f640cbc062b179840219918bf20f20a4aa02f6155206558f87900: Status 404 returned error can't find the container with id 7b8229137e5f640cbc062b179840219918bf20f20a4aa02f6155206558f87900
Sep 10 14:49:15.446571 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:15.446554    2545 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 14:49:15.546940 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:15.546903    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cvj6w/must-gather-66dzw" event={"ID":"b1746bfe-1cab-45fc-a503-b6f15a195b1e","Type":"ContainerStarted","Data":"7b8229137e5f640cbc062b179840219918bf20f20a4aa02f6155206558f87900"}
Sep 10 14:49:17.570124 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:17.569199    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cvj6w/must-gather-66dzw" event={"ID":"b1746bfe-1cab-45fc-a503-b6f15a195b1e","Type":"ContainerStarted","Data":"8da6f38cf872d7b6416879376ecab04e095a16350ac1ad4cdb2f59cd25bd893f"}
Sep 10 14:49:17.570124 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:17.569262    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cvj6w/must-gather-66dzw" event={"ID":"b1746bfe-1cab-45fc-a503-b6f15a195b1e","Type":"ContainerStarted","Data":"801705fdb6d6b65e901675fbcc37e93573089e2ced842a58c51aef018fac7993"}
Sep 10 14:49:17.587210 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:17.587152    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cvj6w/must-gather-66dzw" podStartSLOduration=2.262060154 podStartE2EDuration="3.587133867s" totalImagesPullingTime="1.325073713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:49:17.585594644 +0000 UTC m=+2255.703136117" watchObservedRunningTime="2026-09-10 14:49:17.587133867 +0000 UTC m=+2255.704675341"
Sep 10 14:49:18.344063 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:18.344017    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6rscd_c49d3edb-4324-4cce-aeb7-aa73eda47a3b/global-pull-secret-syncer/0.log"
Sep 10 14:49:18.495565 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:18.495528    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7trgp_70bb7897-ea8f-4d68-adc1-53b35c76b9ae/konnectivity-agent/0.log"
Sep 10 14:49:18.597651 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:18.597571    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-114.ec2.internal_450be98a163c16e402ad994ce289c366/haproxy/0.log"
Sep 10 14:49:24.499297 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:24.499268    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_78a47a5e-640a-47ef-a219-57caa2c2567d/alertmanager/0.log"
Sep 10 14:49:24.524105 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:24.524076    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_78a47a5e-640a-47ef-a219-57caa2c2567d/config-reloader/0.log"
Sep 10 14:49:24.548996 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:24.548933    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_78a47a5e-640a-47ef-a219-57caa2c2567d/kube-rbac-proxy-web/0.log"
Sep 10 14:49:24.589768 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:24.589715    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_78a47a5e-640a-47ef-a219-57caa2c2567d/kube-rbac-proxy/0.log"
Sep 10 14:49:24.613592 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:24.613566    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_78a47a5e-640a-47ef-a219-57caa2c2567d/kube-rbac-proxy-metric/0.log"
Sep 10 14:49:24.637749 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:24.637715    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_78a47a5e-640a-47ef-a219-57caa2c2567d/prom-label-proxy/0.log"
Sep 10 14:49:24.661995 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:24.661950    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_78a47a5e-640a-47ef-a219-57caa2c2567d/init-config-reloader/0.log"
Sep 10 14:49:24.812824 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:24.812753    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7b4589cc5b-zhcd4_5f594479-f14f-4d4b-8fe5-a3b69e421ad2/metrics-server/0.log"
Sep 10 14:49:25.039806 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:25.039779    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vknb5_0a6a16df-bc28-4257-b604-a4fb088d70ab/node-exporter/0.log"
Sep 10 14:49:25.062013 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:25.061974    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vknb5_0a6a16df-bc28-4257-b604-a4fb088d70ab/kube-rbac-proxy/0.log"
Sep 10 14:49:25.087020 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:25.086938    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vknb5_0a6a16df-bc28-4257-b604-a4fb088d70ab/init-textfile/0.log"
Sep 10 14:49:25.365979 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:25.365879    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-7nwnj_706ff688-277b-4996-ad23-b73d1bfbb843/prometheus-operator/0.log"
Sep 10 14:49:25.385297 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:25.385269    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-7nwnj_706ff688-277b-4996-ad23-b73d1bfbb843/kube-rbac-proxy/0.log"
Sep 10 14:49:25.448321 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:25.448291    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c844879b9-gwdf6_f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c/telemeter-client/0.log"
Sep 10 14:49:25.472198 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:25.472115    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c844879b9-gwdf6_f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c/reload/0.log"
Sep 10 14:49:25.499052 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:25.499014    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c844879b9-gwdf6_f7e32b9d-2b75-4ada-9623-5a0e7d3b0d4c/kube-rbac-proxy/0.log"
Sep 10 14:49:25.533525 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:25.533471    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67dd4dc5c8-nbxfs_1d018408-6349-4c02-b94d-05652645b698/thanos-query/0.log"
Sep 10 14:49:25.555877 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:25.555827    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67dd4dc5c8-nbxfs_1d018408-6349-4c02-b94d-05652645b698/kube-rbac-proxy-web/0.log"
Sep 10 14:49:25.607563 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:25.607170    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67dd4dc5c8-nbxfs_1d018408-6349-4c02-b94d-05652645b698/kube-rbac-proxy/0.log"
Sep 10 14:49:25.627790 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:25.627712    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67dd4dc5c8-nbxfs_1d018408-6349-4c02-b94d-05652645b698/prom-label-proxy/0.log"
Sep 10 14:49:25.658961 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:25.658930    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67dd4dc5c8-nbxfs_1d018408-6349-4c02-b94d-05652645b698/kube-rbac-proxy-rules/0.log"
Sep 10 14:49:25.693670 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:25.693640    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67dd4dc5c8-nbxfs_1d018408-6349-4c02-b94d-05652645b698/kube-rbac-proxy-metrics/0.log"
Sep 10 14:49:28.588670 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:28.588642    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-684f4b5dd-ldt5b_af86e634-6c18-47fa-ac8b-4afff6c559ce/console/0.log"
Sep 10 14:49:29.592353 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:29.592312    2545 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cvj6w/perf-node-gather-daemonset-vwb2b"]
Sep 10 14:49:29.599832 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:29.599799    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cvj6w/perf-node-gather-daemonset-vwb2b"
Sep 10 14:49:29.604702 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:29.604673    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cvj6w/perf-node-gather-daemonset-vwb2b"]
Sep 10 14:49:29.668138 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:29.668102    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/26e03935-6d28-4d24-87ef-8e0182abb753-proc\") pod \"perf-node-gather-daemonset-vwb2b\" (UID: \"26e03935-6d28-4d24-87ef-8e0182abb753\") " pod="openshift-must-gather-cvj6w/perf-node-gather-daemonset-vwb2b"
Sep 10 14:49:29.668312 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:29.668169    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26e03935-6d28-4d24-87ef-8e0182abb753-lib-modules\") pod \"perf-node-gather-daemonset-vwb2b\" (UID: \"26e03935-6d28-4d24-87ef-8e0182abb753\") " pod="openshift-must-gather-cvj6w/perf-node-gather-daemonset-vwb2b"
Sep 10 14:49:29.668312 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:29.668224    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptjkk\" (UniqueName: \"kubernetes.io/projected/26e03935-6d28-4d24-87ef-8e0182abb753-kube-api-access-ptjkk\") pod \"perf-node-gather-daemonset-vwb2b\" (UID: \"26e03935-6d28-4d24-87ef-8e0182abb753\") " pod="openshift-must-gather-cvj6w/perf-node-gather-daemonset-vwb2b"
Sep 10 14:49:29.668312 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:29.668262    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/26e03935-6d28-4d24-87ef-8e0182abb753-podres\") pod \"perf-node-gather-daemonset-vwb2b\" (UID: \"26e03935-6d28-4d24-87ef-8e0182abb753\") " pod="openshift-must-gather-cvj6w/perf-node-gather-daemonset-vwb2b"
Sep 10 14:49:29.668312 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:29.668294    2545 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26e03935-6d28-4d24-87ef-8e0182abb753-sys\") pod \"perf-node-gather-daemonset-vwb2b\" (UID: \"26e03935-6d28-4d24-87ef-8e0182abb753\") " pod="openshift-must-gather-cvj6w/perf-node-gather-daemonset-vwb2b"
Sep 10 14:49:29.769206 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:29.769171    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/26e03935-6d28-4d24-87ef-8e0182abb753-proc\") pod \"perf-node-gather-daemonset-vwb2b\" (UID: \"26e03935-6d28-4d24-87ef-8e0182abb753\") " pod="openshift-must-gather-cvj6w/perf-node-gather-daemonset-vwb2b"
Sep 10 14:49:29.769388 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:29.769221    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26e03935-6d28-4d24-87ef-8e0182abb753-lib-modules\") pod \"perf-node-gather-daemonset-vwb2b\" (UID: \"26e03935-6d28-4d24-87ef-8e0182abb753\") " pod="openshift-must-gather-cvj6w/perf-node-gather-daemonset-vwb2b"
Sep 10 14:49:29.769388 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:29.769345    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26e03935-6d28-4d24-87ef-8e0182abb753-lib-modules\") pod \"perf-node-gather-daemonset-vwb2b\" (UID: \"26e03935-6d28-4d24-87ef-8e0182abb753\") " pod="openshift-must-gather-cvj6w/perf-node-gather-daemonset-vwb2b"
Sep 10 14:49:29.769388 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:29.769332    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/26e03935-6d28-4d24-87ef-8e0182abb753-proc\") pod \"perf-node-gather-daemonset-vwb2b\" (UID: \"26e03935-6d28-4d24-87ef-8e0182abb753\") " pod="openshift-must-gather-cvj6w/perf-node-gather-daemonset-vwb2b"
Sep 10 14:49:29.769597 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:29.769380    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptjkk\" (UniqueName: \"kubernetes.io/projected/26e03935-6d28-4d24-87ef-8e0182abb753-kube-api-access-ptjkk\") pod \"perf-node-gather-daemonset-vwb2b\" (UID: \"26e03935-6d28-4d24-87ef-8e0182abb753\") " pod="openshift-must-gather-cvj6w/perf-node-gather-daemonset-vwb2b"
Sep 10 14:49:29.769597 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:29.769447    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/26e03935-6d28-4d24-87ef-8e0182abb753-podres\") pod \"perf-node-gather-daemonset-vwb2b\" (UID: \"26e03935-6d28-4d24-87ef-8e0182abb753\") " pod="openshift-must-gather-cvj6w/perf-node-gather-daemonset-vwb2b"
Sep 10 14:49:29.769597 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:29.769498    2545 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26e03935-6d28-4d24-87ef-8e0182abb753-sys\") pod \"perf-node-gather-daemonset-vwb2b\" (UID: \"26e03935-6d28-4d24-87ef-8e0182abb753\") " pod="openshift-must-gather-cvj6w/perf-node-gather-daemonset-vwb2b"
Sep 10 14:49:29.769715 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:29.769594    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/26e03935-6d28-4d24-87ef-8e0182abb753-podres\") pod \"perf-node-gather-daemonset-vwb2b\" (UID: \"26e03935-6d28-4d24-87ef-8e0182abb753\") " pod="openshift-must-gather-cvj6w/perf-node-gather-daemonset-vwb2b"
Sep 10 14:49:29.769715 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:29.769631    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26e03935-6d28-4d24-87ef-8e0182abb753-sys\") pod \"perf-node-gather-daemonset-vwb2b\" (UID: \"26e03935-6d28-4d24-87ef-8e0182abb753\") " pod="openshift-must-gather-cvj6w/perf-node-gather-daemonset-vwb2b"
Sep 10 14:49:29.778926 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:29.778898    2545 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptjkk\" (UniqueName: \"kubernetes.io/projected/26e03935-6d28-4d24-87ef-8e0182abb753-kube-api-access-ptjkk\") pod \"perf-node-gather-daemonset-vwb2b\" (UID: \"26e03935-6d28-4d24-87ef-8e0182abb753\") " pod="openshift-must-gather-cvj6w/perf-node-gather-daemonset-vwb2b"
Sep 10 14:49:29.922955 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:29.922868    2545 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cvj6w/perf-node-gather-daemonset-vwb2b"
Sep 10 14:49:30.221726 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:30.221692    2545 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cvj6w/perf-node-gather-daemonset-vwb2b"]
Sep 10 14:49:30.223232 ip-10-0-137-114 kubenswrapper[2545]: W0910 14:49:30.223193    2545 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod26e03935_6d28_4d24_87ef_8e0182abb753.slice/crio-1d43050f2faabbea4a6dcd8324dbbd193b5750b8b48b59f3846b363a6cb9f64e WatchSource:0}: Error finding container 1d43050f2faabbea4a6dcd8324dbbd193b5750b8b48b59f3846b363a6cb9f64e: Status 404 returned error can't find the container with id 1d43050f2faabbea4a6dcd8324dbbd193b5750b8b48b59f3846b363a6cb9f64e
Sep 10 14:49:30.657074 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:30.657046    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-whqv6_b803a53c-a904-436c-9d1b-4956ef29b1e7/dns/0.log"
Sep 10 14:49:30.678419 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:30.678377    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cvj6w/perf-node-gather-daemonset-vwb2b" event={"ID":"26e03935-6d28-4d24-87ef-8e0182abb753","Type":"ContainerStarted","Data":"0353f6df3dd1a89c15e880d2c2dff352c38ab51ddccd8cd9bf3cef98dd0dc311"}
Sep 10 14:49:30.678629 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:30.678441    2545 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cvj6w/perf-node-gather-daemonset-vwb2b" event={"ID":"26e03935-6d28-4d24-87ef-8e0182abb753","Type":"ContainerStarted","Data":"1d43050f2faabbea4a6dcd8324dbbd193b5750b8b48b59f3846b363a6cb9f64e"}
Sep 10 14:49:30.678629 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:30.678518    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cvj6w/perf-node-gather-daemonset-vwb2b"
Sep 10 14:49:30.678896 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:30.678877    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-whqv6_b803a53c-a904-436c-9d1b-4956ef29b1e7/kube-rbac-proxy/0.log"
Sep 10 14:49:30.697506 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:30.696206    2545 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cvj6w/perf-node-gather-daemonset-vwb2b" podStartSLOduration=1.696187578 podStartE2EDuration="1.696187578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:49:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:49:30.694290906 +0000 UTC m=+2268.811832381" watchObservedRunningTime="2026-09-10 14:49:30.696187578 +0000 UTC m=+2268.813729056"
Sep 10 14:49:30.741116 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:30.741090    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ff5pl_0ea5e2be-249a-4829-8bad-e978cbdaf6fe/dns-node-resolver/0.log"
Sep 10 14:49:31.356932 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:31.356890    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rw64n_370d222e-be9d-42d0-aa73-d9934e17cdfb/node-ca/0.log"
Sep 10 14:49:32.282152 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:32.282120    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5_567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7/istio-proxy/0.log"
Sep 10 14:49:32.560679 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:32.560604    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zzg9d_c899a529-91d7-4bd5-a0f5-0dfba4d6cea7/discovery/0.log"
Sep 10 14:49:32.634294 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:32.634254    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-7sjh4_f081950b-a0fa-45fd-a638-7672785e5170/istio-proxy/0.log"
Sep 10 14:49:32.645566 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:32.645535    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-7sjh4_f081950b-a0fa-45fd-a638-7672785e5170/istio-proxy/1.log"
Sep 10 14:49:32.729737 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:32.729703    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-bbcvl_bbf1ec85-8ba1-4185-b9f4-e8ac8b82464d/payload-processing/0.log"
Sep 10 14:49:32.752233 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:32.752204    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58d678bf84-6skhd_b9ef0e19-99ad-4e56-b12a-e21a168b04b9/router/0.log"
Sep 10 14:49:33.617324 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:33.617298    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hhnkw_50606e5c-a872-4b2f-9437-a490b24bcda9/serve-healthcheck-canary/0.log"
Sep 10 14:49:34.158141 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:34.158110    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-djjnx_ba0e5564-7333-4c1f-acdf-89ebb69989ca/kube-rbac-proxy/0.log"
Sep 10 14:49:34.179756 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:34.179723    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-djjnx_ba0e5564-7333-4c1f-acdf-89ebb69989ca/exporter/0.log"
Sep 10 14:49:34.203574 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:34.203539    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-djjnx_ba0e5564-7333-4c1f-acdf-89ebb69989ca/extractor/0.log"
Sep 10 14:49:36.697511 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:36.697465    2545 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cvj6w/perf-node-gather-daemonset-vwb2b"
Sep 10 14:49:36.895351 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:36.895320    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hfbhz_85337035-a698-4b91-b90e-ce7f70677d0e/manager/0.log"
Sep 10 14:49:37.108930 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:37.108898    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55f59f54dd-stpts_4066b4c7-3deb-416f-a03d-417d4e016898/manager/0.log"
Sep 10 14:49:37.188830 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:37.188805    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55f59f54dd-stpts_4066b4c7-3deb-416f-a03d-417d4e016898/copy-manifests/0.log"
Sep 10 14:49:38.643289 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:38.643258    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7b64d8b6d6-72cj6_e38bf9dd-9f7d-4156-878d-a32a0e7a68ec/manager/0.log"
Sep 10 14:49:38.704078 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:38.704043    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5_567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7/istio-proxy/0.log"
Sep 10 14:49:38.997203 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:38.997170    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zzg9d_c899a529-91d7-4bd5-a0f5-0dfba4d6cea7/discovery/0.log"
Sep 10 14:49:39.054094 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:39.054024    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-7sjh4_f081950b-a0fa-45fd-a638-7672785e5170/istio-proxy/0.log"
Sep 10 14:49:39.067346 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:39.067298    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-7sjh4_f081950b-a0fa-45fd-a638-7672785e5170/istio-proxy/1.log"
Sep 10 14:49:39.134898 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:39.134823    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-bbcvl_bbf1ec85-8ba1-4185-b9f4-e8ac8b82464d/payload-processing/0.log"
Sep 10 14:49:39.159290 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:39.159253    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58d678bf84-6skhd_b9ef0e19-99ad-4e56-b12a-e21a168b04b9/router/0.log"
Sep 10 14:49:40.639114 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:40.639083    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6cbcdcfcccbzmb5_567cf522-3a1d-47b4-8bd4-7a4b6f9e60c7/istio-proxy/0.log"
Sep 10 14:49:40.953614 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:40.953473    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-zzg9d_c899a529-91d7-4bd5-a0f5-0dfba4d6cea7/discovery/0.log"
Sep 10 14:49:41.011254 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:41.011223    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-7sjh4_f081950b-a0fa-45fd-a638-7672785e5170/istio-proxy/0.log"
Sep 10 14:49:41.023293 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:41.023257    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-7sjh4_f081950b-a0fa-45fd-a638-7672785e5170/istio-proxy/1.log"
Sep 10 14:49:41.093981 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:41.093944    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-bbcvl_bbf1ec85-8ba1-4185-b9f4-e8ac8b82464d/payload-processing/0.log"
Sep 10 14:49:41.112024 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:41.111986    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58d678bf84-6skhd_b9ef0e19-99ad-4e56-b12a-e21a168b04b9/router/0.log"
Sep 10 14:49:43.071407 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:43.071376    2545 scope.go:117] "RemoveContainer" containerID="9b10328cac1131f51625f82d4d4232b3a97818d63bff2bab3cabccc6ab556c19"
Sep 10 14:49:43.084288 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:43.083789    2545 scope.go:117] "RemoveContainer" containerID="c8bb8ddfbcde576f1e84389e2fdba7b411802189ba352661007250148d309b52"
Sep 10 14:49:44.289673 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:44.289647    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-jfq22_242ed23a-ba27-4858-b8ea-2cdd4488fea4/kube-storage-version-migrator-operator/1.log"
Sep 10 14:49:44.290474 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:44.290450    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-jfq22_242ed23a-ba27-4858-b8ea-2cdd4488fea4/kube-storage-version-migrator-operator/0.log"
Sep 10 14:49:45.474948 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:45.474919    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6dsj_8c3c3e79-574d-4f59-ab18-d906e6480e94/kube-multus-additional-cni-plugins/0.log"
Sep 10 14:49:45.499465 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:45.499438    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6dsj_8c3c3e79-574d-4f59-ab18-d906e6480e94/egress-router-binary-copy/0.log"
Sep 10 14:49:45.521091 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:45.521066    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6dsj_8c3c3e79-574d-4f59-ab18-d906e6480e94/cni-plugins/0.log"
Sep 10 14:49:45.543135 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:45.543112    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6dsj_8c3c3e79-574d-4f59-ab18-d906e6480e94/bond-cni-plugin/0.log"
Sep 10 14:49:45.565267 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:45.565241    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6dsj_8c3c3e79-574d-4f59-ab18-d906e6480e94/routeoverride-cni/0.log"
Sep 10 14:49:45.586224 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:45.586198    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6dsj_8c3c3e79-574d-4f59-ab18-d906e6480e94/whereabouts-cni-bincopy/0.log"
Sep 10 14:49:45.606684 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:45.606654    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n6dsj_8c3c3e79-574d-4f59-ab18-d906e6480e94/whereabouts-cni/0.log"
Sep 10 14:49:45.828783 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:45.828746    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bx255_c993b267-6073-47f0-8c82-3881b57d4bbd/kube-multus/0.log"
Sep 10 14:49:45.942374 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:45.942342    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dzrg2_f60ac0b0-5ece-478d-855b-9ed8c8bff1d2/network-metrics-daemon/0.log"
Sep 10 14:49:45.963135 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:45.963106    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dzrg2_f60ac0b0-5ece-478d-855b-9ed8c8bff1d2/kube-rbac-proxy/0.log"
Sep 10 14:49:46.869323 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:46.869294    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fcvs7_db1cf9fc-221c-4c0e-a26e-6188c2339bd5/ovn-controller/0.log"
Sep 10 14:49:46.887527 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:46.887497    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fcvs7_db1cf9fc-221c-4c0e-a26e-6188c2339bd5/ovn-acl-logging/0.log"
Sep 10 14:49:46.911737 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:46.911708    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fcvs7_db1cf9fc-221c-4c0e-a26e-6188c2339bd5/kube-rbac-proxy-node/0.log"
Sep 10 14:49:46.933714 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:46.933681    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fcvs7_db1cf9fc-221c-4c0e-a26e-6188c2339bd5/kube-rbac-proxy-ovn-metrics/0.log"
Sep 10 14:49:46.953812 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:46.953784    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fcvs7_db1cf9fc-221c-4c0e-a26e-6188c2339bd5/northd/0.log"
Sep 10 14:49:46.977432 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:46.977362    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fcvs7_db1cf9fc-221c-4c0e-a26e-6188c2339bd5/nbdb/0.log"
Sep 10 14:49:46.998573 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:46.998545    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fcvs7_db1cf9fc-221c-4c0e-a26e-6188c2339bd5/sbdb/0.log"
Sep 10 14:49:47.064729 ip-10-0-137-114 kubenswrapper[2545]: I0910 14:49:47.064692    2545 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fcvs7_db1cf9fc-221c-4c0e-a26e-6188c2339bd5/ovnkube-controller/0.log"