Sep 16 12:00:06.667763 ip-10-0-137-240 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 16 12:00:06.667774 ip-10-0-137-240 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 16 12:00:06.667781 ip-10-0-137-240 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 16 12:00:06.667996 ip-10-0-137-240 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 16 12:00:16.750062 ip-10-0-137-240 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 16 12:00:16.750079 ip-10-0-137-240 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 32a111bf501444d58cdcf7367ddf496c --
Sep 16 12:02:13.739612 ip-10-0-137-240 systemd[1]: Starting Kubernetes Kubelet...
Sep 16 12:02:14.157076 ip-10-0-137-240 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 12:02:14.157076 ip-10-0-137-240 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 16 12:02:14.157076 ip-10-0-137-240 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 12:02:14.157076 ip-10-0-137-240 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 16 12:02:14.157076 ip-10-0-137-240 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 12:02:14.158259 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.158170    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 16 12:02:14.165792 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165762    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:02:14.165792 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165787    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:02:14.165792 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165792    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:02:14.165792 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165795    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:02:14.165792 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165799    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:02:14.165792 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165802    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:02:14.166019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165805    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:02:14.166019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165808    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:02:14.166019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165811    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:02:14.166019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165813    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:02:14.166019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165816    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:02:14.166019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165818    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:02:14.166019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165821    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:02:14.166019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165824    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:02:14.166019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165826    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:02:14.166019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165829    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:02:14.166019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165832    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:02:14.166019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165834    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:02:14.166019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165837    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:02:14.166019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165840    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:02:14.166019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165842    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:02:14.166019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165845    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:02:14.166019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165848    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:02:14.166019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165850    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:02:14.166019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165853    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:02:14.166019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165855    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:02:14.166517 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165858    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:02:14.166517 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165860    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:02:14.166517 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165864    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:02:14.166517 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165884    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:02:14.166517 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165887    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:02:14.166517 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165891    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:02:14.166517 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165894    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:02:14.166517 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165897    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:02:14.166517 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165899    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:02:14.166517 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165902    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:02:14.166517 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165904    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:02:14.166517 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165907    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:02:14.166517 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165909    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:02:14.166517 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165912    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:02:14.166517 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165914    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:02:14.166517 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165917    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:02:14.166517 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165920    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:02:14.166517 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165922    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:02:14.166517 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165925    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:02:14.166987 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165928    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:02:14.166987 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165930    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:02:14.166987 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165932    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:02:14.166987 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165935    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:02:14.166987 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165938    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:02:14.166987 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165942    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:02:14.166987 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165945    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:02:14.166987 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165947    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:02:14.166987 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165950    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:02:14.166987 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165953    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:02:14.166987 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165955    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:02:14.166987 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165958    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:02:14.166987 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165962    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:02:14.166987 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165966    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:02:14.166987 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165969    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:02:14.166987 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165972    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:02:14.166987 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165976    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:02:14.166987 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165979    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:02:14.166987 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165982    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:02:14.166987 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165985    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:02:14.167495 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165987    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:02:14.167495 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165989    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:02:14.167495 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165992    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:02:14.167495 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165995    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:02:14.167495 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.165997    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:02:14.167495 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166000    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:02:14.167495 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166002    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:02:14.167495 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166005    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:02:14.167495 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166007    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:02:14.167495 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166010    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:02:14.167495 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166013    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:02:14.167495 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166016    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:02:14.167495 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166018    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:02:14.167495 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166020    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:02:14.167495 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166023    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:02:14.167495 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166027    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:02:14.167495 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166030    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:02:14.167495 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166033    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:02:14.167495 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166036    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:02:14.167495 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166038    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:02:14.168036 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166041    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:02:14.168036 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166043    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:02:14.168036 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166047    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:02:14.168036 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166051    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:02:14.168036 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166053    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:02:14.168036 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166056    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:02:14.168036 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166059    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:02:14.168036 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166062    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:02:14.168036 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166064    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:02:14.168036 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166067    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:02:14.168036 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166070    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:02:14.168036 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166072    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:02:14.168036 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166074    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:02:14.168036 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166077    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:02:14.168036 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166814    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:02:14.168036 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166821    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:02:14.168036 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166824    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:02:14.168036 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166827    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:02:14.168036 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166830    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:02:14.168524 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166834    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:02:14.168524 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166837    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:02:14.168524 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166839    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:02:14.168524 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166842    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:02:14.168524 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166844    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:02:14.168524 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166847    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:02:14.168524 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166850    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:02:14.168524 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166853    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:02:14.168524 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166856    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:02:14.168524 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166859    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:02:14.168524 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166861    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:02:14.168524 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166864    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:02:14.168524 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166870    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:02:14.168524 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166873    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:02:14.168524 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166875    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:02:14.168524 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166878    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:02:14.168524 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166880    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:02:14.168524 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166883    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:02:14.168524 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166885    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:02:14.168524 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166888    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:02:14.169019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166890    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:02:14.169019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166892    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:02:14.169019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166897    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:02:14.169019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166901    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:02:14.169019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166903    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:02:14.169019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166906    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:02:14.169019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166909    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:02:14.169019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166913    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:02:14.169019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166915    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:02:14.169019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166918    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:02:14.169019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166921    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:02:14.169019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166924    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:02:14.169019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166927    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:02:14.169019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166931    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:02:14.169019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166933    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:02:14.169019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166936    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:02:14.169019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166938    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:02:14.169019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166941    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:02:14.169019 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166943    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:02:14.169492 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166946    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:02:14.169492 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166949    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:02:14.169492 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166952    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:02:14.169492 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166954    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:02:14.169492 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166957    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:02:14.169492 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166959    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:02:14.169492 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166962    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:02:14.169492 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166965    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:02:14.169492 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166967    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:02:14.169492 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166970    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:02:14.169492 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166972    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:02:14.169492 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166975    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:02:14.169492 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166977    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:02:14.169492 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166980    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:02:14.169492 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166982    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:02:14.169492 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166984    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:02:14.169492 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166987    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:02:14.169492 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166989    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:02:14.169492 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166992    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:02:14.169492 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166994    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:02:14.169989 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.166997    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:02:14.169989 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167000    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:02:14.169989 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167003    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:02:14.169989 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167005    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:02:14.169989 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167010    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:02:14.169989 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167012    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:02:14.169989 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167014    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:02:14.169989 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167017    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:02:14.169989 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167019    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:02:14.169989 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167022    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:02:14.169989 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167024    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:02:14.169989 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167027    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:02:14.169989 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167029    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:02:14.169989 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167031    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:02:14.169989 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167034    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:02:14.169989 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167037    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:02:14.169989 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167041    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:02:14.169989 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167044    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:02:14.169989 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167047    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:02:14.170558 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167050    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:02:14.170558 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167053    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:02:14.170558 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167055    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:02:14.170558 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167058    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:02:14.170558 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167060    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:02:14.170558 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167063    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:02:14.170558 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167065    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:02:14.170558 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167068    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:02:14.170558 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167070    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:02:14.170558 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167073    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:02:14.170558 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167075    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:02:14.170558 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167078    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:02:14.170558 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167081    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:02:14.170558 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167084    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:02:14.170558 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167086    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:02:14.170558 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167089    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:02:14.170558 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167506    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:02:14.170558 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167512    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:02:14.170558 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167515    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:02:14.171017 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167517    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:02:14.171017 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167520    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:02:14.171017 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167522    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:02:14.171017 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167525    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:02:14.171017 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167527    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:02:14.171017 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167530    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:02:14.171017 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167532    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:02:14.171017 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167536    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:02:14.171017 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167539    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:02:14.171017 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167542    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:02:14.171017 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167545    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:02:14.171017 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167548    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:02:14.171017 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167552    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:02:14.171017 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167556    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:02:14.171017 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167559    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:02:14.171017 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167562    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:02:14.171017 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167564    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:02:14.171017 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167567    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:02:14.171017 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167570    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:02:14.171494 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167572    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:02:14.171494 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167575    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:02:14.171494 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167577    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:02:14.171494 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167580    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:02:14.171494 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167582    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:02:14.171494 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167585    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:02:14.171494 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167587    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:02:14.171494 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167590    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:02:14.171494 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167593    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:02:14.171494 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167596    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:02:14.171494 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167598    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:02:14.171494 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167600    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:02:14.171494 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167603    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:02:14.171494 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167606    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:02:14.171494 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167608    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:02:14.171494 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167611    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:02:14.171494 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167613    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:02:14.171494 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167616    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:02:14.171494 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167619    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:02:14.171966 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167623    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:02:14.171966 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167626    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:02:14.171966 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167629    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:02:14.171966 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167631    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:02:14.171966 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167634    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:02:14.171966 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167636    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:02:14.171966 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167639    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:02:14.171966 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167642    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:02:14.171966 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167645    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:02:14.171966 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167648    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:02:14.171966 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167650    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:02:14.171966 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167653    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:02:14.171966 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167656    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:02:14.171966 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167658    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:02:14.171966 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167661    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:02:14.171966 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167664    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:02:14.171966 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167666    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:02:14.171966 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167668    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:02:14.171966 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167671    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:02:14.171966 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167673    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:02:14.172456 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167676    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:02:14.172456 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167679    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:02:14.172456 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167681    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:02:14.172456 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167685    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:02:14.172456 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167688    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:02:14.172456 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167691    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:02:14.172456 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167693    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:02:14.172456 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167695    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:02:14.172456 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167698    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:02:14.172456 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167700    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:02:14.172456 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167703    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:02:14.172456 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167705    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:02:14.172456 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167707    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:02:14.172456 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167710    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:02:14.172456 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167712    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:02:14.172456 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167715    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:02:14.172456 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167717    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:02:14.172456 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167720    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:02:14.172456 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167722    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:02:14.172456 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167724    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:02:14.172969 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167727    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:02:14.172969 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167730    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:02:14.172969 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167732    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:02:14.172969 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167735    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:02:14.172969 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167737    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:02:14.172969 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167739    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:02:14.172969 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167742    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:02:14.172969 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167746    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:02:14.172969 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167750    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:02:14.172969 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167754    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:02:14.172969 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167757    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:02:14.172969 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167760    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:02:14.172969 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167762    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:02:14.172969 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167766    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:02:14.172969 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167768    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:02:14.172969 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167771    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:02:14.172969 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167774    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:02:14.172969 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.167776    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:02:14.172969 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167851    2576 flags.go:64] FLAG: --address="0.0.0.0"
Sep 16 12:02:14.172969 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167894    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 16 12:02:14.173472 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167903    2576 flags.go:64] FLAG: --anonymous-auth="true"
Sep 16 12:02:14.173472 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167908    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 16 12:02:14.173472 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167912    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 16 12:02:14.173472 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167915    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 16 12:02:14.173472 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167919    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 16 12:02:14.173472 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167924    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 16 12:02:14.173472 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167927    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 16 12:02:14.173472 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167930    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 16 12:02:14.173472 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167934    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 16 12:02:14.173472 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167937    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 16 12:02:14.173472 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167940    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 16 12:02:14.173472 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167943    2576 flags.go:64] FLAG: --cgroup-root=""
Sep 16 12:02:14.173472 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167946    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 16 12:02:14.173472 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167949    2576 flags.go:64] FLAG: --client-ca-file=""
Sep 16 12:02:14.173472 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167952    2576 flags.go:64] FLAG: --cloud-provider="external"
Sep 16 12:02:14.173472 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167955    2576 flags.go:64] FLAG: --cluster-dns="[]"
Sep 16 12:02:14.173472 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167959    2576 flags.go:64] FLAG: --cluster-domain=""
Sep 16 12:02:14.173472 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167962    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 16 12:02:14.173472 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167964    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 16 12:02:14.173472 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167970    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 16 12:02:14.173472 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167973    2576 flags.go:64] FLAG: --container-log-max-files="5"
Sep 16 12:02:14.173472 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167977    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 16 12:02:14.173472 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167980    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 16 12:02:14.174066 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167982    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 16 12:02:14.174066 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167986    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 16 12:02:14.174066 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167989    2576 flags.go:64] FLAG: --contention-profiling="false"
Sep 16 12:02:14.174066 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167992    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 16 12:02:14.174066 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167995    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 16 12:02:14.174066 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.167998    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 16 12:02:14.174066 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168000    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 16 12:02:14.174066 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168004    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 16 12:02:14.174066 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168007    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 16 12:02:14.174066 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168010    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 16 12:02:14.174066 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168013    2576 flags.go:64] FLAG: --enable-load-reader="false"
Sep 16 12:02:14.174066 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168016    2576 flags.go:64] FLAG: --enable-server="true"
Sep 16 12:02:14.174066 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168018    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 16 12:02:14.174066 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168023    2576 flags.go:64] FLAG: --event-burst="100"
Sep 16 12:02:14.174066 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168028    2576 flags.go:64] FLAG: --event-qps="50"
Sep 16 12:02:14.174066 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168031    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 16 12:02:14.174066 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168034    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 16 12:02:14.174066 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168037    2576 flags.go:64] FLAG: --eviction-hard=""
Sep 16 12:02:14.174066 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168040    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 16 12:02:14.174066 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168044    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 16 12:02:14.174066 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168047    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 16 12:02:14.174066 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168049    2576 flags.go:64] FLAG: --eviction-soft=""
Sep 16 12:02:14.174066 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168052    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 16 12:02:14.174066 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168055    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 16 12:02:14.174066 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168059    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 16 12:02:14.174708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168061    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 16 12:02:14.174708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168064    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 16 12:02:14.174708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168067    2576 flags.go:64] FLAG: --fail-swap-on="true"
Sep 16 12:02:14.174708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168071    2576 flags.go:64] FLAG: --feature-gates=""
Sep 16 12:02:14.174708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168074    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 16 12:02:14.174708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168077    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 16 12:02:14.174708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168080    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 16 12:02:14.174708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168083    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 16 12:02:14.174708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168086    2576 flags.go:64] FLAG: --healthz-port="10248"
Sep 16 12:02:14.174708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168089    2576 flags.go:64] FLAG: --help="false"
Sep 16 12:02:14.174708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168092    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-137-240.ec2.internal"
Sep 16 12:02:14.174708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168095    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 16 12:02:14.174708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168097    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 16 12:02:14.174708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168100    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 16 12:02:14.174708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168103    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 16 12:02:14.174708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168106    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 16 12:02:14.174708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168109    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 16 12:02:14.174708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168112    2576 flags.go:64] FLAG: --image-service-endpoint=""
Sep 16 12:02:14.174708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168114    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 16 12:02:14.174708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168117    2576 flags.go:64] FLAG: --kube-api-burst="100"
Sep 16 12:02:14.174708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168120    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 16 12:02:14.174708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168125    2576 flags.go:64] FLAG: --kube-api-qps="50"
Sep 16 12:02:14.174708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168127    2576 flags.go:64] FLAG: --kube-reserved=""
Sep 16 12:02:14.174708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168130    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 16 12:02:14.175289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168133    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 16 12:02:14.175289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168136    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 16 12:02:14.175289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168138    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 16 12:02:14.175289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168141    2576 flags.go:64] FLAG: --lock-file=""
Sep 16 12:02:14.175289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168144    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 16 12:02:14.175289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168147    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 16 12:02:14.175289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168150    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 16 12:02:14.175289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168155    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 16 12:02:14.175289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168158    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 16 12:02:14.175289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168161    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 16 12:02:14.175289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168164    2576 flags.go:64] FLAG: --logging-format="text"
Sep 16 12:02:14.175289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168168    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 16 12:02:14.175289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168171    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 16 12:02:14.175289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168174    2576 flags.go:64] FLAG: --manifest-url=""
Sep 16 12:02:14.175289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168177    2576 flags.go:64] FLAG: --manifest-url-header=""
Sep 16 12:02:14.175289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168181    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 16 12:02:14.175289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168183    2576 flags.go:64] FLAG: --max-open-files="1000000"
Sep 16 12:02:14.175289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168187    2576 flags.go:64] FLAG: --max-pods="110"
Sep 16 12:02:14.175289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168190    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 16 12:02:14.175289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168193    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 16 12:02:14.175289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168196    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 16 12:02:14.175289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168199    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 16 12:02:14.175289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168201    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 16 12:02:14.175289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168204    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 16 12:02:14.175289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168207    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 16 12:02:14.175919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168215    2576 flags.go:64] FLAG: --node-status-max-images="50"
Sep 16 12:02:14.175919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168218    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 16 12:02:14.175919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168221    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 16 12:02:14.175919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168223    2576 flags.go:64] FLAG: --pod-cidr=""
Sep 16 12:02:14.175919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168227    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 16 12:02:14.175919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168233    2576 flags.go:64] FLAG: --pod-manifest-path=""
Sep 16 12:02:14.175919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168235    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 16 12:02:14.175919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168238    2576 flags.go:64] FLAG: --pods-per-core="0"
Sep 16 12:02:14.175919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168241    2576 flags.go:64] FLAG: --port="10250"
Sep 16 12:02:14.175919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168244    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 16 12:02:14.175919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168247    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07a7f0ff76caafe53"
Sep 16 12:02:14.175919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168250    2576 flags.go:64] FLAG: --qos-reserved=""
Sep 16 12:02:14.175919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168253    2576 flags.go:64] FLAG: --read-only-port="10255"
Sep 16 12:02:14.175919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168256    2576 flags.go:64] FLAG: --register-node="true"
Sep 16 12:02:14.175919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168258    2576 flags.go:64] FLAG: --register-with-taints=""
Sep 16 12:02:14.175919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168262    2576 flags.go:64] FLAG: --registry-burst="10"
Sep 16 12:02:14.175919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168265    2576 flags.go:64] FLAG: --registry-qps="5"
Sep 16 12:02:14.175919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168268    2576 flags.go:64] FLAG: --reserved-cpus=""
Sep 16 12:02:14.175919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168271    2576 flags.go:64] FLAG: --reserved-memory=""
Sep 16 12:02:14.175919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168275    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 16 12:02:14.175919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168278    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 16 12:02:14.175919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168281    2576 flags.go:64] FLAG: --rotate-certificates="false"
Sep 16 12:02:14.175919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168284    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 16 12:02:14.175919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168287    2576 flags.go:64] FLAG: --runonce="false"
Sep 16 12:02:14.175919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168290    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 16 12:02:14.176585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168293    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 16 12:02:14.176585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168296    2576 flags.go:64] FLAG: --seccomp-default="false"
Sep 16 12:02:14.176585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168298    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 16 12:02:14.176585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168301    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 16 12:02:14.176585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168304    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 16 12:02:14.176585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168307    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 16 12:02:14.176585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168324    2576 flags.go:64] FLAG: --storage-driver-password="root"
Sep 16 12:02:14.176585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168328    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 16 12:02:14.176585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168330    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 16 12:02:14.176585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168333    2576 flags.go:64] FLAG: --storage-driver-user="root"
Sep 16 12:02:14.176585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168337    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 16 12:02:14.176585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168341    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 16 12:02:14.176585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168344    2576 flags.go:64] FLAG: --system-cgroups=""
Sep 16 12:02:14.176585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168347    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 16 12:02:14.176585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168352    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 16 12:02:14.176585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168355    2576 flags.go:64] FLAG: --tls-cert-file=""
Sep 16 12:02:14.176585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168358    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 16 12:02:14.176585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168362    2576 flags.go:64] FLAG: --tls-min-version=""
Sep 16 12:02:14.176585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168365    2576 flags.go:64] FLAG: --tls-private-key-file=""
Sep 16 12:02:14.176585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168368    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 16 12:02:14.176585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168370    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 16 12:02:14.176585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168373    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 16 12:02:14.176585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168376    2576 flags.go:64] FLAG: --v="2"
Sep 16 12:02:14.176585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168380    2576 flags.go:64] FLAG: --version="false"
Sep 16 12:02:14.176585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168384    2576 flags.go:64] FLAG: --vmodule=""
Sep 16 12:02:14.177174 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168388    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 16 12:02:14.177174 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.168392    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 16 12:02:14.177174 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168515    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:02:14.177174 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168521    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:02:14.177174 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168524    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:02:14.177174 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168527    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:02:14.177174 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168529    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:02:14.177174 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168532    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:02:14.177174 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168534    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:02:14.177174 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168537    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:02:14.177174 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168540    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:02:14.177174 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168542    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:02:14.177174 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168545    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:02:14.177174 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168547    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:02:14.177174 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168550    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:02:14.177174 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168552    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:02:14.177174 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168555    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:02:14.177174 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168557    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:02:14.177174 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168561    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:02:14.177174 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168564    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:02:14.177685 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168567    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:02:14.177685 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168570    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:02:14.177685 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168572    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:02:14.177685 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168574    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:02:14.177685 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168577    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:02:14.177685 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168579    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:02:14.177685 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168582    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:02:14.177685 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168585    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:02:14.177685 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168587    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:02:14.177685 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168590    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:02:14.177685 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168592    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:02:14.177685 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168594    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:02:14.177685 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168597    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:02:14.177685 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168601    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:02:14.177685 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168604    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:02:14.177685 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168606    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:02:14.177685 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168609    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:02:14.177685 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168611    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:02:14.177685 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168613    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:02:14.178141 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168616    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:02:14.178141 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168618    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:02:14.178141 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168621    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:02:14.178141 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168623    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:02:14.178141 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168626    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:02:14.178141 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168629    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:02:14.178141 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168631    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:02:14.178141 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168634    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:02:14.178141 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168636    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:02:14.178141 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168639    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:02:14.178141 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168641    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:02:14.178141 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168647    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:02:14.178141 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168650    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:02:14.178141 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168652    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:02:14.178141 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168655    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:02:14.178141 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168658    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:02:14.178141 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168660    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:02:14.178141 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168662    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:02:14.178141 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168666    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:02:14.178629 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168670    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:02:14.178629 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168673    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:02:14.178629 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168676    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:02:14.178629 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168678    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:02:14.178629 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168681    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:02:14.178629 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168683    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:02:14.178629 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168685    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:02:14.178629 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168694    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:02:14.178629 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168697    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:02:14.178629 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168700    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:02:14.178629 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168702    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:02:14.178629 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168705    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:02:14.178629 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168707    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:02:14.178629 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168710    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:02:14.178629 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168713    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:02:14.178629 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168715    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:02:14.178629 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168718    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:02:14.178629 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168720    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:02:14.178629 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168723    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:02:14.178629 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168726    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:02:14.178629 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168728    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:02:14.179131 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168731    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:02:14.179131 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168733    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:02:14.179131 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168737    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:02:14.179131 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168741    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:02:14.179131 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168745    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:02:14.179131 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168748    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:02:14.179131 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168751    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:02:14.179131 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168753    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:02:14.179131 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168756    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:02:14.179131 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168758    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:02:14.179131 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168761    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:02:14.179131 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168763    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:02:14.179131 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168766    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:02:14.179131 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168768    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:02:14.179131 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168771    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:02:14.179131 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168773    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:02:14.179131 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168777    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:02:14.179131 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168780    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:02:14.179131 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168784    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:02:14.179633 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168790    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:02:14.179633 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168793    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:02:14.179633 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.168795    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:02:14.179633 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.169426    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 12:02:14.179633 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.177558    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 16 12:02:14.179633 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.177574    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 16 12:02:14.179633 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.178477    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 16 12:02:14.179633 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.178485    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 16 12:02:14.179633 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178551    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:02:14.179633 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178556    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:02:14.179633 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178560    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:02:14.179633 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178563    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:02:14.179633 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178566    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:02:14.179633 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178568    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:02:14.179982 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178571    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:02:14.179982 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178574    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:02:14.179982 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178576    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:02:14.179982 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178579    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:02:14.179982 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178582    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:02:14.179982 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178584    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:02:14.179982 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178587    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:02:14.179982 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178589    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:02:14.179982 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178591    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:02:14.179982 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178594    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:02:14.179982 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178597    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:02:14.179982 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178599    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:02:14.179982 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178602    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:02:14.179982 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178605    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:02:14.179982 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178608    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:02:14.179982 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178610    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:02:14.179982 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178613    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:02:14.179982 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178615    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:02:14.179982 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178618    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:02:14.179982 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178620    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:02:14.180483 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178623    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:02:14.180483 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178625    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:02:14.180483 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178628    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:02:14.180483 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178631    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:02:14.180483 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178634    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:02:14.180483 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178637    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:02:14.180483 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178640    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:02:14.180483 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178642    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:02:14.180483 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178645    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:02:14.180483 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178647    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:02:14.180483 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178650    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:02:14.180483 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178654    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:02:14.180483 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178658    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:02:14.180483 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178661    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:02:14.180483 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178664    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:02:14.180483 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178666    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:02:14.180483 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178669    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:02:14.180483 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178671    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:02:14.180483 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178674    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:02:14.180947 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178677    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:02:14.180947 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178680    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:02:14.180947 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178682    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:02:14.180947 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178686    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:02:14.180947 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178690    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:02:14.180947 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178693    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:02:14.180947 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178695    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:02:14.180947 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178698    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:02:14.180947 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178700    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:02:14.180947 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178703    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:02:14.180947 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178705    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:02:14.180947 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178708    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:02:14.180947 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178710    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:02:14.180947 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178713    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:02:14.180947 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178715    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:02:14.180947 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178718    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:02:14.180947 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178721    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:02:14.180947 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178724    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:02:14.180947 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178727    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:02:14.180947 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178729    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:02:14.181434 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178732    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:02:14.181434 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178734    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:02:14.181434 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178737    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:02:14.181434 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178740    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:02:14.181434 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178742    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:02:14.181434 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178744    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:02:14.181434 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178747    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:02:14.181434 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178749    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:02:14.181434 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178752    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:02:14.181434 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178754    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:02:14.181434 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178757    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:02:14.181434 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178759    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:02:14.181434 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178761    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:02:14.181434 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178764    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:02:14.181434 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178768    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:02:14.181434 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178772    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:02:14.181434 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178774    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:02:14.181434 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178777    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:02:14.181434 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178780    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:02:14.181434 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178782    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:02:14.181945 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178784    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:02:14.181945 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178787    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:02:14.181945 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178789    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:02:14.181945 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178792    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:02:14.181945 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178794    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:02:14.181945 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178797    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:02:14.181945 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178799    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:02:14.181945 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178802    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:02:14.181945 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178805    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:02:14.181945 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178808    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:02:14.181945 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178810    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:02:14.181945 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178813    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:02:14.181945 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178815    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:02:14.181945 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178818    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:02:14.181945 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.178823    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 12:02:14.182398 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178944    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:02:14.182398 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178949    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:02:14.182398 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178952    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:02:14.182398 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178955    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:02:14.182398 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178958    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:02:14.182398 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178960    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:02:14.182398 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178963    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:02:14.182398 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178965    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:02:14.182398 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178968    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:02:14.182398 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178971    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:02:14.182398 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178974    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:02:14.182398 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178976    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:02:14.182398 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178979    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:02:14.182398 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178981    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:02:14.182398 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178984    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:02:14.182398 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178986    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:02:14.182398 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178989    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:02:14.182398 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178992    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:02:14.182398 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178994    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:02:14.182398 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178997    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:02:14.182874 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.178999    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:02:14.182874 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179002    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:02:14.182874 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179004    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:02:14.182874 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179007    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:02:14.182874 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179009    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:02:14.182874 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179012    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:02:14.182874 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179014    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:02:14.182874 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179016    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:02:14.182874 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179019    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:02:14.182874 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179023    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:02:14.182874 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179027    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:02:14.182874 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179029    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:02:14.182874 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179032    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:02:14.182874 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179034    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:02:14.182874 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179037    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:02:14.182874 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179039    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:02:14.182874 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179042    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:02:14.182874 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179044    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:02:14.182874 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179047    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:02:14.183331 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179051    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:02:14.183331 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179053    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:02:14.183331 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179056    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:02:14.183331 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179058    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:02:14.183331 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179060    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:02:14.183331 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179063    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:02:14.183331 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179065    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:02:14.183331 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179068    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:02:14.183331 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179070    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:02:14.183331 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179073    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:02:14.183331 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179076    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:02:14.183331 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179078    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:02:14.183331 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179081    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:02:14.183331 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179083    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:02:14.183331 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179086    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:02:14.183331 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179088    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:02:14.183331 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179090    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:02:14.183331 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179093    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:02:14.183331 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179096    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:02:14.183331 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179098    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:02:14.183807 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179101    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:02:14.183807 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179103    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:02:14.183807 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179106    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:02:14.183807 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179109    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:02:14.183807 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179111    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:02:14.183807 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179113    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:02:14.183807 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179116    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:02:14.183807 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179118    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:02:14.183807 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179121    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:02:14.183807 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179123    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:02:14.183807 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179126    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:02:14.183807 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179128    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:02:14.183807 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179130    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:02:14.183807 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179133    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:02:14.183807 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179135    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:02:14.183807 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179138    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:02:14.183807 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179141    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:02:14.183807 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179143    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:02:14.183807 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179146    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:02:14.183807 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179148    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:02:14.184273 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179151    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:02:14.184273 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179154    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:02:14.184273 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179156    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:02:14.184273 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179158    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:02:14.184273 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179161    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:02:14.184273 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179163    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:02:14.184273 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179167    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:02:14.184273 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179170    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:02:14.184273 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179173    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:02:14.184273 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179176    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:02:14.184273 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179179    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:02:14.184273 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179181    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:02:14.184273 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179183    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:02:14.184273 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179186    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:02:14.184273 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179188    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:02:14.184273 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179191    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:02:14.184273 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179194    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:02:14.184273 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179196    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:02:14.184273 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179198    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:02:14.184740 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:14.179201    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:02:14.184740 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.179206    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 12:02:14.184740 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.179307    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 16 12:02:14.184740 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.181701    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 16 12:02:14.184740 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.182806    2576 server.go:1019] "Starting client certificate rotation"
Sep 16 12:02:14.184740 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.182903    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 12:02:14.184740 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.182968    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 12:02:14.185614 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.185600    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 12:02:14.187779 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.186800    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 12:02:14.198672 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.198650    2576 log.go:25] "Validated CRI v1 runtime API"
Sep 16 12:02:14.203073 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.203060    2576 log.go:25] "Validated CRI v1 image API"
Sep 16 12:02:14.203983 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.203965    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 16 12:02:14.206707 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.206682    2576 fs.go:135] Filesystem UUIDs: map[35774e4f-31cb-4109-9493-c489fdd2ab5e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 94d1bd8e-938b-4a1e-9aef-01b23ce399c4:/dev/nvme0n1p3]
Sep 16 12:02:14.206775 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.206701    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 16 12:02:14.211735 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.211600    2576 manager.go:216] Machine: {Timestamp:2026-09-16 12:02:14.210340787 +0000 UTC m=+0.379305484 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3046664 MemoryCapacity:32812150784 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e5eb18f4f7a0afa74e8fa06958141 SystemUUID:ec2e5eb1-8f4f-7a0a-fa74-e8fa06958141 BootID:32a111bf-5014-44d5-8cdc-f7367ddf496c Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:ee:91:f3:af Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:ee:91:f3:af Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:84:2d:28:be:b7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812150784 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 16 12:02:14.211735 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.211729    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 16 12:02:14.211864 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.211834    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 16 12:02:14.213020 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.212997    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 16 12:02:14.213182 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.213022    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-240.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 16 12:02:14.213550 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.213534    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 12:02:14.214631 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.214619    2576 topology_manager.go:138] "Creating topology manager with none policy"
Sep 16 12:02:14.214676 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.214634    2576 container_manager_linux.go:309] "Creating device plugin manager"
Sep 16 12:02:14.214676 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.214642    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 12:02:14.215482 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.215471    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 12:02:14.216751 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.216741    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 16 12:02:14.221387 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.221376    2576 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 12:02:14.221504 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.221495    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 16 12:02:14.221541 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.221528    2576 kubelet.go:486] "Attempting to sync node with API server"
Sep 16 12:02:14.221577 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.221542    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 16 12:02:14.221577 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.221555    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 16 12:02:14.221577 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.221564    2576 kubelet.go:398] "Adding apiserver pod source"
Sep 16 12:02:14.221577 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.221573    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 16 12:02:14.221940 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.221928    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 12:02:14.221973 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.221953    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 12:02:14.227192 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.227171    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 16 12:02:14.237416 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.231638    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 16 12:02:14.237416 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.231666    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 16 12:02:14.237416 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:14.232071    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-240.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 16 12:02:14.237416 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:14.232102    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 16 12:02:14.237416 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.233702    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 16 12:02:14.237416 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.233716    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 16 12:02:14.237416 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.233722    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 16 12:02:14.237416 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.233728    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 16 12:02:14.237416 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.233736    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 16 12:02:14.237416 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.233742    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 16 12:02:14.237416 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.233755    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 16 12:02:14.237416 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.233760    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 16 12:02:14.237416 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.233768    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 16 12:02:14.237416 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.233773    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 16 12:02:14.237416 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.233786    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 16 12:02:14.237416 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.233791    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 16 12:02:14.237416 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.234664    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 16 12:02:14.237416 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.234677    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 16 12:02:14.237416 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.237398    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-240.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 16 12:02:14.238628 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.238614    2576 server.go:1268] "Started kubelet"
Sep 16 12:02:14.238717 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.238690    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 16 12:02:14.238776 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.238708    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 16 12:02:14.238840 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.238793    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 16 12:02:14.240588 ip-10-0-137-240 systemd[1]: Started Kubernetes Kubelet.
Sep 16 12:02:14.242159 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.241460    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 16 12:02:14.242159 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.242135    2576 server.go:310] "Adding debug handlers to kubelet server"
Sep 16 12:02:14.243767 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:14.243745    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 16 12:02:14.244401 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.244384    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cvbqp"
Sep 16 12:02:14.249721 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.249704    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 16 12:02:14.250508 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.250493    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 16 12:02:14.250769 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:14.250744    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-240.ec2.internal\" not found"
Sep 16 12:02:14.251254 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.251233    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 16 12:02:14.251364 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.251307    2576 factory.go:55] Registering systemd factory
Sep 16 12:02:14.251364 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.251343    2576 factory.go:223] Registration of the systemd container factory successfully
Sep 16 12:02:14.251449 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.251237    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 16 12:02:14.251500 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.251464    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 16 12:02:14.251570 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.251558    2576 factory.go:153] Registering CRI-O factory
Sep 16 12:02:14.251623 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.251573    2576 factory.go:223] Registration of the crio container factory successfully
Sep 16 12:02:14.251623 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.251580    2576 reconstruct.go:97] "Volume reconstruction finished"
Sep 16 12:02:14.251623 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.251588    2576 reconciler.go:29] "Reconciler: start to sync state"
Sep 16 12:02:14.251741 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.251664    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 16 12:02:14.251741 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.251690    2576 factory.go:103] Registering Raw factory
Sep 16 12:02:14.251741 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.251704    2576 manager.go:1196] Started watching for new ooms in manager
Sep 16 12:02:14.252024 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.252010    2576 manager.go:349] Starting recovery of all containers
Sep 16 12:02:14.252701 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.252678    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cvbqp"
Sep 16 12:02:14.259910 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.259885    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:02:14.261898 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.261883    2576 manager.go:354] Recovery completed
Sep 16 12:02:14.262217 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:14.262189    2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-240.ec2.internal\" not found" node="ip-10-0-137-240.ec2.internal"
Sep 16 12:02:14.266228 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.266211    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:02:14.267926 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.267905    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-240.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:02:14.267995 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.267947    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-240.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:02:14.267995 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.267959    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-240.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:02:14.268916 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.268901    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 16 12:02:14.268916 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.268914    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 16 12:02:14.269047 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.268933    2576 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 12:02:14.269047 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.268945    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:02:14.269852 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.269836    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-240.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:02:14.269939 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.269864    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-240.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:02:14.269939 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.269874    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-240.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:02:14.270964 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.270952    2576 policy_none.go:49] "None policy: Start"
Sep 16 12:02:14.270996 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.270968    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 16 12:02:14.270996 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.270979    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 16 12:02:14.272919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.272908    2576 policy_none.go:47] "Start"
Sep 16 12:02:14.315948 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.315928    2576 manager.go:337] "Starting Device Plugin manager"
Sep 16 12:02:14.336296 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:14.315967    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 16 12:02:14.336296 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.315977    2576 server.go:87] "Starting device plugin registration server"
Sep 16 12:02:14.336296 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.316258    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 16 12:02:14.336296 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.316269    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 16 12:02:14.336296 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.316370    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 16 12:02:14.336296 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.316454    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 16 12:02:14.336296 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.316463    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 16 12:02:14.336296 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:14.316984    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 16 12:02:14.336296 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:14.317029    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-240.ec2.internal\" not found"
Sep 16 12:02:14.385370 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.385339    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 16 12:02:14.386613 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.386593    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 16 12:02:14.386707 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.386641    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 16 12:02:14.386707 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.386663    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 16 12:02:14.386707 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:14.386698    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 16 12:02:14.388487 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.388471    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:02:14.416715 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.416692    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:02:14.417576 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.417561    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-240.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:02:14.417625 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.417594    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-240.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:02:14.417625 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.417604    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-240.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:02:14.417694 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.417627    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-240.ec2.internal"
Sep 16 12:02:14.426537 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.426522    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-240.ec2.internal"
Sep 16 12:02:14.426608 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:14.426543    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-240.ec2.internal\": node \"ip-10-0-137-240.ec2.internal\" not found"
Sep 16 12:02:14.443114 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:14.443097    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-240.ec2.internal\" not found"
Sep 16 12:02:14.487433 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.487396    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-240.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-240.ec2.internal"]
Sep 16 12:02:14.487529 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.487477    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:02:14.488892 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.488877    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-240.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:02:14.488969 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.488906    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-240.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:02:14.488969 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.488915    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-240.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:02:14.491221 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.491209    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:02:14.491374 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.491358    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-240.ec2.internal"
Sep 16 12:02:14.491429 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.491389    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:02:14.491939 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.491924    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-240.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:02:14.492017 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.491950    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-240.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:02:14.492017 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.491966    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-240.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:02:14.492017 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.491928    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-240.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:02:14.492155 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.492020    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-240.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:02:14.492155 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.492031    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-240.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:02:14.494987 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.494968    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-240.ec2.internal"
Sep 16 12:02:14.495090 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.495000    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:02:14.495739 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.495725    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-240.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:02:14.495791 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.495748    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-240.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:02:14.495791 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.495759    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-240.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:02:14.514018 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:14.514002    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-240.ec2.internal\" not found" node="ip-10-0-137-240.ec2.internal"
Sep 16 12:02:14.518386 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:14.518372    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-240.ec2.internal\" not found" node="ip-10-0-137-240.ec2.internal"
Sep 16 12:02:14.543670 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:14.543652    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-240.ec2.internal\" not found"
Sep 16 12:02:14.552756 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.552737    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/780080cf4361c8479ffff1f797551d43-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-240.ec2.internal\" (UID: \"780080cf4361c8479ffff1f797551d43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-240.ec2.internal"
Sep 16 12:02:14.552807 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.552761    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a9435f0d3784aef4bb9e6f27c49dafc3-config\") pod \"kube-apiserver-proxy-ip-10-0-137-240.ec2.internal\" (UID: \"a9435f0d3784aef4bb9e6f27c49dafc3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-240.ec2.internal"
Sep 16 12:02:14.552807 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.552775    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/780080cf4361c8479ffff1f797551d43-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-240.ec2.internal\" (UID: \"780080cf4361c8479ffff1f797551d43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-240.ec2.internal"
Sep 16 12:02:14.644228 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:14.644158    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-240.ec2.internal\" not found"
Sep 16 12:02:14.653500 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.653481    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a9435f0d3784aef4bb9e6f27c49dafc3-config\") pod \"kube-apiserver-proxy-ip-10-0-137-240.ec2.internal\" (UID: \"a9435f0d3784aef4bb9e6f27c49dafc3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-240.ec2.internal"
Sep 16 12:02:14.653554 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.653518    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/780080cf4361c8479ffff1f797551d43-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-240.ec2.internal\" (UID: \"780080cf4361c8479ffff1f797551d43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-240.ec2.internal"
Sep 16 12:02:14.653554 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.653527    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a9435f0d3784aef4bb9e6f27c49dafc3-config\") pod \"kube-apiserver-proxy-ip-10-0-137-240.ec2.internal\" (UID: \"a9435f0d3784aef4bb9e6f27c49dafc3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-240.ec2.internal"
Sep 16 12:02:14.653554 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.653537    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/780080cf4361c8479ffff1f797551d43-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-240.ec2.internal\" (UID: \"780080cf4361c8479ffff1f797551d43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-240.ec2.internal"
Sep 16 12:02:14.653654 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.653570    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/780080cf4361c8479ffff1f797551d43-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-240.ec2.internal\" (UID: \"780080cf4361c8479ffff1f797551d43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-240.ec2.internal"
Sep 16 12:02:14.653654 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.653579    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/780080cf4361c8479ffff1f797551d43-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-240.ec2.internal\" (UID: \"780080cf4361c8479ffff1f797551d43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-240.ec2.internal"
Sep 16 12:02:14.744941 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:14.744899    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-240.ec2.internal\" not found"
Sep 16 12:02:14.816490 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.816460    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-240.ec2.internal"
Sep 16 12:02:14.821883 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:14.821280    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-240.ec2.internal"
Sep 16 12:02:14.845900 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:14.845879    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-240.ec2.internal\" not found"
Sep 16 12:02:14.946484 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:14.946424    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-240.ec2.internal\" not found"
Sep 16 12:02:15.046926 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:15.046886    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-240.ec2.internal\" not found"
Sep 16 12:02:15.147438 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:15.147406    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-240.ec2.internal\" not found"
Sep 16 12:02:15.182836 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:15.182821    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 16 12:02:15.183192 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:15.182955    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 12:02:15.183192 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:15.182959    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 12:02:15.248269 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:15.248220    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-240.ec2.internal\" not found"
Sep 16 12:02:15.256996 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:15.256964    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 11:57:14 +0000 UTC" deadline="2028-06-20 13:17:05.900286498 +0000 UTC"
Sep 16 12:02:15.256996 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:15.256994    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15433h14m50.643295087s"
Sep 16 12:02:15.275020 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:15.274999    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:02:15.349195 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:15.349170    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-240.ec2.internal\" not found"
Sep 16 12:02:15.449822 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:15.449583    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-240.ec2.internal\" not found"
Sep 16 12:02:15.550218 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:15.550188    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-240.ec2.internal\" not found"
Sep 16 12:02:15.579930 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:15.579897    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod780080cf4361c8479ffff1f797551d43.slice/crio-b94666e08d62aef5220b072c7fc02d9a0f32b5ffc8e7ea1fcfd945dc615e4b21 WatchSource:0}: Error finding container b94666e08d62aef5220b072c7fc02d9a0f32b5ffc8e7ea1fcfd945dc615e4b21: Status 404 returned error can't find the container with id b94666e08d62aef5220b072c7fc02d9a0f32b5ffc8e7ea1fcfd945dc615e4b21
Sep 16 12:02:15.585369 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:15.585353    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 12:02:15.651639 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:15.651596    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-240.ec2.internal\" not found"
Sep 16 12:02:15.697623 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:15.697596    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9435f0d3784aef4bb9e6f27c49dafc3.slice/crio-bc0028f72dd34eb0a16be7148cb9bd8a06974e86b3056d3d6aa69193258551f9 WatchSource:0}: Error finding container bc0028f72dd34eb0a16be7148cb9bd8a06974e86b3056d3d6aa69193258551f9: Status 404 returned error can't find the container with id bc0028f72dd34eb0a16be7148cb9bd8a06974e86b3056d3d6aa69193258551f9
Sep 16 12:02:15.752478 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:15.752429    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-240.ec2.internal\" not found"
Sep 16 12:02:15.794659 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:15.794599    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:02:15.855253 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:15.855218    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-240.ec2.internal"
Sep 16 12:02:15.865688 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:15.865669    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 12:02:15.866522 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:15.866509    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-240.ec2.internal"
Sep 16 12:02:15.878478 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:15.878460    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 12:02:16.222361 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.222329    2576 apiserver.go:52] "Watching apiserver"
Sep 16 12:02:16.230186 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.230154    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 16 12:02:16.232467 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.232445    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-zjz4j","openshift-multus/network-metrics-daemon-wc55w","openshift-network-diagnostics/network-check-target-7ff2t","openshift-network-operator/iptables-alerter-dnd6x","openshift-ovn-kubernetes/ovnkube-node-tb7dg","kube-system/kube-apiserver-proxy-ip-10-0-137-240.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4","openshift-cluster-node-tuning-operator/tuned-7dlf8","openshift-dns/node-resolver-njgng","openshift-image-registry/node-ca-5kmrr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-240.ec2.internal","openshift-multus/multus-additional-cni-plugins-htz2b","openshift-multus/multus-hcflr","kube-system/global-pull-secret-syncer-f2cw4"]
Sep 16 12:02:16.237087 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.237060    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4"
Sep 16 12:02:16.239362 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.239343    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.239866 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.239841    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 16 12:02:16.240081 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.240063    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 16 12:02:16.240159 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.240087    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kk577\""
Sep 16 12:02:16.240217 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.240199    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 16 12:02:16.241687 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.241668    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 16 12:02:16.241951 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.241929    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 16 12:02:16.241951 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.241942    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 16 12:02:16.242483 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.242297    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:16.242483 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.242364    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 16 12:02:16.242483 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.242380    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tdx8w\""
Sep 16 12:02:16.242483 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:16.242391    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ff2t" podUID="3d17e8cd-157a-49a4-9c05-cd1e15a8ef11"
Sep 16 12:02:16.244731 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.244713    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dnd6x"
Sep 16 12:02:16.247176 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.247148    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.247421 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.247302    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 16 12:02:16.247621 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.247606    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tf62w\""
Sep 16 12:02:16.247677 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.247653    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 16 12:02:16.247733 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.247718    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 16 12:02:16.249732 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.249712    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:16.249802 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:16.249780    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2cw4" podUID="adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa"
Sep 16 12:02:16.250215 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.250200    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 16 12:02:16.251748 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.251727    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 16 12:02:16.252042 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.252023    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 16 12:02:16.252175 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.252161    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-njgng"
Sep 16 12:02:16.253311 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.253116    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rbr8r\""
Sep 16 12:02:16.253311 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.253133    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 16 12:02:16.253311 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.253176    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 16 12:02:16.253311 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.253200    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 16 12:02:16.253591 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.253383    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 16 12:02:16.253656 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.253612    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:02:16.254496 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.254479    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 16 12:02:16.254496 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.254494    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 16 12:02:16.254646 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.254564    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wkfhq\""
Sep 16 12:02:16.254742 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.254710    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zjz4j"
Sep 16 12:02:16.257089 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.257020    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 16 12:02:16.257279 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.257256    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:16.257384 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:16.257347    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wc55w" podUID="acdb4981-6d20-4436-8bd4-b45d51990f22"
Sep 16 12:02:16.258131 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.258114    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vmkrn\""
Sep 16 12:02:16.258207 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.258137    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 16 12:02:16.259698 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.259681    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5kmrr"
Sep 16 12:02:16.260608 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.260593    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-dbus\") pod \"global-pull-secret-syncer-f2cw4\" (UID: \"adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa\") " pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:16.260847 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.260814    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3db0bb13-5776-4486-8cfb-c0a94ac46e7d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7znf4\" (UID: \"3db0bb13-5776-4486-8cfb-c0a94ac46e7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4"
Sep 16 12:02:16.260924 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.260872    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-cnibin\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.261020 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.260993    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-host-run-k8s-cni-cncf-io\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.261120 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.261044    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-systemd-units\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.261120 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.261111    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-node-log\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.261226 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.261174    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-kubelet-config\") pod \"global-pull-secret-syncer-f2cw4\" (UID: \"adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa\") " pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:16.261285 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.261250    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-multus-daemon-config\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.261382 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.261358    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3db0bb13-5776-4486-8cfb-c0a94ac46e7d-registration-dir\") pod \"aws-ebs-csi-driver-node-7znf4\" (UID: \"3db0bb13-5776-4486-8cfb-c0a94ac46e7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4"
Sep 16 12:02:16.261443 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.261425    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-multus-socket-dir-parent\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.261491 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.261464    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-host-var-lib-cni-multus\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.261546 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.261517    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cflxm\" (UniqueName: \"kubernetes.io/projected/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-kube-api-access-cflxm\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.261598 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.261553    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa718227-1ca3-4c74-9a18-39bc115f912e-host-slash\") pod \"iptables-alerter-dnd6x\" (UID: \"fa718227-1ca3-4c74-9a18-39bc115f912e\") " pod="openshift-network-operator/iptables-alerter-dnd6x"
Sep 16 12:02:16.261598 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.261584    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdhfv\" (UniqueName: \"kubernetes.io/projected/fa718227-1ca3-4c74-9a18-39bc115f912e-kube-api-access-tdhfv\") pod \"iptables-alerter-dnd6x\" (UID: \"fa718227-1ca3-4c74-9a18-39bc115f912e\") " pod="openshift-network-operator/iptables-alerter-dnd6x"
Sep 16 12:02:16.261693 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.261610    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-host-kubelet\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.261693 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.261679    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3db0bb13-5776-4486-8cfb-c0a94ac46e7d-socket-dir\") pod \"aws-ebs-csi-driver-node-7znf4\" (UID: \"3db0bb13-5776-4486-8cfb-c0a94ac46e7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4"
Sep 16 12:02:16.261786 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.261713    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3db0bb13-5776-4486-8cfb-c0a94ac46e7d-device-dir\") pod \"aws-ebs-csi-driver-node-7znf4\" (UID: \"3db0bb13-5776-4486-8cfb-c0a94ac46e7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4"
Sep 16 12:02:16.261786 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.261746    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5db11b86-96e5-48c8-84cc-174c9d8f5afe-tmp-dir\") pod \"node-resolver-njgng\" (UID: \"5db11b86-96e5-48c8-84cc-174c9d8f5afe\") " pod="openshift-dns/node-resolver-njgng"
Sep 16 12:02:16.261786 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.261777    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-etc-kubernetes\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.261921 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.261802    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-var-lib-openvswitch\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.261921 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.261833    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-run-openvswitch\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.261921 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.261865    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-host-cni-bin\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.262060 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.261965    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-host-cni-netd\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.262060 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262008    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86nth\" (UniqueName: \"kubernetes.io/projected/3d17e8cd-157a-49a4-9c05-cd1e15a8ef11-kube-api-access-86nth\") pod \"network-check-target-7ff2t\" (UID: \"3d17e8cd-157a-49a4-9c05-cd1e15a8ef11\") " pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:16.262060 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262039    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-host-var-lib-kubelet\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.262201 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262075    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-hostroot\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.262201 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262105    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-host-slash\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.262201 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262128    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-run-systemd\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.262201 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262160    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb6b35a8-78d4-40b2-a087-7b45e92b2234-ovn-node-metrics-cert\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.262201 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262190    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb6b35a8-78d4-40b2-a087-7b45e92b2234-ovnkube-script-lib\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.262490 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262228    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-run-ovn\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.262490 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262255    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-log-socket\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.262490 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262280    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb6b35a8-78d4-40b2-a087-7b45e92b2234-env-overrides\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.262490 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262311    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-original-pull-secret\") pod \"global-pull-secret-syncer-f2cw4\" (UID: \"adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa\") " pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:16.262490 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262476    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-host-run-multus-certs\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.262771 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262517    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3db0bb13-5776-4486-8cfb-c0a94ac46e7d-sys-fs\") pod \"aws-ebs-csi-driver-node-7znf4\" (UID: \"3db0bb13-5776-4486-8cfb-c0a94ac46e7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4"
Sep 16 12:02:16.262771 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262548    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5db11b86-96e5-48c8-84cc-174c9d8f5afe-hosts-file\") pod \"node-resolver-njgng\" (UID: \"5db11b86-96e5-48c8-84cc-174c9d8f5afe\") " pod="openshift-dns/node-resolver-njgng"
Sep 16 12:02:16.262771 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262578    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-system-cni-dir\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.262771 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262607    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-cni-binary-copy\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.262771 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262635    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-host-run-netns\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.262771 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262667    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-host-var-lib-cni-bin\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.262771 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262701    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa718227-1ca3-4c74-9a18-39bc115f912e-iptables-alerter-script\") pod \"iptables-alerter-dnd6x\" (UID: \"fa718227-1ca3-4c74-9a18-39bc115f912e\") " pod="openshift-network-operator/iptables-alerter-dnd6x"
Sep 16 12:02:16.262771 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262738    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrkb9\" (UniqueName: \"kubernetes.io/projected/3db0bb13-5776-4486-8cfb-c0a94ac46e7d-kube-api-access-mrkb9\") pod \"aws-ebs-csi-driver-node-7znf4\" (UID: \"3db0bb13-5776-4486-8cfb-c0a94ac46e7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4"
Sep 16 12:02:16.263130 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262769    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7qwm\" (UniqueName: \"kubernetes.io/projected/5db11b86-96e5-48c8-84cc-174c9d8f5afe-kube-api-access-w7qwm\") pod \"node-resolver-njgng\" (UID: \"5db11b86-96e5-48c8-84cc-174c9d8f5afe\") " pod="openshift-dns/node-resolver-njgng"
Sep 16 12:02:16.263130 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262807    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-multus-cni-dir\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.263130 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262839    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-multus-conf-dir\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.263130 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262865    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-etc-openvswitch\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.263130 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262896    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-host-run-ovn-kubernetes\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.263130 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262927    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.263130 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262960    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3db0bb13-5776-4486-8cfb-c0a94ac46e7d-etc-selinux\") pod \"aws-ebs-csi-driver-node-7znf4\" (UID: \"3db0bb13-5776-4486-8cfb-c0a94ac46e7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4"
Sep 16 12:02:16.263130 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.262990    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-host-run-netns\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.263130 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.263017    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb6b35a8-78d4-40b2-a087-7b45e92b2234-ovnkube-config\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.263130 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.263048    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r56pw\" (UniqueName: \"kubernetes.io/projected/fb6b35a8-78d4-40b2-a087-7b45e92b2234-kube-api-access-r56pw\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.263931 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.263911    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.265524 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.265273    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 16 12:02:16.265524 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.265286    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 16 12:02:16.265524 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.265392    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2n2n7\""
Sep 16 12:02:16.265881 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.265858    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-htz2b"
Sep 16 12:02:16.266161 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.266141    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 16 12:02:16.266528 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.266513    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 16 12:02:16.266700 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.266680    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xsmws\""
Sep 16 12:02:16.266784 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.266738    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 16 12:02:16.268126 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.268106    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 16 12:02:16.268367 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.268350    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-444nq\""
Sep 16 12:02:16.268469 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.268372    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 16 12:02:16.270744 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.270713    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 12:02:16.298435 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.298411    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mc4cw"
Sep 16 12:02:16.307054 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.307036    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mc4cw"
Sep 16 12:02:16.352979 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.352945    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 16 12:02:16.363867 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.363839    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-systemd-units\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.364017 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.363875    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-node-log\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.364017 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.363900    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-kubelet-config\") pod \"global-pull-secret-syncer-f2cw4\" (UID: \"adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa\") " pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:16.364017 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.363919    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-etc-systemd\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.364017 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.363938    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cmdj\" (UniqueName: \"kubernetes.io/projected/f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2-kube-api-access-7cmdj\") pod \"multus-additional-cni-plugins-htz2b\" (UID: \"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2\") " pod="openshift-multus/multus-additional-cni-plugins-htz2b"
Sep 16 12:02:16.364017 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.363955    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-systemd-units\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.364017 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.363964    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/43306d34-2366-4ca1-b63b-1362b9495ee9-agent-certs\") pod \"konnectivity-agent-zjz4j\" (UID: \"43306d34-2366-4ca1-b63b-1362b9495ee9\") " pod="kube-system/konnectivity-agent-zjz4j"
Sep 16 12:02:16.364017 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364012    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-node-log\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.364017 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364015    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3db0bb13-5776-4486-8cfb-c0a94ac46e7d-registration-dir\") pod \"aws-ebs-csi-driver-node-7znf4\" (UID: \"3db0bb13-5776-4486-8cfb-c0a94ac46e7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4"
Sep 16 12:02:16.364406 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364038    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-multus-socket-dir-parent\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.364406 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364059    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3db0bb13-5776-4486-8cfb-c0a94ac46e7d-registration-dir\") pod \"aws-ebs-csi-driver-node-7znf4\" (UID: \"3db0bb13-5776-4486-8cfb-c0a94ac46e7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4"
Sep 16 12:02:16.364406 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364085    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-host-var-lib-cni-multus\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.364406 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364110    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cflxm\" (UniqueName: \"kubernetes.io/projected/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-kube-api-access-cflxm\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.364406 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364115    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-kubelet-config\") pod \"global-pull-secret-syncer-f2cw4\" (UID: \"adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa\") " pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:16.364406 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364136    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-run-openvswitch\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.364406 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364169    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-etc-kubernetes\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.364406 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364206    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-etc-sysctl-d\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.364406 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364229    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-lib-modules\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.364406 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364232    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-multus-socket-dir-parent\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.364406 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364268    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3db0bb13-5776-4486-8cfb-c0a94ac46e7d-socket-dir\") pod \"aws-ebs-csi-driver-node-7znf4\" (UID: \"3db0bb13-5776-4486-8cfb-c0a94ac46e7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4"
Sep 16 12:02:16.364406 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364278    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-host-var-lib-cni-multus\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.364406 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364297    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3db0bb13-5776-4486-8cfb-c0a94ac46e7d-device-dir\") pod \"aws-ebs-csi-driver-node-7znf4\" (UID: \"3db0bb13-5776-4486-8cfb-c0a94ac46e7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4"
Sep 16 12:02:16.364406 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364325    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5db11b86-96e5-48c8-84cc-174c9d8f5afe-tmp-dir\") pod \"node-resolver-njgng\" (UID: \"5db11b86-96e5-48c8-84cc-174c9d8f5afe\") " pod="openshift-dns/node-resolver-njgng"
Sep 16 12:02:16.364406 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364349    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-etc-kubernetes\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.364406 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364374    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-host-cni-bin\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.364962 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364424    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2-system-cni-dir\") pod \"multus-additional-cni-plugins-htz2b\" (UID: \"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2\") " pod="openshift-multus/multus-additional-cni-plugins-htz2b"
Sep 16 12:02:16.364962 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364456    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86nth\" (UniqueName: \"kubernetes.io/projected/3d17e8cd-157a-49a4-9c05-cd1e15a8ef11-kube-api-access-86nth\") pod \"network-check-target-7ff2t\" (UID: \"3d17e8cd-157a-49a4-9c05-cd1e15a8ef11\") " pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:16.364962 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364483    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-hostroot\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.364962 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364510    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-host-slash\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.364962 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364535    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-run-systemd\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.364962 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364559    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-etc-modprobe-d\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.364962 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364583    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-etc-sysconfig\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.364962 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364610    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-log-socket\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.364962 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364637    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-original-pull-secret\") pod \"global-pull-secret-syncer-f2cw4\" (UID: \"adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa\") " pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:16.364962 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364662    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5db11b86-96e5-48c8-84cc-174c9d8f5afe-hosts-file\") pod \"node-resolver-njgng\" (UID: \"5db11b86-96e5-48c8-84cc-174c9d8f5afe\") " pod="openshift-dns/node-resolver-njgng"
Sep 16 12:02:16.364962 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364687    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-host-run-netns\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.364962 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364719    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-host-var-lib-cni-bin\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.364962 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364748    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.364962 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364775    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-htz2b\" (UID: \"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2\") " pod="openshift-multus/multus-additional-cni-plugins-htz2b"
Sep 16 12:02:16.364962 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364801    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-htz2b\" (UID: \"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2\") " pod="openshift-multus/multus-additional-cni-plugins-htz2b"
Sep 16 12:02:16.364962 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364829    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7qwm\" (UniqueName: \"kubernetes.io/projected/5db11b86-96e5-48c8-84cc-174c9d8f5afe-kube-api-access-w7qwm\") pod \"node-resolver-njgng\" (UID: \"5db11b86-96e5-48c8-84cc-174c9d8f5afe\") " pod="openshift-dns/node-resolver-njgng"
Sep 16 12:02:16.364962 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364854    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-multus-conf-dir\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.365574 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364881    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-host-run-ovn-kubernetes\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.365574 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364920    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb6b35a8-78d4-40b2-a087-7b45e92b2234-ovnkube-config\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.365574 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364937    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-host-run-ovn-kubernetes\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.365574 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364954    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r56pw\" (UniqueName: \"kubernetes.io/projected/fb6b35a8-78d4-40b2-a087-7b45e92b2234-kube-api-access-r56pw\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.365574 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364982    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-dbus\") pod \"global-pull-secret-syncer-f2cw4\" (UID: \"adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa\") " pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:16.365574 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364986    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-etc-kubernetes\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.365574 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.365010    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89e827e0-522b-4227-b77f-42892fd8de3c-tmp\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.365574 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.365031    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-host-cni-bin\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.365574 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.365039    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3db0bb13-5776-4486-8cfb-c0a94ac46e7d-etc-selinux\") pod \"aws-ebs-csi-driver-node-7znf4\" (UID: \"3db0bb13-5776-4486-8cfb-c0a94ac46e7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4"
Sep 16 12:02:16.365574 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.365180    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3db0bb13-5776-4486-8cfb-c0a94ac46e7d-etc-selinux\") pod \"aws-ebs-csi-driver-node-7znf4\" (UID: \"3db0bb13-5776-4486-8cfb-c0a94ac46e7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4"
Sep 16 12:02:16.365574 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.365238    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-run-openvswitch\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.365574 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.365315    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-hostroot\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.365574 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.365340    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3db0bb13-5776-4486-8cfb-c0a94ac46e7d-socket-dir\") pod \"aws-ebs-csi-driver-node-7znf4\" (UID: \"3db0bb13-5776-4486-8cfb-c0a94ac46e7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4"
Sep 16 12:02:16.365574 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.365385    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3db0bb13-5776-4486-8cfb-c0a94ac46e7d-device-dir\") pod \"aws-ebs-csi-driver-node-7znf4\" (UID: \"3db0bb13-5776-4486-8cfb-c0a94ac46e7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4"
Sep 16 12:02:16.365574 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.365416    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-host-slash\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.365574 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.365461    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-run-systemd\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.365574 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.365526    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-log-socket\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.366366 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:16.365633    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:02:16.366366 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:16.365715    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-original-pull-secret podName:adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa nodeName:}" failed. No retries permitted until 2026-09-16 12:02:16.86568261 +0000 UTC m=+3.034647301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-original-pull-secret") pod "global-pull-secret-syncer-f2cw4" (UID: "adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:02:16.366366 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.365909    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-host-run-netns\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.366366 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.365953    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-host-var-lib-cni-bin\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.366366 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.365973    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb6b35a8-78d4-40b2-a087-7b45e92b2234-ovnkube-config\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.366366 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366012    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-dbus\") pod \"global-pull-secret-syncer-f2cw4\" (UID: \"adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa\") " pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:16.366366 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366013    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.366366 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.364853    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5db11b86-96e5-48c8-84cc-174c9d8f5afe-tmp-dir\") pod \"node-resolver-njgng\" (UID: \"5db11b86-96e5-48c8-84cc-174c9d8f5afe\") " pod="openshift-dns/node-resolver-njgng"
Sep 16 12:02:16.366366 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366096    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-host-run-netns\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.366366 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366208    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acdb4981-6d20-4436-8bd4-b45d51990f22-metrics-certs\") pod \"network-metrics-daemon-wc55w\" (UID: \"acdb4981-6d20-4436-8bd4-b45d51990f22\") " pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:16.366366 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366215    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-multus-conf-dir\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.366366 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366237    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2-cnibin\") pod \"multus-additional-cni-plugins-htz2b\" (UID: \"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2\") " pod="openshift-multus/multus-additional-cni-plugins-htz2b"
Sep 16 12:02:16.366366 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366262    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5db11b86-96e5-48c8-84cc-174c9d8f5afe-hosts-file\") pod \"node-resolver-njgng\" (UID: \"5db11b86-96e5-48c8-84cc-174c9d8f5afe\") " pod="openshift-dns/node-resolver-njgng"
Sep 16 12:02:16.366366 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366301    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-htz2b\" (UID: \"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2\") " pod="openshift-multus/multus-additional-cni-plugins-htz2b"
Sep 16 12:02:16.366366 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366316    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-host-run-netns\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.366366 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4445dc63-354e-46f6-8c05-70215ea9909e-serviceca\") pod \"node-ca-5kmrr\" (UID: \"4445dc63-354e-46f6-8c05-70215ea9909e\") " pod="openshift-image-registry/node-ca-5kmrr"
Sep 16 12:02:16.369026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366378    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3db0bb13-5776-4486-8cfb-c0a94ac46e7d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7znf4\" (UID: \"3db0bb13-5776-4486-8cfb-c0a94ac46e7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4"
Sep 16 12:02:16.369026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366424    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-cnibin\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.369026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366449    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-host-run-k8s-cni-cncf-io\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.369026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366476    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3db0bb13-5776-4486-8cfb-c0a94ac46e7d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7znf4\" (UID: \"3db0bb13-5776-4486-8cfb-c0a94ac46e7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4"
Sep 16 12:02:16.369026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4445dc63-354e-46f6-8c05-70215ea9909e-host\") pod \"node-ca-5kmrr\" (UID: \"4445dc63-354e-46f6-8c05-70215ea9909e\") " pod="openshift-image-registry/node-ca-5kmrr"
Sep 16 12:02:16.369026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366509    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-cnibin\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.369026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366517    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-host-run-k8s-cni-cncf-io\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.369026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366525    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb6b35a8-78d4-40b2-a087-7b45e92b2234-env-overrides\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.369026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366545    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-multus-daemon-config\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.369026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366566    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa718227-1ca3-4c74-9a18-39bc115f912e-host-slash\") pod \"iptables-alerter-dnd6x\" (UID: \"fa718227-1ca3-4c74-9a18-39bc115f912e\") " pod="openshift-network-operator/iptables-alerter-dnd6x"
Sep 16 12:02:16.369026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366591    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdhfv\" (UniqueName: \"kubernetes.io/projected/fa718227-1ca3-4c74-9a18-39bc115f912e-kube-api-access-tdhfv\") pod \"iptables-alerter-dnd6x\" (UID: \"fa718227-1ca3-4c74-9a18-39bc115f912e\") " pod="openshift-network-operator/iptables-alerter-dnd6x"
Sep 16 12:02:16.369026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366616    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-host-kubelet\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.369026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366644    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-host\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.369026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366673    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc2gj\" (UniqueName: \"kubernetes.io/projected/4445dc63-354e-46f6-8c05-70215ea9909e-kube-api-access-vc2gj\") pod \"node-ca-5kmrr\" (UID: \"4445dc63-354e-46f6-8c05-70215ea9909e\") " pod="openshift-image-registry/node-ca-5kmrr"
Sep 16 12:02:16.369026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366703    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-var-lib-openvswitch\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.369026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366728    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-host-cni-netd\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.369026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366755    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb6b35a8-78d4-40b2-a087-7b45e92b2234-ovnkube-script-lib\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.369999 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366779    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-run\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.369999 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366804    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-host-var-lib-kubelet\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.369999 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366818    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa718227-1ca3-4c74-9a18-39bc115f912e-host-slash\") pod \"iptables-alerter-dnd6x\" (UID: \"fa718227-1ca3-4c74-9a18-39bc115f912e\") " pod="openshift-network-operator/iptables-alerter-dnd6x"
Sep 16 12:02:16.369999 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366829    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb6b35a8-78d4-40b2-a087-7b45e92b2234-ovn-node-metrics-cert\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.369999 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366858    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm8tn\" (UniqueName: \"kubernetes.io/projected/acdb4981-6d20-4436-8bd4-b45d51990f22-kube-api-access-hm8tn\") pod \"network-metrics-daemon-wc55w\" (UID: \"acdb4981-6d20-4436-8bd4-b45d51990f22\") " pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:16.369999 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366888    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-var-lib-kubelet\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.369999 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366913    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-run-ovn\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.369999 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366937    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/89e827e0-522b-4227-b77f-42892fd8de3c-etc-tuned\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.369999 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366964    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-host-run-multus-certs\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.369999 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.366988    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3db0bb13-5776-4486-8cfb-c0a94ac46e7d-sys-fs\") pod \"aws-ebs-csi-driver-node-7znf4\" (UID: \"3db0bb13-5776-4486-8cfb-c0a94ac46e7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4"
Sep 16 12:02:16.369999 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.367013    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-system-cni-dir\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.369999 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.367038    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-cni-binary-copy\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.369999 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.367066    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa718227-1ca3-4c74-9a18-39bc115f912e-iptables-alerter-script\") pod \"iptables-alerter-dnd6x\" (UID: \"fa718227-1ca3-4c74-9a18-39bc115f912e\") " pod="openshift-network-operator/iptables-alerter-dnd6x"
Sep 16 12:02:16.369999 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.367069    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-host-kubelet\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.369999 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.367091    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-etc-sysctl-conf\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.369999 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.367119    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-sys\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.369999 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.367127    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-multus-daemon-config\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.370864 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.367137    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-var-lib-openvswitch\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.370864 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.367145    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5p46\" (UniqueName: \"kubernetes.io/projected/89e827e0-522b-4227-b77f-42892fd8de3c-kube-api-access-q5p46\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.370864 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.367174    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrkb9\" (UniqueName: \"kubernetes.io/projected/3db0bb13-5776-4486-8cfb-c0a94ac46e7d-kube-api-access-mrkb9\") pod \"aws-ebs-csi-driver-node-7znf4\" (UID: \"3db0bb13-5776-4486-8cfb-c0a94ac46e7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4"
Sep 16 12:02:16.370864 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.367189    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-host-var-lib-kubelet\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.370864 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.367220    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-multus-cni-dir\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.370864 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.367296    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-etc-openvswitch\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.370864 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.367324    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2-cni-binary-copy\") pod \"multus-additional-cni-plugins-htz2b\" (UID: \"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2\") " pod="openshift-multus/multus-additional-cni-plugins-htz2b"
Sep 16 12:02:16.370864 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.367350    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/43306d34-2366-4ca1-b63b-1362b9495ee9-konnectivity-ca\") pod \"konnectivity-agent-zjz4j\" (UID: \"43306d34-2366-4ca1-b63b-1362b9495ee9\") " pod="kube-system/konnectivity-agent-zjz4j"
Sep 16 12:02:16.370864 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.367488    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-run-ovn\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.370864 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.367547    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-host-run-multus-certs\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.370864 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.367606    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3db0bb13-5776-4486-8cfb-c0a94ac46e7d-sys-fs\") pod \"aws-ebs-csi-driver-node-7znf4\" (UID: \"3db0bb13-5776-4486-8cfb-c0a94ac46e7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4"
Sep 16 12:02:16.370864 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.367606    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb6b35a8-78d4-40b2-a087-7b45e92b2234-ovnkube-script-lib\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.370864 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.367598    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 16 12:02:16.370864 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.367736    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-system-cni-dir\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.370864 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.368025    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-multus-cni-dir\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.370864 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.368073    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-host-cni-netd\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.370864 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.368101    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-cni-binary-copy\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.370864 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.368116    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb6b35a8-78d4-40b2-a087-7b45e92b2234-etc-openvswitch\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.371814 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.368490    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fa718227-1ca3-4c74-9a18-39bc115f912e-iptables-alerter-script\") pod \"iptables-alerter-dnd6x\" (UID: \"fa718227-1ca3-4c74-9a18-39bc115f912e\") " pod="openshift-network-operator/iptables-alerter-dnd6x"
Sep 16 12:02:16.371814 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.369034    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb6b35a8-78d4-40b2-a087-7b45e92b2234-env-overrides\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.371814 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:16.371774    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:02:16.371814 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:16.371794    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:02:16.371814 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:16.371808    2576 projected.go:196] Error preparing data for projected volume kube-api-access-86nth for pod openshift-network-diagnostics/network-check-target-7ff2t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:02:16.372127 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:16.371871    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d17e8cd-157a-49a4-9c05-cd1e15a8ef11-kube-api-access-86nth podName:3d17e8cd-157a-49a4-9c05-cd1e15a8ef11 nodeName:}" failed. No retries permitted until 2026-09-16 12:02:16.871853923 +0000 UTC m=+3.040818612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-86nth" (UniqueName: "kubernetes.io/projected/3d17e8cd-157a-49a4-9c05-cd1e15a8ef11-kube-api-access-86nth") pod "network-check-target-7ff2t" (UID: "3d17e8cd-157a-49a4-9c05-cd1e15a8ef11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:02:16.373804 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.373777    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb6b35a8-78d4-40b2-a087-7b45e92b2234-ovn-node-metrics-cert\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.373946 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.373930    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cflxm\" (UniqueName: \"kubernetes.io/projected/1bc7ece7-2e13-4685-b3be-b8cc3e8e6400-kube-api-access-cflxm\") pod \"multus-hcflr\" (UID: \"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400\") " pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.385071 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.385046    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7qwm\" (UniqueName: \"kubernetes.io/projected/5db11b86-96e5-48c8-84cc-174c9d8f5afe-kube-api-access-w7qwm\") pod \"node-resolver-njgng\" (UID: \"5db11b86-96e5-48c8-84cc-174c9d8f5afe\") " pod="openshift-dns/node-resolver-njgng"
Sep 16 12:02:16.385161 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.385117    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrkb9\" (UniqueName: \"kubernetes.io/projected/3db0bb13-5776-4486-8cfb-c0a94ac46e7d-kube-api-access-mrkb9\") pod \"aws-ebs-csi-driver-node-7znf4\" (UID: \"3db0bb13-5776-4486-8cfb-c0a94ac46e7d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4"
Sep 16 12:02:16.386385 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.386364    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdhfv\" (UniqueName: \"kubernetes.io/projected/fa718227-1ca3-4c74-9a18-39bc115f912e-kube-api-access-tdhfv\") pod \"iptables-alerter-dnd6x\" (UID: \"fa718227-1ca3-4c74-9a18-39bc115f912e\") " pod="openshift-network-operator/iptables-alerter-dnd6x"
Sep 16 12:02:16.387417 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.387281    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r56pw\" (UniqueName: \"kubernetes.io/projected/fb6b35a8-78d4-40b2-a087-7b45e92b2234-kube-api-access-r56pw\") pod \"ovnkube-node-tb7dg\" (UID: \"fb6b35a8-78d4-40b2-a087-7b45e92b2234\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.395316 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.395245    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-240.ec2.internal" event={"ID":"a9435f0d3784aef4bb9e6f27c49dafc3","Type":"ContainerStarted","Data":"bc0028f72dd34eb0a16be7148cb9bd8a06974e86b3056d3d6aa69193258551f9"}
Sep 16 12:02:16.398689 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.398625    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-240.ec2.internal" event={"ID":"780080cf4361c8479ffff1f797551d43","Type":"ContainerStarted","Data":"b94666e08d62aef5220b072c7fc02d9a0f32b5ffc8e7ea1fcfd945dc615e4b21"}
Sep 16 12:02:16.458882 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.458682    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:02:16.468197 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468164    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-etc-modprobe-d\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.468336 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468208    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-etc-sysconfig\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.468336 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468252    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-htz2b\" (UID: \"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2\") " pod="openshift-multus/multus-additional-cni-plugins-htz2b"
Sep 16 12:02:16.468336 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468286    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-htz2b\" (UID: \"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2\") " pod="openshift-multus/multus-additional-cni-plugins-htz2b"
Sep 16 12:02:16.468336 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468319    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89e827e0-522b-4227-b77f-42892fd8de3c-tmp\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.468614 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468364    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acdb4981-6d20-4436-8bd4-b45d51990f22-metrics-certs\") pod \"network-metrics-daemon-wc55w\" (UID: \"acdb4981-6d20-4436-8bd4-b45d51990f22\") " pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:16.468614 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468391    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2-cnibin\") pod \"multus-additional-cni-plugins-htz2b\" (UID: \"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2\") " pod="openshift-multus/multus-additional-cni-plugins-htz2b"
Sep 16 12:02:16.468614 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468417    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-htz2b\" (UID: \"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2\") " pod="openshift-multus/multus-additional-cni-plugins-htz2b"
Sep 16 12:02:16.468614 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468443    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4445dc63-354e-46f6-8c05-70215ea9909e-serviceca\") pod \"node-ca-5kmrr\" (UID: \"4445dc63-354e-46f6-8c05-70215ea9909e\") " pod="openshift-image-registry/node-ca-5kmrr"
Sep 16 12:02:16.468614 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468467    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4445dc63-354e-46f6-8c05-70215ea9909e-host\") pod \"node-ca-5kmrr\" (UID: \"4445dc63-354e-46f6-8c05-70215ea9909e\") " pod="openshift-image-registry/node-ca-5kmrr"
Sep 16 12:02:16.468614 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468495    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-host\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.468614 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468519    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc2gj\" (UniqueName: \"kubernetes.io/projected/4445dc63-354e-46f6-8c05-70215ea9909e-kube-api-access-vc2gj\") pod \"node-ca-5kmrr\" (UID: \"4445dc63-354e-46f6-8c05-70215ea9909e\") " pod="openshift-image-registry/node-ca-5kmrr"
Sep 16 12:02:16.468614 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468545    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-run\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.468614 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468570    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm8tn\" (UniqueName: \"kubernetes.io/projected/acdb4981-6d20-4436-8bd4-b45d51990f22-kube-api-access-hm8tn\") pod \"network-metrics-daemon-wc55w\" (UID: \"acdb4981-6d20-4436-8bd4-b45d51990f22\") " pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:16.468614 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468594    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-var-lib-kubelet\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.469111 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468619    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/89e827e0-522b-4227-b77f-42892fd8de3c-etc-tuned\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.469111 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468650    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-etc-sysctl-conf\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.469111 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468675    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-sys\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.469111 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468701    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5p46\" (UniqueName: \"kubernetes.io/projected/89e827e0-522b-4227-b77f-42892fd8de3c-kube-api-access-q5p46\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.469111 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468730    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2-cni-binary-copy\") pod \"multus-additional-cni-plugins-htz2b\" (UID: \"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2\") " pod="openshift-multus/multus-additional-cni-plugins-htz2b"
Sep 16 12:02:16.469111 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468756    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/43306d34-2366-4ca1-b63b-1362b9495ee9-konnectivity-ca\") pod \"konnectivity-agent-zjz4j\" (UID: \"43306d34-2366-4ca1-b63b-1362b9495ee9\") " pod="kube-system/konnectivity-agent-zjz4j"
Sep 16 12:02:16.469111 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468782    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-etc-systemd\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.469111 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468807    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cmdj\" (UniqueName: \"kubernetes.io/projected/f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2-kube-api-access-7cmdj\") pod \"multus-additional-cni-plugins-htz2b\" (UID: \"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2\") " pod="openshift-multus/multus-additional-cni-plugins-htz2b"
Sep 16 12:02:16.469111 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468832    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/43306d34-2366-4ca1-b63b-1362b9495ee9-agent-certs\") pod \"konnectivity-agent-zjz4j\" (UID: \"43306d34-2366-4ca1-b63b-1362b9495ee9\") " pod="kube-system/konnectivity-agent-zjz4j"
Sep 16 12:02:16.469111 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468863    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-etc-kubernetes\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.469111 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468886    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-etc-sysctl-d\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.469111 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468910    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-lib-modules\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.469111 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.468943    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2-system-cni-dir\") pod \"multus-additional-cni-plugins-htz2b\" (UID: \"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2\") " pod="openshift-multus/multus-additional-cni-plugins-htz2b"
Sep 16 12:02:16.469111 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.469035    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2-system-cni-dir\") pod \"multus-additional-cni-plugins-htz2b\" (UID: \"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2\") " pod="openshift-multus/multus-additional-cni-plugins-htz2b"
Sep 16 12:02:16.469817 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.469181    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-etc-modprobe-d\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.469817 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.469242    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-etc-sysconfig\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.469817 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.469428    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-htz2b\" (UID: \"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2\") " pod="openshift-multus/multus-additional-cni-plugins-htz2b"
Sep 16 12:02:16.470021 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.469993    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-htz2b\" (UID: \"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2\") " pod="openshift-multus/multus-additional-cni-plugins-htz2b"
Sep 16 12:02:16.470745 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.470716    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4445dc63-354e-46f6-8c05-70215ea9909e-host\") pod \"node-ca-5kmrr\" (UID: \"4445dc63-354e-46f6-8c05-70215ea9909e\") " pod="openshift-image-registry/node-ca-5kmrr"
Sep 16 12:02:16.470850 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:16.470833    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:02:16.470925 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:16.470898    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acdb4981-6d20-4436-8bd4-b45d51990f22-metrics-certs podName:acdb4981-6d20-4436-8bd4-b45d51990f22 nodeName:}" failed. No retries permitted until 2026-09-16 12:02:16.970878028 +0000 UTC m=+3.139842721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acdb4981-6d20-4436-8bd4-b45d51990f22-metrics-certs") pod "network-metrics-daemon-wc55w" (UID: "acdb4981-6d20-4436-8bd4-b45d51990f22") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:02:16.471139 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.471109    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2-cnibin\") pod \"multus-additional-cni-plugins-htz2b\" (UID: \"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2\") " pod="openshift-multus/multus-additional-cni-plugins-htz2b"
Sep 16 12:02:16.473278 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.471599    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-etc-sysctl-conf\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.473278 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.471637    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-htz2b\" (UID: \"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2\") " pod="openshift-multus/multus-additional-cni-plugins-htz2b"
Sep 16 12:02:16.473278 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.471676    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-sys\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.473278 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.472068    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4445dc63-354e-46f6-8c05-70215ea9909e-serviceca\") pod \"node-ca-5kmrr\" (UID: \"4445dc63-354e-46f6-8c05-70215ea9909e\") " pod="openshift-image-registry/node-ca-5kmrr"
Sep 16 12:02:16.473278 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.472359    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2-cni-binary-copy\") pod \"multus-additional-cni-plugins-htz2b\" (UID: \"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2\") " pod="openshift-multus/multus-additional-cni-plugins-htz2b"
Sep 16 12:02:16.473278 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.472484    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-etc-systemd\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.473278 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.472908    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/43306d34-2366-4ca1-b63b-1362b9495ee9-konnectivity-ca\") pod \"konnectivity-agent-zjz4j\" (UID: \"43306d34-2366-4ca1-b63b-1362b9495ee9\") " pod="kube-system/konnectivity-agent-zjz4j"
Sep 16 12:02:16.473278 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.472933    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-run\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.473278 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.472975    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-host\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.473278 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.472989    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-etc-kubernetes\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.473278 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.473112    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-etc-sysctl-d\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.473278 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.473153    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-var-lib-kubelet\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.473278 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.473161    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89e827e0-522b-4227-b77f-42892fd8de3c-lib-modules\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.474814 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.474705    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/89e827e0-522b-4227-b77f-42892fd8de3c-etc-tuned\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.475295 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.475271    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/43306d34-2366-4ca1-b63b-1362b9495ee9-agent-certs\") pod \"konnectivity-agent-zjz4j\" (UID: \"43306d34-2366-4ca1-b63b-1362b9495ee9\") " pod="kube-system/konnectivity-agent-zjz4j"
Sep 16 12:02:16.482496 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.482399    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89e827e0-522b-4227-b77f-42892fd8de3c-tmp\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.483724 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.483634    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5p46\" (UniqueName: \"kubernetes.io/projected/89e827e0-522b-4227-b77f-42892fd8de3c-kube-api-access-q5p46\") pod \"tuned-7dlf8\" (UID: \"89e827e0-522b-4227-b77f-42892fd8de3c\") " pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.484369 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.484281    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm8tn\" (UniqueName: \"kubernetes.io/projected/acdb4981-6d20-4436-8bd4-b45d51990f22-kube-api-access-hm8tn\") pod \"network-metrics-daemon-wc55w\" (UID: \"acdb4981-6d20-4436-8bd4-b45d51990f22\") " pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:16.486931 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.486885    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc2gj\" (UniqueName: \"kubernetes.io/projected/4445dc63-354e-46f6-8c05-70215ea9909e-kube-api-access-vc2gj\") pod \"node-ca-5kmrr\" (UID: \"4445dc63-354e-46f6-8c05-70215ea9909e\") " pod="openshift-image-registry/node-ca-5kmrr"
Sep 16 12:02:16.488437 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.488416    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cmdj\" (UniqueName: \"kubernetes.io/projected/f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2-kube-api-access-7cmdj\") pod \"multus-additional-cni-plugins-htz2b\" (UID: \"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2\") " pod="openshift-multus/multus-additional-cni-plugins-htz2b"
Sep 16 12:02:16.547476 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.547421    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4"
Sep 16 12:02:16.554329 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.554303    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hcflr"
Sep 16 12:02:16.561609 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:16.561584    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3db0bb13_5776_4486_8cfb_c0a94ac46e7d.slice/crio-0810f38cd0de9feaad0946ed734f3ceaeee5bfa2f682763b37dab9b7097526c5 WatchSource:0}: Error finding container 0810f38cd0de9feaad0946ed734f3ceaeee5bfa2f682763b37dab9b7097526c5: Status 404 returned error can't find the container with id 0810f38cd0de9feaad0946ed734f3ceaeee5bfa2f682763b37dab9b7097526c5
Sep 16 12:02:16.564523 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.564498    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dnd6x"
Sep 16 12:02:16.567136 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:16.567105    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bc7ece7_2e13_4685_b3be_b8cc3e8e6400.slice/crio-6f6609007c55e8f458cb4f9889d49dadc332a0b10d93d76e29201195aa8d19c5 WatchSource:0}: Error finding container 6f6609007c55e8f458cb4f9889d49dadc332a0b10d93d76e29201195aa8d19c5: Status 404 returned error can't find the container with id 6f6609007c55e8f458cb4f9889d49dadc332a0b10d93d76e29201195aa8d19c5
Sep 16 12:02:16.573708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.573686    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:16.579842 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:16.579815    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa718227_1ca3_4c74_9a18_39bc115f912e.slice/crio-cd6886f5df240846ae36bb097fab1f7d42a8a890b88e00bb5a2851c76c197e63 WatchSource:0}: Error finding container cd6886f5df240846ae36bb097fab1f7d42a8a890b88e00bb5a2851c76c197e63: Status 404 returned error can't find the container with id cd6886f5df240846ae36bb097fab1f7d42a8a890b88e00bb5a2851c76c197e63
Sep 16 12:02:16.581067 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.581047    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-njgng"
Sep 16 12:02:16.588161 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:16.588140    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb6b35a8_78d4_40b2_a087_7b45e92b2234.slice/crio-673d5884d3a19168c1fb42c25fa3d41d75338aba355c7862a8b4cf79f1cccdbf WatchSource:0}: Error finding container 673d5884d3a19168c1fb42c25fa3d41d75338aba355c7862a8b4cf79f1cccdbf: Status 404 returned error can't find the container with id 673d5884d3a19168c1fb42c25fa3d41d75338aba355c7862a8b4cf79f1cccdbf
Sep 16 12:02:16.589416 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.589384    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zjz4j"
Sep 16 12:02:16.594052 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:16.594028    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5db11b86_96e5_48c8_84cc_174c9d8f5afe.slice/crio-4f68c96bd8ae03b86501eb0e105dff689c7990c1883b54603e60fab19a7f81c2 WatchSource:0}: Error finding container 4f68c96bd8ae03b86501eb0e105dff689c7990c1883b54603e60fab19a7f81c2: Status 404 returned error can't find the container with id 4f68c96bd8ae03b86501eb0e105dff689c7990c1883b54603e60fab19a7f81c2
Sep 16 12:02:16.596302 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.596279    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5kmrr"
Sep 16 12:02:16.604721 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.604536    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7dlf8"
Sep 16 12:02:16.604954 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:16.604928    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43306d34_2366_4ca1_b63b_1362b9495ee9.slice/crio-f7027f0b932116bfcdb8cf2ca05ff390c2a14767186a1d0ce65d6fabaa4d3c9f WatchSource:0}: Error finding container f7027f0b932116bfcdb8cf2ca05ff390c2a14767186a1d0ce65d6fabaa4d3c9f: Status 404 returned error can't find the container with id f7027f0b932116bfcdb8cf2ca05ff390c2a14767186a1d0ce65d6fabaa4d3c9f
Sep 16 12:02:16.611568 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.611543    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-htz2b"
Sep 16 12:02:16.611669 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:16.611644    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4445dc63_354e_46f6_8c05_70215ea9909e.slice/crio-260b888294a9b4f2cca9098019144c39a95aa63c82a3c70711bb9da3961f3237 WatchSource:0}: Error finding container 260b888294a9b4f2cca9098019144c39a95aa63c82a3c70711bb9da3961f3237: Status 404 returned error can't find the container with id 260b888294a9b4f2cca9098019144c39a95aa63c82a3c70711bb9da3961f3237
Sep 16 12:02:16.621467 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:16.621438    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89e827e0_522b_4227_b77f_42892fd8de3c.slice/crio-7e9e9cb1a792c8246b4f151bd66674a1e9a3e272bdf891cf1df2d78afde0ec2c WatchSource:0}: Error finding container 7e9e9cb1a792c8246b4f151bd66674a1e9a3e272bdf891cf1df2d78afde0ec2c: Status 404 returned error can't find the container with id 7e9e9cb1a792c8246b4f151bd66674a1e9a3e272bdf891cf1df2d78afde0ec2c
Sep 16 12:02:16.634027 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:02:16.633987    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8bb1ac9_9c65_4d16_ba57_fbe54acbf0f2.slice/crio-ea77a84bac44edaf77c664b7c61517912b3eb188b2b57f63a24256451bc29d68 WatchSource:0}: Error finding container ea77a84bac44edaf77c664b7c61517912b3eb188b2b57f63a24256451bc29d68: Status 404 returned error can't find the container with id ea77a84bac44edaf77c664b7c61517912b3eb188b2b57f63a24256451bc29d68
Sep 16 12:02:16.872473 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.872431    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86nth\" (UniqueName: \"kubernetes.io/projected/3d17e8cd-157a-49a4-9c05-cd1e15a8ef11-kube-api-access-86nth\") pod \"network-check-target-7ff2t\" (UID: \"3d17e8cd-157a-49a4-9c05-cd1e15a8ef11\") " pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:16.872659 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.872486    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-original-pull-secret\") pod \"global-pull-secret-syncer-f2cw4\" (UID: \"adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa\") " pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:16.872659 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:16.872592    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:02:16.872659 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:16.872621    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:02:16.872659 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:16.872632    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:02:16.872659 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:16.872635    2576 projected.go:196] Error preparing data for projected volume kube-api-access-86nth for pod openshift-network-diagnostics/network-check-target-7ff2t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:02:16.872896 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:16.872705    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-original-pull-secret podName:adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa nodeName:}" failed. No retries permitted until 2026-09-16 12:02:17.872685018 +0000 UTC m=+4.041649722 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-original-pull-secret") pod "global-pull-secret-syncer-f2cw4" (UID: "adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:02:16.872896 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:16.872728    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d17e8cd-157a-49a4-9c05-cd1e15a8ef11-kube-api-access-86nth podName:3d17e8cd-157a-49a4-9c05-cd1e15a8ef11 nodeName:}" failed. No retries permitted until 2026-09-16 12:02:17.872717278 +0000 UTC m=+4.041681979 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-86nth" (UniqueName: "kubernetes.io/projected/3d17e8cd-157a-49a4-9c05-cd1e15a8ef11-kube-api-access-86nth") pod "network-check-target-7ff2t" (UID: "3d17e8cd-157a-49a4-9c05-cd1e15a8ef11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:02:16.973873 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:16.973830    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acdb4981-6d20-4436-8bd4-b45d51990f22-metrics-certs\") pod \"network-metrics-daemon-wc55w\" (UID: \"acdb4981-6d20-4436-8bd4-b45d51990f22\") " pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:16.974060 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:16.973980    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:02:16.974060 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:16.974060    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acdb4981-6d20-4436-8bd4-b45d51990f22-metrics-certs podName:acdb4981-6d20-4436-8bd4-b45d51990f22 nodeName:}" failed. No retries permitted until 2026-09-16 12:02:17.974039605 +0000 UTC m=+4.143004306 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acdb4981-6d20-4436-8bd4-b45d51990f22-metrics-certs") pod "network-metrics-daemon-wc55w" (UID: "acdb4981-6d20-4436-8bd4-b45d51990f22") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:02:17.310375 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:17.310243    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 11:57:16 +0000 UTC" deadline="2028-02-21 15:13:13.467112241 +0000 UTC"
Sep 16 12:02:17.310375 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:17.310301    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12555h10m56.156817389s"
Sep 16 12:02:17.387055 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:17.387021    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:17.387252 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:17.387159    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2cw4" podUID="adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa"
Sep 16 12:02:17.402028 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:17.401918    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5kmrr" event={"ID":"4445dc63-354e-46f6-8c05-70215ea9909e","Type":"ContainerStarted","Data":"260b888294a9b4f2cca9098019144c39a95aa63c82a3c70711bb9da3961f3237"}
Sep 16 12:02:17.403593 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:17.403558    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zjz4j" event={"ID":"43306d34-2366-4ca1-b63b-1362b9495ee9","Type":"ContainerStarted","Data":"f7027f0b932116bfcdb8cf2ca05ff390c2a14767186a1d0ce65d6fabaa4d3c9f"}
Sep 16 12:02:17.405071 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:17.405008    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-njgng" event={"ID":"5db11b86-96e5-48c8-84cc-174c9d8f5afe","Type":"ContainerStarted","Data":"4f68c96bd8ae03b86501eb0e105dff689c7990c1883b54603e60fab19a7f81c2"}
Sep 16 12:02:17.406514 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:17.406481    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4" event={"ID":"3db0bb13-5776-4486-8cfb-c0a94ac46e7d","Type":"ContainerStarted","Data":"0810f38cd0de9feaad0946ed734f3ceaeee5bfa2f682763b37dab9b7097526c5"}
Sep 16 12:02:17.407882 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:17.407832    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htz2b" event={"ID":"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2","Type":"ContainerStarted","Data":"ea77a84bac44edaf77c664b7c61517912b3eb188b2b57f63a24256451bc29d68"}
Sep 16 12:02:17.409226 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:17.409200    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7dlf8" event={"ID":"89e827e0-522b-4227-b77f-42892fd8de3c","Type":"ContainerStarted","Data":"7e9e9cb1a792c8246b4f151bd66674a1e9a3e272bdf891cf1df2d78afde0ec2c"}
Sep 16 12:02:17.410782 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:17.410757    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg" event={"ID":"fb6b35a8-78d4-40b2-a087-7b45e92b2234","Type":"ContainerStarted","Data":"673d5884d3a19168c1fb42c25fa3d41d75338aba355c7862a8b4cf79f1cccdbf"}
Sep 16 12:02:17.412147 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:17.412097    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dnd6x" event={"ID":"fa718227-1ca3-4c74-9a18-39bc115f912e","Type":"ContainerStarted","Data":"cd6886f5df240846ae36bb097fab1f7d42a8a890b88e00bb5a2851c76c197e63"}
Sep 16 12:02:17.413556 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:17.413529    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hcflr" event={"ID":"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400","Type":"ContainerStarted","Data":"6f6609007c55e8f458cb4f9889d49dadc332a0b10d93d76e29201195aa8d19c5"}
Sep 16 12:02:17.883404 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:17.883334    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86nth\" (UniqueName: \"kubernetes.io/projected/3d17e8cd-157a-49a4-9c05-cd1e15a8ef11-kube-api-access-86nth\") pod \"network-check-target-7ff2t\" (UID: \"3d17e8cd-157a-49a4-9c05-cd1e15a8ef11\") " pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:17.883404 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:17.883406    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-original-pull-secret\") pod \"global-pull-secret-syncer-f2cw4\" (UID: \"adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa\") " pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:17.883644 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:17.883560    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:02:17.883644 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:17.883625    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-original-pull-secret podName:adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa nodeName:}" failed. No retries permitted until 2026-09-16 12:02:19.883606935 +0000 UTC m=+6.052571623 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-original-pull-secret") pod "global-pull-secret-syncer-f2cw4" (UID: "adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:02:17.884091 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:17.884070    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:02:17.884172 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:17.884097    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:02:17.884172 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:17.884110    2576 projected.go:196] Error preparing data for projected volume kube-api-access-86nth for pod openshift-network-diagnostics/network-check-target-7ff2t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:02:17.884172 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:17.884157    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d17e8cd-157a-49a4-9c05-cd1e15a8ef11-kube-api-access-86nth podName:3d17e8cd-157a-49a4-9c05-cd1e15a8ef11 nodeName:}" failed. No retries permitted until 2026-09-16 12:02:19.884141936 +0000 UTC m=+6.053106626 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-86nth" (UniqueName: "kubernetes.io/projected/3d17e8cd-157a-49a4-9c05-cd1e15a8ef11-kube-api-access-86nth") pod "network-check-target-7ff2t" (UID: "3d17e8cd-157a-49a4-9c05-cd1e15a8ef11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:02:17.985036 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:17.984594    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acdb4981-6d20-4436-8bd4-b45d51990f22-metrics-certs\") pod \"network-metrics-daemon-wc55w\" (UID: \"acdb4981-6d20-4436-8bd4-b45d51990f22\") " pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:17.985036 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:17.984755    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:02:17.985036 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:17.984827    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acdb4981-6d20-4436-8bd4-b45d51990f22-metrics-certs podName:acdb4981-6d20-4436-8bd4-b45d51990f22 nodeName:}" failed. No retries permitted until 2026-09-16 12:02:19.984806929 +0000 UTC m=+6.153771641 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acdb4981-6d20-4436-8bd4-b45d51990f22-metrics-certs") pod "network-metrics-daemon-wc55w" (UID: "acdb4981-6d20-4436-8bd4-b45d51990f22") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:02:18.311051 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:18.310916    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 11:57:16 +0000 UTC" deadline="2028-02-12 03:19:06.852785816 +0000 UTC"
Sep 16 12:02:18.311051 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:18.310992    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12327h16m48.541798758s"
Sep 16 12:02:18.388279 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:18.388241    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:18.388491 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:18.388412    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ff2t" podUID="3d17e8cd-157a-49a4-9c05-cd1e15a8ef11"
Sep 16 12:02:18.389036 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:18.389012    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:18.389170 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:18.389144    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wc55w" podUID="acdb4981-6d20-4436-8bd4-b45d51990f22"
Sep 16 12:02:19.387774 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:19.387540    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:19.388170 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:19.387873    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2cw4" podUID="adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa"
Sep 16 12:02:19.436340 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:19.436061    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-240.ec2.internal" event={"ID":"a9435f0d3784aef4bb9e6f27c49dafc3","Type":"ContainerStarted","Data":"11f5c64ce86d84e92e51f891e5b2a4adca73a59dca985a96b33c7180080d192f"}
Sep 16 12:02:19.447274 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:19.446928    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-240.ec2.internal" event={"ID":"780080cf4361c8479ffff1f797551d43","Type":"ContainerStarted","Data":"176ec4daae3fba2fbb6d912ec5f686c05858eadefabe9845632a5a60d9d8f155"}
Sep 16 12:02:19.468243 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:19.467630    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-240.ec2.internal" podStartSLOduration=3.467611857 podStartE2EDuration="3.467611857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:02:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:02:19.453241947 +0000 UTC m=+5.622206655" watchObservedRunningTime="2026-09-16 12:02:19.467611857 +0000 UTC m=+5.636576565"
Sep 16 12:02:19.909544 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:19.909504    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86nth\" (UniqueName: \"kubernetes.io/projected/3d17e8cd-157a-49a4-9c05-cd1e15a8ef11-kube-api-access-86nth\") pod \"network-check-target-7ff2t\" (UID: \"3d17e8cd-157a-49a4-9c05-cd1e15a8ef11\") " pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:19.909717 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:19.909561    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-original-pull-secret\") pod \"global-pull-secret-syncer-f2cw4\" (UID: \"adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa\") " pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:19.909717 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:19.909680    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:02:19.909841 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:19.909741    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-original-pull-secret podName:adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa nodeName:}" failed. No retries permitted until 2026-09-16 12:02:23.909721277 +0000 UTC m=+10.078685969 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-original-pull-secret") pod "global-pull-secret-syncer-f2cw4" (UID: "adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:02:19.909841 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:19.909832    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:02:19.909948 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:19.909850    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:02:19.909948 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:19.909862    2576 projected.go:196] Error preparing data for projected volume kube-api-access-86nth for pod openshift-network-diagnostics/network-check-target-7ff2t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:02:19.909948 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:19.909925    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d17e8cd-157a-49a4-9c05-cd1e15a8ef11-kube-api-access-86nth podName:3d17e8cd-157a-49a4-9c05-cd1e15a8ef11 nodeName:}" failed. No retries permitted until 2026-09-16 12:02:23.909911358 +0000 UTC m=+10.078876049 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-86nth" (UniqueName: "kubernetes.io/projected/3d17e8cd-157a-49a4-9c05-cd1e15a8ef11-kube-api-access-86nth") pod "network-check-target-7ff2t" (UID: "3d17e8cd-157a-49a4-9c05-cd1e15a8ef11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:02:20.010280 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:20.010238    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acdb4981-6d20-4436-8bd4-b45d51990f22-metrics-certs\") pod \"network-metrics-daemon-wc55w\" (UID: \"acdb4981-6d20-4436-8bd4-b45d51990f22\") " pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:20.010478 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:20.010457    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:02:20.010540 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:20.010516    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acdb4981-6d20-4436-8bd4-b45d51990f22-metrics-certs podName:acdb4981-6d20-4436-8bd4-b45d51990f22 nodeName:}" failed. No retries permitted until 2026-09-16 12:02:24.010496861 +0000 UTC m=+10.179461549 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acdb4981-6d20-4436-8bd4-b45d51990f22-metrics-certs") pod "network-metrics-daemon-wc55w" (UID: "acdb4981-6d20-4436-8bd4-b45d51990f22") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:02:20.388072 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:20.387611    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:20.388072 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:20.387740    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ff2t" podUID="3d17e8cd-157a-49a4-9c05-cd1e15a8ef11"
Sep 16 12:02:20.388072 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:20.388045    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:20.388524 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:20.388148    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wc55w" podUID="acdb4981-6d20-4436-8bd4-b45d51990f22"
Sep 16 12:02:21.387202 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:21.387168    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:21.387411 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:21.387296    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2cw4" podUID="adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa"
Sep 16 12:02:22.390478 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:22.389764    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:22.390478 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:22.389901    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wc55w" podUID="acdb4981-6d20-4436-8bd4-b45d51990f22"
Sep 16 12:02:22.390478 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:22.390266    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:22.390478 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:22.390356    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ff2t" podUID="3d17e8cd-157a-49a4-9c05-cd1e15a8ef11"
Sep 16 12:02:22.456074 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:22.455915    2576 generic.go:356] "Generic (PLEG): container finished" podID="780080cf4361c8479ffff1f797551d43" containerID="176ec4daae3fba2fbb6d912ec5f686c05858eadefabe9845632a5a60d9d8f155" exitCode=0
Sep 16 12:02:22.456074 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:22.455968    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-240.ec2.internal" event={"ID":"780080cf4361c8479ffff1f797551d43","Type":"ContainerDied","Data":"176ec4daae3fba2fbb6d912ec5f686c05858eadefabe9845632a5a60d9d8f155"}
Sep 16 12:02:23.387824 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:23.387782    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:23.387981 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:23.387901    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2cw4" podUID="adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa"
Sep 16 12:02:23.944107 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:23.944071    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86nth\" (UniqueName: \"kubernetes.io/projected/3d17e8cd-157a-49a4-9c05-cd1e15a8ef11-kube-api-access-86nth\") pod \"network-check-target-7ff2t\" (UID: \"3d17e8cd-157a-49a4-9c05-cd1e15a8ef11\") " pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:23.944107 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:23.944121    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-original-pull-secret\") pod \"global-pull-secret-syncer-f2cw4\" (UID: \"adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa\") " pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:23.944671 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:23.944287    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:02:23.944671 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:23.944363    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-original-pull-secret podName:adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa nodeName:}" failed. No retries permitted until 2026-09-16 12:02:31.944345617 +0000 UTC m=+18.113310315 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-original-pull-secret") pod "global-pull-secret-syncer-f2cw4" (UID: "adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:02:23.944800 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:23.944775    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:02:23.944870 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:23.944802    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:02:23.944870 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:23.944814    2576 projected.go:196] Error preparing data for projected volume kube-api-access-86nth for pod openshift-network-diagnostics/network-check-target-7ff2t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:02:23.944870 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:23.944860    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d17e8cd-157a-49a4-9c05-cd1e15a8ef11-kube-api-access-86nth podName:3d17e8cd-157a-49a4-9c05-cd1e15a8ef11 nodeName:}" failed. No retries permitted until 2026-09-16 12:02:31.944846113 +0000 UTC m=+18.113810800 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-86nth" (UniqueName: "kubernetes.io/projected/3d17e8cd-157a-49a4-9c05-cd1e15a8ef11-kube-api-access-86nth") pod "network-check-target-7ff2t" (UID: "3d17e8cd-157a-49a4-9c05-cd1e15a8ef11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:02:24.045368 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:24.045328    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acdb4981-6d20-4436-8bd4-b45d51990f22-metrics-certs\") pod \"network-metrics-daemon-wc55w\" (UID: \"acdb4981-6d20-4436-8bd4-b45d51990f22\") " pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:24.045534 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:24.045502    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:02:24.045610 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:24.045562    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acdb4981-6d20-4436-8bd4-b45d51990f22-metrics-certs podName:acdb4981-6d20-4436-8bd4-b45d51990f22 nodeName:}" failed. No retries permitted until 2026-09-16 12:02:32.045543774 +0000 UTC m=+18.214508476 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acdb4981-6d20-4436-8bd4-b45d51990f22-metrics-certs") pod "network-metrics-daemon-wc55w" (UID: "acdb4981-6d20-4436-8bd4-b45d51990f22") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:02:24.388750 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:24.388148    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:24.388750 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:24.388266    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ff2t" podUID="3d17e8cd-157a-49a4-9c05-cd1e15a8ef11"
Sep 16 12:02:24.388750 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:24.388588    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:24.388750 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:24.388707    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wc55w" podUID="acdb4981-6d20-4436-8bd4-b45d51990f22"
Sep 16 12:02:25.388366 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:25.387816    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:25.388366 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:25.387986    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2cw4" podUID="adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa"
Sep 16 12:02:26.387701 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:26.387305    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:26.387701 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:26.387443    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ff2t" podUID="3d17e8cd-157a-49a4-9c05-cd1e15a8ef11"
Sep 16 12:02:26.387953 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:26.387778    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:26.387953 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:26.387909    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wc55w" podUID="acdb4981-6d20-4436-8bd4-b45d51990f22"
Sep 16 12:02:27.387061 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:27.387031    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:27.387471 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:27.387125    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2cw4" podUID="adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa"
Sep 16 12:02:28.387486 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:28.387448    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:28.387957 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:28.387577    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ff2t" podUID="3d17e8cd-157a-49a4-9c05-cd1e15a8ef11"
Sep 16 12:02:28.387957 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:28.387448    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:28.387957 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:28.387761    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wc55w" podUID="acdb4981-6d20-4436-8bd4-b45d51990f22"
Sep 16 12:02:29.387052 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:29.387018    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:29.387231 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:29.387136    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2cw4" podUID="adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa"
Sep 16 12:02:30.387086 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:30.387049    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:30.387507 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:30.387173    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ff2t" podUID="3d17e8cd-157a-49a4-9c05-cd1e15a8ef11"
Sep 16 12:02:30.387507 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:30.387217    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:30.387507 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:30.387299    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wc55w" podUID="acdb4981-6d20-4436-8bd4-b45d51990f22"
Sep 16 12:02:31.387415 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:31.387377    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:31.387845 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:31.387492    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2cw4" podUID="adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa"
Sep 16 12:02:32.002797 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:32.002758    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-original-pull-secret\") pod \"global-pull-secret-syncer-f2cw4\" (UID: \"adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa\") " pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:32.003044 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:32.002867    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86nth\" (UniqueName: \"kubernetes.io/projected/3d17e8cd-157a-49a4-9c05-cd1e15a8ef11-kube-api-access-86nth\") pod \"network-check-target-7ff2t\" (UID: \"3d17e8cd-157a-49a4-9c05-cd1e15a8ef11\") " pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:32.003044 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:32.002922    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:02:32.003044 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:32.002978    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:02:32.003044 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:32.002993    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:02:32.003044 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:32.003002    2576 projected.go:196] Error preparing data for projected volume kube-api-access-86nth for pod openshift-network-diagnostics/network-check-target-7ff2t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:02:32.003044 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:32.003004    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-original-pull-secret podName:adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa nodeName:}" failed. No retries permitted until 2026-09-16 12:02:48.002983853 +0000 UTC m=+34.171948555 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-original-pull-secret") pod "global-pull-secret-syncer-f2cw4" (UID: "adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:02:32.003343 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:32.003052    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d17e8cd-157a-49a4-9c05-cd1e15a8ef11-kube-api-access-86nth podName:3d17e8cd-157a-49a4-9c05-cd1e15a8ef11 nodeName:}" failed. No retries permitted until 2026-09-16 12:02:48.003038669 +0000 UTC m=+34.172003375 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-86nth" (UniqueName: "kubernetes.io/projected/3d17e8cd-157a-49a4-9c05-cd1e15a8ef11-kube-api-access-86nth") pod "network-check-target-7ff2t" (UID: "3d17e8cd-157a-49a4-9c05-cd1e15a8ef11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:02:32.103656 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:32.103622    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acdb4981-6d20-4436-8bd4-b45d51990f22-metrics-certs\") pod \"network-metrics-daemon-wc55w\" (UID: \"acdb4981-6d20-4436-8bd4-b45d51990f22\") " pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:32.103839 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:32.103773    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:02:32.103911 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:32.103844    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acdb4981-6d20-4436-8bd4-b45d51990f22-metrics-certs podName:acdb4981-6d20-4436-8bd4-b45d51990f22 nodeName:}" failed. No retries permitted until 2026-09-16 12:02:48.103825619 +0000 UTC m=+34.272790309 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acdb4981-6d20-4436-8bd4-b45d51990f22-metrics-certs") pod "network-metrics-daemon-wc55w" (UID: "acdb4981-6d20-4436-8bd4-b45d51990f22") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:02:32.387795 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:32.387718    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:32.388194 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:32.387732    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:32.388194 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:32.387831    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ff2t" podUID="3d17e8cd-157a-49a4-9c05-cd1e15a8ef11"
Sep 16 12:02:32.388194 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:32.387928    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wc55w" podUID="acdb4981-6d20-4436-8bd4-b45d51990f22"
Sep 16 12:02:33.387211 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:33.387183    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:33.387396 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:33.387282    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2cw4" podUID="adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa"
Sep 16 12:02:34.388435 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:34.388400    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:34.388899 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:34.388507    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ff2t" podUID="3d17e8cd-157a-49a4-9c05-cd1e15a8ef11"
Sep 16 12:02:34.388899 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:34.388596    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:34.388899 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:34.388773    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wc55w" podUID="acdb4981-6d20-4436-8bd4-b45d51990f22"
Sep 16 12:02:35.387377 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:35.387345    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:35.387525 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:35.387444    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2cw4" podUID="adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa"
Sep 16 12:02:36.388344 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:36.387752    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:36.388344 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:36.388299    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ff2t" podUID="3d17e8cd-157a-49a4-9c05-cd1e15a8ef11"
Sep 16 12:02:36.389128 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:36.387805    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:36.389128 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:36.388666    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wc55w" podUID="acdb4981-6d20-4436-8bd4-b45d51990f22"
Sep 16 12:02:36.482577 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:36.482505    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-240.ec2.internal" event={"ID":"780080cf4361c8479ffff1f797551d43","Type":"ContainerStarted","Data":"1369f3e4190bc5562b506dcc3112ae8a72fd2df4fc604204e48d69df21292d18"}
Sep 16 12:02:36.483995 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:36.483964    2576 generic.go:356] "Generic (PLEG): container finished" podID="f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2" containerID="cd456dc09d735502d6603b675b03ba73002fe93ce15b61d0afd4959a4ba8bd3d" exitCode=0
Sep 16 12:02:36.484122 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:36.484072    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htz2b" event={"ID":"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2","Type":"ContainerDied","Data":"cd456dc09d735502d6603b675b03ba73002fe93ce15b61d0afd4959a4ba8bd3d"}
Sep 16 12:02:36.485628 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:36.485610    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7dlf8" event={"ID":"89e827e0-522b-4227-b77f-42892fd8de3c","Type":"ContainerStarted","Data":"6455292af683a47f2046b712aeb5e43ba05b6e8535115f4ef253beb10c1f81a4"}
Sep 16 12:02:36.488469 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:36.488454    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tb7dg_fb6b35a8-78d4-40b2-a087-7b45e92b2234/ovn-acl-logging/0.log"
Sep 16 12:02:36.488862 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:36.488836    2576 generic.go:356] "Generic (PLEG): container finished" podID="fb6b35a8-78d4-40b2-a087-7b45e92b2234" containerID="26f5fdfb1d42f28078c6e02d80a2df2f32ea32cf04e6f9dfb375862203eebae6" exitCode=1
Sep 16 12:02:36.488973 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:36.488905    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg" event={"ID":"fb6b35a8-78d4-40b2-a087-7b45e92b2234","Type":"ContainerStarted","Data":"c8ab01e41da82d70a6bcf425df2f32c92c95c6d11cce6d75ab1c95d169bd8de3"}
Sep 16 12:02:36.489032 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:36.488985    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg" event={"ID":"fb6b35a8-78d4-40b2-a087-7b45e92b2234","Type":"ContainerStarted","Data":"ef7a6366b19bac63a35f52ae7890bcac1409c1dbd21f62ba7ea202c2f3bf8e93"}
Sep 16 12:02:36.489071 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:36.489036    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg" event={"ID":"fb6b35a8-78d4-40b2-a087-7b45e92b2234","Type":"ContainerStarted","Data":"e3fdb1ef4d0d5dd84e81b039a302095263c66ca9d9abf7ab925e46ff753842e5"}
Sep 16 12:02:36.489106 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:36.489087    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg" event={"ID":"fb6b35a8-78d4-40b2-a087-7b45e92b2234","Type":"ContainerStarted","Data":"85568c97f8b0e00323480c595e955e4152a2e688f9556cf2a1db04d4a339a0c8"}
Sep 16 12:02:36.489160 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:36.489127    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg" event={"ID":"fb6b35a8-78d4-40b2-a087-7b45e92b2234","Type":"ContainerDied","Data":"26f5fdfb1d42f28078c6e02d80a2df2f32ea32cf04e6f9dfb375862203eebae6"}
Sep 16 12:02:36.489208 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:36.489159    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg" event={"ID":"fb6b35a8-78d4-40b2-a087-7b45e92b2234","Type":"ContainerStarted","Data":"43fd2f2d7687a8cf41c198a14f4f12fc399a2d21d58afd50531314ab134de80b"}
Sep 16 12:02:36.490502 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:36.490479    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hcflr" event={"ID":"1bc7ece7-2e13-4685-b3be-b8cc3e8e6400","Type":"ContainerStarted","Data":"d97253a93b9453cf4b94fd0074ae65e7255acd6bbe9338052066b11ffb1c2a0f"}
Sep 16 12:02:36.491863 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:36.491845    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5kmrr" event={"ID":"4445dc63-354e-46f6-8c05-70215ea9909e","Type":"ContainerStarted","Data":"92d6eea285755b4c695c57046954e9ba3f4d0576fc7c31f00bfa0c26ab15a374"}
Sep 16 12:02:36.493152 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:36.493134    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zjz4j" event={"ID":"43306d34-2366-4ca1-b63b-1362b9495ee9","Type":"ContainerStarted","Data":"fbd7f403f876684cb9635f54135f055d0aaa3e11ef94b461eaf2ba0740b53436"}
Sep 16 12:02:36.494632 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:36.494601    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-njgng" event={"ID":"5db11b86-96e5-48c8-84cc-174c9d8f5afe","Type":"ContainerStarted","Data":"355bb8268f7de94e56a8a260c3a228d151f5b2b50f836d610bb44dc18c988acf"}
Sep 16 12:02:36.496111 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:36.496092    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4" event={"ID":"3db0bb13-5776-4486-8cfb-c0a94ac46e7d","Type":"ContainerStarted","Data":"53cdcac67daeb8b371f0fb87b7a32e789147b5e369f81c758160357474bf3f14"}
Sep 16 12:02:36.499617 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:36.499584    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-240.ec2.internal" podStartSLOduration=20.499570643 podStartE2EDuration="20.499570643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:02:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:02:36.499106864 +0000 UTC m=+22.668071571" watchObservedRunningTime="2026-09-16 12:02:36.499570643 +0000 UTC m=+22.668535351"
Sep 16 12:02:36.546777 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:36.546725    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-njgng" podStartSLOduration=3.552171638 podStartE2EDuration="22.546710943s" totalImagesPullingTime="18.994539305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:02:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:02:36.516189353 +0000 UTC m=+22.685154061" watchObservedRunningTime="2026-09-16 12:02:36.546710943 +0000 UTC m=+22.715675650"
Sep 16 12:02:36.547006 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:36.546985    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zjz4j" podStartSLOduration=3.502906189 podStartE2EDuration="22.546978954s" totalImagesPullingTime="19.044072765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:02:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:02:36.546684043 +0000 UTC m=+22.715648740" watchObservedRunningTime="2026-09-16 12:02:36.546978954 +0000 UTC m=+22.715943716"
Sep 16 12:02:36.574441 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:36.574405    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7dlf8" podStartSLOduration=3.546631809 podStartE2EDuration="22.574391123s" totalImagesPullingTime="19.027759314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:02:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:02:36.573892152 +0000 UTC m=+22.742856859" watchObservedRunningTime="2026-09-16 12:02:36.574391123 +0000 UTC m=+22.743355829"
Sep 16 12:02:36.593245 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:36.593209    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5kmrr" podStartSLOduration=3.556238086 podStartE2EDuration="22.593197549s" totalImagesPullingTime="19.036959463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:02:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:02:36.592845245 +0000 UTC m=+22.761809952" watchObservedRunningTime="2026-09-16 12:02:36.593197549 +0000 UTC m=+22.762162256"
Sep 16 12:02:36.629474 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:36.629412    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hcflr" podStartSLOduration=3.122896594 podStartE2EDuration="22.629392609s" totalImagesPullingTime="19.506496015s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:02:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:02:36.628970741 +0000 UTC m=+22.797935447" watchObservedRunningTime="2026-09-16 12:02:36.629392609 +0000 UTC m=+22.798357316"
Sep 16 12:02:37.338674 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:37.338647    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 16 12:02:37.387240 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:37.387215    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:37.387382 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:37.387355    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2cw4" podUID="adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa"
Sep 16 12:02:37.500438 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:37.500400    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4" event={"ID":"3db0bb13-5776-4486-8cfb-c0a94ac46e7d","Type":"ContainerStarted","Data":"6332e2f3cee28fb4fff7bd9718b696141ca7f93639c2e0538b46710e3786d48e"}
Sep 16 12:02:37.502190 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:37.502126    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dnd6x" event={"ID":"fa718227-1ca3-4c74-9a18-39bc115f912e","Type":"ContainerStarted","Data":"c5ca8d499cd0b285ec2a28988aa67f3049e6adc8a9fe08ff98f88642687909ac"}
Sep 16 12:02:37.517476 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:37.517414    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dnd6x" podStartSLOduration=8.294623947 podStartE2EDuration="23.517398623s" totalImagesPullingTime="15.222774676s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:02:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:02:37.51709657 +0000 UTC m=+23.686061278" watchObservedRunningTime="2026-09-16 12:02:37.517398623 +0000 UTC m=+23.686363329"
Sep 16 12:02:38.328011 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:38.327935    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T12:02:37.338669493Z","UUID":"91b662cc-a41a-4af1-b36d-6e7e329e2862","Handler":null,"Name":"","Endpoint":""}
Sep 16 12:02:38.329334 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:38.329290    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 16 12:02:38.329455 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:38.329344    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 16 12:02:38.387251 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:38.387225    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:38.387393 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:38.387364    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ff2t" podUID="3d17e8cd-157a-49a4-9c05-cd1e15a8ef11"
Sep 16 12:02:38.387446 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:38.387402    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:38.387515 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:38.387492    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wc55w" podUID="acdb4981-6d20-4436-8bd4-b45d51990f22"
Sep 16 12:02:38.508620 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:38.508588    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tb7dg_fb6b35a8-78d4-40b2-a087-7b45e92b2234/ovn-acl-logging/0.log"
Sep 16 12:02:38.509212 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:38.509067    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg" event={"ID":"fb6b35a8-78d4-40b2-a087-7b45e92b2234","Type":"ContainerStarted","Data":"b5e188222f90b57b27405e25c3cd7221de0eb8687266ca4ac074c8c4d944d936"}
Sep 16 12:02:38.673862 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:38.673840    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zjz4j"
Sep 16 12:02:38.674386 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:38.674360    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zjz4j"
Sep 16 12:02:39.217269 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:39.217180    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-njgng_5db11b86-96e5-48c8-84cc-174c9d8f5afe/dns-node-resolver/0.log"
Sep 16 12:02:39.387449 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:39.387417    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:39.387608 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:39.387524    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2cw4" podUID="adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa"
Sep 16 12:02:39.514454 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:39.514361    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4" event={"ID":"3db0bb13-5776-4486-8cfb-c0a94ac46e7d","Type":"ContainerStarted","Data":"c80bedebf93cabcd934627301fd824ba6ec0605f17a2b452709f1c2fbfb00dda"}
Sep 16 12:02:39.514951 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:39.514743    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zjz4j"
Sep 16 12:02:39.515294 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:39.515268    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zjz4j"
Sep 16 12:02:39.531964 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:39.531922    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7znf4" podStartSLOduration=7.742697483 podStartE2EDuration="25.531909297s" totalImagesPullingTime="17.789211814s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:02:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:02:39.531858842 +0000 UTC m=+25.700823549" watchObservedRunningTime="2026-09-16 12:02:39.531909297 +0000 UTC m=+25.700874003"
Sep 16 12:02:39.801007 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:39.800936    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5kmrr_4445dc63-354e-46f6-8c05-70215ea9909e/node-ca/0.log"
Sep 16 12:02:40.387877 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:40.387848    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:40.387877 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:40.387869    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:40.388085 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:40.387944    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ff2t" podUID="3d17e8cd-157a-49a4-9c05-cd1e15a8ef11"
Sep 16 12:02:40.388131 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:40.388081    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wc55w" podUID="acdb4981-6d20-4436-8bd4-b45d51990f22"
Sep 16 12:02:41.387839 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:41.387811    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:41.388437 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:41.387943    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2cw4" podUID="adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa"
Sep 16 12:02:41.520624 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:41.520440    2576 generic.go:356] "Generic (PLEG): container finished" podID="f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2" containerID="533865852e9c49a8f4a04cedf1d0bdcecb4a2e7fc71cf760eb234be2bb8c88c5" exitCode=0
Sep 16 12:02:41.520745 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:41.520525    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htz2b" event={"ID":"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2","Type":"ContainerDied","Data":"533865852e9c49a8f4a04cedf1d0bdcecb4a2e7fc71cf760eb234be2bb8c88c5"}
Sep 16 12:02:41.524170 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:41.524153    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tb7dg_fb6b35a8-78d4-40b2-a087-7b45e92b2234/ovn-acl-logging/0.log"
Sep 16 12:02:41.524587 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:41.524567    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg" event={"ID":"fb6b35a8-78d4-40b2-a087-7b45e92b2234","Type":"ContainerStarted","Data":"5cbd813a1dc7b6f4e3378714f753cbfcb5a2d3eb7cb069c3347c586718f87256"}
Sep 16 12:02:41.524970 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:41.524956    2576 scope.go:117] "RemoveContainer" containerID="26f5fdfb1d42f28078c6e02d80a2df2f32ea32cf04e6f9dfb375862203eebae6"
Sep 16 12:02:42.195345 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:42.195298    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:42.386989 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:42.386966    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:42.387106 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:42.387081    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ff2t" podUID="3d17e8cd-157a-49a4-9c05-cd1e15a8ef11"
Sep 16 12:02:42.387156 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:42.387126    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:42.387229 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:42.387211    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wc55w" podUID="acdb4981-6d20-4436-8bd4-b45d51990f22"
Sep 16 12:02:42.529085 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:42.529052    2576 generic.go:356] "Generic (PLEG): container finished" podID="f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2" containerID="478b381fd18632f5440e578da2e00e88ab4260020f28d9697f249dd29e543908" exitCode=0
Sep 16 12:02:42.529489 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:42.529147    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htz2b" event={"ID":"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2","Type":"ContainerDied","Data":"478b381fd18632f5440e578da2e00e88ab4260020f28d9697f249dd29e543908"}
Sep 16 12:02:42.533178 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:42.533160    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tb7dg_fb6b35a8-78d4-40b2-a087-7b45e92b2234/ovn-acl-logging/0.log"
Sep 16 12:02:42.533558 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:42.533534    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg" event={"ID":"fb6b35a8-78d4-40b2-a087-7b45e92b2234","Type":"ContainerStarted","Data":"55dcbf25fd6a226d8114dd547b47b4f80fe966cc5abc7362b154397714fe323e"}
Sep 16 12:02:42.533789 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:42.533766    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:42.533888 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:42.533836    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:42.549216 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:42.549189    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:42.549381 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:42.549303    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:02:42.576005 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:42.575960    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg" podStartSLOduration=9.469016081 podStartE2EDuration="28.575946498s" totalImagesPullingTime="19.106930417s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:02:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:02:42.574227363 +0000 UTC m=+28.743192070" watchObservedRunningTime="2026-09-16 12:02:42.575946498 +0000 UTC m=+28.744911207"
Sep 16 12:02:43.386865 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:43.386832    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:43.387080 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:43.386957    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2cw4" podUID="adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa"
Sep 16 12:02:44.388073 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:44.388043    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:44.388510 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:44.388113    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:44.388510 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:44.388188    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wc55w" podUID="acdb4981-6d20-4436-8bd4-b45d51990f22"
Sep 16 12:02:44.388510 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:44.388262    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ff2t" podUID="3d17e8cd-157a-49a4-9c05-cd1e15a8ef11"
Sep 16 12:02:44.540712 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:44.540677    2576 generic.go:356] "Generic (PLEG): container finished" podID="f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2" containerID="4ef76245873d7073ba5a01ca542608358994a6a9e10c803c7113f9ab0a46ca9b" exitCode=0
Sep 16 12:02:44.540858 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:44.540757    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htz2b" event={"ID":"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2","Type":"ContainerDied","Data":"4ef76245873d7073ba5a01ca542608358994a6a9e10c803c7113f9ab0a46ca9b"}
Sep 16 12:02:45.387328 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:45.387281    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:45.387479 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:45.387401    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2cw4" podUID="adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa"
Sep 16 12:02:46.390546 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:46.390509    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:46.390546 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:46.390531    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:46.391009 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:46.390655    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wc55w" podUID="acdb4981-6d20-4436-8bd4-b45d51990f22"
Sep 16 12:02:46.391009 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:46.390789    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ff2t" podUID="3d17e8cd-157a-49a4-9c05-cd1e15a8ef11"
Sep 16 12:02:47.387830 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:47.387794    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:47.388002 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:47.387924    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2cw4" podUID="adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa"
Sep 16 12:02:48.027597 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:48.027563    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86nth\" (UniqueName: \"kubernetes.io/projected/3d17e8cd-157a-49a4-9c05-cd1e15a8ef11-kube-api-access-86nth\") pod \"network-check-target-7ff2t\" (UID: \"3d17e8cd-157a-49a4-9c05-cd1e15a8ef11\") " pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:48.027597 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:48.027599    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-original-pull-secret\") pod \"global-pull-secret-syncer-f2cw4\" (UID: \"adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa\") " pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:48.028098 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:48.027715    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:02:48.028098 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:48.027742    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:02:48.028098 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:48.027756    2576 projected.go:196] Error preparing data for projected volume kube-api-access-86nth for pod openshift-network-diagnostics/network-check-target-7ff2t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:02:48.028098 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:48.027801    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3d17e8cd-157a-49a4-9c05-cd1e15a8ef11-kube-api-access-86nth podName:3d17e8cd-157a-49a4-9c05-cd1e15a8ef11 nodeName:}" failed. No retries permitted until 2026-09-16 12:03:20.027786675 +0000 UTC m=+66.196751360 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-86nth" (UniqueName: "kubernetes.io/projected/3d17e8cd-157a-49a4-9c05-cd1e15a8ef11-kube-api-access-86nth") pod "network-check-target-7ff2t" (UID: "3d17e8cd-157a-49a4-9c05-cd1e15a8ef11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:02:48.028098 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:48.027718    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:02:48.028098 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:48.027867    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-original-pull-secret podName:adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa nodeName:}" failed. No retries permitted until 2026-09-16 12:03:20.027852598 +0000 UTC m=+66.196817303 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-original-pull-secret") pod "global-pull-secret-syncer-f2cw4" (UID: "adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:02:48.128572 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:48.128539    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acdb4981-6d20-4436-8bd4-b45d51990f22-metrics-certs\") pod \"network-metrics-daemon-wc55w\" (UID: \"acdb4981-6d20-4436-8bd4-b45d51990f22\") " pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:48.128717 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:48.128665    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:02:48.128757 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:48.128720    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acdb4981-6d20-4436-8bd4-b45d51990f22-metrics-certs podName:acdb4981-6d20-4436-8bd4-b45d51990f22 nodeName:}" failed. No retries permitted until 2026-09-16 12:03:20.128705978 +0000 UTC m=+66.297670663 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acdb4981-6d20-4436-8bd4-b45d51990f22-metrics-certs") pod "network-metrics-daemon-wc55w" (UID: "acdb4981-6d20-4436-8bd4-b45d51990f22") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:02:48.387661 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:48.387625    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:48.387918 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:48.387631    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:48.387918 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:48.387733    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ff2t" podUID="3d17e8cd-157a-49a4-9c05-cd1e15a8ef11"
Sep 16 12:02:48.387918 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:48.387863    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wc55w" podUID="acdb4981-6d20-4436-8bd4-b45d51990f22"
Sep 16 12:02:49.387058 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:49.387026    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:49.387478 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:49.387140    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2cw4" podUID="adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa"
Sep 16 12:02:50.387487 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:50.387458    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:50.387902 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:50.387497    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:50.387902 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:50.387583    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wc55w" podUID="acdb4981-6d20-4436-8bd4-b45d51990f22"
Sep 16 12:02:50.387902 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:50.387638    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ff2t" podUID="3d17e8cd-157a-49a4-9c05-cd1e15a8ef11"
Sep 16 12:02:50.558103 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:50.558039    2576 generic.go:356] "Generic (PLEG): container finished" podID="f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2" containerID="bdba5a96367f31e807b2ee31b9d00f5641fd10b79708edd86fbe461e98d6ed91" exitCode=0
Sep 16 12:02:50.558103 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:50.558096    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htz2b" event={"ID":"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2","Type":"ContainerDied","Data":"bdba5a96367f31e807b2ee31b9d00f5641fd10b79708edd86fbe461e98d6ed91"}
Sep 16 12:02:51.387535 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:51.387504    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:51.387897 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:51.387593    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2cw4" podUID="adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa"
Sep 16 12:02:51.565395 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:51.565357    2576 generic.go:356] "Generic (PLEG): container finished" podID="f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2" containerID="c4c8eaea1682ce8215e7863af8459fd33b088061a5f3880b2bb9d9ddb902ca92" exitCode=0
Sep 16 12:02:51.565556 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:51.565430    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htz2b" event={"ID":"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2","Type":"ContainerDied","Data":"c4c8eaea1682ce8215e7863af8459fd33b088061a5f3880b2bb9d9ddb902ca92"}
Sep 16 12:02:52.387826 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:52.387795    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:52.388214 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:52.387825    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:52.388214 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:52.387961    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wc55w" podUID="acdb4981-6d20-4436-8bd4-b45d51990f22"
Sep 16 12:02:52.388214 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:52.388014    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ff2t" podUID="3d17e8cd-157a-49a4-9c05-cd1e15a8ef11"
Sep 16 12:02:52.570223 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:52.570192    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-htz2b" event={"ID":"f8bb1ac9-9c65-4d16-ba57-fbe54acbf0f2","Type":"ContainerStarted","Data":"76c1eb6ce24328a150a8d5a33718065fc7399d40bd30ddc821e800fdcf2cfe7b"}
Sep 16 12:02:52.603025 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:52.602981    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-htz2b" podStartSLOduration=7.232542364 podStartE2EDuration="38.602965752s" totalImagesPullingTime="31.370423388s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:02:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:02:52.601426472 +0000 UTC m=+38.770391177" watchObservedRunningTime="2026-09-16 12:02:52.602965752 +0000 UTC m=+38.771930459"
Sep 16 12:02:53.387859 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:53.387834    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:53.388195 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:53.387925    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2cw4" podUID="adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa"
Sep 16 12:02:54.390235 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:54.390200    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:54.390680 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:54.390334    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wc55w" podUID="acdb4981-6d20-4436-8bd4-b45d51990f22"
Sep 16 12:02:54.390680 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:54.390364    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:54.390680 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:54.390461    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ff2t" podUID="3d17e8cd-157a-49a4-9c05-cd1e15a8ef11"
Sep 16 12:02:55.387760 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:55.387590    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:55.387916 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:55.387839    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2cw4" podUID="adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa"
Sep 16 12:02:56.390365 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:56.390309    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:56.390775 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:56.390334    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:56.390775 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:56.390464    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wc55w" podUID="acdb4981-6d20-4436-8bd4-b45d51990f22"
Sep 16 12:02:56.390775 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:56.390541    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ff2t" podUID="3d17e8cd-157a-49a4-9c05-cd1e15a8ef11"
Sep 16 12:02:57.387050 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:57.387021    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:57.387222 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:57.387123    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2cw4" podUID="adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa"
Sep 16 12:02:58.387930 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:58.387895    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:02:58.388401 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:58.388001    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ff2t" podUID="3d17e8cd-157a-49a4-9c05-cd1e15a8ef11"
Sep 16 12:02:58.388401 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:58.388054    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:02:58.388401 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:58.388148    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wc55w" podUID="acdb4981-6d20-4436-8bd4-b45d51990f22"
Sep 16 12:02:59.387043 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:02:59.387015    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:02:59.387214 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:02:59.387126    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2cw4" podUID="adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa"
Sep 16 12:03:00.387021 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:00.386988    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:03:00.387453 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:03:00.387107    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ff2t" podUID="3d17e8cd-157a-49a4-9c05-cd1e15a8ef11"
Sep 16 12:03:00.387453 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:00.387145    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:03:00.387453 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:03:00.387233    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wc55w" podUID="acdb4981-6d20-4436-8bd4-b45d51990f22"
Sep 16 12:03:01.301670 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:01.301640    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7ff2t"]
Sep 16 12:03:01.301843 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:01.301748    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:03:01.301843 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:01.301761    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f2cw4"]
Sep 16 12:03:01.301963 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:03:01.301852    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ff2t" podUID="3d17e8cd-157a-49a4-9c05-cd1e15a8ef11"
Sep 16 12:03:01.301963 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:01.301915    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:03:01.302095 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:03:01.302007    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2cw4" podUID="adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa"
Sep 16 12:03:01.303649 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:01.303627    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wc55w"]
Sep 16 12:03:01.303752 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:01.303696    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:03:01.303796 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:03:01.303770    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wc55w" podUID="acdb4981-6d20-4436-8bd4-b45d51990f22"
Sep 16 12:03:02.387101 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:02.387068    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:03:02.387638 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:03:02.387208    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2cw4" podUID="adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa"
Sep 16 12:03:03.387407 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:03.387367    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:03:03.387819 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:03.387369    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:03:03.387819 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:03:03.387526    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wc55w" podUID="acdb4981-6d20-4436-8bd4-b45d51990f22"
Sep 16 12:03:03.387819 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:03:03.387539    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ff2t" podUID="3d17e8cd-157a-49a4-9c05-cd1e15a8ef11"
Sep 16 12:03:04.387579 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:04.387548    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:03:04.388091 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:03:04.387654    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f2cw4" podUID="adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa"
Sep 16 12:03:05.387244 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.387216    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:03:05.387449 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:03:05.387327    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7ff2t" podUID="3d17e8cd-157a-49a4-9c05-cd1e15a8ef11"
Sep 16 12:03:05.387449 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.387403    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:03:05.387525 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:03:05.387492    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wc55w" podUID="acdb4981-6d20-4436-8bd4-b45d51990f22"
Sep 16 12:03:05.664454 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.664427    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-240.ec2.internal" event="NodeReady"
Sep 16 12:03:05.664837 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.664525    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 16 12:03:05.714660 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.714626    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-n46zh"]
Sep 16 12:03:05.716650 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.716634    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n46zh"
Sep 16 12:03:05.717684 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.717664    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-t4gsd"]
Sep 16 12:03:05.719025 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.719005    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 16 12:03:05.719124 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.719071    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 16 12:03:05.719124 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.719102    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 16 12:03:05.719221 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.719117    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 16 12:03:05.719221 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.719156    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l4nl5\""
Sep 16 12:03:05.722220 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.719699    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t4gsd"
Sep 16 12:03:05.722809 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.722787    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8hlmq\""
Sep 16 12:03:05.723557 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.723537    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 16 12:03:05.723557 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.723557    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 16 12:03:05.727255 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.727231    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n46zh"]
Sep 16 12:03:05.730085 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.730032    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t4gsd"]
Sep 16 12:03:05.749178 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.749157    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/338da2cf-d706-4e26-a554-cdf094cfab4a-metrics-tls\") pod \"dns-default-t4gsd\" (UID: \"338da2cf-d706-4e26-a554-cdf094cfab4a\") " pod="openshift-dns/dns-default-t4gsd"
Sep 16 12:03:05.749273 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.749189    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bntfg\" (UniqueName: \"kubernetes.io/projected/6d3631ca-3bfd-4470-a406-13156c76abda-kube-api-access-bntfg\") pod \"insights-runtime-extractor-n46zh\" (UID: \"6d3631ca-3bfd-4470-a406-13156c76abda\") " pod="openshift-insights/insights-runtime-extractor-n46zh"
Sep 16 12:03:05.749273 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.749211    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d3631ca-3bfd-4470-a406-13156c76abda-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n46zh\" (UID: \"6d3631ca-3bfd-4470-a406-13156c76abda\") " pod="openshift-insights/insights-runtime-extractor-n46zh"
Sep 16 12:03:05.749273 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.749252    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/338da2cf-d706-4e26-a554-cdf094cfab4a-config-volume\") pod \"dns-default-t4gsd\" (UID: \"338da2cf-d706-4e26-a554-cdf094cfab4a\") " pod="openshift-dns/dns-default-t4gsd"
Sep 16 12:03:05.749439 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.749286    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8htm9\" (UniqueName: \"kubernetes.io/projected/338da2cf-d706-4e26-a554-cdf094cfab4a-kube-api-access-8htm9\") pod \"dns-default-t4gsd\" (UID: \"338da2cf-d706-4e26-a554-cdf094cfab4a\") " pod="openshift-dns/dns-default-t4gsd"
Sep 16 12:03:05.749439 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.749303    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6d3631ca-3bfd-4470-a406-13156c76abda-crio-socket\") pod \"insights-runtime-extractor-n46zh\" (UID: \"6d3631ca-3bfd-4470-a406-13156c76abda\") " pod="openshift-insights/insights-runtime-extractor-n46zh"
Sep 16 12:03:05.749439 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.749359    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d3631ca-3bfd-4470-a406-13156c76abda-data-volume\") pod \"insights-runtime-extractor-n46zh\" (UID: \"6d3631ca-3bfd-4470-a406-13156c76abda\") " pod="openshift-insights/insights-runtime-extractor-n46zh"
Sep 16 12:03:05.749439 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.749374    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d3631ca-3bfd-4470-a406-13156c76abda-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n46zh\" (UID: \"6d3631ca-3bfd-4470-a406-13156c76abda\") " pod="openshift-insights/insights-runtime-extractor-n46zh"
Sep 16 12:03:05.749439 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.749419    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/338da2cf-d706-4e26-a554-cdf094cfab4a-tmp-dir\") pod \"dns-default-t4gsd\" (UID: \"338da2cf-d706-4e26-a554-cdf094cfab4a\") " pod="openshift-dns/dns-default-t4gsd"
Sep 16 12:03:05.819013 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.818936    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kt228"]
Sep 16 12:03:05.821017 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.821001    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kt228"
Sep 16 12:03:05.823466 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.823432    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 16 12:03:05.823466 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.823451    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 16 12:03:05.823597 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.823469    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rcl6b\""
Sep 16 12:03:05.823597 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.823486    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 16 12:03:05.830277 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.830256    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kt228"]
Sep 16 12:03:05.849882 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.849863    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d3631ca-3bfd-4470-a406-13156c76abda-data-volume\") pod \"insights-runtime-extractor-n46zh\" (UID: \"6d3631ca-3bfd-4470-a406-13156c76abda\") " pod="openshift-insights/insights-runtime-extractor-n46zh"
Sep 16 12:03:05.849993 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.849893    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d3631ca-3bfd-4470-a406-13156c76abda-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n46zh\" (UID: \"6d3631ca-3bfd-4470-a406-13156c76abda\") " pod="openshift-insights/insights-runtime-extractor-n46zh"
Sep 16 12:03:05.849993 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.849935    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/338da2cf-d706-4e26-a554-cdf094cfab4a-tmp-dir\") pod \"dns-default-t4gsd\" (UID: \"338da2cf-d706-4e26-a554-cdf094cfab4a\") " pod="openshift-dns/dns-default-t4gsd"
Sep 16 12:03:05.849993 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.849978    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/244e73f8-246b-4a53-baa6-551d6e490867-cert\") pod \"ingress-canary-kt228\" (UID: \"244e73f8-246b-4a53-baa6-551d6e490867\") " pod="openshift-ingress-canary/ingress-canary-kt228"
Sep 16 12:03:05.850127 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.850001    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c278q\" (UniqueName: \"kubernetes.io/projected/244e73f8-246b-4a53-baa6-551d6e490867-kube-api-access-c278q\") pod \"ingress-canary-kt228\" (UID: \"244e73f8-246b-4a53-baa6-551d6e490867\") " pod="openshift-ingress-canary/ingress-canary-kt228"
Sep 16 12:03:05.850197 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.850176    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/338da2cf-d706-4e26-a554-cdf094cfab4a-metrics-tls\") pod \"dns-default-t4gsd\" (UID: \"338da2cf-d706-4e26-a554-cdf094cfab4a\") " pod="openshift-dns/dns-default-t4gsd"
Sep 16 12:03:05.850249 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.850215    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d3631ca-3bfd-4470-a406-13156c76abda-data-volume\") pod \"insights-runtime-extractor-n46zh\" (UID: \"6d3631ca-3bfd-4470-a406-13156c76abda\") " pod="openshift-insights/insights-runtime-extractor-n46zh"
Sep 16 12:03:05.850249 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.850231    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bntfg\" (UniqueName: \"kubernetes.io/projected/6d3631ca-3bfd-4470-a406-13156c76abda-kube-api-access-bntfg\") pod \"insights-runtime-extractor-n46zh\" (UID: \"6d3631ca-3bfd-4470-a406-13156c76abda\") " pod="openshift-insights/insights-runtime-extractor-n46zh"
Sep 16 12:03:05.850369 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.850263    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d3631ca-3bfd-4470-a406-13156c76abda-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n46zh\" (UID: \"6d3631ca-3bfd-4470-a406-13156c76abda\") " pod="openshift-insights/insights-runtime-extractor-n46zh"
Sep 16 12:03:05.850369 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.850279    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/338da2cf-d706-4e26-a554-cdf094cfab4a-config-volume\") pod \"dns-default-t4gsd\" (UID: \"338da2cf-d706-4e26-a554-cdf094cfab4a\") " pod="openshift-dns/dns-default-t4gsd"
Sep 16 12:03:05.850369 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.850304    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8htm9\" (UniqueName: \"kubernetes.io/projected/338da2cf-d706-4e26-a554-cdf094cfab4a-kube-api-access-8htm9\") pod \"dns-default-t4gsd\" (UID: \"338da2cf-d706-4e26-a554-cdf094cfab4a\") " pod="openshift-dns/dns-default-t4gsd"
Sep 16 12:03:05.850369 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.850347    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6d3631ca-3bfd-4470-a406-13156c76abda-crio-socket\") pod \"insights-runtime-extractor-n46zh\" (UID: \"6d3631ca-3bfd-4470-a406-13156c76abda\") " pod="openshift-insights/insights-runtime-extractor-n46zh"
Sep 16 12:03:05.850543 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.850366    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/338da2cf-d706-4e26-a554-cdf094cfab4a-tmp-dir\") pod \"dns-default-t4gsd\" (UID: \"338da2cf-d706-4e26-a554-cdf094cfab4a\") " pod="openshift-dns/dns-default-t4gsd"
Sep 16 12:03:05.850543 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.850500    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6d3631ca-3bfd-4470-a406-13156c76abda-crio-socket\") pod \"insights-runtime-extractor-n46zh\" (UID: \"6d3631ca-3bfd-4470-a406-13156c76abda\") " pod="openshift-insights/insights-runtime-extractor-n46zh"
Sep 16 12:03:05.850628 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.850584    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d3631ca-3bfd-4470-a406-13156c76abda-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n46zh\" (UID: \"6d3631ca-3bfd-4470-a406-13156c76abda\") " pod="openshift-insights/insights-runtime-extractor-n46zh"
Sep 16 12:03:05.850879 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.850857    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/338da2cf-d706-4e26-a554-cdf094cfab4a-config-volume\") pod \"dns-default-t4gsd\" (UID: \"338da2cf-d706-4e26-a554-cdf094cfab4a\") " pod="openshift-dns/dns-default-t4gsd"
Sep 16 12:03:05.854142 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.854125    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d3631ca-3bfd-4470-a406-13156c76abda-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n46zh\" (UID: \"6d3631ca-3bfd-4470-a406-13156c76abda\") " pod="openshift-insights/insights-runtime-extractor-n46zh"
Sep 16 12:03:05.854208 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.854132    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/338da2cf-d706-4e26-a554-cdf094cfab4a-metrics-tls\") pod \"dns-default-t4gsd\" (UID: \"338da2cf-d706-4e26-a554-cdf094cfab4a\") " pod="openshift-dns/dns-default-t4gsd"
Sep 16 12:03:05.859117 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.859097    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8htm9\" (UniqueName: \"kubernetes.io/projected/338da2cf-d706-4e26-a554-cdf094cfab4a-kube-api-access-8htm9\") pod \"dns-default-t4gsd\" (UID: \"338da2cf-d706-4e26-a554-cdf094cfab4a\") " pod="openshift-dns/dns-default-t4gsd"
Sep 16 12:03:05.859202 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.859130    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bntfg\" (UniqueName: \"kubernetes.io/projected/6d3631ca-3bfd-4470-a406-13156c76abda-kube-api-access-bntfg\") pod \"insights-runtime-extractor-n46zh\" (UID: \"6d3631ca-3bfd-4470-a406-13156c76abda\") " pod="openshift-insights/insights-runtime-extractor-n46zh"
Sep 16 12:03:05.951426 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.951377    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/244e73f8-246b-4a53-baa6-551d6e490867-cert\") pod \"ingress-canary-kt228\" (UID: \"244e73f8-246b-4a53-baa6-551d6e490867\") " pod="openshift-ingress-canary/ingress-canary-kt228"
Sep 16 12:03:05.951426 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.951428    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c278q\" (UniqueName: \"kubernetes.io/projected/244e73f8-246b-4a53-baa6-551d6e490867-kube-api-access-c278q\") pod \"ingress-canary-kt228\" (UID: \"244e73f8-246b-4a53-baa6-551d6e490867\") " pod="openshift-ingress-canary/ingress-canary-kt228"
Sep 16 12:03:05.953886 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.953864    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/244e73f8-246b-4a53-baa6-551d6e490867-cert\") pod \"ingress-canary-kt228\" (UID: \"244e73f8-246b-4a53-baa6-551d6e490867\") " pod="openshift-ingress-canary/ingress-canary-kt228"
Sep 16 12:03:05.960680 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:05.960661    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c278q\" (UniqueName: \"kubernetes.io/projected/244e73f8-246b-4a53-baa6-551d6e490867-kube-api-access-c278q\") pod \"ingress-canary-kt228\" (UID: \"244e73f8-246b-4a53-baa6-551d6e490867\") " pod="openshift-ingress-canary/ingress-canary-kt228"
Sep 16 12:03:06.031379 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:06.031353    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n46zh"
Sep 16 12:03:06.036900 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:06.036689    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t4gsd"
Sep 16 12:03:06.129989 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:06.129946    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kt228"
Sep 16 12:03:06.319738 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:06.319706    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t4gsd"]
Sep 16 12:03:06.322672 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:06.322645    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n46zh"]
Sep 16 12:03:06.324156 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:03:06.324131    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod338da2cf_d706_4e26_a554_cdf094cfab4a.slice/crio-1bd6d3f283cb8065b2bf99380cc90748796a6c400ee76f3f4e2b703fd153cbd9 WatchSource:0}: Error finding container 1bd6d3f283cb8065b2bf99380cc90748796a6c400ee76f3f4e2b703fd153cbd9: Status 404 returned error can't find the container with id 1bd6d3f283cb8065b2bf99380cc90748796a6c400ee76f3f4e2b703fd153cbd9
Sep 16 12:03:06.325776 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:03:06.325754    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d3631ca_3bfd_4470_a406_13156c76abda.slice/crio-1ef78c91eb4de5b70f9b678078742f2477f725774b21bad67d8243efb3edf1df WatchSource:0}: Error finding container 1ef78c91eb4de5b70f9b678078742f2477f725774b21bad67d8243efb3edf1df: Status 404 returned error can't find the container with id 1ef78c91eb4de5b70f9b678078742f2477f725774b21bad67d8243efb3edf1df
Sep 16 12:03:06.387886 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:06.387861    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:03:06.390438 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:06.390420    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 12:03:06.396342 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:06.396298    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kt228"]
Sep 16 12:03:06.399761 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:03:06.399737    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod244e73f8_246b_4a53_baa6_551d6e490867.slice/crio-ced5c75883d18e6361ee578e583e2e8a4ad3272380040005840cb5f3cc1654f0 WatchSource:0}: Error finding container ced5c75883d18e6361ee578e583e2e8a4ad3272380040005840cb5f3cc1654f0: Status 404 returned error can't find the container with id ced5c75883d18e6361ee578e583e2e8a4ad3272380040005840cb5f3cc1654f0
Sep 16 12:03:06.602259 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:06.602201    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t4gsd" event={"ID":"338da2cf-d706-4e26-a554-cdf094cfab4a","Type":"ContainerStarted","Data":"1bd6d3f283cb8065b2bf99380cc90748796a6c400ee76f3f4e2b703fd153cbd9"}
Sep 16 12:03:06.603411 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:06.603378    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kt228" event={"ID":"244e73f8-246b-4a53-baa6-551d6e490867","Type":"ContainerStarted","Data":"ced5c75883d18e6361ee578e583e2e8a4ad3272380040005840cb5f3cc1654f0"}
Sep 16 12:03:06.604814 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:06.604797    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n46zh" event={"ID":"6d3631ca-3bfd-4470-a406-13156c76abda","Type":"ContainerStarted","Data":"9ee0a7d4127328346084b1f7167674e8af8bfb6753be7ef777609b24200bdd02"}
Sep 16 12:03:06.604897 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:06.604831    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n46zh" event={"ID":"6d3631ca-3bfd-4470-a406-13156c76abda","Type":"ContainerStarted","Data":"1ef78c91eb4de5b70f9b678078742f2477f725774b21bad67d8243efb3edf1df"}
Sep 16 12:03:07.388072 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:07.387795    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:03:07.388475 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:07.387810    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:03:07.392207 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:07.392179    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 12:03:07.392494 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:07.392238    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 12:03:07.392494 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:07.392279    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pcfgd\""
Sep 16 12:03:07.392494 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:07.392181    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qzcvp\""
Sep 16 12:03:07.392665 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:07.392526    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 12:03:07.609896 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:07.609856    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n46zh" event={"ID":"6d3631ca-3bfd-4470-a406-13156c76abda","Type":"ContainerStarted","Data":"6a4e4ea4ccc57ff6801d2b8e122e00cf6ff49654f4625f7f4a199275be0b4dd9"}
Sep 16 12:03:08.615035 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:08.614988    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t4gsd" event={"ID":"338da2cf-d706-4e26-a554-cdf094cfab4a","Type":"ContainerStarted","Data":"152280bfffc61dc07b9ad6d08e80dcaacb376e8a2162a92b5e7e3c0fc122b339"}
Sep 16 12:03:09.620558 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:09.620503    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t4gsd" event={"ID":"338da2cf-d706-4e26-a554-cdf094cfab4a","Type":"ContainerStarted","Data":"1e6f3e0b3117fc78fb1ba580459885817d197936fbd1f23301b03e4ebe3305dd"}
Sep 16 12:03:09.621097 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:09.620594    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-t4gsd"
Sep 16 12:03:09.622098 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:09.622074    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kt228" event={"ID":"244e73f8-246b-4a53-baa6-551d6e490867","Type":"ContainerStarted","Data":"6f4634a8918fe4453cfc8b0d8465d81b43fbe0e86f0fd8ad8939be023ad08dd9"}
Sep 16 12:03:09.623983 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:09.623963    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n46zh" event={"ID":"6d3631ca-3bfd-4470-a406-13156c76abda","Type":"ContainerStarted","Data":"8e0974dd8865ed058b311cc8cc99a0c5b6c0ebaf738d478a656837f80fcd99ca"}
Sep 16 12:03:09.640067 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:09.640027    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-t4gsd" podStartSLOduration=3.014659408 podStartE2EDuration="4.64001478s" totalImagesPullingTime="1.625355372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:03:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:03:09.639590844 +0000 UTC m=+55.808555552" watchObservedRunningTime="2026-09-16 12:03:09.64001478 +0000 UTC m=+55.808979504"
Sep 16 12:03:09.656850 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:09.656814    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-n46zh" podStartSLOduration=1.905856363 podStartE2EDuration="4.656801123s" totalImagesPullingTime="2.75094476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:03:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:03:09.656410458 +0000 UTC m=+55.825375167" watchObservedRunningTime="2026-09-16 12:03:09.656801123 +0000 UTC m=+55.825765830"
Sep 16 12:03:09.672484 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:09.672451    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kt228" podStartSLOduration=1.841557385 podStartE2EDuration="4.672439642s" totalImagesPullingTime="2.830882257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:03:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:03:09.671792486 +0000 UTC m=+55.840757193" watchObservedRunningTime="2026-09-16 12:03:09.672439642 +0000 UTC m=+55.841404348"
Sep 16 12:03:10.928276 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:10.928244    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-qbvnt"]
Sep 16 12:03:10.932167 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:10.932151    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-qbvnt"
Sep 16 12:03:10.935867 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:10.935845    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 16 12:03:10.935996 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:10.935934    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-qd9nf\""
Sep 16 12:03:10.935996 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:10.935934    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 16 12:03:10.935996 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:10.935965    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 16 12:03:10.936156 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:10.936082    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 16 12:03:10.936204 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:10.936196    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 16 12:03:10.940408 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:10.940385    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-qbvnt"]
Sep 16 12:03:11.003546 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.003519    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/deb90443-89e0-492f-a22d-4f01c5c042ac-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-qbvnt\" (UID: \"deb90443-89e0-492f-a22d-4f01c5c042ac\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qbvnt"
Sep 16 12:03:11.003655 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.003550    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deb90443-89e0-492f-a22d-4f01c5c042ac-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-qbvnt\" (UID: \"deb90443-89e0-492f-a22d-4f01c5c042ac\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qbvnt"
Sep 16 12:03:11.003655 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.003571    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/deb90443-89e0-492f-a22d-4f01c5c042ac-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-qbvnt\" (UID: \"deb90443-89e0-492f-a22d-4f01c5c042ac\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qbvnt"
Sep 16 12:03:11.003655 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.003595    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x24bp\" (UniqueName: \"kubernetes.io/projected/deb90443-89e0-492f-a22d-4f01c5c042ac-kube-api-access-x24bp\") pod \"prometheus-operator-68bcd7f987-qbvnt\" (UID: \"deb90443-89e0-492f-a22d-4f01c5c042ac\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qbvnt"
Sep 16 12:03:11.104076 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.104046    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/deb90443-89e0-492f-a22d-4f01c5c042ac-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-qbvnt\" (UID: \"deb90443-89e0-492f-a22d-4f01c5c042ac\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qbvnt"
Sep 16 12:03:11.104181 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.104082    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x24bp\" (UniqueName: \"kubernetes.io/projected/deb90443-89e0-492f-a22d-4f01c5c042ac-kube-api-access-x24bp\") pod \"prometheus-operator-68bcd7f987-qbvnt\" (UID: \"deb90443-89e0-492f-a22d-4f01c5c042ac\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qbvnt"
Sep 16 12:03:11.104181 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.104150    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/deb90443-89e0-492f-a22d-4f01c5c042ac-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-qbvnt\" (UID: \"deb90443-89e0-492f-a22d-4f01c5c042ac\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qbvnt"
Sep 16 12:03:11.104181 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.104165    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deb90443-89e0-492f-a22d-4f01c5c042ac-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-qbvnt\" (UID: \"deb90443-89e0-492f-a22d-4f01c5c042ac\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qbvnt"
Sep 16 12:03:11.104831 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.104811    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deb90443-89e0-492f-a22d-4f01c5c042ac-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-qbvnt\" (UID: \"deb90443-89e0-492f-a22d-4f01c5c042ac\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qbvnt"
Sep 16 12:03:11.107939 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.107918    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/deb90443-89e0-492f-a22d-4f01c5c042ac-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-qbvnt\" (UID: \"deb90443-89e0-492f-a22d-4f01c5c042ac\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qbvnt"
Sep 16 12:03:11.108039 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.108019    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/deb90443-89e0-492f-a22d-4f01c5c042ac-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-qbvnt\" (UID: \"deb90443-89e0-492f-a22d-4f01c5c042ac\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qbvnt"
Sep 16 12:03:11.111852 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.111831    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x24bp\" (UniqueName: \"kubernetes.io/projected/deb90443-89e0-492f-a22d-4f01c5c042ac-kube-api-access-x24bp\") pod \"prometheus-operator-68bcd7f987-qbvnt\" (UID: \"deb90443-89e0-492f-a22d-4f01c5c042ac\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-qbvnt"
Sep 16 12:03:11.241271 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.241204    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-qbvnt"
Sep 16 12:03:11.526467 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.526379    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-qbvnt"]
Sep 16 12:03:11.531138 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:03:11.531111    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeb90443_89e0_492f_a22d_4f01c5c042ac.slice/crio-5adf1c24256d378a1ec0c56b1e470201d446abeb23be2deea69fdce1e8030b36 WatchSource:0}: Error finding container 5adf1c24256d378a1ec0c56b1e470201d446abeb23be2deea69fdce1e8030b36: Status 404 returned error can't find the container with id 5adf1c24256d378a1ec0c56b1e470201d446abeb23be2deea69fdce1e8030b36
Sep 16 12:03:11.567418 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.567392    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d446cd64f-swjnm"]
Sep 16 12:03:11.595266 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.595246    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d446cd64f-swjnm"]
Sep 16 12:03:11.595377 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.595350    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d446cd64f-swjnm"
Sep 16 12:03:11.600172 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.600149    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 16 12:03:11.600266 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.600159    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 16 12:03:11.601163 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.601143    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jg44n\""
Sep 16 12:03:11.601267 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.601239    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 16 12:03:11.602471 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.602455    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 16 12:03:11.603361 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.603304    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 16 12:03:11.603361 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.603338    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 16 12:03:11.603537 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.603350    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 16 12:03:11.630286 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.630261    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-qbvnt" event={"ID":"deb90443-89e0-492f-a22d-4f01c5c042ac","Type":"ContainerStarted","Data":"5adf1c24256d378a1ec0c56b1e470201d446abeb23be2deea69fdce1e8030b36"}
Sep 16 12:03:11.708880 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.708857    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7146f48d-b0e1-4322-bc3f-544d5bb939c0-console-serving-cert\") pod \"console-6d446cd64f-swjnm\" (UID: \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\") " pod="openshift-console/console-6d446cd64f-swjnm"
Sep 16 12:03:11.708964 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.708898    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7146f48d-b0e1-4322-bc3f-544d5bb939c0-console-oauth-config\") pod \"console-6d446cd64f-swjnm\" (UID: \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\") " pod="openshift-console/console-6d446cd64f-swjnm"
Sep 16 12:03:11.708964 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.708917    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7146f48d-b0e1-4322-bc3f-544d5bb939c0-console-config\") pod \"console-6d446cd64f-swjnm\" (UID: \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\") " pod="openshift-console/console-6d446cd64f-swjnm"
Sep 16 12:03:11.708964 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.708956    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7146f48d-b0e1-4322-bc3f-544d5bb939c0-service-ca\") pod \"console-6d446cd64f-swjnm\" (UID: \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\") " pod="openshift-console/console-6d446cd64f-swjnm"
Sep 16 12:03:11.709063 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.708979    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68b9l\" (UniqueName: \"kubernetes.io/projected/7146f48d-b0e1-4322-bc3f-544d5bb939c0-kube-api-access-68b9l\") pod \"console-6d446cd64f-swjnm\" (UID: \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\") " pod="openshift-console/console-6d446cd64f-swjnm"
Sep 16 12:03:11.709063 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.709005    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7146f48d-b0e1-4322-bc3f-544d5bb939c0-oauth-serving-cert\") pod \"console-6d446cd64f-swjnm\" (UID: \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\") " pod="openshift-console/console-6d446cd64f-swjnm"
Sep 16 12:03:11.809507 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.809454    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7146f48d-b0e1-4322-bc3f-544d5bb939c0-console-serving-cert\") pod \"console-6d446cd64f-swjnm\" (UID: \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\") " pod="openshift-console/console-6d446cd64f-swjnm"
Sep 16 12:03:11.809608 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.809507    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7146f48d-b0e1-4322-bc3f-544d5bb939c0-console-oauth-config\") pod \"console-6d446cd64f-swjnm\" (UID: \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\") " pod="openshift-console/console-6d446cd64f-swjnm"
Sep 16 12:03:11.809608 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.809539    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7146f48d-b0e1-4322-bc3f-544d5bb939c0-console-config\") pod \"console-6d446cd64f-swjnm\" (UID: \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\") " pod="openshift-console/console-6d446cd64f-swjnm"
Sep 16 12:03:11.809608 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.809566    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7146f48d-b0e1-4322-bc3f-544d5bb939c0-service-ca\") pod \"console-6d446cd64f-swjnm\" (UID: \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\") " pod="openshift-console/console-6d446cd64f-swjnm"
Sep 16 12:03:11.809608 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.809588    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68b9l\" (UniqueName: \"kubernetes.io/projected/7146f48d-b0e1-4322-bc3f-544d5bb939c0-kube-api-access-68b9l\") pod \"console-6d446cd64f-swjnm\" (UID: \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\") " pod="openshift-console/console-6d446cd64f-swjnm"
Sep 16 12:03:11.809796 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.809637    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7146f48d-b0e1-4322-bc3f-544d5bb939c0-oauth-serving-cert\") pod \"console-6d446cd64f-swjnm\" (UID: \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\") " pod="openshift-console/console-6d446cd64f-swjnm"
Sep 16 12:03:11.810329 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.810292    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7146f48d-b0e1-4322-bc3f-544d5bb939c0-oauth-serving-cert\") pod \"console-6d446cd64f-swjnm\" (UID: \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\") " pod="openshift-console/console-6d446cd64f-swjnm"
Sep 16 12:03:11.810419 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.810383    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7146f48d-b0e1-4322-bc3f-544d5bb939c0-service-ca\") pod \"console-6d446cd64f-swjnm\" (UID: \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\") " pod="openshift-console/console-6d446cd64f-swjnm"
Sep 16 12:03:11.810419 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.810393    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7146f48d-b0e1-4322-bc3f-544d5bb939c0-console-config\") pod \"console-6d446cd64f-swjnm\" (UID: \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\") " pod="openshift-console/console-6d446cd64f-swjnm"
Sep 16 12:03:11.811918 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.811899    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7146f48d-b0e1-4322-bc3f-544d5bb939c0-console-serving-cert\") pod \"console-6d446cd64f-swjnm\" (UID: \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\") " pod="openshift-console/console-6d446cd64f-swjnm"
Sep 16 12:03:11.811992 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.811928    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7146f48d-b0e1-4322-bc3f-544d5bb939c0-console-oauth-config\") pod \"console-6d446cd64f-swjnm\" (UID: \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\") " pod="openshift-console/console-6d446cd64f-swjnm"
Sep 16 12:03:11.817826 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.817810    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68b9l\" (UniqueName: \"kubernetes.io/projected/7146f48d-b0e1-4322-bc3f-544d5bb939c0-kube-api-access-68b9l\") pod \"console-6d446cd64f-swjnm\" (UID: \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\") " pod="openshift-console/console-6d446cd64f-swjnm"
Sep 16 12:03:11.903780 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:11.903757    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d446cd64f-swjnm"
Sep 16 12:03:12.199195 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:12.199167    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d446cd64f-swjnm"]
Sep 16 12:03:12.202180 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:03:12.202150    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7146f48d_b0e1_4322_bc3f_544d5bb939c0.slice/crio-90e481cab85ebff4ae3375bda1e26177144435350b9a034e46b432cc2b90050b WatchSource:0}: Error finding container 90e481cab85ebff4ae3375bda1e26177144435350b9a034e46b432cc2b90050b: Status 404 returned error can't find the container with id 90e481cab85ebff4ae3375bda1e26177144435350b9a034e46b432cc2b90050b
Sep 16 12:03:12.635416 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:12.635384    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d446cd64f-swjnm" event={"ID":"7146f48d-b0e1-4322-bc3f-544d5bb939c0","Type":"ContainerStarted","Data":"90e481cab85ebff4ae3375bda1e26177144435350b9a034e46b432cc2b90050b"}
Sep 16 12:03:13.641093 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:13.641050    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-qbvnt" event={"ID":"deb90443-89e0-492f-a22d-4f01c5c042ac","Type":"ContainerStarted","Data":"b75f157115435314d5d298f9a3150076da141f42fbc9dd0150eb02428094489e"}
Sep 16 12:03:13.641591 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:13.641146    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-qbvnt" event={"ID":"deb90443-89e0-492f-a22d-4f01c5c042ac","Type":"ContainerStarted","Data":"a0a7c5df7d9e90706ee70a79bd84a8db20be94fb98202352d69b5fd1f8d3f72e"}
Sep 16 12:03:13.658617 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:13.658571    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-qbvnt" podStartSLOduration=2.182852333 podStartE2EDuration="3.658555859s" totalImagesPullingTime="1.475703526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:03:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:03:13.656713991 +0000 UTC m=+59.825678697" watchObservedRunningTime="2026-09-16 12:03:13.658555859 +0000 UTC m=+59.827520566"
Sep 16 12:03:14.553109 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:14.553071    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tb7dg"
Sep 16 12:03:15.300830 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.300800    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-gb9t4"]
Sep 16 12:03:15.309051 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.309025    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gb9t4"
Sep 16 12:03:15.311923 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.311895    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-225lm\""
Sep 16 12:03:15.311923 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.311918    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 16 12:03:15.312459 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.312238    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 16 12:03:15.318431 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.318409    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-gb9t4"]
Sep 16 12:03:15.323121 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.323096    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f"]
Sep 16 12:03:15.326281 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.326263    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f"
Sep 16 12:03:15.328817 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.328794    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-z87bt"]
Sep 16 12:03:15.329661 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.329640    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-fl25v\""
Sep 16 12:03:15.329910 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.329892    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 16 12:03:15.330009 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.329947    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 16 12:03:15.330074 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.330047    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 16 12:03:15.332140 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.332101    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.334540 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.334369    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 16 12:03:15.334540 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.334394    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-twxkx\""
Sep 16 12:03:15.334731 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.334639    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 16 12:03:15.334803 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.334763    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 16 12:03:15.342507 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.342454    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f"]
Sep 16 12:03:15.437792 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.437760    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-sys\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.437792 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.437792    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/37f094a7-073d-4e13-a44e-725b73012a35-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-4mc9f\" (UID: \"37f094a7-073d-4e13-a44e-725b73012a35\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f"
Sep 16 12:03:15.437989 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.437813    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-metrics-client-ca\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.437989 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.437827    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-659sd\" (UniqueName: \"kubernetes.io/projected/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-kube-api-access-659sd\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.437989 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.437905    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-node-exporter-wtmp\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.437989 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.437955    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-node-exporter-tls\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.437989 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.437972    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59dvn\" (UniqueName: \"kubernetes.io/projected/37f094a7-073d-4e13-a44e-725b73012a35-kube-api-access-59dvn\") pod \"kube-state-metrics-59fbdd77d-4mc9f\" (UID: \"37f094a7-073d-4e13-a44e-725b73012a35\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f"
Sep 16 12:03:15.437989 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.437993    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw5pg\" (UniqueName: \"kubernetes.io/projected/aa578d5c-1d4a-465a-8f1d-00e7be81a208-kube-api-access-bw5pg\") pod \"openshift-state-metrics-67dcf8c979-gb9t4\" (UID: \"aa578d5c-1d4a-465a-8f1d-00e7be81a208\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gb9t4"
Sep 16 12:03:15.438196 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.438009    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/37f094a7-073d-4e13-a44e-725b73012a35-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-4mc9f\" (UID: \"37f094a7-073d-4e13-a44e-725b73012a35\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f"
Sep 16 12:03:15.438196 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.438025    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa578d5c-1d4a-465a-8f1d-00e7be81a208-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-gb9t4\" (UID: \"aa578d5c-1d4a-465a-8f1d-00e7be81a208\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gb9t4"
Sep 16 12:03:15.438196 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.438046    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/37f094a7-073d-4e13-a44e-725b73012a35-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-4mc9f\" (UID: \"37f094a7-073d-4e13-a44e-725b73012a35\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f"
Sep 16 12:03:15.438196 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.438067    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa578d5c-1d4a-465a-8f1d-00e7be81a208-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-gb9t4\" (UID: \"aa578d5c-1d4a-465a-8f1d-00e7be81a208\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gb9t4"
Sep 16 12:03:15.438196 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.438116    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-node-exporter-textfile\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.438196 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.438147    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-node-exporter-accelerators-collector-config\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.438196 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.438183    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa578d5c-1d4a-465a-8f1d-00e7be81a208-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-gb9t4\" (UID: \"aa578d5c-1d4a-465a-8f1d-00e7be81a208\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gb9t4"
Sep 16 12:03:15.438447 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.438202    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-root\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.438447 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.438216    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37f094a7-073d-4e13-a44e-725b73012a35-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-4mc9f\" (UID: \"37f094a7-073d-4e13-a44e-725b73012a35\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f"
Sep 16 12:03:15.438447 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.438254    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.438447 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.438301    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37f094a7-073d-4e13-a44e-725b73012a35-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-4mc9f\" (UID: \"37f094a7-073d-4e13-a44e-725b73012a35\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f"
Sep 16 12:03:15.539179 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.539156    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-metrics-client-ca\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.539280 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.539185    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-659sd\" (UniqueName: \"kubernetes.io/projected/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-kube-api-access-659sd\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.539280 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.539208    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-node-exporter-wtmp\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.539280 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.539250    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-node-exporter-tls\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.539280 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.539274    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59dvn\" (UniqueName: \"kubernetes.io/projected/37f094a7-073d-4e13-a44e-725b73012a35-kube-api-access-59dvn\") pod \"kube-state-metrics-59fbdd77d-4mc9f\" (UID: \"37f094a7-073d-4e13-a44e-725b73012a35\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f"
Sep 16 12:03:15.539491 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.539299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw5pg\" (UniqueName: \"kubernetes.io/projected/aa578d5c-1d4a-465a-8f1d-00e7be81a208-kube-api-access-bw5pg\") pod \"openshift-state-metrics-67dcf8c979-gb9t4\" (UID: \"aa578d5c-1d4a-465a-8f1d-00e7be81a208\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gb9t4"
Sep 16 12:03:15.539491 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.539341    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/37f094a7-073d-4e13-a44e-725b73012a35-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-4mc9f\" (UID: \"37f094a7-073d-4e13-a44e-725b73012a35\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f"
Sep 16 12:03:15.539491 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.539470    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-node-exporter-wtmp\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.539639 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.539543    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa578d5c-1d4a-465a-8f1d-00e7be81a208-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-gb9t4\" (UID: \"aa578d5c-1d4a-465a-8f1d-00e7be81a208\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gb9t4"
Sep 16 12:03:15.539639 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.539592    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/37f094a7-073d-4e13-a44e-725b73012a35-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-4mc9f\" (UID: \"37f094a7-073d-4e13-a44e-725b73012a35\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f"
Sep 16 12:03:15.539639 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.539630    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa578d5c-1d4a-465a-8f1d-00e7be81a208-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-gb9t4\" (UID: \"aa578d5c-1d4a-465a-8f1d-00e7be81a208\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gb9t4"
Sep 16 12:03:15.539785 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.539659    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-node-exporter-textfile\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.539785 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.539684    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-node-exporter-accelerators-collector-config\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.539785 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.539710    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa578d5c-1d4a-465a-8f1d-00e7be81a208-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-gb9t4\" (UID: \"aa578d5c-1d4a-465a-8f1d-00e7be81a208\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gb9t4"
Sep 16 12:03:15.539785 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.539735    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-root\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.539785 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.539759    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37f094a7-073d-4e13-a44e-725b73012a35-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-4mc9f\" (UID: \"37f094a7-073d-4e13-a44e-725b73012a35\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f"
Sep 16 12:03:15.540026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.539794    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.540026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.539827    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/37f094a7-073d-4e13-a44e-725b73012a35-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-4mc9f\" (UID: \"37f094a7-073d-4e13-a44e-725b73012a35\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f"
Sep 16 12:03:15.540026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.539852    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37f094a7-073d-4e13-a44e-725b73012a35-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-4mc9f\" (UID: \"37f094a7-073d-4e13-a44e-725b73012a35\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f"
Sep 16 12:03:15.540026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.539896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-sys\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.540026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.539912    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-metrics-client-ca\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.540026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.539921    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/37f094a7-073d-4e13-a44e-725b73012a35-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-4mc9f\" (UID: \"37f094a7-073d-4e13-a44e-725b73012a35\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f"
Sep 16 12:03:15.540026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.540013    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-root\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.540477 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.540170    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-node-exporter-textfile\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.540477 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.540274    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa578d5c-1d4a-465a-8f1d-00e7be81a208-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-gb9t4\" (UID: \"aa578d5c-1d4a-465a-8f1d-00e7be81a208\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gb9t4"
Sep 16 12:03:15.540594 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.540579    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-node-exporter-accelerators-collector-config\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.540668 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.540649    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-sys\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.540729 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.540702    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37f094a7-073d-4e13-a44e-725b73012a35-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-4mc9f\" (UID: \"37f094a7-073d-4e13-a44e-725b73012a35\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f"
Sep 16 12:03:15.540784 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.540723    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/37f094a7-073d-4e13-a44e-725b73012a35-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-4mc9f\" (UID: \"37f094a7-073d-4e13-a44e-725b73012a35\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f"
Sep 16 12:03:15.542124 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.542101    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-node-exporter-tls\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.543081 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.543055    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa578d5c-1d4a-465a-8f1d-00e7be81a208-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-gb9t4\" (UID: \"aa578d5c-1d4a-465a-8f1d-00e7be81a208\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gb9t4"
Sep 16 12:03:15.543524 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.543497    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa578d5c-1d4a-465a-8f1d-00e7be81a208-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-gb9t4\" (UID: \"aa578d5c-1d4a-465a-8f1d-00e7be81a208\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gb9t4"
Sep 16 12:03:15.543618 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.543527    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.543618 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.543602    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/37f094a7-073d-4e13-a44e-725b73012a35-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-4mc9f\" (UID: \"37f094a7-073d-4e13-a44e-725b73012a35\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f"
Sep 16 12:03:15.543695 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.543632    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/37f094a7-073d-4e13-a44e-725b73012a35-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-4mc9f\" (UID: \"37f094a7-073d-4e13-a44e-725b73012a35\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f"
Sep 16 12:03:15.549614 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.549590    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-659sd\" (UniqueName: \"kubernetes.io/projected/c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564-kube-api-access-659sd\") pod \"node-exporter-z87bt\" (UID: \"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564\") " pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.549698 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.549650    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59dvn\" (UniqueName: \"kubernetes.io/projected/37f094a7-073d-4e13-a44e-725b73012a35-kube-api-access-59dvn\") pod \"kube-state-metrics-59fbdd77d-4mc9f\" (UID: \"37f094a7-073d-4e13-a44e-725b73012a35\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f"
Sep 16 12:03:15.549761 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.549744    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw5pg\" (UniqueName: \"kubernetes.io/projected/aa578d5c-1d4a-465a-8f1d-00e7be81a208-kube-api-access-bw5pg\") pod \"openshift-state-metrics-67dcf8c979-gb9t4\" (UID: \"aa578d5c-1d4a-465a-8f1d-00e7be81a208\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gb9t4"
Sep 16 12:03:15.619609 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.619581    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gb9t4"
Sep 16 12:03:15.636925 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.636899    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f"
Sep 16 12:03:15.644037 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.644016    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z87bt"
Sep 16 12:03:15.649850 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.649828    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d446cd64f-swjnm" event={"ID":"7146f48d-b0e1-4322-bc3f-544d5bb939c0","Type":"ContainerStarted","Data":"7e7f58986a76aa7dc2b6f020f5ad860e0494be065b7bedd86c38617cd1573b33"}
Sep 16 12:03:15.654229 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:03:15.654203    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc32bbaf2_8460_4cfe_9dd5_7dd7c56d1564.slice/crio-29eadb1726bd91f90267c0dfc99e9d905654072ed0ffefad53d7661b2925beed WatchSource:0}: Error finding container 29eadb1726bd91f90267c0dfc99e9d905654072ed0ffefad53d7661b2925beed: Status 404 returned error can't find the container with id 29eadb1726bd91f90267c0dfc99e9d905654072ed0ffefad53d7661b2925beed
Sep 16 12:03:15.667907 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.667858    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d446cd64f-swjnm" podStartSLOduration=1.39605045 podStartE2EDuration="4.667842839s" totalImagesPullingTime="3.271792389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:03:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:03:15.666919941 +0000 UTC m=+61.835884648" watchObservedRunningTime="2026-09-16 12:03:15.667842839 +0000 UTC m=+61.836807545"
Sep 16 12:03:15.900127 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.900051    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-gb9t4"]
Sep 16 12:03:15.903548 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:03:15.903521    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa578d5c_1d4a_465a_8f1d_00e7be81a208.slice/crio-23f262d5f76cf8c3607cc3d49a40ebe4b438bafa9fc25e3be186655db4f08245 WatchSource:0}: Error finding container 23f262d5f76cf8c3607cc3d49a40ebe4b438bafa9fc25e3be186655db4f08245: Status 404 returned error can't find the container with id 23f262d5f76cf8c3607cc3d49a40ebe4b438bafa9fc25e3be186655db4f08245
Sep 16 12:03:15.921440 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:15.921419    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f"]
Sep 16 12:03:15.944241 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:03:15.944216    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f094a7_073d_4e13_a44e_725b73012a35.slice/crio-d93143dfe2276f920548ee883154c27f8edb491be729f114c8e5baec3d584e56 WatchSource:0}: Error finding container d93143dfe2276f920548ee883154c27f8edb491be729f114c8e5baec3d584e56: Status 404 returned error can't find the container with id d93143dfe2276f920548ee883154c27f8edb491be729f114c8e5baec3d584e56
Sep 16 12:03:16.421573 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.421542    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 12:03:16.425281 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.425257    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.428056 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.428036    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 16 12:03:16.428437 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.428419    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 16 12:03:16.428763 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.428735    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 16 12:03:16.428931 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.428915    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 16 12:03:16.429133 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.429118    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wlwv9\""
Sep 16 12:03:16.430339 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.429470    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 16 12:03:16.430339 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.429597    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 16 12:03:16.430339 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.429627    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 16 12:03:16.430339 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.429849    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 16 12:03:16.430339 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.430191    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 16 12:03:16.441884 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.441863    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 12:03:16.548836 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.548770    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8574462b-bf21-498d-bf95-aac976785e75-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.548836 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.548825    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-config-volume\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.549140 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.548845    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.549140 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.548862    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8574462b-bf21-498d-bf95-aac976785e75-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.549140 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.548880    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.549140 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.548934    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8574462b-bf21-498d-bf95-aac976785e75-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.549140 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.549016    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.549140 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.549066    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8574462b-bf21-498d-bf95-aac976785e75-config-out\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.549140 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.549114    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.549140 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.549142    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.549567 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.549193    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nmj4\" (UniqueName: \"kubernetes.io/projected/8574462b-bf21-498d-bf95-aac976785e75-kube-api-access-2nmj4\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.549567 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.549230    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-web-config\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.549567 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.549296    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8574462b-bf21-498d-bf95-aac976785e75-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.649779 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.649747    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.649927 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.649795    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8574462b-bf21-498d-bf95-aac976785e75-config-out\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.649927 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.649824    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.649927 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.649840    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.649927 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.649862    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nmj4\" (UniqueName: \"kubernetes.io/projected/8574462b-bf21-498d-bf95-aac976785e75-kube-api-access-2nmj4\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.649927 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.649881    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-web-config\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.649927 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.649905    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8574462b-bf21-498d-bf95-aac976785e75-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.652181 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.650426    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8574462b-bf21-498d-bf95-aac976785e75-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.652181 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.650477    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-config-volume\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.652181 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.650601    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.652181 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.650702    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8574462b-bf21-498d-bf95-aac976785e75-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.652181 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.650730    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.652181 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.650768    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8574462b-bf21-498d-bf95-aac976785e75-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.652181 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.650797    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8574462b-bf21-498d-bf95-aac976785e75-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.652181 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.651506    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8574462b-bf21-498d-bf95-aac976785e75-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.652181 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:03:16.651646    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8574462b-bf21-498d-bf95-aac976785e75-alertmanager-trusted-ca-bundle podName:8574462b-bf21-498d-bf95-aac976785e75 nodeName:}" failed. No retries permitted until 2026-09-16 12:03:17.15162654 +0000 UTC m=+63.320591240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/8574462b-bf21-498d-bf95-aac976785e75-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "8574462b-bf21-498d-bf95-aac976785e75") : configmap references non-existent config key: ca-bundle.crt
Sep 16 12:03:16.654004 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.652828    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.654004 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.652899    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8574462b-bf21-498d-bf95-aac976785e75-config-out\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.654004 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.653350    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.654004 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.653960    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8574462b-bf21-498d-bf95-aac976785e75-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.654991 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.654944    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.655096 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.655074    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.655329 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.655293    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-web-config\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.655669 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.655625    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-config-volume\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.655921 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.655781    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.657808 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.657783    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nmj4\" (UniqueName: \"kubernetes.io/projected/8574462b-bf21-498d-bf95-aac976785e75-kube-api-access-2nmj4\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:16.657930 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.657835    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z87bt" event={"ID":"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564","Type":"ContainerStarted","Data":"29eadb1726bd91f90267c0dfc99e9d905654072ed0ffefad53d7661b2925beed"}
Sep 16 12:03:16.660737 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.660633    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gb9t4" event={"ID":"aa578d5c-1d4a-465a-8f1d-00e7be81a208","Type":"ContainerStarted","Data":"24f4639d1f4a816839b43f7daaa559d0d7b623d581546329ad77edcd004567c2"}
Sep 16 12:03:16.660737 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.660682    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gb9t4" event={"ID":"aa578d5c-1d4a-465a-8f1d-00e7be81a208","Type":"ContainerStarted","Data":"70d934b0ad712584e214b79a4bef14eca50d9ea075ecd8cc033e40ca21b2f00b"}
Sep 16 12:03:16.660737 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.660706    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gb9t4" event={"ID":"aa578d5c-1d4a-465a-8f1d-00e7be81a208","Type":"ContainerStarted","Data":"23f262d5f76cf8c3607cc3d49a40ebe4b438bafa9fc25e3be186655db4f08245"}
Sep 16 12:03:16.662380 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:16.662357    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f" event={"ID":"37f094a7-073d-4e13-a44e-725b73012a35","Type":"ContainerStarted","Data":"d93143dfe2276f920548ee883154c27f8edb491be729f114c8e5baec3d584e56"}
Sep 16 12:03:17.156305 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:17.156261    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8574462b-bf21-498d-bf95-aac976785e75-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:17.157173 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:17.157144    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8574462b-bf21-498d-bf95-aac976785e75-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:17.337852 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:17.337762    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:03:17.671186 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:17.671157    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gb9t4" event={"ID":"aa578d5c-1d4a-465a-8f1d-00e7be81a208","Type":"ContainerStarted","Data":"1c038829cac3076b7e6b23f1a348b34c963a573f6adcc6febc9c8ec403973b70"}
Sep 16 12:03:17.672984 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:17.672954    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f" event={"ID":"37f094a7-073d-4e13-a44e-725b73012a35","Type":"ContainerStarted","Data":"196f80c68c5d26f6628a2b554b0b5cac62fa9279d63b4d1a38bd035dfdc59744"}
Sep 16 12:03:17.677294 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:17.677252    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z87bt" event={"ID":"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564","Type":"ContainerStarted","Data":"bde449a66bb56d2551dd6d615207e7e756ea001a403389db3b84a938fe4d5c7d"}
Sep 16 12:03:17.697725 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:17.697662    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gb9t4" podStartSLOduration=1.197877324 podStartE2EDuration="2.697640885s" totalImagesPullingTime="1.499763561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:03:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:03:17.696417493 +0000 UTC m=+63.865382203" watchObservedRunningTime="2026-09-16 12:03:17.697640885 +0000 UTC m=+63.866605595"
Sep 16 12:03:17.829719 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:17.829466    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 12:03:17.832046 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:03:17.832020    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8574462b_bf21_498d_bf95_aac976785e75.slice/crio-666459339d37622d27234ea1bc968b96632fb06fb95995c635ac0e07f493f2ad WatchSource:0}: Error finding container 666459339d37622d27234ea1bc968b96632fb06fb95995c635ac0e07f493f2ad: Status 404 returned error can't find the container with id 666459339d37622d27234ea1bc968b96632fb06fb95995c635ac0e07f493f2ad
Sep 16 12:03:18.304638 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.304599    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"]
Sep 16 12:03:18.309015 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.308997    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:18.311450 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.311426    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 16 12:03:18.311585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.311461    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-nmg4j\""
Sep 16 12:03:18.311585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.311500    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-80raqcbqa0jv4\""
Sep 16 12:03:18.311585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.311459    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 16 12:03:18.311760 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.311500    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 16 12:03:18.311760 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.311459    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 16 12:03:18.311842 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.311820    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 16 12:03:18.320591 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.320570    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"]
Sep 16 12:03:18.366928 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.366896    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3d558b8f-26c9-4f80-9697-60b5e5291a50-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d4679ccc4-7l8jv\" (UID: \"3d558b8f-26c9-4f80-9697-60b5e5291a50\") " pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:18.367083 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.366936    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d558b8f-26c9-4f80-9697-60b5e5291a50-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d4679ccc4-7l8jv\" (UID: \"3d558b8f-26c9-4f80-9697-60b5e5291a50\") " pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:18.367083 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.366959    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kfd5\" (UniqueName: \"kubernetes.io/projected/3d558b8f-26c9-4f80-9697-60b5e5291a50-kube-api-access-6kfd5\") pod \"thanos-querier-6d4679ccc4-7l8jv\" (UID: \"3d558b8f-26c9-4f80-9697-60b5e5291a50\") " pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:18.367083 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.367032    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d558b8f-26c9-4f80-9697-60b5e5291a50-metrics-client-ca\") pod \"thanos-querier-6d4679ccc4-7l8jv\" (UID: \"3d558b8f-26c9-4f80-9697-60b5e5291a50\") " pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:18.367220 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.367082    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d558b8f-26c9-4f80-9697-60b5e5291a50-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d4679ccc4-7l8jv\" (UID: \"3d558b8f-26c9-4f80-9697-60b5e5291a50\") " pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:18.367220 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.367116    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3d558b8f-26c9-4f80-9697-60b5e5291a50-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d4679ccc4-7l8jv\" (UID: \"3d558b8f-26c9-4f80-9697-60b5e5291a50\") " pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:18.367220 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.367141    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3d558b8f-26c9-4f80-9697-60b5e5291a50-secret-thanos-querier-tls\") pod \"thanos-querier-6d4679ccc4-7l8jv\" (UID: \"3d558b8f-26c9-4f80-9697-60b5e5291a50\") " pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:18.367220 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.367203    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3d558b8f-26c9-4f80-9697-60b5e5291a50-secret-grpc-tls\") pod \"thanos-querier-6d4679ccc4-7l8jv\" (UID: \"3d558b8f-26c9-4f80-9697-60b5e5291a50\") " pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:18.468197 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.468166    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3d558b8f-26c9-4f80-9697-60b5e5291a50-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d4679ccc4-7l8jv\" (UID: \"3d558b8f-26c9-4f80-9697-60b5e5291a50\") " pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:18.468416 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.468209    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d558b8f-26c9-4f80-9697-60b5e5291a50-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d4679ccc4-7l8jv\" (UID: \"3d558b8f-26c9-4f80-9697-60b5e5291a50\") " pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:18.468416 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.468244    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kfd5\" (UniqueName: \"kubernetes.io/projected/3d558b8f-26c9-4f80-9697-60b5e5291a50-kube-api-access-6kfd5\") pod \"thanos-querier-6d4679ccc4-7l8jv\" (UID: \"3d558b8f-26c9-4f80-9697-60b5e5291a50\") " pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:18.468416 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.468264    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d558b8f-26c9-4f80-9697-60b5e5291a50-metrics-client-ca\") pod \"thanos-querier-6d4679ccc4-7l8jv\" (UID: \"3d558b8f-26c9-4f80-9697-60b5e5291a50\") " pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:18.468416 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.468306    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d558b8f-26c9-4f80-9697-60b5e5291a50-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d4679ccc4-7l8jv\" (UID: \"3d558b8f-26c9-4f80-9697-60b5e5291a50\") " pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:18.468416 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.468371    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3d558b8f-26c9-4f80-9697-60b5e5291a50-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d4679ccc4-7l8jv\" (UID: \"3d558b8f-26c9-4f80-9697-60b5e5291a50\") " pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:18.468416 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.468407    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3d558b8f-26c9-4f80-9697-60b5e5291a50-secret-thanos-querier-tls\") pod \"thanos-querier-6d4679ccc4-7l8jv\" (UID: \"3d558b8f-26c9-4f80-9697-60b5e5291a50\") " pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:18.468757 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.468459    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3d558b8f-26c9-4f80-9697-60b5e5291a50-secret-grpc-tls\") pod \"thanos-querier-6d4679ccc4-7l8jv\" (UID: \"3d558b8f-26c9-4f80-9697-60b5e5291a50\") " pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:18.469086 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.469036    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d558b8f-26c9-4f80-9697-60b5e5291a50-metrics-client-ca\") pod \"thanos-querier-6d4679ccc4-7l8jv\" (UID: \"3d558b8f-26c9-4f80-9697-60b5e5291a50\") " pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:18.471433 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.471406    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d558b8f-26c9-4f80-9697-60b5e5291a50-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d4679ccc4-7l8jv\" (UID: \"3d558b8f-26c9-4f80-9697-60b5e5291a50\") " pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:18.471565 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.471538    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3d558b8f-26c9-4f80-9697-60b5e5291a50-secret-grpc-tls\") pod \"thanos-querier-6d4679ccc4-7l8jv\" (UID: \"3d558b8f-26c9-4f80-9697-60b5e5291a50\") " pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:18.471668 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.471635    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3d558b8f-26c9-4f80-9697-60b5e5291a50-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d4679ccc4-7l8jv\" (UID: \"3d558b8f-26c9-4f80-9697-60b5e5291a50\") " pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:18.471901 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.471881    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3d558b8f-26c9-4f80-9697-60b5e5291a50-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d4679ccc4-7l8jv\" (UID: \"3d558b8f-26c9-4f80-9697-60b5e5291a50\") " pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:18.471967 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.471888    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3d558b8f-26c9-4f80-9697-60b5e5291a50-secret-thanos-querier-tls\") pod \"thanos-querier-6d4679ccc4-7l8jv\" (UID: \"3d558b8f-26c9-4f80-9697-60b5e5291a50\") " pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:18.472519 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.472494    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d558b8f-26c9-4f80-9697-60b5e5291a50-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d4679ccc4-7l8jv\" (UID: \"3d558b8f-26c9-4f80-9697-60b5e5291a50\") " pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:18.476236 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.476211    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kfd5\" (UniqueName: \"kubernetes.io/projected/3d558b8f-26c9-4f80-9697-60b5e5291a50-kube-api-access-6kfd5\") pod \"thanos-querier-6d4679ccc4-7l8jv\" (UID: \"3d558b8f-26c9-4f80-9697-60b5e5291a50\") " pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:18.617694 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.617471    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:18.686820 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.686700    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8574462b-bf21-498d-bf95-aac976785e75","Type":"ContainerStarted","Data":"666459339d37622d27234ea1bc968b96632fb06fb95995c635ac0e07f493f2ad"}
Sep 16 12:03:18.689005 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.688974    2576 generic.go:356] "Generic (PLEG): container finished" podID="c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564" containerID="bde449a66bb56d2551dd6d615207e7e756ea001a403389db3b84a938fe4d5c7d" exitCode=0
Sep 16 12:03:18.689110 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.689080    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z87bt" event={"ID":"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564","Type":"ContainerDied","Data":"bde449a66bb56d2551dd6d615207e7e756ea001a403389db3b84a938fe4d5c7d"}
Sep 16 12:03:18.693590 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.693569    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f" event={"ID":"37f094a7-073d-4e13-a44e-725b73012a35","Type":"ContainerStarted","Data":"7036febe2529f821abb6fa4879ecb6f70849dd26ba02fcf0df654ea3e8553bf4"}
Sep 16 12:03:18.693667 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.693610    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f" event={"ID":"37f094a7-073d-4e13-a44e-725b73012a35","Type":"ContainerStarted","Data":"bec6be910b79cfa19445bd3d5530bba944de463ecde4e950c398c4b4fc4c8da0"}
Sep 16 12:03:18.726227 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.726184    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-4mc9f" podStartSLOduration=2.120507048 podStartE2EDuration="3.726170429s" totalImagesPullingTime="1.605663381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:03:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:03:18.725843101 +0000 UTC m=+64.894807811" watchObservedRunningTime="2026-09-16 12:03:18.726170429 +0000 UTC m=+64.895135136"
Sep 16 12:03:18.912498 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:18.912465    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"]
Sep 16 12:03:18.979850 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:03:18.979821    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d558b8f_26c9_4f80_9697_60b5e5291a50.slice/crio-cdad96cc908900f96b389d18c53c68a709c37c4c347e816182c56f6568d29683 WatchSource:0}: Error finding container cdad96cc908900f96b389d18c53c68a709c37c4c347e816182c56f6568d29683: Status 404 returned error can't find the container with id cdad96cc908900f96b389d18c53c68a709c37c4c347e816182c56f6568d29683
Sep 16 12:03:19.628332 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.628297    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-t4gsd"
Sep 16 12:03:19.640658 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.640631    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7848cb88fc-dtdcm"]
Sep 16 12:03:19.643745 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.643725    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:03:19.645996 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.645977    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 16 12:03:19.646170 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.646004    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5vf2l\""
Sep 16 12:03:19.646170 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.646129    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 16 12:03:19.646286 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.646207    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 16 12:03:19.647342 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.647182    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 16 12:03:19.647342 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.647208    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9ngl22hf7623h\""
Sep 16 12:03:19.657563 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.657457    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7848cb88fc-dtdcm"]
Sep 16 12:03:19.699184 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.699152    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z87bt" event={"ID":"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564","Type":"ContainerStarted","Data":"8c8e014fa5389ebee1bd4eabdd4d81805e3b21cdcac9dc43724fb5f2a9c1414c"}
Sep 16 12:03:19.699650 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.699232    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z87bt" event={"ID":"c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564","Type":"ContainerStarted","Data":"8a245aa3e2cb85de51faae34bb2840f9c32becf2d5b05f9880a62a9187bb9f27"}
Sep 16 12:03:19.700754 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.700727    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv" event={"ID":"3d558b8f-26c9-4f80-9697-60b5e5291a50","Type":"ContainerStarted","Data":"cdad96cc908900f96b389d18c53c68a709c37c4c347e816182c56f6568d29683"}
Sep 16 12:03:19.702356 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.702308    2576 generic.go:356] "Generic (PLEG): container finished" podID="8574462b-bf21-498d-bf95-aac976785e75" containerID="3bd69b7b1686e7a5f53eb3535a456e3ec36e6cd8287c682e2703be4c9f0ff129" exitCode=0
Sep 16 12:03:19.702465 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.702351    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8574462b-bf21-498d-bf95-aac976785e75","Type":"ContainerDied","Data":"3bd69b7b1686e7a5f53eb3535a456e3ec36e6cd8287c682e2703be4c9f0ff129"}
Sep 16 12:03:19.719104 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.719064    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-z87bt" podStartSLOduration=3.319504378 podStartE2EDuration="4.719048718s" totalImagesPullingTime="1.304463561s" totalInitContainerRuntime="95.080779ms" isStatefulPod=true podCreationTimestamp="2026-09-16 12:03:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:03:19.717768864 +0000 UTC m=+65.886733574" watchObservedRunningTime="2026-09-16 12:03:19.719048718 +0000 UTC m=+65.888013425"
Sep 16 12:03:19.780026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.779998    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00d111ef-b475-4d41-8f2a-48bd14eab7ec-client-ca-bundle\") pod \"metrics-server-7848cb88fc-dtdcm\" (UID: \"00d111ef-b475-4d41-8f2a-48bd14eab7ec\") " pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:03:19.780276 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.780240    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00d111ef-b475-4d41-8f2a-48bd14eab7ec-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7848cb88fc-dtdcm\" (UID: \"00d111ef-b475-4d41-8f2a-48bd14eab7ec\") " pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:03:19.780429 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.780283    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzscw\" (UniqueName: \"kubernetes.io/projected/00d111ef-b475-4d41-8f2a-48bd14eab7ec-kube-api-access-nzscw\") pod \"metrics-server-7848cb88fc-dtdcm\" (UID: \"00d111ef-b475-4d41-8f2a-48bd14eab7ec\") " pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:03:19.780498 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.780422    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/00d111ef-b475-4d41-8f2a-48bd14eab7ec-secret-metrics-server-tls\") pod \"metrics-server-7848cb88fc-dtdcm\" (UID: \"00d111ef-b475-4d41-8f2a-48bd14eab7ec\") " pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:03:19.780949 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.780921    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/00d111ef-b475-4d41-8f2a-48bd14eab7ec-secret-metrics-server-client-certs\") pod \"metrics-server-7848cb88fc-dtdcm\" (UID: \"00d111ef-b475-4d41-8f2a-48bd14eab7ec\") " pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:03:19.781340 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.781121    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/00d111ef-b475-4d41-8f2a-48bd14eab7ec-metrics-server-audit-profiles\") pod \"metrics-server-7848cb88fc-dtdcm\" (UID: \"00d111ef-b475-4d41-8f2a-48bd14eab7ec\") " pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:03:19.781340 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.781181    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/00d111ef-b475-4d41-8f2a-48bd14eab7ec-audit-log\") pod \"metrics-server-7848cb88fc-dtdcm\" (UID: \"00d111ef-b475-4d41-8f2a-48bd14eab7ec\") " pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:03:19.882334 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.882248    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00d111ef-b475-4d41-8f2a-48bd14eab7ec-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7848cb88fc-dtdcm\" (UID: \"00d111ef-b475-4d41-8f2a-48bd14eab7ec\") " pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:03:19.882334 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.882282    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzscw\" (UniqueName: \"kubernetes.io/projected/00d111ef-b475-4d41-8f2a-48bd14eab7ec-kube-api-access-nzscw\") pod \"metrics-server-7848cb88fc-dtdcm\" (UID: \"00d111ef-b475-4d41-8f2a-48bd14eab7ec\") " pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:03:19.882334 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.882304    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/00d111ef-b475-4d41-8f2a-48bd14eab7ec-secret-metrics-server-tls\") pod \"metrics-server-7848cb88fc-dtdcm\" (UID: \"00d111ef-b475-4d41-8f2a-48bd14eab7ec\") " pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:03:19.882573 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.882378    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/00d111ef-b475-4d41-8f2a-48bd14eab7ec-secret-metrics-server-client-certs\") pod \"metrics-server-7848cb88fc-dtdcm\" (UID: \"00d111ef-b475-4d41-8f2a-48bd14eab7ec\") " pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:03:19.882573 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.882410    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/00d111ef-b475-4d41-8f2a-48bd14eab7ec-metrics-server-audit-profiles\") pod \"metrics-server-7848cb88fc-dtdcm\" (UID: \"00d111ef-b475-4d41-8f2a-48bd14eab7ec\") " pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:03:19.882573 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.882427    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/00d111ef-b475-4d41-8f2a-48bd14eab7ec-audit-log\") pod \"metrics-server-7848cb88fc-dtdcm\" (UID: \"00d111ef-b475-4d41-8f2a-48bd14eab7ec\") " pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:03:19.882573 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.882446    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00d111ef-b475-4d41-8f2a-48bd14eab7ec-client-ca-bundle\") pod \"metrics-server-7848cb88fc-dtdcm\" (UID: \"00d111ef-b475-4d41-8f2a-48bd14eab7ec\") " pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:03:19.882882 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.882846    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/00d111ef-b475-4d41-8f2a-48bd14eab7ec-audit-log\") pod \"metrics-server-7848cb88fc-dtdcm\" (UID: \"00d111ef-b475-4d41-8f2a-48bd14eab7ec\") " pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:03:19.883074 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.883018    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00d111ef-b475-4d41-8f2a-48bd14eab7ec-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7848cb88fc-dtdcm\" (UID: \"00d111ef-b475-4d41-8f2a-48bd14eab7ec\") " pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:03:19.883720 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.883690    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/00d111ef-b475-4d41-8f2a-48bd14eab7ec-metrics-server-audit-profiles\") pod \"metrics-server-7848cb88fc-dtdcm\" (UID: \"00d111ef-b475-4d41-8f2a-48bd14eab7ec\") " pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:03:19.884961 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.884936    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/00d111ef-b475-4d41-8f2a-48bd14eab7ec-secret-metrics-server-client-certs\") pod \"metrics-server-7848cb88fc-dtdcm\" (UID: \"00d111ef-b475-4d41-8f2a-48bd14eab7ec\") " pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:03:19.885141 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.885121    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00d111ef-b475-4d41-8f2a-48bd14eab7ec-client-ca-bundle\") pod \"metrics-server-7848cb88fc-dtdcm\" (UID: \"00d111ef-b475-4d41-8f2a-48bd14eab7ec\") " pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:03:19.885199 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.885120    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/00d111ef-b475-4d41-8f2a-48bd14eab7ec-secret-metrics-server-tls\") pod \"metrics-server-7848cb88fc-dtdcm\" (UID: \"00d111ef-b475-4d41-8f2a-48bd14eab7ec\") " pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:03:19.889634 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.889615    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzscw\" (UniqueName: \"kubernetes.io/projected/00d111ef-b475-4d41-8f2a-48bd14eab7ec-kube-api-access-nzscw\") pod \"metrics-server-7848cb88fc-dtdcm\" (UID: \"00d111ef-b475-4d41-8f2a-48bd14eab7ec\") " pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:03:19.954494 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:19.954413    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:03:20.071718 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.071679    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-llsqs"]
Sep 16 12:03:20.076145 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.076121    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-llsqs"
Sep 16 12:03:20.079884 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.079862    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 16 12:03:20.080417 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.080396    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-ppgfh\""
Sep 16 12:03:20.082627 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.082605    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-llsqs"]
Sep 16 12:03:20.084605 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.084582    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-original-pull-secret\") pod \"global-pull-secret-syncer-f2cw4\" (UID: \"adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa\") " pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:03:20.084697 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.084684    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86nth\" (UniqueName: \"kubernetes.io/projected/3d17e8cd-157a-49a4-9c05-cd1e15a8ef11-kube-api-access-86nth\") pod \"network-check-target-7ff2t\" (UID: \"3d17e8cd-157a-49a4-9c05-cd1e15a8ef11\") " pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:03:20.086945 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.086926    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 12:03:20.087032 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.087013    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 12:03:20.098140 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.098118    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 12:03:20.099442 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.099426    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa-original-pull-secret\") pod \"global-pull-secret-syncer-f2cw4\" (UID: \"adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa\") " pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:03:20.108557 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.108533    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86nth\" (UniqueName: \"kubernetes.io/projected/3d17e8cd-157a-49a4-9c05-cd1e15a8ef11-kube-api-access-86nth\") pod \"network-check-target-7ff2t\" (UID: \"3d17e8cd-157a-49a4-9c05-cd1e15a8ef11\") " pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:03:20.175123 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.175045    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5854698bf8-ndw5x"]
Sep 16 12:03:20.178764 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.178741    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:20.185923 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.185139    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7005fad8-295b-4177-99ac-d1184abe0892-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-llsqs\" (UID: \"7005fad8-295b-4177-99ac-d1184abe0892\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-llsqs"
Sep 16 12:03:20.185923 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.185186    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acdb4981-6d20-4436-8bd4-b45d51990f22-metrics-certs\") pod \"network-metrics-daemon-wc55w\" (UID: \"acdb4981-6d20-4436-8bd4-b45d51990f22\") " pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:03:20.185923 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.185262    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pbgg\" (UniqueName: \"kubernetes.io/projected/7005fad8-295b-4177-99ac-d1184abe0892-kube-api-access-5pbgg\") pod \"monitoring-plugin-5d85778b9d-llsqs\" (UID: \"7005fad8-295b-4177-99ac-d1184abe0892\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-llsqs"
Sep 16 12:03:20.188276 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.188082    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 16 12:03:20.189634 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.189615    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 12:03:20.195329 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.195289    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5854698bf8-ndw5x"]
Sep 16 12:03:20.198451 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.198251    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f2cw4"
Sep 16 12:03:20.203141 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.203106    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acdb4981-6d20-4436-8bd4-b45d51990f22-metrics-certs\") pod \"network-metrics-daemon-wc55w\" (UID: \"acdb4981-6d20-4436-8bd4-b45d51990f22\") " pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:03:20.247092 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.247052    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7848cb88fc-dtdcm"]
Sep 16 12:03:20.252241 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:03:20.252198    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d111ef_b475_4d41_8f2a_48bd14eab7ec.slice/crio-7f71b661e26f88688397dc6c063e1eecd2b02ca0fef038eddd9c18f6595b7a91 WatchSource:0}: Error finding container 7f71b661e26f88688397dc6c063e1eecd2b02ca0fef038eddd9c18f6595b7a91: Status 404 returned error can't find the container with id 7f71b661e26f88688397dc6c063e1eecd2b02ca0fef038eddd9c18f6595b7a91
Sep 16 12:03:20.285761 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.285716    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-service-ca\") pod \"console-5854698bf8-ndw5x\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") " pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:20.285874 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.285776    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-trusted-ca-bundle\") pod \"console-5854698bf8-ndw5x\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") " pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:20.285874 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.285853    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pbgg\" (UniqueName: \"kubernetes.io/projected/7005fad8-295b-4177-99ac-d1184abe0892-kube-api-access-5pbgg\") pod \"monitoring-plugin-5d85778b9d-llsqs\" (UID: \"7005fad8-295b-4177-99ac-d1184abe0892\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-llsqs"
Sep 16 12:03:20.285977 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.285910    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-oauth-serving-cert\") pod \"console-5854698bf8-ndw5x\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") " pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:20.285977 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.285956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7005fad8-295b-4177-99ac-d1184abe0892-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-llsqs\" (UID: \"7005fad8-295b-4177-99ac-d1184abe0892\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-llsqs"
Sep 16 12:03:20.286070 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.285983    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-console-config\") pod \"console-5854698bf8-ndw5x\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") " pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:20.286070 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.286055    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5vns\" (UniqueName: \"kubernetes.io/projected/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-kube-api-access-l5vns\") pod \"console-5854698bf8-ndw5x\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") " pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:20.286186 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.286085    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-console-serving-cert\") pod \"console-5854698bf8-ndw5x\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") " pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:20.286186 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:03:20.286101    2576 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 16 12:03:20.286186 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.286123    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-console-oauth-config\") pod \"console-5854698bf8-ndw5x\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") " pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:20.286186 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:03:20.286158    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7005fad8-295b-4177-99ac-d1184abe0892-monitoring-plugin-cert podName:7005fad8-295b-4177-99ac-d1184abe0892 nodeName:}" failed. No retries permitted until 2026-09-16 12:03:20.786138196 +0000 UTC m=+66.955102893 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/7005fad8-295b-4177-99ac-d1184abe0892-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-llsqs" (UID: "7005fad8-295b-4177-99ac-d1184abe0892") : secret "monitoring-plugin-cert" not found
Sep 16 12:03:20.297044 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.297024    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pbgg\" (UniqueName: \"kubernetes.io/projected/7005fad8-295b-4177-99ac-d1184abe0892-kube-api-access-5pbgg\") pod \"monitoring-plugin-5d85778b9d-llsqs\" (UID: \"7005fad8-295b-4177-99ac-d1184abe0892\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-llsqs"
Sep 16 12:03:20.307054 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.307034    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pcfgd\""
Sep 16 12:03:20.313289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.313269    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qzcvp\""
Sep 16 12:03:20.315367 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.315338    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:03:20.321446 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.321429    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wc55w"
Sep 16 12:03:20.388553 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.387986    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-trusted-ca-bundle\") pod \"console-5854698bf8-ndw5x\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") " pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:20.388553 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.388046    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-oauth-serving-cert\") pod \"console-5854698bf8-ndw5x\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") " pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:20.388553 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.388106    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-console-config\") pod \"console-5854698bf8-ndw5x\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") " pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:20.388553 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.388170    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5vns\" (UniqueName: \"kubernetes.io/projected/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-kube-api-access-l5vns\") pod \"console-5854698bf8-ndw5x\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") " pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:20.388553 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.388200    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-console-serving-cert\") pod \"console-5854698bf8-ndw5x\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") " pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:20.388553 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.388237    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-console-oauth-config\") pod \"console-5854698bf8-ndw5x\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") " pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:20.388553 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.388281    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-service-ca\") pod \"console-5854698bf8-ndw5x\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") " pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:20.393986 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.391973    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-service-ca\") pod \"console-5854698bf8-ndw5x\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") " pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:20.393986 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.392238    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-trusted-ca-bundle\") pod \"console-5854698bf8-ndw5x\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") " pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:20.393986 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.392748    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-oauth-serving-cert\") pod \"console-5854698bf8-ndw5x\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") " pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:20.393986 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.393533    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-console-config\") pod \"console-5854698bf8-ndw5x\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") " pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:20.393986 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.393899    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-console-serving-cert\") pod \"console-5854698bf8-ndw5x\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") " pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:20.396435 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.395786    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-console-oauth-config\") pod \"console-5854698bf8-ndw5x\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") " pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:20.399584 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.399297    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5vns\" (UniqueName: \"kubernetes.io/projected/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-kube-api-access-l5vns\") pod \"console-5854698bf8-ndw5x\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") " pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:20.478331 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.478243    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f2cw4"]
Sep 16 12:03:20.481384 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:03:20.481360    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc5bf4e_bcb9_4c7f_be43_8d36a70a55aa.slice/crio-34c6e4f38951ffb9dfda2f8dc8bb6252db2a625a2381f340e70ae2ff2e5c28c2 WatchSource:0}: Error finding container 34c6e4f38951ffb9dfda2f8dc8bb6252db2a625a2381f340e70ae2ff2e5c28c2: Status 404 returned error can't find the container with id 34c6e4f38951ffb9dfda2f8dc8bb6252db2a625a2381f340e70ae2ff2e5c28c2
Sep 16 12:03:20.492894 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.492866    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:20.559827 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.559791    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"]
Sep 16 12:03:20.565360 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.564124    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"
Sep 16 12:03:20.567854 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.567035    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 16 12:03:20.567854 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.567363    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-gx54h\""
Sep 16 12:03:20.567854 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.567406    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 16 12:03:20.567854 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.567493    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 16 12:03:20.567854 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.567041    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 16 12:03:20.567854 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.567363    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 16 12:03:20.582947 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.582921    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 16 12:03:20.586800 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.586776    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"]
Sep 16 12:03:20.599878 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.599850    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7ff2t"]
Sep 16 12:03:20.602828 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:03:20.602798    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d17e8cd_157a_49a4_9c05_cd1e15a8ef11.slice/crio-14ae58b5fa4c94adfab056a059c58c4101096106cf4fb25138b19eed4cabc5c2 WatchSource:0}: Error finding container 14ae58b5fa4c94adfab056a059c58c4101096106cf4fb25138b19eed4cabc5c2: Status 404 returned error can't find the container with id 14ae58b5fa4c94adfab056a059c58c4101096106cf4fb25138b19eed4cabc5c2
Sep 16 12:03:20.613173 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.613154    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wc55w"]
Sep 16 12:03:20.616466 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:03:20.616437    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacdb4981_6d20_4436_8bd4_b45d51990f22.slice/crio-7374daf0343771ca77083634b2f1ab7884c4a61bfd1a0354ee0e036d87165166 WatchSource:0}: Error finding container 7374daf0343771ca77083634b2f1ab7884c4a61bfd1a0354ee0e036d87165166: Status 404 returned error can't find the container with id 7374daf0343771ca77083634b2f1ab7884c4a61bfd1a0354ee0e036d87165166
Sep 16 12:03:20.690406 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.690377    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjhln\" (UniqueName: \"kubernetes.io/projected/3c90b7bf-5842-4749-813c-98d02a3c8edf-kube-api-access-kjhln\") pod \"telemeter-client-6895c9dbf5-klvmc\" (UID: \"3c90b7bf-5842-4749-813c-98d02a3c8edf\") " pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"
Sep 16 12:03:20.690579 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.690432    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3c90b7bf-5842-4749-813c-98d02a3c8edf-telemeter-client-tls\") pod \"telemeter-client-6895c9dbf5-klvmc\" (UID: \"3c90b7bf-5842-4749-813c-98d02a3c8edf\") " pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"
Sep 16 12:03:20.690579 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.690504    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c90b7bf-5842-4749-813c-98d02a3c8edf-serving-certs-ca-bundle\") pod \"telemeter-client-6895c9dbf5-klvmc\" (UID: \"3c90b7bf-5842-4749-813c-98d02a3c8edf\") " pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"
Sep 16 12:03:20.690579 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.690558    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c90b7bf-5842-4749-813c-98d02a3c8edf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6895c9dbf5-klvmc\" (UID: \"3c90b7bf-5842-4749-813c-98d02a3c8edf\") " pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"
Sep 16 12:03:20.690732 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.690610    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3c90b7bf-5842-4749-813c-98d02a3c8edf-federate-client-tls\") pod \"telemeter-client-6895c9dbf5-klvmc\" (UID: \"3c90b7bf-5842-4749-813c-98d02a3c8edf\") " pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"
Sep 16 12:03:20.690732 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.690637    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c90b7bf-5842-4749-813c-98d02a3c8edf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6895c9dbf5-klvmc\" (UID: \"3c90b7bf-5842-4749-813c-98d02a3c8edf\") " pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"
Sep 16 12:03:20.690732 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.690709    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3c90b7bf-5842-4749-813c-98d02a3c8edf-secret-telemeter-client\") pod \"telemeter-client-6895c9dbf5-klvmc\" (UID: \"3c90b7bf-5842-4749-813c-98d02a3c8edf\") " pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"
Sep 16 12:03:20.690847 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.690792    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c90b7bf-5842-4749-813c-98d02a3c8edf-metrics-client-ca\") pod \"telemeter-client-6895c9dbf5-klvmc\" (UID: \"3c90b7bf-5842-4749-813c-98d02a3c8edf\") " pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"
Sep 16 12:03:20.720199 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.720158    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm" event={"ID":"00d111ef-b475-4d41-8f2a-48bd14eab7ec","Type":"ContainerStarted","Data":"7f71b661e26f88688397dc6c063e1eecd2b02ca0fef038eddd9c18f6595b7a91"}
Sep 16 12:03:20.722607 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.722540    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f2cw4" event={"ID":"adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa","Type":"ContainerStarted","Data":"34c6e4f38951ffb9dfda2f8dc8bb6252db2a625a2381f340e70ae2ff2e5c28c2"}
Sep 16 12:03:20.724517 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.724489    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wc55w" event={"ID":"acdb4981-6d20-4436-8bd4-b45d51990f22","Type":"ContainerStarted","Data":"7374daf0343771ca77083634b2f1ab7884c4a61bfd1a0354ee0e036d87165166"}
Sep 16 12:03:20.727079 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.727052    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7ff2t" event={"ID":"3d17e8cd-157a-49a4-9c05-cd1e15a8ef11","Type":"ContainerStarted","Data":"14ae58b5fa4c94adfab056a059c58c4101096106cf4fb25138b19eed4cabc5c2"}
Sep 16 12:03:20.774951 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.774924    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5854698bf8-ndw5x"]
Sep 16 12:03:20.778849 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:03:20.778641    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f0b90ff_c6fb_45fb_9505_d915ed7b8f46.slice/crio-891af44d4774887a44acb1885f0ed9457f9e096487fe2859dfffe0f8c5d416cb WatchSource:0}: Error finding container 891af44d4774887a44acb1885f0ed9457f9e096487fe2859dfffe0f8c5d416cb: Status 404 returned error can't find the container with id 891af44d4774887a44acb1885f0ed9457f9e096487fe2859dfffe0f8c5d416cb
Sep 16 12:03:20.791789 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.791758    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3c90b7bf-5842-4749-813c-98d02a3c8edf-secret-telemeter-client\") pod \"telemeter-client-6895c9dbf5-klvmc\" (UID: \"3c90b7bf-5842-4749-813c-98d02a3c8edf\") " pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"
Sep 16 12:03:20.794199 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.792667    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7005fad8-295b-4177-99ac-d1184abe0892-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-llsqs\" (UID: \"7005fad8-295b-4177-99ac-d1184abe0892\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-llsqs"
Sep 16 12:03:20.794199 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.792743    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c90b7bf-5842-4749-813c-98d02a3c8edf-metrics-client-ca\") pod \"telemeter-client-6895c9dbf5-klvmc\" (UID: \"3c90b7bf-5842-4749-813c-98d02a3c8edf\") " pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"
Sep 16 12:03:20.794199 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.792834    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjhln\" (UniqueName: \"kubernetes.io/projected/3c90b7bf-5842-4749-813c-98d02a3c8edf-kube-api-access-kjhln\") pod \"telemeter-client-6895c9dbf5-klvmc\" (UID: \"3c90b7bf-5842-4749-813c-98d02a3c8edf\") " pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"
Sep 16 12:03:20.794199 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.792903    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3c90b7bf-5842-4749-813c-98d02a3c8edf-telemeter-client-tls\") pod \"telemeter-client-6895c9dbf5-klvmc\" (UID: \"3c90b7bf-5842-4749-813c-98d02a3c8edf\") " pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"
Sep 16 12:03:20.794199 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.792964    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c90b7bf-5842-4749-813c-98d02a3c8edf-serving-certs-ca-bundle\") pod \"telemeter-client-6895c9dbf5-klvmc\" (UID: \"3c90b7bf-5842-4749-813c-98d02a3c8edf\") " pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"
Sep 16 12:03:20.794199 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.792997    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c90b7bf-5842-4749-813c-98d02a3c8edf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6895c9dbf5-klvmc\" (UID: \"3c90b7bf-5842-4749-813c-98d02a3c8edf\") " pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"
Sep 16 12:03:20.794199 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.793108    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3c90b7bf-5842-4749-813c-98d02a3c8edf-federate-client-tls\") pod \"telemeter-client-6895c9dbf5-klvmc\" (UID: \"3c90b7bf-5842-4749-813c-98d02a3c8edf\") " pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"
Sep 16 12:03:20.794199 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.793134    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c90b7bf-5842-4749-813c-98d02a3c8edf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6895c9dbf5-klvmc\" (UID: \"3c90b7bf-5842-4749-813c-98d02a3c8edf\") " pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"
Sep 16 12:03:20.794199 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.793719    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c90b7bf-5842-4749-813c-98d02a3c8edf-serving-certs-ca-bundle\") pod \"telemeter-client-6895c9dbf5-klvmc\" (UID: \"3c90b7bf-5842-4749-813c-98d02a3c8edf\") " pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"
Sep 16 12:03:20.796096 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.795302    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c90b7bf-5842-4749-813c-98d02a3c8edf-metrics-client-ca\") pod \"telemeter-client-6895c9dbf5-klvmc\" (UID: \"3c90b7bf-5842-4749-813c-98d02a3c8edf\") " pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"
Sep 16 12:03:20.796096 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.796058    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c90b7bf-5842-4749-813c-98d02a3c8edf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6895c9dbf5-klvmc\" (UID: \"3c90b7bf-5842-4749-813c-98d02a3c8edf\") " pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"
Sep 16 12:03:20.796877 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.796687    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c90b7bf-5842-4749-813c-98d02a3c8edf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6895c9dbf5-klvmc\" (UID: \"3c90b7bf-5842-4749-813c-98d02a3c8edf\") " pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"
Sep 16 12:03:20.798785 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.797307    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3c90b7bf-5842-4749-813c-98d02a3c8edf-telemeter-client-tls\") pod \"telemeter-client-6895c9dbf5-klvmc\" (UID: \"3c90b7bf-5842-4749-813c-98d02a3c8edf\") " pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"
Sep 16 12:03:20.798785 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.797492    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3c90b7bf-5842-4749-813c-98d02a3c8edf-federate-client-tls\") pod \"telemeter-client-6895c9dbf5-klvmc\" (UID: \"3c90b7bf-5842-4749-813c-98d02a3c8edf\") " pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"
Sep 16 12:03:20.800232 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.800205    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7005fad8-295b-4177-99ac-d1184abe0892-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-llsqs\" (UID: \"7005fad8-295b-4177-99ac-d1184abe0892\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-llsqs"
Sep 16 12:03:20.802090 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.802068    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjhln\" (UniqueName: \"kubernetes.io/projected/3c90b7bf-5842-4749-813c-98d02a3c8edf-kube-api-access-kjhln\") pod \"telemeter-client-6895c9dbf5-klvmc\" (UID: \"3c90b7bf-5842-4749-813c-98d02a3c8edf\") " pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"
Sep 16 12:03:20.813084 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.813017    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3c90b7bf-5842-4749-813c-98d02a3c8edf-secret-telemeter-client\") pod \"telemeter-client-6895c9dbf5-klvmc\" (UID: \"3c90b7bf-5842-4749-813c-98d02a3c8edf\") " pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"
Sep 16 12:03:20.901141 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.901085    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"
Sep 16 12:03:20.986839 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:20.986805    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-llsqs"
Sep 16 12:03:21.549819 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.549787    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 12:03:21.555092 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.554711    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.558060 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.557997    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 16 12:03:21.559078 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.558429    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-spdh6\""
Sep 16 12:03:21.559078 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.559000    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 16 12:03:21.559078 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.559022    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 16 12:03:21.559290 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.559188    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 16 12:03:21.559578 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.559558    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 16 12:03:21.560342 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.559749    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 16 12:03:21.560342 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.559807    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-btk5vm6euom8t\""
Sep 16 12:03:21.560342 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.559979    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 16 12:03:21.560342 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.560157    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 16 12:03:21.560342 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.560265    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 16 12:03:21.560342 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.560289    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 16 12:03:21.560716 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.560702    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 16 12:03:21.561156 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.561139    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 16 12:03:21.562338 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.562294    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 16 12:03:21.568422 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.566560    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 16 12:03:21.568422 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.566899    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 12:03:21.702162 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.702124    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-config\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.702162 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.702162    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1140296b-38d4-41e4-be7d-a7a0f76021d3-config-out\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.702420 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.702187    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.702420 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.702262    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.702420 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.702348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1140296b-38d4-41e4-be7d-a7a0f76021d3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.702420 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.702386    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.702420 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.702409    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.702673 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.702429    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.702673 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.702505    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpg8v\" (UniqueName: \"kubernetes.io/projected/1140296b-38d4-41e4-be7d-a7a0f76021d3-kube-api-access-cpg8v\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.702673 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.702540    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.702673 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.702566    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.702673 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.702619    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.702673 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.702649    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-web-config\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.702960 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.702691    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.702960 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.702733    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.702960 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.702761    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.702960 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.702811    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.702960 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.702830    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.702960 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.702893    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.702960 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.702916    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.735352 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.735022    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5854698bf8-ndw5x" event={"ID":"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46","Type":"ContainerStarted","Data":"817e97c211e795600dc9279d3ad25e86c37742a0a77665d576cba4ae1e95b867"}
Sep 16 12:03:21.735352 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.735083    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5854698bf8-ndw5x" event={"ID":"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46","Type":"ContainerStarted","Data":"891af44d4774887a44acb1885f0ed9457f9e096487fe2859dfffe0f8c5d416cb"}
Sep 16 12:03:21.805286 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.803696    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-config\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.805286 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.803738    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1140296b-38d4-41e4-be7d-a7a0f76021d3-config-out\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.805286 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.803756    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.805286 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.803801    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.805286 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.803832    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1140296b-38d4-41e4-be7d-a7a0f76021d3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.805286 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.803855    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.805286 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.803881    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.805286 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.803903    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.805286 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.803950    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpg8v\" (UniqueName: \"kubernetes.io/projected/1140296b-38d4-41e4-be7d-a7a0f76021d3-kube-api-access-cpg8v\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.805286 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.803974    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.805286 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.803990    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.805286 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.804040    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.805286 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.804063    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-web-config\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.805286 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.804083    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.805286 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.804110    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.805286 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.804133    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.805286 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.804210    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.806153 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.804239    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.806153 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.804270    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.806153 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.804299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.806153 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.804839    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.806702 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.806674    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.808562 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.807787    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.808562 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.808337    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.809467 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.809440    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.809693 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.809669    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.814290 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.814263    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.814894 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.814871    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1140296b-38d4-41e4-be7d-a7a0f76021d3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.816082 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.815276    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.816082 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.815727    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.817222 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.816944    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.817645 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.817547    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.817728 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.817684    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.817997 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.817975    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.818378 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.818355    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1140296b-38d4-41e4-be7d-a7a0f76021d3-config-out\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.818746 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.818729    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-config\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.819363 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.819339    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.820656 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.820635    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-web-config\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.821159 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.821137    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.829513 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.829488    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpg8v\" (UniqueName: \"kubernetes.io/projected/1140296b-38d4-41e4-be7d-a7a0f76021d3-kube-api-access-cpg8v\") pod \"prometheus-k8s-0\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.871950 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.871668    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:21.904548 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.904512    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d446cd64f-swjnm"
Sep 16 12:03:21.904709 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.904619    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d446cd64f-swjnm"
Sep 16 12:03:21.911891 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.911649    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d446cd64f-swjnm"
Sep 16 12:03:21.929656 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:21.929601    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5854698bf8-ndw5x" podStartSLOduration=1.9295827700000001 podStartE2EDuration="1.92958277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:03:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:03:21.754334291 +0000 UTC m=+67.923298991" watchObservedRunningTime="2026-09-16 12:03:21.92958277 +0000 UTC m=+68.098547479"
Sep 16 12:03:22.743653 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:22.743560    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv" event={"ID":"3d558b8f-26c9-4f80-9697-60b5e5291a50","Type":"ContainerStarted","Data":"6cb1fab72fde563d12bd00d241e57a47608052419094fc2090d6b2f63948653e"}
Sep 16 12:03:22.749677 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:22.748826    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm" event={"ID":"00d111ef-b475-4d41-8f2a-48bd14eab7ec","Type":"ContainerStarted","Data":"d883ab1973e9e8a40e883bf8450933e2a300ec2c71e4387edb4d00cc7aba40e5"}
Sep 16 12:03:22.755189 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:22.755129    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d446cd64f-swjnm"
Sep 16 12:03:22.766395 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:22.765686    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm" podStartSLOduration=1.448117507 podStartE2EDuration="3.765661107s" totalImagesPullingTime="2.3175436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:03:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:03:22.764782535 +0000 UTC m=+68.933747243" watchObservedRunningTime="2026-09-16 12:03:22.765661107 +0000 UTC m=+68.934625815"
Sep 16 12:03:22.867333 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:22.866964    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-llsqs"]
Sep 16 12:03:22.883183 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:22.883087    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 12:03:22.887843 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:22.887814    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6895c9dbf5-klvmc"]
Sep 16 12:03:23.754716 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:23.754674    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv" event={"ID":"3d558b8f-26c9-4f80-9697-60b5e5291a50","Type":"ContainerStarted","Data":"65e1ae80175819d8fa5f00e23cbb6f07b10c7e2e460d17acd6ca6c54768c3a81"}
Sep 16 12:03:23.755171 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:23.754793    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv" event={"ID":"3d558b8f-26c9-4f80-9697-60b5e5291a50","Type":"ContainerStarted","Data":"dcf35d8b66a1f411159d570f6acf0944a93e4d7a836f3fa44789bbac0e0cf221"}
Sep 16 12:03:23.759716 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:23.759688    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8574462b-bf21-498d-bf95-aac976785e75","Type":"ContainerStarted","Data":"c5200b2c421c733ce39f347ed1de583c9aa7546ccdfa5f156b614325271a64a9"}
Sep 16 12:03:23.759842 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:23.759757    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8574462b-bf21-498d-bf95-aac976785e75","Type":"ContainerStarted","Data":"18ef356ce24a462aa239f01e004874f4314680870ac1c5c9fd5ada9ca146f588"}
Sep 16 12:03:23.759842 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:23.759783    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8574462b-bf21-498d-bf95-aac976785e75","Type":"ContainerStarted","Data":"97804179718fcb58315f6520109caeacf0b2fbd7d7e88193ba0d2606f43826c3"}
Sep 16 12:03:23.759842 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:23.759807    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8574462b-bf21-498d-bf95-aac976785e75","Type":"ContainerStarted","Data":"2df791e372d1262ca119c3802e1ab81b6375408780041879a49ced7c729b1239"}
Sep 16 12:03:23.759842 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:23.759828    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8574462b-bf21-498d-bf95-aac976785e75","Type":"ContainerStarted","Data":"eb7ad32393655f0a242a37f2979d7201ec9afd5414a67562e6dac7fc7f6cd889"}
Sep 16 12:03:23.762044 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:23.761914    2576 generic.go:356] "Generic (PLEG): container finished" podID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerID="73521c4100fce1427aef1c6d018e946273ed301d3f0cb60d02031de17d8daef6" exitCode=0
Sep 16 12:03:23.762044 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:23.761949    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1140296b-38d4-41e4-be7d-a7a0f76021d3","Type":"ContainerDied","Data":"73521c4100fce1427aef1c6d018e946273ed301d3f0cb60d02031de17d8daef6"}
Sep 16 12:03:23.762044 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:23.762019    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1140296b-38d4-41e4-be7d-a7a0f76021d3","Type":"ContainerStarted","Data":"e8504ca561a4e3256a7c67680aa49609daf05f4f7cf070ab1ee0930d79f62e3d"}
Sep 16 12:03:23.764001 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:23.763974    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc" event={"ID":"3c90b7bf-5842-4749-813c-98d02a3c8edf","Type":"ContainerStarted","Data":"e799c85593d965925956fc43ea4c9e3c81baef0f2d06832c7e821345e7fed2ab"}
Sep 16 12:03:23.766536 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:23.766480    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-llsqs" event={"ID":"7005fad8-295b-4177-99ac-d1184abe0892","Type":"ContainerStarted","Data":"448de4d2a9dcb5e99a33162766e46fcbf663094c264fd772bac2bf681e3ab09e"}
Sep 16 12:03:24.777603 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:24.777483    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wc55w" event={"ID":"acdb4981-6d20-4436-8bd4-b45d51990f22","Type":"ContainerStarted","Data":"a0f8ee8a92ddba3f37633b1edee34d47870aa66adac29d6a75f455f5a7ce9d78"}
Sep 16 12:03:24.777603 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:24.777561    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wc55w" event={"ID":"acdb4981-6d20-4436-8bd4-b45d51990f22","Type":"ContainerStarted","Data":"774e738ffb7c6349d6a56ba6e4afe7dccff669b096a20a14a4c43d42e9876393"}
Sep 16 12:03:24.795483 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:24.795429    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wc55w" podStartSLOduration=67.442939462 podStartE2EDuration="1m10.795414776s" totalImagesPullingTime="3.352475314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:02:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:03:24.793156299 +0000 UTC m=+70.962121019" watchObservedRunningTime="2026-09-16 12:03:24.795414776 +0000 UTC m=+70.964379483"
Sep 16 12:03:29.802278 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:29.802132    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv" event={"ID":"3d558b8f-26c9-4f80-9697-60b5e5291a50","Type":"ContainerStarted","Data":"0ae2cf38a7dfce891403071478d066bc6a07b7435beb95d05edec7e39cc11fa1"}
Sep 16 12:03:29.802278 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:29.802241    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv" event={"ID":"3d558b8f-26c9-4f80-9697-60b5e5291a50","Type":"ContainerStarted","Data":"b24a926d4c194224f5bc5cd67946530f8fcaed44935d34efc17b5efd6a0567e9"}
Sep 16 12:03:29.802775 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:29.802281    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv" event={"ID":"3d558b8f-26c9-4f80-9697-60b5e5291a50","Type":"ContainerStarted","Data":"2faa7ff1ec98d6fa8224ca195fb879377bc1bff8db4539affc92c19f72f539cd"}
Sep 16 12:03:29.802775 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:29.802623    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:29.806846 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:29.806819    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8574462b-bf21-498d-bf95-aac976785e75","Type":"ContainerStarted","Data":"bd93a8ca5f3995cf034cc7fc68b05f6deb7402df20f298689e4171f61cb3acd6"}
Sep 16 12:03:29.809276 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:29.809142    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv"
Sep 16 12:03:29.810446 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:29.810423    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1140296b-38d4-41e4-be7d-a7a0f76021d3","Type":"ContainerStarted","Data":"ea096662f11dd4acb097e6e6257f3b5fc65fd693718868c357d15269f2918bc3"}
Sep 16 12:03:29.810518 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:29.810478    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1140296b-38d4-41e4-be7d-a7a0f76021d3","Type":"ContainerStarted","Data":"7e50f2fe6eaba5ee5f1de8c761bb4f7f9baf055439bc33ca3e69228d0d2d5863"}
Sep 16 12:03:29.810518 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:29.810512    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1140296b-38d4-41e4-be7d-a7a0f76021d3","Type":"ContainerStarted","Data":"df7fe6a17275c5004e5ce131053f16954fa4d63025a9534da8752162a8d3c6d3"}
Sep 16 12:03:29.812903 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:29.812875    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc" event={"ID":"3c90b7bf-5842-4749-813c-98d02a3c8edf","Type":"ContainerStarted","Data":"3d92b649638d766090f1ad618768dfb531d71dd65258bdd3a046bbfad7233e7a"}
Sep 16 12:03:29.813023 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:29.812916    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc" event={"ID":"3c90b7bf-5842-4749-813c-98d02a3c8edf","Type":"ContainerStarted","Data":"1f6c98aefe48cb8010599e4e0a7ee262e7d24bf1ef324a270d9f08cd95fca45f"}
Sep 16 12:03:29.813023 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:29.812934    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc" event={"ID":"3c90b7bf-5842-4749-813c-98d02a3c8edf","Type":"ContainerStarted","Data":"beb4298cf367712e676a9c69b2b24bc1117c3425f754d313a789fc39040eb734"}
Sep 16 12:03:29.815293 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:29.814907    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7ff2t" event={"ID":"3d17e8cd-157a-49a4-9c05-cd1e15a8ef11","Type":"ContainerStarted","Data":"15069293f93fbd0d91181f8a6ee62a8574d1fca9634764018d71cd9191173b7d"}
Sep 16 12:03:29.815293 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:29.815061    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:03:29.816426 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:29.816406    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-llsqs" event={"ID":"7005fad8-295b-4177-99ac-d1184abe0892","Type":"ContainerStarted","Data":"6f6e27d9c84c1e6369c9d6aeaee6deb47c1e1330961e0cbc95f3087f4c6c867a"}
Sep 16 12:03:29.816947 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:29.816908    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-llsqs"
Sep 16 12:03:29.818710 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:29.818586    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f2cw4" event={"ID":"adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa","Type":"ContainerStarted","Data":"8fc0a0afb431777bfa692097c4c97b73dc32beed2c11927618d99aaaab822d8b"}
Sep 16 12:03:29.823421 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:29.823404    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-llsqs"
Sep 16 12:03:29.831375 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:29.830182    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6d4679ccc4-7l8jv" podStartSLOduration=1.819401396 podStartE2EDuration="11.83016282s" totalImagesPullingTime="10.010761424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:03:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:03:29.827785439 +0000 UTC m=+75.996750342" watchObservedRunningTime="2026-09-16 12:03:29.83016282 +0000 UTC m=+75.999127528"
Sep 16 12:03:29.853704 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:29.853666    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7ff2t" podStartSLOduration=67.093993233 podStartE2EDuration="1m15.853651083s" totalImagesPullingTime="8.75965785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:02:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:03:29.853283311 +0000 UTC m=+76.022248020" watchObservedRunningTime="2026-09-16 12:03:29.853651083 +0000 UTC m=+76.022615787"
Sep 16 12:03:29.875427 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:29.875292    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6895c9dbf5-klvmc" podStartSLOduration=3.406111725 podStartE2EDuration="9.875272086s" totalImagesPullingTime="6.469160361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:03:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:03:29.87396347 +0000 UTC m=+76.042928177" watchObservedRunningTime="2026-09-16 12:03:29.875272086 +0000 UTC m=+76.044236794"
Sep 16 12:03:29.905231 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:29.905113    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.637970102 podStartE2EDuration="13.905095019s" totalImagesPullingTime="10.251633429s" totalInitContainerRuntime="15.491488ms" isStatefulPod=false podCreationTimestamp="2026-09-16 12:03:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:03:29.90181747 +0000 UTC m=+76.070782179" watchObservedRunningTime="2026-09-16 12:03:29.905095019 +0000 UTC m=+76.074059727"
Sep 16 12:03:29.922223 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:29.922172    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-llsqs" podStartSLOduration=3.44329528 podStartE2EDuration="9.922154392s" totalImagesPullingTime="6.478859112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:03:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:03:29.9216637 +0000 UTC m=+76.090628408" watchObservedRunningTime="2026-09-16 12:03:29.922154392 +0000 UTC m=+76.091119100"
Sep 16 12:03:29.941195 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:29.941124    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-f2cw4" podStartSLOduration=67.059186748 podStartE2EDuration="1m15.941104938s" totalImagesPullingTime="8.88191819s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:02:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:03:29.940648778 +0000 UTC m=+76.109613485" watchObservedRunningTime="2026-09-16 12:03:29.941104938 +0000 UTC m=+76.110069646"
Sep 16 12:03:30.493091 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:30.493063    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:30.493248 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:30.493128    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:30.498587 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:30.498552    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:30.828762 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:30.828651    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1140296b-38d4-41e4-be7d-a7a0f76021d3","Type":"ContainerStarted","Data":"f49daffd27e94b1cc4f6d82eb8ed3524b7ccfef9219e23c68e156da81d8d6d62"}
Sep 16 12:03:30.829198 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:30.828784    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1140296b-38d4-41e4-be7d-a7a0f76021d3","Type":"ContainerStarted","Data":"ad9fe6ec1061d159234b022cd0f64e7367306beb7ba85f7be3d41eaa15298c93"}
Sep 16 12:03:30.829198 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:30.828831    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1140296b-38d4-41e4-be7d-a7a0f76021d3","Type":"ContainerStarted","Data":"1011d0863506967396214dc4cc9415e5e3b576b2b453250e5937fa3ec2ac08ab"}
Sep 16 12:03:30.834425 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:30.834394    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:03:30.863147 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:30.863074    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.218177353 podStartE2EDuration="9.863053633s" totalImagesPullingTime="5.608396403s" totalInitContainerRuntime="36.479877ms" isStatefulPod=false podCreationTimestamp="2026-09-16 12:03:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:03:30.861566593 +0000 UTC m=+77.030531303" watchObservedRunningTime="2026-09-16 12:03:30.863053633 +0000 UTC m=+77.032018343"
Sep 16 12:03:30.921629 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:30.921583    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d446cd64f-swjnm"]
Sep 16 12:03:31.872363 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:31.872334    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:03:39.954628 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:39.954507    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:03:39.954628 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:39.954597    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:03:42.558218 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:42.558190    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5854698bf8-ndw5x"]
Sep 16 12:03:55.943566 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:55.943501    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d446cd64f-swjnm" podUID="7146f48d-b0e1-4322-bc3f-544d5bb939c0" containerName="console" containerID="cri-o://7e7f58986a76aa7dc2b6f020f5ad860e0494be065b7bedd86c38617cd1573b33" gracePeriod=15
Sep 16 12:03:56.227122 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.227091    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d446cd64f-swjnm"
Sep 16 12:03:56.317269 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.317240    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68b9l\" (UniqueName: \"kubernetes.io/projected/7146f48d-b0e1-4322-bc3f-544d5bb939c0-kube-api-access-68b9l\") pod \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\" (UID: \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\") "
Sep 16 12:03:56.317488 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.317284    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7146f48d-b0e1-4322-bc3f-544d5bb939c0-oauth-serving-cert\") pod \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\" (UID: \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\") "
Sep 16 12:03:56.317488 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.317364    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7146f48d-b0e1-4322-bc3f-544d5bb939c0-console-serving-cert\") pod \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\" (UID: \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\") "
Sep 16 12:03:56.317488 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.317390    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7146f48d-b0e1-4322-bc3f-544d5bb939c0-console-oauth-config\") pod \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\" (UID: \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\") "
Sep 16 12:03:56.317488 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.317435    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7146f48d-b0e1-4322-bc3f-544d5bb939c0-console-config\") pod \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\" (UID: \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\") "
Sep 16 12:03:56.317488 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.317481    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7146f48d-b0e1-4322-bc3f-544d5bb939c0-service-ca\") pod \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\" (UID: \"7146f48d-b0e1-4322-bc3f-544d5bb939c0\") "
Sep 16 12:03:56.317840 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.317804    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7146f48d-b0e1-4322-bc3f-544d5bb939c0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7146f48d-b0e1-4322-bc3f-544d5bb939c0" (UID: "7146f48d-b0e1-4322-bc3f-544d5bb939c0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:03:56.317993 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.317964    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7146f48d-b0e1-4322-bc3f-544d5bb939c0-console-config" (OuterVolumeSpecName: "console-config") pod "7146f48d-b0e1-4322-bc3f-544d5bb939c0" (UID: "7146f48d-b0e1-4322-bc3f-544d5bb939c0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:03:56.318266 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.318238    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7146f48d-b0e1-4322-bc3f-544d5bb939c0-service-ca" (OuterVolumeSpecName: "service-ca") pod "7146f48d-b0e1-4322-bc3f-544d5bb939c0" (UID: "7146f48d-b0e1-4322-bc3f-544d5bb939c0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:03:56.319905 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.319880    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7146f48d-b0e1-4322-bc3f-544d5bb939c0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7146f48d-b0e1-4322-bc3f-544d5bb939c0" (UID: "7146f48d-b0e1-4322-bc3f-544d5bb939c0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:03:56.319997 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.319914    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7146f48d-b0e1-4322-bc3f-544d5bb939c0-kube-api-access-68b9l" (OuterVolumeSpecName: "kube-api-access-68b9l") pod "7146f48d-b0e1-4322-bc3f-544d5bb939c0" (UID: "7146f48d-b0e1-4322-bc3f-544d5bb939c0"). InnerVolumeSpecName "kube-api-access-68b9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:03:56.319997 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.319944    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7146f48d-b0e1-4322-bc3f-544d5bb939c0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7146f48d-b0e1-4322-bc3f-544d5bb939c0" (UID: "7146f48d-b0e1-4322-bc3f-544d5bb939c0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:03:56.418177 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.418152    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7146f48d-b0e1-4322-bc3f-544d5bb939c0-console-config\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:03:56.418177 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.418174    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7146f48d-b0e1-4322-bc3f-544d5bb939c0-service-ca\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:03:56.418177 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.418183    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68b9l\" (UniqueName: \"kubernetes.io/projected/7146f48d-b0e1-4322-bc3f-544d5bb939c0-kube-api-access-68b9l\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:03:56.418401 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.418193    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7146f48d-b0e1-4322-bc3f-544d5bb939c0-oauth-serving-cert\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:03:56.418401 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.418202    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7146f48d-b0e1-4322-bc3f-544d5bb939c0-console-serving-cert\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:03:56.418401 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.418210    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7146f48d-b0e1-4322-bc3f-544d5bb939c0-console-oauth-config\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:03:56.940679 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.940638    2576 generic.go:356] "Generic (PLEG): container finished" podID="7146f48d-b0e1-4322-bc3f-544d5bb939c0" containerID="7e7f58986a76aa7dc2b6f020f5ad860e0494be065b7bedd86c38617cd1573b33" exitCode=0
Sep 16 12:03:56.940874 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.940690    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d446cd64f-swjnm"
Sep 16 12:03:56.940874 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.940730    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d446cd64f-swjnm" event={"ID":"7146f48d-b0e1-4322-bc3f-544d5bb939c0","Type":"ContainerDied","Data":"7e7f58986a76aa7dc2b6f020f5ad860e0494be065b7bedd86c38617cd1573b33"}
Sep 16 12:03:56.940874 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.940794    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d446cd64f-swjnm" event={"ID":"7146f48d-b0e1-4322-bc3f-544d5bb939c0","Type":"ContainerDied","Data":"90e481cab85ebff4ae3375bda1e26177144435350b9a034e46b432cc2b90050b"}
Sep 16 12:03:56.940874 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.940835    2576 scope.go:117] "RemoveContainer" containerID="7e7f58986a76aa7dc2b6f020f5ad860e0494be065b7bedd86c38617cd1573b33"
Sep 16 12:03:56.949546 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.949396    2576 scope.go:117] "RemoveContainer" containerID="7e7f58986a76aa7dc2b6f020f5ad860e0494be065b7bedd86c38617cd1573b33"
Sep 16 12:03:56.949765 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:03:56.949667    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e7f58986a76aa7dc2b6f020f5ad860e0494be065b7bedd86c38617cd1573b33\": container with ID starting with 7e7f58986a76aa7dc2b6f020f5ad860e0494be065b7bedd86c38617cd1573b33 not found: ID does not exist" containerID="7e7f58986a76aa7dc2b6f020f5ad860e0494be065b7bedd86c38617cd1573b33"
Sep 16 12:03:56.949765 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.949690    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e7f58986a76aa7dc2b6f020f5ad860e0494be065b7bedd86c38617cd1573b33"} err="failed to get container status \"7e7f58986a76aa7dc2b6f020f5ad860e0494be065b7bedd86c38617cd1573b33\": rpc error: code = NotFound desc = could not find container \"7e7f58986a76aa7dc2b6f020f5ad860e0494be065b7bedd86c38617cd1573b33\": container with ID starting with 7e7f58986a76aa7dc2b6f020f5ad860e0494be065b7bedd86c38617cd1573b33 not found: ID does not exist"
Sep 16 12:03:56.957707 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.957685    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d446cd64f-swjnm"]
Sep 16 12:03:56.961387 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:56.961368    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d446cd64f-swjnm"]
Sep 16 12:03:58.392193 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:58.392157    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7146f48d-b0e1-4322-bc3f-544d5bb939c0" path="/var/lib/kubelet/pods/7146f48d-b0e1-4322-bc3f-544d5bb939c0/volumes"
Sep 16 12:03:59.960553 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:59.960528    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:03:59.964791 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:03:59.964769    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7848cb88fc-dtdcm"
Sep 16 12:04:00.832196 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:00.832163    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7ff2t"
Sep 16 12:04:07.577524 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:07.577463    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5854698bf8-ndw5x" podUID="4f0b90ff-c6fb-45fb-9505-d915ed7b8f46" containerName="console" containerID="cri-o://817e97c211e795600dc9279d3ad25e86c37742a0a77665d576cba4ae1e95b867" gracePeriod=15
Sep 16 12:04:07.820514 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:07.820491    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:04:07.919394 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:07.919361    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-service-ca\") pod \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") "
Sep 16 12:04:07.919561 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:07.919430    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-console-config\") pod \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") "
Sep 16 12:04:07.919561 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:07.919457    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5vns\" (UniqueName: \"kubernetes.io/projected/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-kube-api-access-l5vns\") pod \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") "
Sep 16 12:04:07.919561 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:07.919483    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-trusted-ca-bundle\") pod \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") "
Sep 16 12:04:07.919561 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:07.919514    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-oauth-serving-cert\") pod \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") "
Sep 16 12:04:07.919774 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:07.919602    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-console-serving-cert\") pod \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") "
Sep 16 12:04:07.919774 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:07.919631    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-console-oauth-config\") pod \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\" (UID: \"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46\") "
Sep 16 12:04:07.919875 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:07.919838    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-service-ca" (OuterVolumeSpecName: "service-ca") pod "4f0b90ff-c6fb-45fb-9505-d915ed7b8f46" (UID: "4f0b90ff-c6fb-45fb-9505-d915ed7b8f46"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:04:07.920007 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:07.919980    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-console-config" (OuterVolumeSpecName: "console-config") pod "4f0b90ff-c6fb-45fb-9505-d915ed7b8f46" (UID: "4f0b90ff-c6fb-45fb-9505-d915ed7b8f46"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:04:07.920007 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:07.919984    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-service-ca\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:07.920164 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:07.920012    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4f0b90ff-c6fb-45fb-9505-d915ed7b8f46" (UID: "4f0b90ff-c6fb-45fb-9505-d915ed7b8f46"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:04:07.920164 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:07.920022    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4f0b90ff-c6fb-45fb-9505-d915ed7b8f46" (UID: "4f0b90ff-c6fb-45fb-9505-d915ed7b8f46"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:04:07.921932 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:07.921902    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4f0b90ff-c6fb-45fb-9505-d915ed7b8f46" (UID: "4f0b90ff-c6fb-45fb-9505-d915ed7b8f46"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:04:07.922024 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:07.921999    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4f0b90ff-c6fb-45fb-9505-d915ed7b8f46" (UID: "4f0b90ff-c6fb-45fb-9505-d915ed7b8f46"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:04:07.922068 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:07.922048    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-kube-api-access-l5vns" (OuterVolumeSpecName: "kube-api-access-l5vns") pod "4f0b90ff-c6fb-45fb-9505-d915ed7b8f46" (UID: "4f0b90ff-c6fb-45fb-9505-d915ed7b8f46"). InnerVolumeSpecName "kube-api-access-l5vns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:04:07.987120 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:07.987090    2576 generic.go:356] "Generic (PLEG): container finished" podID="4f0b90ff-c6fb-45fb-9505-d915ed7b8f46" containerID="817e97c211e795600dc9279d3ad25e86c37742a0a77665d576cba4ae1e95b867" exitCode=0
Sep 16 12:04:07.987245 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:07.987140    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5854698bf8-ndw5x"
Sep 16 12:04:07.987245 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:07.987150    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5854698bf8-ndw5x" event={"ID":"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46","Type":"ContainerDied","Data":"817e97c211e795600dc9279d3ad25e86c37742a0a77665d576cba4ae1e95b867"}
Sep 16 12:04:07.987245 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:07.987189    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5854698bf8-ndw5x" event={"ID":"4f0b90ff-c6fb-45fb-9505-d915ed7b8f46","Type":"ContainerDied","Data":"891af44d4774887a44acb1885f0ed9457f9e096487fe2859dfffe0f8c5d416cb"}
Sep 16 12:04:07.987245 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:07.987210    2576 scope.go:117] "RemoveContainer" containerID="817e97c211e795600dc9279d3ad25e86c37742a0a77665d576cba4ae1e95b867"
Sep 16 12:04:07.995889 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:07.995871    2576 scope.go:117] "RemoveContainer" containerID="817e97c211e795600dc9279d3ad25e86c37742a0a77665d576cba4ae1e95b867"
Sep 16 12:04:07.996161 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:04:07.996142    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"817e97c211e795600dc9279d3ad25e86c37742a0a77665d576cba4ae1e95b867\": container with ID starting with 817e97c211e795600dc9279d3ad25e86c37742a0a77665d576cba4ae1e95b867 not found: ID does not exist" containerID="817e97c211e795600dc9279d3ad25e86c37742a0a77665d576cba4ae1e95b867"
Sep 16 12:04:07.996218 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:07.996169    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"817e97c211e795600dc9279d3ad25e86c37742a0a77665d576cba4ae1e95b867"} err="failed to get container status \"817e97c211e795600dc9279d3ad25e86c37742a0a77665d576cba4ae1e95b867\": rpc error: code = NotFound desc = could not find container \"817e97c211e795600dc9279d3ad25e86c37742a0a77665d576cba4ae1e95b867\": container with ID starting with 817e97c211e795600dc9279d3ad25e86c37742a0a77665d576cba4ae1e95b867 not found: ID does not exist"
Sep 16 12:04:08.008770 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:08.008747    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5854698bf8-ndw5x"]
Sep 16 12:04:08.012771 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:08.012749    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5854698bf8-ndw5x"]
Sep 16 12:04:08.020580 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:08.020561    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-console-config\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:08.020639 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:08.020583    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5vns\" (UniqueName: \"kubernetes.io/projected/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-kube-api-access-l5vns\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:08.020639 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:08.020594    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-trusted-ca-bundle\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:08.020639 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:08.020603    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-oauth-serving-cert\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:08.020639 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:08.020611    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-console-serving-cert\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:08.020639 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:08.020619    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46-console-oauth-config\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:08.393224 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:08.393183    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f0b90ff-c6fb-45fb-9505-d915ed7b8f46" path="/var/lib/kubelet/pods/4f0b90ff-c6fb-45fb-9505-d915ed7b8f46/volumes"
Sep 16 12:04:21.872492 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:21.872453    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:21.892607 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:21.892582    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:22.063659 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:22.063631    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:35.654224 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:35.654189    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 12:04:35.654622 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:35.654523    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8574462b-bf21-498d-bf95-aac976785e75" containerName="alertmanager" containerID="cri-o://eb7ad32393655f0a242a37f2979d7201ec9afd5414a67562e6dac7fc7f6cd889" gracePeriod=120
Sep 16 12:04:35.654622 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:35.654600    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8574462b-bf21-498d-bf95-aac976785e75" containerName="kube-rbac-proxy-metric" containerID="cri-o://c5200b2c421c733ce39f347ed1de583c9aa7546ccdfa5f156b614325271a64a9" gracePeriod=120
Sep 16 12:04:35.654730 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:35.654604    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8574462b-bf21-498d-bf95-aac976785e75" containerName="kube-rbac-proxy-web" containerID="cri-o://97804179718fcb58315f6520109caeacf0b2fbd7d7e88193ba0d2606f43826c3" gracePeriod=120
Sep 16 12:04:35.654730 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:35.654648    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8574462b-bf21-498d-bf95-aac976785e75" containerName="prom-label-proxy" containerID="cri-o://bd93a8ca5f3995cf034cc7fc68b05f6deb7402df20f298689e4171f61cb3acd6" gracePeriod=120
Sep 16 12:04:35.654730 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:35.654608    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8574462b-bf21-498d-bf95-aac976785e75" containerName="kube-rbac-proxy" containerID="cri-o://18ef356ce24a462aa239f01e004874f4314680870ac1c5c9fd5ada9ca146f588" gracePeriod=120
Sep 16 12:04:35.654730 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:35.654680    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8574462b-bf21-498d-bf95-aac976785e75" containerName="config-reloader" containerID="cri-o://2df791e372d1262ca119c3802e1ab81b6375408780041879a49ced7c729b1239" gracePeriod=120
Sep 16 12:04:36.104689 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.104659    2576 generic.go:356] "Generic (PLEG): container finished" podID="8574462b-bf21-498d-bf95-aac976785e75" containerID="bd93a8ca5f3995cf034cc7fc68b05f6deb7402df20f298689e4171f61cb3acd6" exitCode=0
Sep 16 12:04:36.104689 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.104684    2576 generic.go:356] "Generic (PLEG): container finished" podID="8574462b-bf21-498d-bf95-aac976785e75" containerID="18ef356ce24a462aa239f01e004874f4314680870ac1c5c9fd5ada9ca146f588" exitCode=0
Sep 16 12:04:36.104689 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.104690    2576 generic.go:356] "Generic (PLEG): container finished" podID="8574462b-bf21-498d-bf95-aac976785e75" containerID="2df791e372d1262ca119c3802e1ab81b6375408780041879a49ced7c729b1239" exitCode=0
Sep 16 12:04:36.104689 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.104698    2576 generic.go:356] "Generic (PLEG): container finished" podID="8574462b-bf21-498d-bf95-aac976785e75" containerID="eb7ad32393655f0a242a37f2979d7201ec9afd5414a67562e6dac7fc7f6cd889" exitCode=0
Sep 16 12:04:36.104939 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.104740    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8574462b-bf21-498d-bf95-aac976785e75","Type":"ContainerDied","Data":"bd93a8ca5f3995cf034cc7fc68b05f6deb7402df20f298689e4171f61cb3acd6"}
Sep 16 12:04:36.104939 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.104805    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8574462b-bf21-498d-bf95-aac976785e75","Type":"ContainerDied","Data":"18ef356ce24a462aa239f01e004874f4314680870ac1c5c9fd5ada9ca146f588"}
Sep 16 12:04:36.104939 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.104830    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8574462b-bf21-498d-bf95-aac976785e75","Type":"ContainerDied","Data":"2df791e372d1262ca119c3802e1ab81b6375408780041879a49ced7c729b1239"}
Sep 16 12:04:36.104939 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.104854    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8574462b-bf21-498d-bf95-aac976785e75","Type":"ContainerDied","Data":"eb7ad32393655f0a242a37f2979d7201ec9afd5414a67562e6dac7fc7f6cd889"}
Sep 16 12:04:36.899268 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.899245    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:36.971210 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.971178    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8574462b-bf21-498d-bf95-aac976785e75-tls-assets\") pod \"8574462b-bf21-498d-bf95-aac976785e75\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") "
Sep 16 12:04:36.971423 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.971250    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-web-config\") pod \"8574462b-bf21-498d-bf95-aac976785e75\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") "
Sep 16 12:04:36.971423 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.971297    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8574462b-bf21-498d-bf95-aac976785e75-alertmanager-trusted-ca-bundle\") pod \"8574462b-bf21-498d-bf95-aac976785e75\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") "
Sep 16 12:04:36.971423 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.971353    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-config-volume\") pod \"8574462b-bf21-498d-bf95-aac976785e75\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") "
Sep 16 12:04:36.971423 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.971381    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-secret-alertmanager-kube-rbac-proxy\") pod \"8574462b-bf21-498d-bf95-aac976785e75\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") "
Sep 16 12:04:36.971423 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.971416    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-secret-alertmanager-kube-rbac-proxy-web\") pod \"8574462b-bf21-498d-bf95-aac976785e75\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") "
Sep 16 12:04:36.971679 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.971451    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8574462b-bf21-498d-bf95-aac976785e75-alertmanager-main-db\") pod \"8574462b-bf21-498d-bf95-aac976785e75\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") "
Sep 16 12:04:36.971679 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.971491    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8574462b-bf21-498d-bf95-aac976785e75\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") "
Sep 16 12:04:36.971679 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.971542    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8574462b-bf21-498d-bf95-aac976785e75-metrics-client-ca\") pod \"8574462b-bf21-498d-bf95-aac976785e75\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") "
Sep 16 12:04:36.971679 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.971567    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-secret-alertmanager-main-tls\") pod \"8574462b-bf21-498d-bf95-aac976785e75\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") "
Sep 16 12:04:36.971679 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.971593    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nmj4\" (UniqueName: \"kubernetes.io/projected/8574462b-bf21-498d-bf95-aac976785e75-kube-api-access-2nmj4\") pod \"8574462b-bf21-498d-bf95-aac976785e75\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") "
Sep 16 12:04:36.971679 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.971626    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-cluster-tls-config\") pod \"8574462b-bf21-498d-bf95-aac976785e75\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") "
Sep 16 12:04:36.971957 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.971683    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8574462b-bf21-498d-bf95-aac976785e75-config-out\") pod \"8574462b-bf21-498d-bf95-aac976785e75\" (UID: \"8574462b-bf21-498d-bf95-aac976785e75\") "
Sep 16 12:04:36.972807 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.972090    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8574462b-bf21-498d-bf95-aac976785e75-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8574462b-bf21-498d-bf95-aac976785e75" (UID: "8574462b-bf21-498d-bf95-aac976785e75"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:04:36.972807 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.972234    2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8574462b-bf21-498d-bf95-aac976785e75-alertmanager-main-db\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:36.972807 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.972226    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8574462b-bf21-498d-bf95-aac976785e75-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8574462b-bf21-498d-bf95-aac976785e75" (UID: "8574462b-bf21-498d-bf95-aac976785e75"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:04:36.973210 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.972829    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8574462b-bf21-498d-bf95-aac976785e75-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8574462b-bf21-498d-bf95-aac976785e75" (UID: "8574462b-bf21-498d-bf95-aac976785e75"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:04:36.975886 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.975842    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8574462b-bf21-498d-bf95-aac976785e75" (UID: "8574462b-bf21-498d-bf95-aac976785e75"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:04:36.976005 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.975954    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-config-volume" (OuterVolumeSpecName: "config-volume") pod "8574462b-bf21-498d-bf95-aac976785e75" (UID: "8574462b-bf21-498d-bf95-aac976785e75"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:04:36.976073 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.976007    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8574462b-bf21-498d-bf95-aac976785e75-config-out" (OuterVolumeSpecName: "config-out") pod "8574462b-bf21-498d-bf95-aac976785e75" (UID: "8574462b-bf21-498d-bf95-aac976785e75"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:04:36.976274 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.976237    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8574462b-bf21-498d-bf95-aac976785e75" (UID: "8574462b-bf21-498d-bf95-aac976785e75"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:04:36.976393 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.976352    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8574462b-bf21-498d-bf95-aac976785e75-kube-api-access-2nmj4" (OuterVolumeSpecName: "kube-api-access-2nmj4") pod "8574462b-bf21-498d-bf95-aac976785e75" (UID: "8574462b-bf21-498d-bf95-aac976785e75"). InnerVolumeSpecName "kube-api-access-2nmj4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:04:36.976611 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.976587    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8574462b-bf21-498d-bf95-aac976785e75" (UID: "8574462b-bf21-498d-bf95-aac976785e75"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:04:36.976688 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.976665    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8574462b-bf21-498d-bf95-aac976785e75-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8574462b-bf21-498d-bf95-aac976785e75" (UID: "8574462b-bf21-498d-bf95-aac976785e75"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:04:36.977524 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.977508    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8574462b-bf21-498d-bf95-aac976785e75" (UID: "8574462b-bf21-498d-bf95-aac976785e75"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:04:36.982143 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.982113    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8574462b-bf21-498d-bf95-aac976785e75" (UID: "8574462b-bf21-498d-bf95-aac976785e75"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:04:36.987239 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:36.987182    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-web-config" (OuterVolumeSpecName: "web-config") pod "8574462b-bf21-498d-bf95-aac976785e75" (UID: "8574462b-bf21-498d-bf95-aac976785e75"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:04:37.073507 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.073478    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:37.073507 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.073501    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8574462b-bf21-498d-bf95-aac976785e75-metrics-client-ca\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:37.073507 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.073511    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-secret-alertmanager-main-tls\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:37.073714 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.073520    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nmj4\" (UniqueName: \"kubernetes.io/projected/8574462b-bf21-498d-bf95-aac976785e75-kube-api-access-2nmj4\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:37.073714 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.073528    2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-cluster-tls-config\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:37.073714 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.073537    2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8574462b-bf21-498d-bf95-aac976785e75-config-out\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:37.073714 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.073545    2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8574462b-bf21-498d-bf95-aac976785e75-tls-assets\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:37.073714 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.073552    2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-web-config\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:37.073714 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.073559    2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8574462b-bf21-498d-bf95-aac976785e75-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:37.073714 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.073568    2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-config-volume\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:37.073714 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.073576    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:37.073714 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.073584    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8574462b-bf21-498d-bf95-aac976785e75-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:37.111468 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.111431    2576 generic.go:356] "Generic (PLEG): container finished" podID="8574462b-bf21-498d-bf95-aac976785e75" containerID="c5200b2c421c733ce39f347ed1de583c9aa7546ccdfa5f156b614325271a64a9" exitCode=0
Sep 16 12:04:37.111468 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.111459    2576 generic.go:356] "Generic (PLEG): container finished" podID="8574462b-bf21-498d-bf95-aac976785e75" containerID="97804179718fcb58315f6520109caeacf0b2fbd7d7e88193ba0d2606f43826c3" exitCode=0
Sep 16 12:04:37.111637 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.111501    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.111637 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.111514    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8574462b-bf21-498d-bf95-aac976785e75","Type":"ContainerDied","Data":"c5200b2c421c733ce39f347ed1de583c9aa7546ccdfa5f156b614325271a64a9"}
Sep 16 12:04:37.111637 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.111577    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8574462b-bf21-498d-bf95-aac976785e75","Type":"ContainerDied","Data":"97804179718fcb58315f6520109caeacf0b2fbd7d7e88193ba0d2606f43826c3"}
Sep 16 12:04:37.111637 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.111604    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8574462b-bf21-498d-bf95-aac976785e75","Type":"ContainerDied","Data":"666459339d37622d27234ea1bc968b96632fb06fb95995c635ac0e07f493f2ad"}
Sep 16 12:04:37.111637 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.111634    2576 scope.go:117] "RemoveContainer" containerID="bd93a8ca5f3995cf034cc7fc68b05f6deb7402df20f298689e4171f61cb3acd6"
Sep 16 12:04:37.119507 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.119492    2576 scope.go:117] "RemoveContainer" containerID="c5200b2c421c733ce39f347ed1de583c9aa7546ccdfa5f156b614325271a64a9"
Sep 16 12:04:37.126631 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.126614    2576 scope.go:117] "RemoveContainer" containerID="18ef356ce24a462aa239f01e004874f4314680870ac1c5c9fd5ada9ca146f588"
Sep 16 12:04:37.133694 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.133641    2576 scope.go:117] "RemoveContainer" containerID="97804179718fcb58315f6520109caeacf0b2fbd7d7e88193ba0d2606f43826c3"
Sep 16 12:04:37.135191 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.135169    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 12:04:37.139832 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.139809    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 12:04:37.141020 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.141007    2576 scope.go:117] "RemoveContainer" containerID="2df791e372d1262ca119c3802e1ab81b6375408780041879a49ced7c729b1239"
Sep 16 12:04:37.147907 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.147891    2576 scope.go:117] "RemoveContainer" containerID="eb7ad32393655f0a242a37f2979d7201ec9afd5414a67562e6dac7fc7f6cd889"
Sep 16 12:04:37.154909 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.154893    2576 scope.go:117] "RemoveContainer" containerID="3bd69b7b1686e7a5f53eb3535a456e3ec36e6cd8287c682e2703be4c9f0ff129"
Sep 16 12:04:37.161839 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.161822    2576 scope.go:117] "RemoveContainer" containerID="bd93a8ca5f3995cf034cc7fc68b05f6deb7402df20f298689e4171f61cb3acd6"
Sep 16 12:04:37.162095 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:04:37.162078    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd93a8ca5f3995cf034cc7fc68b05f6deb7402df20f298689e4171f61cb3acd6\": container with ID starting with bd93a8ca5f3995cf034cc7fc68b05f6deb7402df20f298689e4171f61cb3acd6 not found: ID does not exist" containerID="bd93a8ca5f3995cf034cc7fc68b05f6deb7402df20f298689e4171f61cb3acd6"
Sep 16 12:04:37.162150 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.162105    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd93a8ca5f3995cf034cc7fc68b05f6deb7402df20f298689e4171f61cb3acd6"} err="failed to get container status \"bd93a8ca5f3995cf034cc7fc68b05f6deb7402df20f298689e4171f61cb3acd6\": rpc error: code = NotFound desc = could not find container \"bd93a8ca5f3995cf034cc7fc68b05f6deb7402df20f298689e4171f61cb3acd6\": container with ID starting with bd93a8ca5f3995cf034cc7fc68b05f6deb7402df20f298689e4171f61cb3acd6 not found: ID does not exist"
Sep 16 12:04:37.162150 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.162123    2576 scope.go:117] "RemoveContainer" containerID="c5200b2c421c733ce39f347ed1de583c9aa7546ccdfa5f156b614325271a64a9"
Sep 16 12:04:37.162375 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:04:37.162354    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5200b2c421c733ce39f347ed1de583c9aa7546ccdfa5f156b614325271a64a9\": container with ID starting with c5200b2c421c733ce39f347ed1de583c9aa7546ccdfa5f156b614325271a64a9 not found: ID does not exist" containerID="c5200b2c421c733ce39f347ed1de583c9aa7546ccdfa5f156b614325271a64a9"
Sep 16 12:04:37.162451 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.162386    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5200b2c421c733ce39f347ed1de583c9aa7546ccdfa5f156b614325271a64a9"} err="failed to get container status \"c5200b2c421c733ce39f347ed1de583c9aa7546ccdfa5f156b614325271a64a9\": rpc error: code = NotFound desc = could not find container \"c5200b2c421c733ce39f347ed1de583c9aa7546ccdfa5f156b614325271a64a9\": container with ID starting with c5200b2c421c733ce39f347ed1de583c9aa7546ccdfa5f156b614325271a64a9 not found: ID does not exist"
Sep 16 12:04:37.162451 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.162406    2576 scope.go:117] "RemoveContainer" containerID="18ef356ce24a462aa239f01e004874f4314680870ac1c5c9fd5ada9ca146f588"
Sep 16 12:04:37.162697 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:04:37.162678    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18ef356ce24a462aa239f01e004874f4314680870ac1c5c9fd5ada9ca146f588\": container with ID starting with 18ef356ce24a462aa239f01e004874f4314680870ac1c5c9fd5ada9ca146f588 not found: ID does not exist" containerID="18ef356ce24a462aa239f01e004874f4314680870ac1c5c9fd5ada9ca146f588"
Sep 16 12:04:37.162737 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.162703    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18ef356ce24a462aa239f01e004874f4314680870ac1c5c9fd5ada9ca146f588"} err="failed to get container status \"18ef356ce24a462aa239f01e004874f4314680870ac1c5c9fd5ada9ca146f588\": rpc error: code = NotFound desc = could not find container \"18ef356ce24a462aa239f01e004874f4314680870ac1c5c9fd5ada9ca146f588\": container with ID starting with 18ef356ce24a462aa239f01e004874f4314680870ac1c5c9fd5ada9ca146f588 not found: ID does not exist"
Sep 16 12:04:37.162737 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.162718    2576 scope.go:117] "RemoveContainer" containerID="97804179718fcb58315f6520109caeacf0b2fbd7d7e88193ba0d2606f43826c3"
Sep 16 12:04:37.162926 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:04:37.162907    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97804179718fcb58315f6520109caeacf0b2fbd7d7e88193ba0d2606f43826c3\": container with ID starting with 97804179718fcb58315f6520109caeacf0b2fbd7d7e88193ba0d2606f43826c3 not found: ID does not exist" containerID="97804179718fcb58315f6520109caeacf0b2fbd7d7e88193ba0d2606f43826c3"
Sep 16 12:04:37.162992 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.162932    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97804179718fcb58315f6520109caeacf0b2fbd7d7e88193ba0d2606f43826c3"} err="failed to get container status \"97804179718fcb58315f6520109caeacf0b2fbd7d7e88193ba0d2606f43826c3\": rpc error: code = NotFound desc = could not find container \"97804179718fcb58315f6520109caeacf0b2fbd7d7e88193ba0d2606f43826c3\": container with ID starting with 97804179718fcb58315f6520109caeacf0b2fbd7d7e88193ba0d2606f43826c3 not found: ID does not exist"
Sep 16 12:04:37.162992 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.162951    2576 scope.go:117] "RemoveContainer" containerID="2df791e372d1262ca119c3802e1ab81b6375408780041879a49ced7c729b1239"
Sep 16 12:04:37.163211 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:04:37.163193    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2df791e372d1262ca119c3802e1ab81b6375408780041879a49ced7c729b1239\": container with ID starting with 2df791e372d1262ca119c3802e1ab81b6375408780041879a49ced7c729b1239 not found: ID does not exist" containerID="2df791e372d1262ca119c3802e1ab81b6375408780041879a49ced7c729b1239"
Sep 16 12:04:37.163251 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.163217    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2df791e372d1262ca119c3802e1ab81b6375408780041879a49ced7c729b1239"} err="failed to get container status \"2df791e372d1262ca119c3802e1ab81b6375408780041879a49ced7c729b1239\": rpc error: code = NotFound desc = could not find container \"2df791e372d1262ca119c3802e1ab81b6375408780041879a49ced7c729b1239\": container with ID starting with 2df791e372d1262ca119c3802e1ab81b6375408780041879a49ced7c729b1239 not found: ID does not exist"
Sep 16 12:04:37.163251 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.163232    2576 scope.go:117] "RemoveContainer" containerID="eb7ad32393655f0a242a37f2979d7201ec9afd5414a67562e6dac7fc7f6cd889"
Sep 16 12:04:37.163491 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:04:37.163474    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb7ad32393655f0a242a37f2979d7201ec9afd5414a67562e6dac7fc7f6cd889\": container with ID starting with eb7ad32393655f0a242a37f2979d7201ec9afd5414a67562e6dac7fc7f6cd889 not found: ID does not exist" containerID="eb7ad32393655f0a242a37f2979d7201ec9afd5414a67562e6dac7fc7f6cd889"
Sep 16 12:04:37.163552 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.163497    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb7ad32393655f0a242a37f2979d7201ec9afd5414a67562e6dac7fc7f6cd889"} err="failed to get container status \"eb7ad32393655f0a242a37f2979d7201ec9afd5414a67562e6dac7fc7f6cd889\": rpc error: code = NotFound desc = could not find container \"eb7ad32393655f0a242a37f2979d7201ec9afd5414a67562e6dac7fc7f6cd889\": container with ID starting with eb7ad32393655f0a242a37f2979d7201ec9afd5414a67562e6dac7fc7f6cd889 not found: ID does not exist"
Sep 16 12:04:37.163552 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.163515    2576 scope.go:117] "RemoveContainer" containerID="3bd69b7b1686e7a5f53eb3535a456e3ec36e6cd8287c682e2703be4c9f0ff129"
Sep 16 12:04:37.163766 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:04:37.163748    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bd69b7b1686e7a5f53eb3535a456e3ec36e6cd8287c682e2703be4c9f0ff129\": container with ID starting with 3bd69b7b1686e7a5f53eb3535a456e3ec36e6cd8287c682e2703be4c9f0ff129 not found: ID does not exist" containerID="3bd69b7b1686e7a5f53eb3535a456e3ec36e6cd8287c682e2703be4c9f0ff129"
Sep 16 12:04:37.163808 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.163770    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd69b7b1686e7a5f53eb3535a456e3ec36e6cd8287c682e2703be4c9f0ff129"} err="failed to get container status \"3bd69b7b1686e7a5f53eb3535a456e3ec36e6cd8287c682e2703be4c9f0ff129\": rpc error: code = NotFound desc = could not find container \"3bd69b7b1686e7a5f53eb3535a456e3ec36e6cd8287c682e2703be4c9f0ff129\": container with ID starting with 3bd69b7b1686e7a5f53eb3535a456e3ec36e6cd8287c682e2703be4c9f0ff129 not found: ID does not exist"
Sep 16 12:04:37.163808 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.163783    2576 scope.go:117] "RemoveContainer" containerID="bd93a8ca5f3995cf034cc7fc68b05f6deb7402df20f298689e4171f61cb3acd6"
Sep 16 12:04:37.163982 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.163966    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd93a8ca5f3995cf034cc7fc68b05f6deb7402df20f298689e4171f61cb3acd6"} err="failed to get container status \"bd93a8ca5f3995cf034cc7fc68b05f6deb7402df20f298689e4171f61cb3acd6\": rpc error: code = NotFound desc = could not find container \"bd93a8ca5f3995cf034cc7fc68b05f6deb7402df20f298689e4171f61cb3acd6\": container with ID starting with bd93a8ca5f3995cf034cc7fc68b05f6deb7402df20f298689e4171f61cb3acd6 not found: ID does not exist"
Sep 16 12:04:37.164025 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.163982    2576 scope.go:117] "RemoveContainer" containerID="c5200b2c421c733ce39f347ed1de583c9aa7546ccdfa5f156b614325271a64a9"
Sep 16 12:04:37.164208 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.164189    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5200b2c421c733ce39f347ed1de583c9aa7546ccdfa5f156b614325271a64a9"} err="failed to get container status \"c5200b2c421c733ce39f347ed1de583c9aa7546ccdfa5f156b614325271a64a9\": rpc error: code = NotFound desc = could not find container \"c5200b2c421c733ce39f347ed1de583c9aa7546ccdfa5f156b614325271a64a9\": container with ID starting with c5200b2c421c733ce39f347ed1de583c9aa7546ccdfa5f156b614325271a64a9 not found: ID does not exist"
Sep 16 12:04:37.164259 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.164210    2576 scope.go:117] "RemoveContainer" containerID="18ef356ce24a462aa239f01e004874f4314680870ac1c5c9fd5ada9ca146f588"
Sep 16 12:04:37.164417 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.164401    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18ef356ce24a462aa239f01e004874f4314680870ac1c5c9fd5ada9ca146f588"} err="failed to get container status \"18ef356ce24a462aa239f01e004874f4314680870ac1c5c9fd5ada9ca146f588\": rpc error: code = NotFound desc = could not find container \"18ef356ce24a462aa239f01e004874f4314680870ac1c5c9fd5ada9ca146f588\": container with ID starting with 18ef356ce24a462aa239f01e004874f4314680870ac1c5c9fd5ada9ca146f588 not found: ID does not exist"
Sep 16 12:04:37.164467 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.164417    2576 scope.go:117] "RemoveContainer" containerID="97804179718fcb58315f6520109caeacf0b2fbd7d7e88193ba0d2606f43826c3"
Sep 16 12:04:37.164655 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.164633    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97804179718fcb58315f6520109caeacf0b2fbd7d7e88193ba0d2606f43826c3"} err="failed to get container status \"97804179718fcb58315f6520109caeacf0b2fbd7d7e88193ba0d2606f43826c3\": rpc error: code = NotFound desc = could not find container \"97804179718fcb58315f6520109caeacf0b2fbd7d7e88193ba0d2606f43826c3\": container with ID starting with 97804179718fcb58315f6520109caeacf0b2fbd7d7e88193ba0d2606f43826c3 not found: ID does not exist"
Sep 16 12:04:37.164704 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.164658    2576 scope.go:117] "RemoveContainer" containerID="2df791e372d1262ca119c3802e1ab81b6375408780041879a49ced7c729b1239"
Sep 16 12:04:37.164927 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.164900    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2df791e372d1262ca119c3802e1ab81b6375408780041879a49ced7c729b1239"} err="failed to get container status \"2df791e372d1262ca119c3802e1ab81b6375408780041879a49ced7c729b1239\": rpc error: code = NotFound desc = could not find container \"2df791e372d1262ca119c3802e1ab81b6375408780041879a49ced7c729b1239\": container with ID starting with 2df791e372d1262ca119c3802e1ab81b6375408780041879a49ced7c729b1239 not found: ID does not exist"
Sep 16 12:04:37.164927 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.164927    2576 scope.go:117] "RemoveContainer" containerID="eb7ad32393655f0a242a37f2979d7201ec9afd5414a67562e6dac7fc7f6cd889"
Sep 16 12:04:37.165268 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.165226    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb7ad32393655f0a242a37f2979d7201ec9afd5414a67562e6dac7fc7f6cd889"} err="failed to get container status \"eb7ad32393655f0a242a37f2979d7201ec9afd5414a67562e6dac7fc7f6cd889\": rpc error: code = NotFound desc = could not find container \"eb7ad32393655f0a242a37f2979d7201ec9afd5414a67562e6dac7fc7f6cd889\": container with ID starting with eb7ad32393655f0a242a37f2979d7201ec9afd5414a67562e6dac7fc7f6cd889 not found: ID does not exist"
Sep 16 12:04:37.165268 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.165251    2576 scope.go:117] "RemoveContainer" containerID="3bd69b7b1686e7a5f53eb3535a456e3ec36e6cd8287c682e2703be4c9f0ff129"
Sep 16 12:04:37.165738 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.165708    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd69b7b1686e7a5f53eb3535a456e3ec36e6cd8287c682e2703be4c9f0ff129"} err="failed to get container status \"3bd69b7b1686e7a5f53eb3535a456e3ec36e6cd8287c682e2703be4c9f0ff129\": rpc error: code = NotFound desc = could not find container \"3bd69b7b1686e7a5f53eb3535a456e3ec36e6cd8287c682e2703be4c9f0ff129\": container with ID starting with 3bd69b7b1686e7a5f53eb3535a456e3ec36e6cd8287c682e2703be4c9f0ff129 not found: ID does not exist"
Sep 16 12:04:37.167144 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167123    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 12:04:37.167479 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167464    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8574462b-bf21-498d-bf95-aac976785e75" containerName="init-config-reloader"
Sep 16 12:04:37.167556 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167482    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8574462b-bf21-498d-bf95-aac976785e75" containerName="init-config-reloader"
Sep 16 12:04:37.167556 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167501    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7146f48d-b0e1-4322-bc3f-544d5bb939c0" containerName="console"
Sep 16 12:04:37.167556 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167511    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7146f48d-b0e1-4322-bc3f-544d5bb939c0" containerName="console"
Sep 16 12:04:37.167556 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167532    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f0b90ff-c6fb-45fb-9505-d915ed7b8f46" containerName="console"
Sep 16 12:04:37.167556 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167541    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f0b90ff-c6fb-45fb-9505-d915ed7b8f46" containerName="console"
Sep 16 12:04:37.167795 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167550    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8574462b-bf21-498d-bf95-aac976785e75" containerName="kube-rbac-proxy-metric"
Sep 16 12:04:37.167795 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167568    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8574462b-bf21-498d-bf95-aac976785e75" containerName="kube-rbac-proxy-metric"
Sep 16 12:04:37.167795 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167577    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8574462b-bf21-498d-bf95-aac976785e75" containerName="prom-label-proxy"
Sep 16 12:04:37.167795 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167585    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8574462b-bf21-498d-bf95-aac976785e75" containerName="prom-label-proxy"
Sep 16 12:04:37.167795 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167597    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8574462b-bf21-498d-bf95-aac976785e75" containerName="config-reloader"
Sep 16 12:04:37.167795 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167605    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8574462b-bf21-498d-bf95-aac976785e75" containerName="config-reloader"
Sep 16 12:04:37.167795 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167613    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8574462b-bf21-498d-bf95-aac976785e75" containerName="kube-rbac-proxy-web"
Sep 16 12:04:37.167795 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167620    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8574462b-bf21-498d-bf95-aac976785e75" containerName="kube-rbac-proxy-web"
Sep 16 12:04:37.167795 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167630    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8574462b-bf21-498d-bf95-aac976785e75" containerName="kube-rbac-proxy"
Sep 16 12:04:37.167795 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167638    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8574462b-bf21-498d-bf95-aac976785e75" containerName="kube-rbac-proxy"
Sep 16 12:04:37.167795 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167654    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8574462b-bf21-498d-bf95-aac976785e75" containerName="alertmanager"
Sep 16 12:04:37.167795 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167662    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8574462b-bf21-498d-bf95-aac976785e75" containerName="alertmanager"
Sep 16 12:04:37.167795 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167732    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8574462b-bf21-498d-bf95-aac976785e75" containerName="kube-rbac-proxy-web"
Sep 16 12:04:37.167795 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167746    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8574462b-bf21-498d-bf95-aac976785e75" containerName="kube-rbac-proxy"
Sep 16 12:04:37.167795 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167755    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8574462b-bf21-498d-bf95-aac976785e75" containerName="prom-label-proxy"
Sep 16 12:04:37.167795 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167764    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8574462b-bf21-498d-bf95-aac976785e75" containerName="kube-rbac-proxy-metric"
Sep 16 12:04:37.167795 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167775    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8574462b-bf21-498d-bf95-aac976785e75" containerName="config-reloader"
Sep 16 12:04:37.167795 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167783    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f0b90ff-c6fb-45fb-9505-d915ed7b8f46" containerName="console"
Sep 16 12:04:37.167795 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167790    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7146f48d-b0e1-4322-bc3f-544d5bb939c0" containerName="console"
Sep 16 12:04:37.167795 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.167797    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8574462b-bf21-498d-bf95-aac976785e75" containerName="alertmanager"
Sep 16 12:04:37.173092 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.173073    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.176122 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.176103    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wlwv9\""
Sep 16 12:04:37.176232 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.176172    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 16 12:04:37.176301 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.176231    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 16 12:04:37.176444 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.176430    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 16 12:04:37.176708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.176686    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 16 12:04:37.176981 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.176956    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 16 12:04:37.177504 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.177454    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 16 12:04:37.177504 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.177490    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 16 12:04:37.177675 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.177489    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 16 12:04:37.187889 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.183730    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 16 12:04:37.197508 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.197488    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 12:04:37.275004 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.274928    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f0f07c08-edbf-4a82-8d71-ac25d24866ea-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.275004 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.274959    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f0f07c08-edbf-4a82-8d71-ac25d24866ea-web-config\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.275004 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.274985    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f0f07c08-edbf-4a82-8d71-ac25d24866ea-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.275195 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.275043    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0f07c08-edbf-4a82-8d71-ac25d24866ea-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.275195 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.275093    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0f07c08-edbf-4a82-8d71-ac25d24866ea-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.275195 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.275126    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f0f07c08-edbf-4a82-8d71-ac25d24866ea-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.275195 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.275157    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f0f07c08-edbf-4a82-8d71-ac25d24866ea-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.275195 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.275176    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f0f07c08-edbf-4a82-8d71-ac25d24866ea-config-volume\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.275380 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.275197    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f0f07c08-edbf-4a82-8d71-ac25d24866ea-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.275380 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.275222    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g62c\" (UniqueName: \"kubernetes.io/projected/f0f07c08-edbf-4a82-8d71-ac25d24866ea-kube-api-access-8g62c\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.275380 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.275252    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f0f07c08-edbf-4a82-8d71-ac25d24866ea-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.275380 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.275284    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f0f07c08-edbf-4a82-8d71-ac25d24866ea-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.275380 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.275350    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f0f07c08-edbf-4a82-8d71-ac25d24866ea-config-out\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.376511 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.376476    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f0f07c08-edbf-4a82-8d71-ac25d24866ea-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.376511 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.376509    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f0f07c08-edbf-4a82-8d71-ac25d24866ea-web-config\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.376748 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.376526    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f0f07c08-edbf-4a82-8d71-ac25d24866ea-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.376748 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.376556    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0f07c08-edbf-4a82-8d71-ac25d24866ea-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.376748 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.376582    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0f07c08-edbf-4a82-8d71-ac25d24866ea-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.376748 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.376612    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f0f07c08-edbf-4a82-8d71-ac25d24866ea-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.376748 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.376649    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f0f07c08-edbf-4a82-8d71-ac25d24866ea-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.376996 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.376953    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f0f07c08-edbf-4a82-8d71-ac25d24866ea-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.377051 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.377029    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f0f07c08-edbf-4a82-8d71-ac25d24866ea-config-volume\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.377108 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.377083    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f0f07c08-edbf-4a82-8d71-ac25d24866ea-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.377164 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.377112    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g62c\" (UniqueName: \"kubernetes.io/projected/f0f07c08-edbf-4a82-8d71-ac25d24866ea-kube-api-access-8g62c\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.377164 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.377143    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f0f07c08-edbf-4a82-8d71-ac25d24866ea-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.377260 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.377204    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f0f07c08-edbf-4a82-8d71-ac25d24866ea-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.377260 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.377237    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f0f07c08-edbf-4a82-8d71-ac25d24866ea-config-out\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.377477 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.377437    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0f07c08-edbf-4a82-8d71-ac25d24866ea-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.377594 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.377564    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0f07c08-edbf-4a82-8d71-ac25d24866ea-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.379946 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.379913    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f0f07c08-edbf-4a82-8d71-ac25d24866ea-config-volume\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.379946 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.379943    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f0f07c08-edbf-4a82-8d71-ac25d24866ea-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.380121 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.380107    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f0f07c08-edbf-4a82-8d71-ac25d24866ea-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.380180 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.380119    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f0f07c08-edbf-4a82-8d71-ac25d24866ea-web-config\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.380298 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.380277    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f0f07c08-edbf-4a82-8d71-ac25d24866ea-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.380543 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.380517    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f0f07c08-edbf-4a82-8d71-ac25d24866ea-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.380650 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.380629    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f0f07c08-edbf-4a82-8d71-ac25d24866ea-config-out\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.380797 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.380778    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f0f07c08-edbf-4a82-8d71-ac25d24866ea-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.382000 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.381983    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f0f07c08-edbf-4a82-8d71-ac25d24866ea-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.386500 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.386481    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g62c\" (UniqueName: \"kubernetes.io/projected/f0f07c08-edbf-4a82-8d71-ac25d24866ea-kube-api-access-8g62c\") pod \"alertmanager-main-0\" (UID: \"f0f07c08-edbf-4a82-8d71-ac25d24866ea\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.483749 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.483723    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 16 12:04:37.766887 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:37.766863    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 12:04:37.769099 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:04:37.769073    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0f07c08_edbf_4a82_8d71_ac25d24866ea.slice/crio-d43c6ff6487d3a7d4a0de235292b7670634faf58b70115bcfae14d64b1bbcbf0 WatchSource:0}: Error finding container d43c6ff6487d3a7d4a0de235292b7670634faf58b70115bcfae14d64b1bbcbf0: Status 404 returned error can't find the container with id d43c6ff6487d3a7d4a0de235292b7670634faf58b70115bcfae14d64b1bbcbf0
Sep 16 12:04:38.117193 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:38.117153    2576 generic.go:356] "Generic (PLEG): container finished" podID="f0f07c08-edbf-4a82-8d71-ac25d24866ea" containerID="9eed86f092cc1f14a112bb41f659ac23b324a8b9fc7037e4a991d87320f212e8" exitCode=0
Sep 16 12:04:38.117636 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:38.117237    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f0f07c08-edbf-4a82-8d71-ac25d24866ea","Type":"ContainerDied","Data":"9eed86f092cc1f14a112bb41f659ac23b324a8b9fc7037e4a991d87320f212e8"}
Sep 16 12:04:38.117636 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:38.117306    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f0f07c08-edbf-4a82-8d71-ac25d24866ea","Type":"ContainerStarted","Data":"d43c6ff6487d3a7d4a0de235292b7670634faf58b70115bcfae14d64b1bbcbf0"}
Sep 16 12:04:38.392245 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:38.392222    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8574462b-bf21-498d-bf95-aac976785e75" path="/var/lib/kubelet/pods/8574462b-bf21-498d-bf95-aac976785e75/volumes"
Sep 16 12:04:39.125880 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:39.125839    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f0f07c08-edbf-4a82-8d71-ac25d24866ea","Type":"ContainerStarted","Data":"ae7e3898f21a4d19fcbb71579f1fad3bfa6c69ccc67e6d3df672bdf3d339dbd1"}
Sep 16 12:04:39.126226 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:39.125922    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f0f07c08-edbf-4a82-8d71-ac25d24866ea","Type":"ContainerStarted","Data":"d6d565c48c5a15f746cf0c61467a3ccc91f1e7f53ccfdf77d225cf63fda24326"}
Sep 16 12:04:39.126226 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:39.125963    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f0f07c08-edbf-4a82-8d71-ac25d24866ea","Type":"ContainerStarted","Data":"b1d1275e5232f8b5b799e7126d7f8dbd57e8ec545ea88997d20a15372e41a332"}
Sep 16 12:04:39.126226 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:39.126001    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f0f07c08-edbf-4a82-8d71-ac25d24866ea","Type":"ContainerStarted","Data":"af0219d88ee6db88ae31945b086bbc64d83c3b0b56e8608d61559250b8e78f86"}
Sep 16 12:04:39.126226 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:39.126035    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f0f07c08-edbf-4a82-8d71-ac25d24866ea","Type":"ContainerStarted","Data":"18a76c0c2e156b01dd73a2590ba3590d1b382705299d3b94435733f10d547d47"}
Sep 16 12:04:39.126226 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:39.126069    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f0f07c08-edbf-4a82-8d71-ac25d24866ea","Type":"ContainerStarted","Data":"787e97851d3cfae1d8734c1a560b3717e45bcda72a40cd4786c899a637de820f"}
Sep 16 12:04:39.156373 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:39.156297    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.140984908 podStartE2EDuration="2.156281128s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.29622ms" isStatefulPod=false podCreationTimestamp="2026-09-16 12:04:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:04:39.154082866 +0000 UTC m=+145.323047574" watchObservedRunningTime="2026-09-16 12:04:39.156281128 +0000 UTC m=+145.325245835"
Sep 16 12:04:39.915814 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:39.915777    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 12:04:39.916099 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:39.916075    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerName="prometheus" containerID="cri-o://df7fe6a17275c5004e5ce131053f16954fa4d63025a9534da8752162a8d3c6d3" gracePeriod=600
Sep 16 12:04:39.916203 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:39.916152    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerName="kube-rbac-proxy-thanos" containerID="cri-o://f49daffd27e94b1cc4f6d82eb8ed3524b7ccfef9219e23c68e156da81d8d6d62" gracePeriod=600
Sep 16 12:04:39.916267 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:39.916172    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerName="kube-rbac-proxy" containerID="cri-o://ad9fe6ec1061d159234b022cd0f64e7367306beb7ba85f7be3d41eaa15298c93" gracePeriod=600
Sep 16 12:04:39.916267 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:39.916215    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerName="thanos-sidecar" containerID="cri-o://ea096662f11dd4acb097e6e6257f3b5fc65fd693718868c357d15269f2918bc3" gracePeriod=600
Sep 16 12:04:39.916393 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:39.916239    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerName="config-reloader" containerID="cri-o://7e50f2fe6eaba5ee5f1de8c761bb4f7f9baf055439bc33ca3e69228d0d2d5863" gracePeriod=600
Sep 16 12:04:39.916393 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:39.916168    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerName="kube-rbac-proxy-web" containerID="cri-o://1011d0863506967396214dc4cc9415e5e3b576b2b453250e5937fa3ec2ac08ab" gracePeriod=600
Sep 16 12:04:40.140732 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.140699    2576 generic.go:356] "Generic (PLEG): container finished" podID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerID="f49daffd27e94b1cc4f6d82eb8ed3524b7ccfef9219e23c68e156da81d8d6d62" exitCode=0
Sep 16 12:04:40.140732 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.140726    2576 generic.go:356] "Generic (PLEG): container finished" podID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerID="ad9fe6ec1061d159234b022cd0f64e7367306beb7ba85f7be3d41eaa15298c93" exitCode=0
Sep 16 12:04:40.140732 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.140733    2576 generic.go:356] "Generic (PLEG): container finished" podID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerID="1011d0863506967396214dc4cc9415e5e3b576b2b453250e5937fa3ec2ac08ab" exitCode=0
Sep 16 12:04:40.140732 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.140740    2576 generic.go:356] "Generic (PLEG): container finished" podID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerID="ea096662f11dd4acb097e6e6257f3b5fc65fd693718868c357d15269f2918bc3" exitCode=0
Sep 16 12:04:40.141258 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.140732    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1140296b-38d4-41e4-be7d-a7a0f76021d3","Type":"ContainerDied","Data":"f49daffd27e94b1cc4f6d82eb8ed3524b7ccfef9219e23c68e156da81d8d6d62"}
Sep 16 12:04:40.141258 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.140745    2576 generic.go:356] "Generic (PLEG): container finished" podID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerID="7e50f2fe6eaba5ee5f1de8c761bb4f7f9baf055439bc33ca3e69228d0d2d5863" exitCode=0
Sep 16 12:04:40.141258 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.140829    2576 generic.go:356] "Generic (PLEG): container finished" podID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerID="df7fe6a17275c5004e5ce131053f16954fa4d63025a9534da8752162a8d3c6d3" exitCode=0
Sep 16 12:04:40.141258 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.140835    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1140296b-38d4-41e4-be7d-a7a0f76021d3","Type":"ContainerDied","Data":"ad9fe6ec1061d159234b022cd0f64e7367306beb7ba85f7be3d41eaa15298c93"}
Sep 16 12:04:40.141258 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.140886    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1140296b-38d4-41e4-be7d-a7a0f76021d3","Type":"ContainerDied","Data":"1011d0863506967396214dc4cc9415e5e3b576b2b453250e5937fa3ec2ac08ab"}
Sep 16 12:04:40.141258 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.140942    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1140296b-38d4-41e4-be7d-a7a0f76021d3","Type":"ContainerDied","Data":"ea096662f11dd4acb097e6e6257f3b5fc65fd693718868c357d15269f2918bc3"}
Sep 16 12:04:40.141258 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.140980    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1140296b-38d4-41e4-be7d-a7a0f76021d3","Type":"ContainerDied","Data":"7e50f2fe6eaba5ee5f1de8c761bb4f7f9baf055439bc33ca3e69228d0d2d5863"}
Sep 16 12:04:40.141258 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.141021    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1140296b-38d4-41e4-be7d-a7a0f76021d3","Type":"ContainerDied","Data":"df7fe6a17275c5004e5ce131053f16954fa4d63025a9534da8752162a8d3c6d3"}
Sep 16 12:04:40.171258 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.171193    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:40.201612 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.201571    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-configmap-metrics-client-ca\") pod \"1140296b-38d4-41e4-be7d-a7a0f76021d3\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") "
Sep 16 12:04:40.201796 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.201622    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-k8s-rulefiles-1\") pod \"1140296b-38d4-41e4-be7d-a7a0f76021d3\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") "
Sep 16 12:04:40.201796 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.201674    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1140296b-38d4-41e4-be7d-a7a0f76021d3-tls-assets\") pod \"1140296b-38d4-41e4-be7d-a7a0f76021d3\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") "
Sep 16 12:04:40.201796 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.201704    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-thanos-prometheus-http-client-file\") pod \"1140296b-38d4-41e4-be7d-a7a0f76021d3\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") "
Sep 16 12:04:40.201796 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.201736    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-prometheus-k8s-tls\") pod \"1140296b-38d4-41e4-be7d-a7a0f76021d3\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") "
Sep 16 12:04:40.201796 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.201762    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-grpc-tls\") pod \"1140296b-38d4-41e4-be7d-a7a0f76021d3\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") "
Sep 16 12:04:40.201796 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.201784    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-metrics-client-certs\") pod \"1140296b-38d4-41e4-be7d-a7a0f76021d3\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") "
Sep 16 12:04:40.202074 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.201809    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpg8v\" (UniqueName: \"kubernetes.io/projected/1140296b-38d4-41e4-be7d-a7a0f76021d3-kube-api-access-cpg8v\") pod \"1140296b-38d4-41e4-be7d-a7a0f76021d3\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") "
Sep 16 12:04:40.202074 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.201835    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1140296b-38d4-41e4-be7d-a7a0f76021d3-config-out\") pod \"1140296b-38d4-41e4-be7d-a7a0f76021d3\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") "
Sep 16 12:04:40.202074 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.201871    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-k8s-rulefiles-0\") pod \"1140296b-38d4-41e4-be7d-a7a0f76021d3\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") "
Sep 16 12:04:40.202074 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.201902    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1140296b-38d4-41e4-be7d-a7a0f76021d3\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") "
Sep 16 12:04:40.202074 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.201932    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-k8s-rulefiles-2\") pod \"1140296b-38d4-41e4-be7d-a7a0f76021d3\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") "
Sep 16 12:04:40.202074 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.201953    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-k8s-db\") pod \"1140296b-38d4-41e4-be7d-a7a0f76021d3\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") "
Sep 16 12:04:40.202074 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.201992    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-web-config\") pod \"1140296b-38d4-41e4-be7d-a7a0f76021d3\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") "
Sep 16 12:04:40.202074 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.202016    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-trusted-ca-bundle\") pod \"1140296b-38d4-41e4-be7d-a7a0f76021d3\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") "
Sep 16 12:04:40.202074 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.202041    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-kube-rbac-proxy\") pod \"1140296b-38d4-41e4-be7d-a7a0f76021d3\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") "
Sep 16 12:04:40.202074 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.202073    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-configmap-serving-certs-ca-bundle\") pod \"1140296b-38d4-41e4-be7d-a7a0f76021d3\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") "
Sep 16 12:04:40.202540 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.202115    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1140296b-38d4-41e4-be7d-a7a0f76021d3\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") "
Sep 16 12:04:40.202540 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.202154    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-config\") pod \"1140296b-38d4-41e4-be7d-a7a0f76021d3\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") "
Sep 16 12:04:40.202540 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.202198    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-configmap-kubelet-serving-ca-bundle\") pod \"1140296b-38d4-41e4-be7d-a7a0f76021d3\" (UID: \"1140296b-38d4-41e4-be7d-a7a0f76021d3\") "
Sep 16 12:04:40.202540 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.202367    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "1140296b-38d4-41e4-be7d-a7a0f76021d3" (UID: "1140296b-38d4-41e4-be7d-a7a0f76021d3"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:04:40.203014 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.202766    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-configmap-metrics-client-ca\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:40.205272 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.203715    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "1140296b-38d4-41e4-be7d-a7a0f76021d3" (UID: "1140296b-38d4-41e4-be7d-a7a0f76021d3"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:04:40.205272 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.204005    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "1140296b-38d4-41e4-be7d-a7a0f76021d3" (UID: "1140296b-38d4-41e4-be7d-a7a0f76021d3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:04:40.205272 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.204291    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "1140296b-38d4-41e4-be7d-a7a0f76021d3" (UID: "1140296b-38d4-41e4-be7d-a7a0f76021d3"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:04:40.205272 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.204783    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "1140296b-38d4-41e4-be7d-a7a0f76021d3" (UID: "1140296b-38d4-41e4-be7d-a7a0f76021d3"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:04:40.206280 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.206196    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "1140296b-38d4-41e4-be7d-a7a0f76021d3" (UID: "1140296b-38d4-41e4-be7d-a7a0f76021d3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:04:40.206280 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.206257    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "1140296b-38d4-41e4-be7d-a7a0f76021d3" (UID: "1140296b-38d4-41e4-be7d-a7a0f76021d3"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:04:40.207732 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.207705    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "1140296b-38d4-41e4-be7d-a7a0f76021d3" (UID: "1140296b-38d4-41e4-be7d-a7a0f76021d3"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:04:40.207844 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.207822    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "1140296b-38d4-41e4-be7d-a7a0f76021d3" (UID: "1140296b-38d4-41e4-be7d-a7a0f76021d3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:04:40.208690 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.208649    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "1140296b-38d4-41e4-be7d-a7a0f76021d3" (UID: "1140296b-38d4-41e4-be7d-a7a0f76021d3"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:04:40.210403 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.210378    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "1140296b-38d4-41e4-be7d-a7a0f76021d3" (UID: "1140296b-38d4-41e4-be7d-a7a0f76021d3"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:04:40.210504 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.210451    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1140296b-38d4-41e4-be7d-a7a0f76021d3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1140296b-38d4-41e4-be7d-a7a0f76021d3" (UID: "1140296b-38d4-41e4-be7d-a7a0f76021d3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:04:40.210571 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.210535    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "1140296b-38d4-41e4-be7d-a7a0f76021d3" (UID: "1140296b-38d4-41e4-be7d-a7a0f76021d3"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:04:40.210861 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.210753    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "1140296b-38d4-41e4-be7d-a7a0f76021d3" (UID: "1140296b-38d4-41e4-be7d-a7a0f76021d3"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:04:40.210861 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.210801    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-config" (OuterVolumeSpecName: "config") pod "1140296b-38d4-41e4-be7d-a7a0f76021d3" (UID: "1140296b-38d4-41e4-be7d-a7a0f76021d3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:04:40.211083 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.211050    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "1140296b-38d4-41e4-be7d-a7a0f76021d3" (UID: "1140296b-38d4-41e4-be7d-a7a0f76021d3"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:04:40.211415 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.210641    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1140296b-38d4-41e4-be7d-a7a0f76021d3-kube-api-access-cpg8v" (OuterVolumeSpecName: "kube-api-access-cpg8v") pod "1140296b-38d4-41e4-be7d-a7a0f76021d3" (UID: "1140296b-38d4-41e4-be7d-a7a0f76021d3"). InnerVolumeSpecName "kube-api-access-cpg8v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:04:40.211889 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.211855    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1140296b-38d4-41e4-be7d-a7a0f76021d3-config-out" (OuterVolumeSpecName: "config-out") pod "1140296b-38d4-41e4-be7d-a7a0f76021d3" (UID: "1140296b-38d4-41e4-be7d-a7a0f76021d3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:04:40.212132 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.212108    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "1140296b-38d4-41e4-be7d-a7a0f76021d3" (UID: "1140296b-38d4-41e4-be7d-a7a0f76021d3"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:04:40.222068 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.222044    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-web-config" (OuterVolumeSpecName: "web-config") pod "1140296b-38d4-41e4-be7d-a7a0f76021d3" (UID: "1140296b-38d4-41e4-be7d-a7a0f76021d3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:04:40.303977 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.303930    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:40.303977 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.303968    2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1140296b-38d4-41e4-be7d-a7a0f76021d3-tls-assets\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:40.303977 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.303982    2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:40.304237 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.303997    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:40.304237 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.304009    2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-grpc-tls\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:40.304237 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.304022    2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-metrics-client-certs\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:40.304237 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.304032    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpg8v\" (UniqueName: \"kubernetes.io/projected/1140296b-38d4-41e4-be7d-a7a0f76021d3-kube-api-access-cpg8v\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:40.304237 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.304043    2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1140296b-38d4-41e4-be7d-a7a0f76021d3-config-out\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:40.304237 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.304055    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:40.304237 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.304066    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:40.304237 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.304080    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:40.304237 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.304091    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-k8s-db\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:40.304237 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.304104    2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-web-config\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:40.304237 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.304115    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:40.304237 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.304129    2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-kube-rbac-proxy\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:40.304237 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.304141    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:40.304237 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.304153    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:40.304237 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.304167    2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1140296b-38d4-41e4-be7d-a7a0f76021d3-config\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:40.304237 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:40.304181    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1140296b-38d4-41e4-be7d-a7a0f76021d3-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:04:41.149061 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.149031    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1140296b-38d4-41e4-be7d-a7a0f76021d3","Type":"ContainerDied","Data":"e8504ca561a4e3256a7c67680aa49609daf05f4f7cf070ab1ee0930d79f62e3d"}
Sep 16 12:04:41.149490 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.149108    2576 scope.go:117] "RemoveContainer" containerID="f49daffd27e94b1cc4f6d82eb8ed3524b7ccfef9219e23c68e156da81d8d6d62"
Sep 16 12:04:41.149490 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.149115    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.157081 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.157067    2576 scope.go:117] "RemoveContainer" containerID="ad9fe6ec1061d159234b022cd0f64e7367306beb7ba85f7be3d41eaa15298c93"
Sep 16 12:04:41.164497 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.164483    2576 scope.go:117] "RemoveContainer" containerID="1011d0863506967396214dc4cc9415e5e3b576b2b453250e5937fa3ec2ac08ab"
Sep 16 12:04:41.171003 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.170986    2576 scope.go:117] "RemoveContainer" containerID="ea096662f11dd4acb097e6e6257f3b5fc65fd693718868c357d15269f2918bc3"
Sep 16 12:04:41.174817 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.174796    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 12:04:41.179047 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.179024    2576 scope.go:117] "RemoveContainer" containerID="7e50f2fe6eaba5ee5f1de8c761bb4f7f9baf055439bc33ca3e69228d0d2d5863"
Sep 16 12:04:41.180819 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.180800    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 12:04:41.186124 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.186109    2576 scope.go:117] "RemoveContainer" containerID="df7fe6a17275c5004e5ce131053f16954fa4d63025a9534da8752162a8d3c6d3"
Sep 16 12:04:41.193170 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.193148    2576 scope.go:117] "RemoveContainer" containerID="73521c4100fce1427aef1c6d018e946273ed301d3f0cb60d02031de17d8daef6"
Sep 16 12:04:41.205715 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.205695    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 12:04:41.205988 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.205977    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerName="thanos-sidecar"
Sep 16 12:04:41.206025 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.205990    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerName="thanos-sidecar"
Sep 16 12:04:41.206025 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.205999    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerName="kube-rbac-proxy"
Sep 16 12:04:41.206025 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.206004    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerName="kube-rbac-proxy"
Sep 16 12:04:41.206025 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.206016    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerName="kube-rbac-proxy-web"
Sep 16 12:04:41.206025 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.206022    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerName="kube-rbac-proxy-web"
Sep 16 12:04:41.206179 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.206029    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerName="init-config-reloader"
Sep 16 12:04:41.206179 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.206034    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerName="init-config-reloader"
Sep 16 12:04:41.206179 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.206041    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerName="kube-rbac-proxy-thanos"
Sep 16 12:04:41.206179 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.206046    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerName="kube-rbac-proxy-thanos"
Sep 16 12:04:41.206179 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.206056    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerName="config-reloader"
Sep 16 12:04:41.206179 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.206061    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerName="config-reloader"
Sep 16 12:04:41.206179 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.206068    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerName="prometheus"
Sep 16 12:04:41.206179 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.206074    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerName="prometheus"
Sep 16 12:04:41.206179 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.206118    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerName="config-reloader"
Sep 16 12:04:41.206179 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.206127    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerName="thanos-sidecar"
Sep 16 12:04:41.206179 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.206134    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerName="prometheus"
Sep 16 12:04:41.206179 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.206139    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerName="kube-rbac-proxy-thanos"
Sep 16 12:04:41.206179 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.206145    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerName="kube-rbac-proxy"
Sep 16 12:04:41.206179 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.206150    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" containerName="kube-rbac-proxy-web"
Sep 16 12:04:41.211236 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.211217    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.214638 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.214602    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 16 12:04:41.214727 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.214707    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 16 12:04:41.214782 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.214754    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 16 12:04:41.214782 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.214760    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 16 12:04:41.214883 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.214796    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-spdh6\""
Sep 16 12:04:41.214883 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.214839    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 16 12:04:41.214995 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.214976    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 16 12:04:41.214995 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.214976    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 16 12:04:41.215128 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.215031    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 16 12:04:41.215128 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.215047    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 16 12:04:41.215128 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.215117    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-btk5vm6euom8t\""
Sep 16 12:04:41.215629 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.215613    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 16 12:04:41.215725 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.215631    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 16 12:04:41.215792 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.215731    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 16 12:04:41.218810 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.218756    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 16 12:04:41.224929 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.224907    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 16 12:04:41.229725 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.229706    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 12:04:41.312023 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.311996    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f03e463e-5f57-4c6c-a864-e30965cac514-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.312023 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.312027    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f03e463e-5f57-4c6c-a864-e30965cac514-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.312237 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.312053    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.312237 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.312078    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f03e463e-5f57-4c6c-a864-e30965cac514-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.312237 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.312112    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f03e463e-5f57-4c6c-a864-e30965cac514-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.312237 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.312138    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f03e463e-5f57-4c6c-a864-e30965cac514-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.312237 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.312213    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-web-config\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.312459 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.312263    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.312459 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.312291    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f03e463e-5f57-4c6c-a864-e30965cac514-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.312459 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.312354    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.312459 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.312389    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.312459 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.312410    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.312459 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.312430    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-config\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.312459 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.312447    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f03e463e-5f57-4c6c-a864-e30965cac514-config-out\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.312459 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.312460    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f03e463e-5f57-4c6c-a864-e30965cac514-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.312759 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.312482    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.312759 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.312528    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.312759 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.312543    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f03e463e-5f57-4c6c-a864-e30965cac514-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.312759 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.312595    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f03e463e-5f57-4c6c-a864-e30965cac514-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.312759 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.312644    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh4j9\" (UniqueName: \"kubernetes.io/projected/f03e463e-5f57-4c6c-a864-e30965cac514-kube-api-access-wh4j9\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.413650 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.413601    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.413650 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.413655    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-config\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.413878 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.413674    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f03e463e-5f57-4c6c-a864-e30965cac514-config-out\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.413878 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.413691    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f03e463e-5f57-4c6c-a864-e30965cac514-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.413878 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.413715    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.413878 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.413752    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.413878 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.413776    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f03e463e-5f57-4c6c-a864-e30965cac514-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.413878 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.413804    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f03e463e-5f57-4c6c-a864-e30965cac514-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.413878 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.413842    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh4j9\" (UniqueName: \"kubernetes.io/projected/f03e463e-5f57-4c6c-a864-e30965cac514-kube-api-access-wh4j9\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.414214 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.413888    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f03e463e-5f57-4c6c-a864-e30965cac514-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.414214 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.413906    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f03e463e-5f57-4c6c-a864-e30965cac514-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.414214 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.413932    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.414214 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.413961    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f03e463e-5f57-4c6c-a864-e30965cac514-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.414214 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.413988    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f03e463e-5f57-4c6c-a864-e30965cac514-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.414214 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.414008    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f03e463e-5f57-4c6c-a864-e30965cac514-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.414214 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.414032    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-web-config\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.414214 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.414065    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.414214 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.414090    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f03e463e-5f57-4c6c-a864-e30965cac514-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.414214 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.414118    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.414214 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.414148    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.414952 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.414552    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f03e463e-5f57-4c6c-a864-e30965cac514-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.414952 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.414808    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f03e463e-5f57-4c6c-a864-e30965cac514-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.415092 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.415068    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f03e463e-5f57-4c6c-a864-e30965cac514-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.415676 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.415649    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f03e463e-5f57-4c6c-a864-e30965cac514-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.416564 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.416539    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f03e463e-5f57-4c6c-a864-e30965cac514-config-out\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.418970 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.416624    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.418970 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.416881    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-config\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.418970 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.416968    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.418970 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.417035    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f03e463e-5f57-4c6c-a864-e30965cac514-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.418970 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.417234    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.418970 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.417604    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f03e463e-5f57-4c6c-a864-e30965cac514-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.418970 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.418063    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f03e463e-5f57-4c6c-a864-e30965cac514-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.418970 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.418920    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f03e463e-5f57-4c6c-a864-e30965cac514-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.419516 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.419416    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-web-config\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.419567 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.419520    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.419623 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.419603    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.419938 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.419918    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.419973 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.419952    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f03e463e-5f57-4c6c-a864-e30965cac514-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.420840 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.420821    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f03e463e-5f57-4c6c-a864-e30965cac514-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.424046 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.424021    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh4j9\" (UniqueName: \"kubernetes.io/projected/f03e463e-5f57-4c6c-a864-e30965cac514-kube-api-access-wh4j9\") pod \"prometheus-k8s-0\" (UID: \"f03e463e-5f57-4c6c-a864-e30965cac514\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.525781 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.525689    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:04:41.809968 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:41.809945    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 12:04:41.811635 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:04:41.811605    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf03e463e_5f57_4c6c_a864_e30965cac514.slice/crio-7c24748e65a602754a7bc92dae7d489cd96cedc9bdc7bd1522e6345af5d8a76f WatchSource:0}: Error finding container 7c24748e65a602754a7bc92dae7d489cd96cedc9bdc7bd1522e6345af5d8a76f: Status 404 returned error can't find the container with id 7c24748e65a602754a7bc92dae7d489cd96cedc9bdc7bd1522e6345af5d8a76f
Sep 16 12:04:42.154250 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:42.154222    2576 generic.go:356] "Generic (PLEG): container finished" podID="f03e463e-5f57-4c6c-a864-e30965cac514" containerID="763d97c101622cfd19f62d538b1bb13b452377bede5772213551a661d7180068" exitCode=0
Sep 16 12:04:42.154737 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:42.154334    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f03e463e-5f57-4c6c-a864-e30965cac514","Type":"ContainerDied","Data":"763d97c101622cfd19f62d538b1bb13b452377bede5772213551a661d7180068"}
Sep 16 12:04:42.154737 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:42.154404    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f03e463e-5f57-4c6c-a864-e30965cac514","Type":"ContainerStarted","Data":"7c24748e65a602754a7bc92dae7d489cd96cedc9bdc7bd1522e6345af5d8a76f"}
Sep 16 12:04:42.396153 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:42.396122    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1140296b-38d4-41e4-be7d-a7a0f76021d3" path="/var/lib/kubelet/pods/1140296b-38d4-41e4-be7d-a7a0f76021d3/volumes"
Sep 16 12:04:43.163077 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:43.163041    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f03e463e-5f57-4c6c-a864-e30965cac514","Type":"ContainerStarted","Data":"2e47fb3272bd16e3eadfafc233dbed49fff023c76dd867422a0f86fb83e93b90"}
Sep 16 12:04:43.163539 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:43.163125    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f03e463e-5f57-4c6c-a864-e30965cac514","Type":"ContainerStarted","Data":"114538f44e5e6f9c2082c824e0c26c60042853ffe3ce9e21f34def51d289235f"}
Sep 16 12:04:43.163539 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:43.163166    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f03e463e-5f57-4c6c-a864-e30965cac514","Type":"ContainerStarted","Data":"0fd010de8879fd20bd79a1ca21c499df32f0cb7750042a4145de99ccd422f211"}
Sep 16 12:04:43.163539 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:43.163207    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f03e463e-5f57-4c6c-a864-e30965cac514","Type":"ContainerStarted","Data":"3180fd63c587520fa81533cfb8ead1ee0acf073db28749b1a8f70a096628a466"}
Sep 16 12:04:43.163539 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:43.163248    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f03e463e-5f57-4c6c-a864-e30965cac514","Type":"ContainerStarted","Data":"2d6835ed46873b47a08d87975755fa193030e64a4f03637c0ac2869e087c4fa9"}
Sep 16 12:04:43.163539 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:43.163283    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f03e463e-5f57-4c6c-a864-e30965cac514","Type":"ContainerStarted","Data":"b97ced8a55e058b6bcae941d1878029eb210eff6664975c82d853b98f2eb0235"}
Sep 16 12:04:43.195254 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:43.195204    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.174951752 podStartE2EDuration="2.195186028s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.234276ms" isStatefulPod=false podCreationTimestamp="2026-09-16 12:04:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:04:43.192965038 +0000 UTC m=+149.361929938" watchObservedRunningTime="2026-09-16 12:04:43.195186028 +0000 UTC m=+149.364150735"
Sep 16 12:04:46.526097 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:04:46.526061    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:05:41.526411 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:05:41.526379    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:05:41.542208 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:05:41.542181    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:05:42.415525 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:05:42.415499    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 12:06:31.145156 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:31.145122    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-27w6v"]
Sep 16 12:06:31.148498 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:31.148480    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-27w6v"
Sep 16 12:06:31.150775 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:31.150750    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 16 12:06:31.151744 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:31.151727    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 16 12:06:31.151798 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:31.151727    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-dchbb\""
Sep 16 12:06:31.157470 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:31.157445    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-27w6v"]
Sep 16 12:06:31.244590 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:31.244557    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9nw5\" (UniqueName: \"kubernetes.io/projected/a435100e-a636-4c34-ba1f-e438af7d4fc4-kube-api-access-l9nw5\") pod \"cert-manager-cainjector-559cdd8c87-27w6v\" (UID: \"a435100e-a636-4c34-ba1f-e438af7d4fc4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-27w6v"
Sep 16 12:06:31.244734 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:31.244610    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a435100e-a636-4c34-ba1f-e438af7d4fc4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-27w6v\" (UID: \"a435100e-a636-4c34-ba1f-e438af7d4fc4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-27w6v"
Sep 16 12:06:31.346045 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:31.346007    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a435100e-a636-4c34-ba1f-e438af7d4fc4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-27w6v\" (UID: \"a435100e-a636-4c34-ba1f-e438af7d4fc4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-27w6v"
Sep 16 12:06:31.346169 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:31.346095    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9nw5\" (UniqueName: \"kubernetes.io/projected/a435100e-a636-4c34-ba1f-e438af7d4fc4-kube-api-access-l9nw5\") pod \"cert-manager-cainjector-559cdd8c87-27w6v\" (UID: \"a435100e-a636-4c34-ba1f-e438af7d4fc4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-27w6v"
Sep 16 12:06:31.354617 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:31.354589    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a435100e-a636-4c34-ba1f-e438af7d4fc4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-27w6v\" (UID: \"a435100e-a636-4c34-ba1f-e438af7d4fc4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-27w6v"
Sep 16 12:06:31.354941 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:31.354921    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9nw5\" (UniqueName: \"kubernetes.io/projected/a435100e-a636-4c34-ba1f-e438af7d4fc4-kube-api-access-l9nw5\") pod \"cert-manager-cainjector-559cdd8c87-27w6v\" (UID: \"a435100e-a636-4c34-ba1f-e438af7d4fc4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-27w6v"
Sep 16 12:06:31.475706 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:31.475641    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-27w6v"
Sep 16 12:06:31.744720 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:31.744696    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-27w6v"]
Sep 16 12:06:31.747478 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:06:31.747456    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda435100e_a636_4c34_ba1f_e438af7d4fc4.slice/crio-433c95246b08091cb0823c5df3639532fcef101b9da986b21681893473791fee WatchSource:0}: Error finding container 433c95246b08091cb0823c5df3639532fcef101b9da986b21681893473791fee: Status 404 returned error can't find the container with id 433c95246b08091cb0823c5df3639532fcef101b9da986b21681893473791fee
Sep 16 12:06:32.601873 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:32.601817    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-27w6v" event={"ID":"a435100e-a636-4c34-ba1f-e438af7d4fc4","Type":"ContainerStarted","Data":"433c95246b08091cb0823c5df3639532fcef101b9da986b21681893473791fee"}
Sep 16 12:06:35.616883 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:35.616795    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-27w6v" event={"ID":"a435100e-a636-4c34-ba1f-e438af7d4fc4","Type":"ContainerStarted","Data":"4337ddf3613f900220fa15f4510836a8356168bfdcc78f65c9ebe5fb835938fb"}
Sep 16 12:06:35.632754 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:35.632706    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-27w6v" podStartSLOduration=1.669223584 podStartE2EDuration="4.632691772s" totalImagesPullingTime="2.963468188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:06:35.630720021 +0000 UTC m=+261.799684741" watchObservedRunningTime="2026-09-16 12:06:35.632691772 +0000 UTC m=+261.801656478"
Sep 16 12:06:40.678507 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:40.678472    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tldlv"]
Sep 16 12:06:40.681723 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:40.681707    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-tldlv"
Sep 16 12:06:40.684127 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:40.684105    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-52kz5\""
Sep 16 12:06:40.694421 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:40.692268    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tldlv"]
Sep 16 12:06:40.829118 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:40.829082    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4733f5f3-d919-49c4-8d9c-1b2780409165-bound-sa-token\") pod \"cert-manager-55b4d954d5-tldlv\" (UID: \"4733f5f3-d919-49c4-8d9c-1b2780409165\") " pod="cert-manager/cert-manager-55b4d954d5-tldlv"
Sep 16 12:06:40.829291 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:40.829128    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxr7n\" (UniqueName: \"kubernetes.io/projected/4733f5f3-d919-49c4-8d9c-1b2780409165-kube-api-access-gxr7n\") pod \"cert-manager-55b4d954d5-tldlv\" (UID: \"4733f5f3-d919-49c4-8d9c-1b2780409165\") " pod="cert-manager/cert-manager-55b4d954d5-tldlv"
Sep 16 12:06:40.930115 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:40.930029    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4733f5f3-d919-49c4-8d9c-1b2780409165-bound-sa-token\") pod \"cert-manager-55b4d954d5-tldlv\" (UID: \"4733f5f3-d919-49c4-8d9c-1b2780409165\") " pod="cert-manager/cert-manager-55b4d954d5-tldlv"
Sep 16 12:06:40.930115 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:40.930072    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxr7n\" (UniqueName: \"kubernetes.io/projected/4733f5f3-d919-49c4-8d9c-1b2780409165-kube-api-access-gxr7n\") pod \"cert-manager-55b4d954d5-tldlv\" (UID: \"4733f5f3-d919-49c4-8d9c-1b2780409165\") " pod="cert-manager/cert-manager-55b4d954d5-tldlv"
Sep 16 12:06:40.938953 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:40.938915    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxr7n\" (UniqueName: \"kubernetes.io/projected/4733f5f3-d919-49c4-8d9c-1b2780409165-kube-api-access-gxr7n\") pod \"cert-manager-55b4d954d5-tldlv\" (UID: \"4733f5f3-d919-49c4-8d9c-1b2780409165\") " pod="cert-manager/cert-manager-55b4d954d5-tldlv"
Sep 16 12:06:40.939105 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:40.939063    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4733f5f3-d919-49c4-8d9c-1b2780409165-bound-sa-token\") pod \"cert-manager-55b4d954d5-tldlv\" (UID: \"4733f5f3-d919-49c4-8d9c-1b2780409165\") " pod="cert-manager/cert-manager-55b4d954d5-tldlv"
Sep 16 12:06:40.995954 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:40.995928    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-tldlv"
Sep 16 12:06:41.270575 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:41.270508    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tldlv"]
Sep 16 12:06:41.273747 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:06:41.273718    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4733f5f3_d919_49c4_8d9c_1b2780409165.slice/crio-f16485aa83912a2972718fa2b8cdec48a5b6a9f89659737707fb69650a9a8436 WatchSource:0}: Error finding container f16485aa83912a2972718fa2b8cdec48a5b6a9f89659737707fb69650a9a8436: Status 404 returned error can't find the container with id f16485aa83912a2972718fa2b8cdec48a5b6a9f89659737707fb69650a9a8436
Sep 16 12:06:41.641832 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:41.641803    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-tldlv" event={"ID":"4733f5f3-d919-49c4-8d9c-1b2780409165","Type":"ContainerStarted","Data":"5f23795b9690e9ad169bab3ce19251fc746259fa488b8a90393fb4b40e97bf27"}
Sep 16 12:06:41.642006 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:41.641842    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-tldlv" event={"ID":"4733f5f3-d919-49c4-8d9c-1b2780409165","Type":"ContainerStarted","Data":"f16485aa83912a2972718fa2b8cdec48a5b6a9f89659737707fb69650a9a8436"}
Sep 16 12:06:41.656755 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:06:41.656680    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-tldlv" podStartSLOduration=1.656662088 podStartE2EDuration="1.656662088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:06:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:06:41.656494649 +0000 UTC m=+267.825459355" watchObservedRunningTime="2026-09-16 12:06:41.656662088 +0000 UTC m=+267.825626797"
Sep 16 12:07:04.020279 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:04.020245    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf"]
Sep 16 12:07:04.023833 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:04.023815    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf"
Sep 16 12:07:04.026709 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:04.026690    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 16 12:07:04.026826 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:04.026699    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-22d2l\""
Sep 16 12:07:04.026826 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:04.026795    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 16 12:07:04.026951 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:04.026933    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 16 12:07:04.027399 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:04.027380    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 16 12:07:04.043992 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:04.043971    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf"]
Sep 16 12:07:04.124184 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:04.124152    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e61c677-df57-4b0b-b863-60a5ae670cb5-tmp\") pod \"opendatahub-operator-controller-manager-6b54c497cf-rmdvf\" (UID: \"9e61c677-df57-4b0b-b863-60a5ae670cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf"
Sep 16 12:07:04.124184 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:04.124180    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e61c677-df57-4b0b-b863-60a5ae670cb5-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b54c497cf-rmdvf\" (UID: \"9e61c677-df57-4b0b-b863-60a5ae670cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf"
Sep 16 12:07:04.124447 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:04.124209    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnpgw\" (UniqueName: \"kubernetes.io/projected/9e61c677-df57-4b0b-b863-60a5ae670cb5-kube-api-access-rnpgw\") pod \"opendatahub-operator-controller-manager-6b54c497cf-rmdvf\" (UID: \"9e61c677-df57-4b0b-b863-60a5ae670cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf"
Sep 16 12:07:04.124447 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:04.124309    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9e61c677-df57-4b0b-b863-60a5ae670cb5-manifests\") pod \"opendatahub-operator-controller-manager-6b54c497cf-rmdvf\" (UID: \"9e61c677-df57-4b0b-b863-60a5ae670cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf"
Sep 16 12:07:04.124447 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:04.124398    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9e61c677-df57-4b0b-b863-60a5ae670cb5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b54c497cf-rmdvf\" (UID: \"9e61c677-df57-4b0b-b863-60a5ae670cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf"
Sep 16 12:07:04.224909 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:04.224875    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9e61c677-df57-4b0b-b863-60a5ae670cb5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b54c497cf-rmdvf\" (UID: \"9e61c677-df57-4b0b-b863-60a5ae670cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf"
Sep 16 12:07:04.225059 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:04.224918    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e61c677-df57-4b0b-b863-60a5ae670cb5-tmp\") pod \"opendatahub-operator-controller-manager-6b54c497cf-rmdvf\" (UID: \"9e61c677-df57-4b0b-b863-60a5ae670cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf"
Sep 16 12:07:04.225059 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:04.224934    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e61c677-df57-4b0b-b863-60a5ae670cb5-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b54c497cf-rmdvf\" (UID: \"9e61c677-df57-4b0b-b863-60a5ae670cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf"
Sep 16 12:07:04.225059 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:04.224957    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnpgw\" (UniqueName: \"kubernetes.io/projected/9e61c677-df57-4b0b-b863-60a5ae670cb5-kube-api-access-rnpgw\") pod \"opendatahub-operator-controller-manager-6b54c497cf-rmdvf\" (UID: \"9e61c677-df57-4b0b-b863-60a5ae670cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf"
Sep 16 12:07:04.225059 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:04.225004    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9e61c677-df57-4b0b-b863-60a5ae670cb5-manifests\") pod \"opendatahub-operator-controller-manager-6b54c497cf-rmdvf\" (UID: \"9e61c677-df57-4b0b-b863-60a5ae670cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf"
Sep 16 12:07:04.225422 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:04.225396    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9e61c677-df57-4b0b-b863-60a5ae670cb5-manifests\") pod \"opendatahub-operator-controller-manager-6b54c497cf-rmdvf\" (UID: \"9e61c677-df57-4b0b-b863-60a5ae670cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf"
Sep 16 12:07:04.227377 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:04.227348    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e61c677-df57-4b0b-b863-60a5ae670cb5-tmp\") pod \"opendatahub-operator-controller-manager-6b54c497cf-rmdvf\" (UID: \"9e61c677-df57-4b0b-b863-60a5ae670cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf"
Sep 16 12:07:04.227502 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:04.227459    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9e61c677-df57-4b0b-b863-60a5ae670cb5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b54c497cf-rmdvf\" (UID: \"9e61c677-df57-4b0b-b863-60a5ae670cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf"
Sep 16 12:07:04.227565 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:04.227545    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e61c677-df57-4b0b-b863-60a5ae670cb5-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b54c497cf-rmdvf\" (UID: \"9e61c677-df57-4b0b-b863-60a5ae670cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf"
Sep 16 12:07:04.246499 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:04.246473    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnpgw\" (UniqueName: \"kubernetes.io/projected/9e61c677-df57-4b0b-b863-60a5ae670cb5-kube-api-access-rnpgw\") pod \"opendatahub-operator-controller-manager-6b54c497cf-rmdvf\" (UID: \"9e61c677-df57-4b0b-b863-60a5ae670cb5\") " pod="opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf"
Sep 16 12:07:04.335171 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:04.335105    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf"
Sep 16 12:07:04.611665 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:04.611636    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf"]
Sep 16 12:07:04.615105 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:07:04.615076    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e61c677_df57_4b0b_b863_60a5ae670cb5.slice/crio-f4264890890ae0a4486e10d056a608bd658f61597c6e0b8b2acd1dca0d24def6 WatchSource:0}: Error finding container f4264890890ae0a4486e10d056a608bd658f61597c6e0b8b2acd1dca0d24def6: Status 404 returned error can't find the container with id f4264890890ae0a4486e10d056a608bd658f61597c6e0b8b2acd1dca0d24def6
Sep 16 12:07:04.736570 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:04.736541    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf" event={"ID":"9e61c677-df57-4b0b-b863-60a5ae670cb5","Type":"ContainerStarted","Data":"f4264890890ae0a4486e10d056a608bd658f61597c6e0b8b2acd1dca0d24def6"}
Sep 16 12:07:08.758622 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:08.758583    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf" event={"ID":"9e61c677-df57-4b0b-b863-60a5ae670cb5","Type":"ContainerStarted","Data":"a265a0415107916a752f5d327c7fa8af721f3ff4247dc1a6c9ebfb46c9b73367"}
Sep 16 12:07:09.764329 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:09.764292    2576 generic.go:356] "Generic (PLEG): container finished" podID="9e61c677-df57-4b0b-b863-60a5ae670cb5" containerID="a265a0415107916a752f5d327c7fa8af721f3ff4247dc1a6c9ebfb46c9b73367" exitCode=0
Sep 16 12:07:09.764701 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:09.764363    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf" event={"ID":"9e61c677-df57-4b0b-b863-60a5ae670cb5","Type":"ContainerDied","Data":"a265a0415107916a752f5d327c7fa8af721f3ff4247dc1a6c9ebfb46c9b73367"}
Sep 16 12:07:10.772335 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:10.772269    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf" event={"ID":"9e61c677-df57-4b0b-b863-60a5ae670cb5","Type":"ContainerStarted","Data":"6561c37f4fbdba2d70c036f125829c367db55df9f7028579c34828d306ac6d3e"}
Sep 16 12:07:10.772804 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:10.772390    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf"
Sep 16 12:07:10.822931 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:10.822882    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf" podStartSLOduration=3.068924462 podStartE2EDuration="7.822866206s" totalImagesPullingTime="3.664551354s" totalInitContainerRuntime="1.08939039s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:07:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:07:10.819788216 +0000 UTC m=+296.988752922" watchObservedRunningTime="2026-09-16 12:07:10.822866206 +0000 UTC m=+296.991830912"
Sep 16 12:07:14.271891 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:14.271860    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tb7dg_fb6b35a8-78d4-40b2-a087-7b45e92b2234/ovn-acl-logging/0.log"
Sep 16 12:07:14.276175 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:14.276158    2576 kubelet.go:1648] "Image garbage collection succeeded"
Sep 16 12:07:14.278597 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:14.278572    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tb7dg_fb6b35a8-78d4-40b2-a087-7b45e92b2234/ovn-acl-logging/0.log"
Sep 16 12:07:21.779115 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:21.779083    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b54c497cf-rmdvf"
Sep 16 12:07:30.910524 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:30.910490    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"]
Sep 16 12:07:30.913529 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:30.913509    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:30.917149 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:30.917131    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 16 12:07:30.917853 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:30.917830    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 16 12:07:30.917853 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:30.917846    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 16 12:07:30.918032 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:30.917834    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-rw999\""
Sep 16 12:07:30.934077 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:30.934055    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"]
Sep 16 12:07:31.012404 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.012374    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"]
Sep 16 12:07:31.015712 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.015694    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.030460 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.030437    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"]
Sep 16 12:07:31.059025 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.058998    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.059146 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.059033    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.059146 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.059082    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.059146 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.059101    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.059146 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.059115    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.059357 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.059152    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsz29\" (UniqueName: \"kubernetes.io/projected/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-kube-api-access-jsz29\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.059357 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.059198    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.059357 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.059218    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.059493 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.059366    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.160445 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.160416    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsz29\" (UniqueName: \"kubernetes.io/projected/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-kube-api-access-jsz29\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.160631 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.160450    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.160631 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.160468    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl596\" (UniqueName: \"kubernetes.io/projected/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-kube-api-access-sl596\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.160631 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.160507    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.160631 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.160525    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.160631 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.160542    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.160631 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.160561    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.160631 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.160578    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.160631 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.160592    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.161013 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.160645    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.161013 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.160667    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.161013 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.160718    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.161013 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.160734    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.161013 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.160777    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.161013 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.160800    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.161013 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.160822    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.161013 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.160844    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.161013 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.160869    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.161013 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.160952    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.161426 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.161061    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.161426 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.161176    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.161426 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.161208    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.161814 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.161791    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.163150 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.163130    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.163264 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.163249    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.167631 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.167609    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsz29\" (UniqueName: \"kubernetes.io/projected/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-kube-api-access-jsz29\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.167738 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.167609    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.222881 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.222857    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:31.262278 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.262239    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.262485 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.262294    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.262485 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.262347    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.262485 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.262373    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.262485 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.262423    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.262694 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.262514    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.262694 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.262542    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.262694 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.262588    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.262694 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.262612    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl596\" (UniqueName: \"kubernetes.io/projected/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-kube-api-access-sl596\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.262694 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.262672    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.263095 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.263001    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.263222 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.263167    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.264077 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.263964    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.264272 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.264250    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.265453 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.265430    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.265620 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.265599    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.270845 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.270819    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.271042 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.271026    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl596\" (UniqueName: \"kubernetes.io/projected/11b1a66a-a978-4dfa-9485-a56d0a3b6b2d-kube-api-access-sl596\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb\" (UID: \"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.325664 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.325636    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:31.503886 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.503865    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"]
Sep 16 12:07:31.506341 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:07:31.506300    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc4e776a_55f2_4606_b3fc_3ed415aa1f99.slice/crio-b3366d1df71d80db9fa9a794d40c841911b2bcdcebbcbd428ea87e9b9bacd3a6 WatchSource:0}: Error finding container b3366d1df71d80db9fa9a794d40c841911b2bcdcebbcbd428ea87e9b9bacd3a6: Status 404 returned error can't find the container with id b3366d1df71d80db9fa9a794d40c841911b2bcdcebbcbd428ea87e9b9bacd3a6
Sep 16 12:07:31.508293 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.508276    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 12:07:31.599111 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.599090    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"]
Sep 16 12:07:31.601052 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:07:31.601033    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b1a66a_a978_4dfa_9485_a56d0a3b6b2d.slice/crio-4ca929a345e558ecec99e9a91146361c31e7208da1428a8f424fc5b5a36affd4 WatchSource:0}: Error finding container 4ca929a345e558ecec99e9a91146361c31e7208da1428a8f424fc5b5a36affd4: Status 404 returned error can't find the container with id 4ca929a345e558ecec99e9a91146361c31e7208da1428a8f424fc5b5a36affd4
Sep 16 12:07:31.866694 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.866659    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb" event={"ID":"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d","Type":"ContainerStarted","Data":"4ca929a345e558ecec99e9a91146361c31e7208da1428a8f424fc5b5a36affd4"}
Sep 16 12:07:31.867981 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:31.867955    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh" event={"ID":"dc4e776a-55f2-4606-b3fc-3ed415aa1f99","Type":"ContainerStarted","Data":"b3366d1df71d80db9fa9a794d40c841911b2bcdcebbcbd428ea87e9b9bacd3a6"}
Sep 16 12:07:34.381731 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:34.381681    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:07:34.382027 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:34.381778    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:07:34.382027 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:34.381818    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:07:34.388683 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:34.388650    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:07:34.388753 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:34.388730    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:07:34.388790 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:34.388771    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:07:34.885098 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:34.885068    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb" event={"ID":"11b1a66a-a978-4dfa-9485-a56d0a3b6b2d","Type":"ContainerStarted","Data":"c0231a4e3ed9dcbec1a4e3761df676fcc854d13e1c0978784c8e1725d936b26b"}
Sep 16 12:07:34.886905 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:34.886874    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh" event={"ID":"dc4e776a-55f2-4606-b3fc-3ed415aa1f99","Type":"ContainerStarted","Data":"608a79f642d6e4ac524ff3dd8d1229d3f9922ac1b9b51d2e60ad96e60e9b9e77"}
Sep 16 12:07:34.916979 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:34.916915    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb" podStartSLOduration=2.138584078 podStartE2EDuration="4.916898737s" totalImagesPullingTime="2.778314659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:07:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:07:34.914734178 +0000 UTC m=+321.083698885" watchObservedRunningTime="2026-09-16 12:07:34.916898737 +0000 UTC m=+321.085863444"
Sep 16 12:07:34.937676 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:34.937628    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh" podStartSLOduration=2.057664037 podStartE2EDuration="4.937614119s" totalImagesPullingTime="2.879950082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:07:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:07:34.936514692 +0000 UTC m=+321.105479400" watchObservedRunningTime="2026-09-16 12:07:34.937614119 +0000 UTC m=+321.106578826"
Sep 16 12:07:35.223283 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:35.223194    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:35.224405 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:35.224377    2576 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Sep 16 12:07:35.224536 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:35.224447    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh" podUID="dc4e776a-55f2-4606-b3fc-3ed415aa1f99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Sep 16 12:07:35.326193 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:35.326163    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:35.330295 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:35.330272    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:35.891129 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:35.891098    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:35.891980 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:35.891962    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb"
Sep 16 12:07:35.952640 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:35.952601    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"]
Sep 16 12:07:36.223592 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:36.223517    2576 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Sep 16 12:07:36.223592 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:36.223569    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh" podUID="dc4e776a-55f2-4606-b3fc-3ed415aa1f99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Sep 16 12:07:37.223560 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:37.223518    2576 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Sep 16 12:07:37.224024 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:37.223618    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh" podUID="dc4e776a-55f2-4606-b3fc-3ed415aa1f99" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Sep 16 12:07:37.899688 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:37.899652    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh" podUID="dc4e776a-55f2-4606-b3fc-3ed415aa1f99" containerName="istio-proxy" containerID="cri-o://608a79f642d6e4ac524ff3dd8d1229d3f9922ac1b9b51d2e60ad96e60e9b9e77" gracePeriod=30
Sep 16 12:07:42.525305 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:42.525270    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-596fbdbcd6-q5fbg"]
Sep 16 12:07:42.534982 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:42.534959    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-596fbdbcd6-q5fbg"
Sep 16 12:07:42.538371 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:42.537562    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 16 12:07:42.539278 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:42.539245    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-lwbjg\""
Sep 16 12:07:42.540269 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:42.539462    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 16 12:07:42.540269 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:42.539719    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 16 12:07:42.540269 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:42.539902    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 16 12:07:42.540269 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:42.540049    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 16 12:07:42.540269 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:42.540191    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-596fbdbcd6-q5fbg"]
Sep 16 12:07:42.559417 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:42.559386    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/97ec7311-fe23-4ae4-b24b-07f9b3d62f85-manager-config\") pod \"lws-controller-manager-596fbdbcd6-q5fbg\" (UID: \"97ec7311-fe23-4ae4-b24b-07f9b3d62f85\") " pod="openshift-lws-operator/lws-controller-manager-596fbdbcd6-q5fbg"
Sep 16 12:07:42.559417 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:42.559417    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97ec7311-fe23-4ae4-b24b-07f9b3d62f85-cert\") pod \"lws-controller-manager-596fbdbcd6-q5fbg\" (UID: \"97ec7311-fe23-4ae4-b24b-07f9b3d62f85\") " pod="openshift-lws-operator/lws-controller-manager-596fbdbcd6-q5fbg"
Sep 16 12:07:42.559561 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:42.559477    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/97ec7311-fe23-4ae4-b24b-07f9b3d62f85-metrics-cert\") pod \"lws-controller-manager-596fbdbcd6-q5fbg\" (UID: \"97ec7311-fe23-4ae4-b24b-07f9b3d62f85\") " pod="openshift-lws-operator/lws-controller-manager-596fbdbcd6-q5fbg"
Sep 16 12:07:42.559561 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:42.559498    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hdw4\" (UniqueName: \"kubernetes.io/projected/97ec7311-fe23-4ae4-b24b-07f9b3d62f85-kube-api-access-5hdw4\") pod \"lws-controller-manager-596fbdbcd6-q5fbg\" (UID: \"97ec7311-fe23-4ae4-b24b-07f9b3d62f85\") " pod="openshift-lws-operator/lws-controller-manager-596fbdbcd6-q5fbg"
Sep 16 12:07:42.660295 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:42.660257    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/97ec7311-fe23-4ae4-b24b-07f9b3d62f85-manager-config\") pod \"lws-controller-manager-596fbdbcd6-q5fbg\" (UID: \"97ec7311-fe23-4ae4-b24b-07f9b3d62f85\") " pod="openshift-lws-operator/lws-controller-manager-596fbdbcd6-q5fbg"
Sep 16 12:07:42.660295 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:42.660293    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97ec7311-fe23-4ae4-b24b-07f9b3d62f85-cert\") pod \"lws-controller-manager-596fbdbcd6-q5fbg\" (UID: \"97ec7311-fe23-4ae4-b24b-07f9b3d62f85\") " pod="openshift-lws-operator/lws-controller-manager-596fbdbcd6-q5fbg"
Sep 16 12:07:42.660525 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:42.660389    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/97ec7311-fe23-4ae4-b24b-07f9b3d62f85-metrics-cert\") pod \"lws-controller-manager-596fbdbcd6-q5fbg\" (UID: \"97ec7311-fe23-4ae4-b24b-07f9b3d62f85\") " pod="openshift-lws-operator/lws-controller-manager-596fbdbcd6-q5fbg"
Sep 16 12:07:42.660525 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:42.660414    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hdw4\" (UniqueName: \"kubernetes.io/projected/97ec7311-fe23-4ae4-b24b-07f9b3d62f85-kube-api-access-5hdw4\") pod \"lws-controller-manager-596fbdbcd6-q5fbg\" (UID: \"97ec7311-fe23-4ae4-b24b-07f9b3d62f85\") " pod="openshift-lws-operator/lws-controller-manager-596fbdbcd6-q5fbg"
Sep 16 12:07:42.661054 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:42.661031    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/97ec7311-fe23-4ae4-b24b-07f9b3d62f85-manager-config\") pod \"lws-controller-manager-596fbdbcd6-q5fbg\" (UID: \"97ec7311-fe23-4ae4-b24b-07f9b3d62f85\") " pod="openshift-lws-operator/lws-controller-manager-596fbdbcd6-q5fbg"
Sep 16 12:07:42.663033 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:42.663010    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97ec7311-fe23-4ae4-b24b-07f9b3d62f85-cert\") pod \"lws-controller-manager-596fbdbcd6-q5fbg\" (UID: \"97ec7311-fe23-4ae4-b24b-07f9b3d62f85\") " pod="openshift-lws-operator/lws-controller-manager-596fbdbcd6-q5fbg"
Sep 16 12:07:42.663153 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:42.663051    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/97ec7311-fe23-4ae4-b24b-07f9b3d62f85-metrics-cert\") pod \"lws-controller-manager-596fbdbcd6-q5fbg\" (UID: \"97ec7311-fe23-4ae4-b24b-07f9b3d62f85\") " pod="openshift-lws-operator/lws-controller-manager-596fbdbcd6-q5fbg"
Sep 16 12:07:42.676234 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:42.676206    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hdw4\" (UniqueName: \"kubernetes.io/projected/97ec7311-fe23-4ae4-b24b-07f9b3d62f85-kube-api-access-5hdw4\") pod \"lws-controller-manager-596fbdbcd6-q5fbg\" (UID: \"97ec7311-fe23-4ae4-b24b-07f9b3d62f85\") " pod="openshift-lws-operator/lws-controller-manager-596fbdbcd6-q5fbg"
Sep 16 12:07:42.850811 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:42.850727    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-596fbdbcd6-q5fbg"
Sep 16 12:07:43.134304 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.134278    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:43.154178 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:07:43.154154    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97ec7311_fe23_4ae4_b24b_07f9b3d62f85.slice/crio-f98286949ee6af518223aee11134f61ee0e762318cd3a606024d06ca07a6adc1 WatchSource:0}: Error finding container f98286949ee6af518223aee11134f61ee0e762318cd3a606024d06ca07a6adc1: Status 404 returned error can't find the container with id f98286949ee6af518223aee11134f61ee0e762318cd3a606024d06ca07a6adc1
Sep 16 12:07:43.162247 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.162225    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-596fbdbcd6-q5fbg"]
Sep 16 12:07:43.165433 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.165416    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsz29\" (UniqueName: \"kubernetes.io/projected/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-kube-api-access-jsz29\") pod \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") "
Sep 16 12:07:43.165521 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.165473    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istio-podinfo\") pod \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") "
Sep 16 12:07:43.165521 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.165498    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-workload-certs\") pod \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") "
Sep 16 12:07:43.165634 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.165529    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istio-data\") pod \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") "
Sep 16 12:07:43.165634 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.165544    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-workload-socket\") pod \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") "
Sep 16 12:07:43.165634 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.165560    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istiod-ca-cert\") pod \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") "
Sep 16 12:07:43.165634 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.165576    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istio-envoy\") pod \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") "
Sep 16 12:07:43.165634 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.165595    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-credential-socket\") pod \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") "
Sep 16 12:07:43.165634 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.165624    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istio-token\") pod \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\" (UID: \"dc4e776a-55f2-4606-b3fc-3ed415aa1f99\") "
Sep 16 12:07:43.165923 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.165783    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dc4e776a-55f2-4606-b3fc-3ed415aa1f99" (UID: "dc4e776a-55f2-4606-b3fc-3ed415aa1f99"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:07:43.165923 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.165796    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dc4e776a-55f2-4606-b3fc-3ed415aa1f99" (UID: "dc4e776a-55f2-4606-b3fc-3ed415aa1f99"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:07:43.165923 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.165829    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istio-data" (OuterVolumeSpecName: "istio-data") pod "dc4e776a-55f2-4606-b3fc-3ed415aa1f99" (UID: "dc4e776a-55f2-4606-b3fc-3ed415aa1f99"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:07:43.166104 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.165944    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dc4e776a-55f2-4606-b3fc-3ed415aa1f99" (UID: "dc4e776a-55f2-4606-b3fc-3ed415aa1f99"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:07:43.166104 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.166028    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-workload-certs\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:07:43.166104 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.166038    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istio-data\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:07:43.166104 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.166046    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-workload-socket\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:07:43.166104 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.166054    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-credential-socket\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:07:43.166518 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.166177    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dc4e776a-55f2-4606-b3fc-3ed415aa1f99" (UID: "dc4e776a-55f2-4606-b3fc-3ed415aa1f99"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:07:43.167923 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.167898    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-kube-api-access-jsz29" (OuterVolumeSpecName: "kube-api-access-jsz29") pod "dc4e776a-55f2-4606-b3fc-3ed415aa1f99" (UID: "dc4e776a-55f2-4606-b3fc-3ed415aa1f99"). InnerVolumeSpecName "kube-api-access-jsz29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:07:43.168056 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.168042    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istio-token" (OuterVolumeSpecName: "istio-token") pod "dc4e776a-55f2-4606-b3fc-3ed415aa1f99" (UID: "dc4e776a-55f2-4606-b3fc-3ed415aa1f99"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:07:43.168253 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.168234    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dc4e776a-55f2-4606-b3fc-3ed415aa1f99" (UID: "dc4e776a-55f2-4606-b3fc-3ed415aa1f99"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:07:43.168304 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.168232    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dc4e776a-55f2-4606-b3fc-3ed415aa1f99" (UID: "dc4e776a-55f2-4606-b3fc-3ed415aa1f99"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:07:43.267029 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.266986    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istiod-ca-cert\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:07:43.267029 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.267014    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istio-envoy\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:07:43.267029 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.267022    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istio-token\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:07:43.267029 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.267032    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsz29\" (UniqueName: \"kubernetes.io/projected/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-kube-api-access-jsz29\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:07:43.267029 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.267041    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc4e776a-55f2-4606-b3fc-3ed415aa1f99-istio-podinfo\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:07:43.935381 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.935284    2576 generic.go:356] "Generic (PLEG): container finished" podID="dc4e776a-55f2-4606-b3fc-3ed415aa1f99" containerID="608a79f642d6e4ac524ff3dd8d1229d3f9922ac1b9b51d2e60ad96e60e9b9e77" exitCode=0
Sep 16 12:07:43.935821 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.935513    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"
Sep 16 12:07:43.935821 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.935579    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh" event={"ID":"dc4e776a-55f2-4606-b3fc-3ed415aa1f99","Type":"ContainerDied","Data":"608a79f642d6e4ac524ff3dd8d1229d3f9922ac1b9b51d2e60ad96e60e9b9e77"}
Sep 16 12:07:43.935821 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.935624    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh" event={"ID":"dc4e776a-55f2-4606-b3fc-3ed415aa1f99","Type":"ContainerDied","Data":"b3366d1df71d80db9fa9a794d40c841911b2bcdcebbcbd428ea87e9b9bacd3a6"}
Sep 16 12:07:43.935821 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.935652    2576 scope.go:117] "RemoveContainer" containerID="608a79f642d6e4ac524ff3dd8d1229d3f9922ac1b9b51d2e60ad96e60e9b9e77"
Sep 16 12:07:43.938718 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.938680    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-596fbdbcd6-q5fbg" event={"ID":"97ec7311-fe23-4ae4-b24b-07f9b3d62f85","Type":"ContainerStarted","Data":"f98286949ee6af518223aee11134f61ee0e762318cd3a606024d06ca07a6adc1"}
Sep 16 12:07:43.952584 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.952559    2576 scope.go:117] "RemoveContainer" containerID="608a79f642d6e4ac524ff3dd8d1229d3f9922ac1b9b51d2e60ad96e60e9b9e77"
Sep 16 12:07:43.952997 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:07:43.952961    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"608a79f642d6e4ac524ff3dd8d1229d3f9922ac1b9b51d2e60ad96e60e9b9e77\": container with ID starting with 608a79f642d6e4ac524ff3dd8d1229d3f9922ac1b9b51d2e60ad96e60e9b9e77 not found: ID does not exist" containerID="608a79f642d6e4ac524ff3dd8d1229d3f9922ac1b9b51d2e60ad96e60e9b9e77"
Sep 16 12:07:43.953108 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.952998    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"608a79f642d6e4ac524ff3dd8d1229d3f9922ac1b9b51d2e60ad96e60e9b9e77"} err="failed to get container status \"608a79f642d6e4ac524ff3dd8d1229d3f9922ac1b9b51d2e60ad96e60e9b9e77\": rpc error: code = NotFound desc = could not find container \"608a79f642d6e4ac524ff3dd8d1229d3f9922ac1b9b51d2e60ad96e60e9b9e77\": container with ID starting with 608a79f642d6e4ac524ff3dd8d1229d3f9922ac1b9b51d2e60ad96e60e9b9e77 not found: ID does not exist"
Sep 16 12:07:43.965995 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.965968    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"]
Sep 16 12:07:43.973808 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:43.973777    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcbc2dh"]
Sep 16 12:07:44.407378 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:44.407345    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc4e776a-55f2-4606-b3fc-3ed415aa1f99" path="/var/lib/kubelet/pods/dc4e776a-55f2-4606-b3fc-3ed415aa1f99/volumes"
Sep 16 12:07:44.459389 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:44.459353    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-tjjlr"]
Sep 16 12:07:44.459955 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:44.459878    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc4e776a-55f2-4606-b3fc-3ed415aa1f99" containerName="istio-proxy"
Sep 16 12:07:44.459955 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:44.459898    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc4e776a-55f2-4606-b3fc-3ed415aa1f99" containerName="istio-proxy"
Sep 16 12:07:44.460211 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:44.459999    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc4e776a-55f2-4606-b3fc-3ed415aa1f99" containerName="istio-proxy"
Sep 16 12:07:44.463488 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:44.463468    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjjlr"
Sep 16 12:07:44.466049 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:44.466028    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-n5qd4\""
Sep 16 12:07:44.466206 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:44.466189    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 16 12:07:44.473158 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:44.473137    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-tjjlr"]
Sep 16 12:07:44.475888 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:44.475868    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dcg42"]
Sep 16 12:07:44.479163 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:44.479146    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dcg42"
Sep 16 12:07:44.479892 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:44.479863    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f4nr\" (UniqueName: \"kubernetes.io/projected/f9760368-a10d-4cbe-91f6-da746a43f44a-kube-api-access-8f4nr\") pod \"kserve-controller-manager-d6f4b65b8-tjjlr\" (UID: \"f9760368-a10d-4cbe-91f6-da746a43f44a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjjlr"
Sep 16 12:07:44.479990 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:44.479919    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9760368-a10d-4cbe-91f6-da746a43f44a-cert\") pod \"kserve-controller-manager-d6f4b65b8-tjjlr\" (UID: \"f9760368-a10d-4cbe-91f6-da746a43f44a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjjlr"
Sep 16 12:07:44.481892 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:44.481868    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 16 12:07:44.481892 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:44.481887    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-xn8jz\""
Sep 16 12:07:44.493595 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:44.493568    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dcg42"]
Sep 16 12:07:44.580974 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:44.580938    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9760368-a10d-4cbe-91f6-da746a43f44a-cert\") pod \"kserve-controller-manager-d6f4b65b8-tjjlr\" (UID: \"f9760368-a10d-4cbe-91f6-da746a43f44a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjjlr"
Sep 16 12:07:44.581163 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:44.580997    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l668x\" (UniqueName: \"kubernetes.io/projected/9e8d62ea-b469-4d45-9113-3480c4a5868a-kube-api-access-l668x\") pod \"llmisvc-controller-manager-777c6bd7d5-dcg42\" (UID: \"9e8d62ea-b469-4d45-9113-3480c4a5868a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dcg42"
Sep 16 12:07:44.581163 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:44.581085    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e8d62ea-b469-4d45-9113-3480c4a5868a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dcg42\" (UID: \"9e8d62ea-b469-4d45-9113-3480c4a5868a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dcg42"
Sep 16 12:07:44.581163 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:07:44.581120    2576 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 16 12:07:44.581340 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:07:44.581178    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9760368-a10d-4cbe-91f6-da746a43f44a-cert podName:f9760368-a10d-4cbe-91f6-da746a43f44a nodeName:}" failed. No retries permitted until 2026-09-16 12:07:45.081162235 +0000 UTC m=+331.250126920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f9760368-a10d-4cbe-91f6-da746a43f44a-cert") pod "kserve-controller-manager-d6f4b65b8-tjjlr" (UID: "f9760368-a10d-4cbe-91f6-da746a43f44a") : secret "kserve-webhook-server-cert" not found
Sep 16 12:07:44.581340 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:44.581196    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f4nr\" (UniqueName: \"kubernetes.io/projected/f9760368-a10d-4cbe-91f6-da746a43f44a-kube-api-access-8f4nr\") pod \"kserve-controller-manager-d6f4b65b8-tjjlr\" (UID: \"f9760368-a10d-4cbe-91f6-da746a43f44a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjjlr"
Sep 16 12:07:44.593114 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:44.593089    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f4nr\" (UniqueName: \"kubernetes.io/projected/f9760368-a10d-4cbe-91f6-da746a43f44a-kube-api-access-8f4nr\") pod \"kserve-controller-manager-d6f4b65b8-tjjlr\" (UID: \"f9760368-a10d-4cbe-91f6-da746a43f44a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjjlr"
Sep 16 12:07:44.681922 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:44.681837    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e8d62ea-b469-4d45-9113-3480c4a5868a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dcg42\" (UID: \"9e8d62ea-b469-4d45-9113-3480c4a5868a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dcg42"
Sep 16 12:07:44.682082 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:44.681950    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l668x\" (UniqueName: \"kubernetes.io/projected/9e8d62ea-b469-4d45-9113-3480c4a5868a-kube-api-access-l668x\") pod \"llmisvc-controller-manager-777c6bd7d5-dcg42\" (UID: \"9e8d62ea-b469-4d45-9113-3480c4a5868a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dcg42"
Sep 16 12:07:44.682279 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:07:44.682253    2576 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 16 12:07:44.682433 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:07:44.682370    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e8d62ea-b469-4d45-9113-3480c4a5868a-cert podName:9e8d62ea-b469-4d45-9113-3480c4a5868a nodeName:}" failed. No retries permitted until 2026-09-16 12:07:45.182348474 +0000 UTC m=+331.351313368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9e8d62ea-b469-4d45-9113-3480c4a5868a-cert") pod "llmisvc-controller-manager-777c6bd7d5-dcg42" (UID: "9e8d62ea-b469-4d45-9113-3480c4a5868a") : secret "llmisvc-webhook-server-cert" not found
Sep 16 12:07:44.711972 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:44.711911    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l668x\" (UniqueName: \"kubernetes.io/projected/9e8d62ea-b469-4d45-9113-3480c4a5868a-kube-api-access-l668x\") pod \"llmisvc-controller-manager-777c6bd7d5-dcg42\" (UID: \"9e8d62ea-b469-4d45-9113-3480c4a5868a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dcg42"
Sep 16 12:07:45.085484 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:45.085408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9760368-a10d-4cbe-91f6-da746a43f44a-cert\") pod \"kserve-controller-manager-d6f4b65b8-tjjlr\" (UID: \"f9760368-a10d-4cbe-91f6-da746a43f44a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjjlr"
Sep 16 12:07:45.088461 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:45.088412    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9760368-a10d-4cbe-91f6-da746a43f44a-cert\") pod \"kserve-controller-manager-d6f4b65b8-tjjlr\" (UID: \"f9760368-a10d-4cbe-91f6-da746a43f44a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjjlr"
Sep 16 12:07:45.186846 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:45.186808    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e8d62ea-b469-4d45-9113-3480c4a5868a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dcg42\" (UID: \"9e8d62ea-b469-4d45-9113-3480c4a5868a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dcg42"
Sep 16 12:07:45.189397 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:45.189366    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e8d62ea-b469-4d45-9113-3480c4a5868a-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dcg42\" (UID: \"9e8d62ea-b469-4d45-9113-3480c4a5868a\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dcg42"
Sep 16 12:07:45.376495 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:45.376462    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjjlr"
Sep 16 12:07:45.394021 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:45.393995    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dcg42"
Sep 16 12:07:45.839724 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:45.839650    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dcg42"]
Sep 16 12:07:45.842346 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:07:45.842294    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9e8d62ea_b469_4d45_9113_3480c4a5868a.slice/crio-da8c606ec1717a63d3d9e68f51f4f98458e67abcfdff074d89e44cede7da7f25 WatchSource:0}: Error finding container da8c606ec1717a63d3d9e68f51f4f98458e67abcfdff074d89e44cede7da7f25: Status 404 returned error can't find the container with id da8c606ec1717a63d3d9e68f51f4f98458e67abcfdff074d89e44cede7da7f25
Sep 16 12:07:45.842722 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:45.842697    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-tjjlr"]
Sep 16 12:07:45.846672 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:07:45.846601    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9760368_a10d_4cbe_91f6_da746a43f44a.slice/crio-89693c2340974b953e6c1c47d6344712119999076d7cf6f2c412b3f94be8ba8a WatchSource:0}: Error finding container 89693c2340974b953e6c1c47d6344712119999076d7cf6f2c412b3f94be8ba8a: Status 404 returned error can't find the container with id 89693c2340974b953e6c1c47d6344712119999076d7cf6f2c412b3f94be8ba8a
Sep 16 12:07:45.953468 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:45.953371    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjjlr" event={"ID":"f9760368-a10d-4cbe-91f6-da746a43f44a","Type":"ContainerStarted","Data":"89693c2340974b953e6c1c47d6344712119999076d7cf6f2c412b3f94be8ba8a"}
Sep 16 12:07:45.954637 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:45.954607    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dcg42" event={"ID":"9e8d62ea-b469-4d45-9113-3480c4a5868a","Type":"ContainerStarted","Data":"da8c606ec1717a63d3d9e68f51f4f98458e67abcfdff074d89e44cede7da7f25"}
Sep 16 12:07:45.956120 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:45.956098    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-596fbdbcd6-q5fbg" event={"ID":"97ec7311-fe23-4ae4-b24b-07f9b3d62f85","Type":"ContainerStarted","Data":"2dd456875c6b48fc42362adeac4279671e0f19faad0d8138775e64a7a1a1d82c"}
Sep 16 12:07:45.956252 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:45.956235    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-596fbdbcd6-q5fbg"
Sep 16 12:07:45.974061 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:45.974018    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-596fbdbcd6-q5fbg" podStartSLOduration=1.514667342 podStartE2EDuration="3.974004863s" totalImagesPullingTime="2.459337521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:07:45.972812911 +0000 UTC m=+332.141777619" watchObservedRunningTime="2026-09-16 12:07:45.974004863 +0000 UTC m=+332.142969570"
Sep 16 12:07:49.986259 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:49.986219    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjjlr" event={"ID":"f9760368-a10d-4cbe-91f6-da746a43f44a","Type":"ContainerStarted","Data":"48291f1dcc4a0d587620b6fb79273262c22e4972fc1f360013c96bbba260b4f8"}
Sep 16 12:07:49.986700 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:49.986284    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjjlr"
Sep 16 12:07:49.987724 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:49.987704    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dcg42" event={"ID":"9e8d62ea-b469-4d45-9113-3480c4a5868a","Type":"ContainerStarted","Data":"12edbac104632384ef7999fd6e64d01727ef9622fe7791d3363616cafc8bc669"}
Sep 16 12:07:49.987826 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:49.987764    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dcg42"
Sep 16 12:07:50.011261 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:50.011213    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjjlr" podStartSLOduration=2.532438881 podStartE2EDuration="6.011199852s" totalImagesPullingTime="3.478760971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:07:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:07:50.009715615 +0000 UTC m=+336.178680321" watchObservedRunningTime="2026-09-16 12:07:50.011199852 +0000 UTC m=+336.180164559"
Sep 16 12:07:50.033498 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:50.033448    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dcg42" podStartSLOduration=2.550272961 podStartE2EDuration="6.033433526s" totalImagesPullingTime="3.483160565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:07:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:07:50.031716484 +0000 UTC m=+336.200681191" watchObservedRunningTime="2026-09-16 12:07:50.033433526 +0000 UTC m=+336.202398232"
Sep 16 12:07:56.965122 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:07:56.965091    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-596fbdbcd6-q5fbg"
Sep 16 12:08:20.994588 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:20.994557    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dcg42"
Sep 16 12:08:20.997886 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:20.997863    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tjjlr"
Sep 16 12:08:21.723905 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:21.723873    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f6777d646-v9f7d"]
Sep 16 12:08:21.738458 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:21.738428    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:21.743307 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:21.743281    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f6777d646-v9f7d"]
Sep 16 12:08:21.743843 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:21.743825    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 16 12:08:21.744826 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:21.744808    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 16 12:08:21.745079 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:21.744810    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 16 12:08:21.745257 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:21.744810    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jg44n\""
Sep 16 12:08:21.745257 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:21.744816    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 16 12:08:21.745446 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:21.744905    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 16 12:08:21.745446 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:21.745300    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 16 12:08:21.745568 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:21.745472    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 16 12:08:21.761468 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:21.761437    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 16 12:08:21.912682 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:21.912648    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/40286131-6f5e-4814-a64c-8ecfa9c9755c-console-config\") pod \"console-7f6777d646-v9f7d\" (UID: \"40286131-6f5e-4814-a64c-8ecfa9c9755c\") " pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:21.912682 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:21.912680    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/40286131-6f5e-4814-a64c-8ecfa9c9755c-oauth-serving-cert\") pod \"console-7f6777d646-v9f7d\" (UID: \"40286131-6f5e-4814-a64c-8ecfa9c9755c\") " pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:21.912864 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:21.912731    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40286131-6f5e-4814-a64c-8ecfa9c9755c-trusted-ca-bundle\") pod \"console-7f6777d646-v9f7d\" (UID: \"40286131-6f5e-4814-a64c-8ecfa9c9755c\") " pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:21.912864 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:21.912800    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/40286131-6f5e-4814-a64c-8ecfa9c9755c-service-ca\") pod \"console-7f6777d646-v9f7d\" (UID: \"40286131-6f5e-4814-a64c-8ecfa9c9755c\") " pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:21.912864 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:21.912816    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6wf5\" (UniqueName: \"kubernetes.io/projected/40286131-6f5e-4814-a64c-8ecfa9c9755c-kube-api-access-k6wf5\") pod \"console-7f6777d646-v9f7d\" (UID: \"40286131-6f5e-4814-a64c-8ecfa9c9755c\") " pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:21.912864 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:21.912832    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/40286131-6f5e-4814-a64c-8ecfa9c9755c-console-serving-cert\") pod \"console-7f6777d646-v9f7d\" (UID: \"40286131-6f5e-4814-a64c-8ecfa9c9755c\") " pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:21.912864 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:21.912845    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/40286131-6f5e-4814-a64c-8ecfa9c9755c-console-oauth-config\") pod \"console-7f6777d646-v9f7d\" (UID: \"40286131-6f5e-4814-a64c-8ecfa9c9755c\") " pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:22.013662 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:22.013581    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/40286131-6f5e-4814-a64c-8ecfa9c9755c-console-config\") pod \"console-7f6777d646-v9f7d\" (UID: \"40286131-6f5e-4814-a64c-8ecfa9c9755c\") " pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:22.013662 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:22.013615    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/40286131-6f5e-4814-a64c-8ecfa9c9755c-oauth-serving-cert\") pod \"console-7f6777d646-v9f7d\" (UID: \"40286131-6f5e-4814-a64c-8ecfa9c9755c\") " pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:22.013662 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:22.013661    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40286131-6f5e-4814-a64c-8ecfa9c9755c-trusted-ca-bundle\") pod \"console-7f6777d646-v9f7d\" (UID: \"40286131-6f5e-4814-a64c-8ecfa9c9755c\") " pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:22.014203 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:22.013701    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/40286131-6f5e-4814-a64c-8ecfa9c9755c-service-ca\") pod \"console-7f6777d646-v9f7d\" (UID: \"40286131-6f5e-4814-a64c-8ecfa9c9755c\") " pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:22.014203 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:22.013715    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6wf5\" (UniqueName: \"kubernetes.io/projected/40286131-6f5e-4814-a64c-8ecfa9c9755c-kube-api-access-k6wf5\") pod \"console-7f6777d646-v9f7d\" (UID: \"40286131-6f5e-4814-a64c-8ecfa9c9755c\") " pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:22.014203 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:22.013739    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/40286131-6f5e-4814-a64c-8ecfa9c9755c-console-serving-cert\") pod \"console-7f6777d646-v9f7d\" (UID: \"40286131-6f5e-4814-a64c-8ecfa9c9755c\") " pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:22.014203 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:22.013761    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/40286131-6f5e-4814-a64c-8ecfa9c9755c-console-oauth-config\") pod \"console-7f6777d646-v9f7d\" (UID: \"40286131-6f5e-4814-a64c-8ecfa9c9755c\") " pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:22.014474 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:22.014450    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/40286131-6f5e-4814-a64c-8ecfa9c9755c-oauth-serving-cert\") pod \"console-7f6777d646-v9f7d\" (UID: \"40286131-6f5e-4814-a64c-8ecfa9c9755c\") " pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:22.014526 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:22.014450    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/40286131-6f5e-4814-a64c-8ecfa9c9755c-console-config\") pod \"console-7f6777d646-v9f7d\" (UID: \"40286131-6f5e-4814-a64c-8ecfa9c9755c\") " pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:22.014745 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:22.014722    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/40286131-6f5e-4814-a64c-8ecfa9c9755c-service-ca\") pod \"console-7f6777d646-v9f7d\" (UID: \"40286131-6f5e-4814-a64c-8ecfa9c9755c\") " pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:22.014803 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:22.014782    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40286131-6f5e-4814-a64c-8ecfa9c9755c-trusted-ca-bundle\") pod \"console-7f6777d646-v9f7d\" (UID: \"40286131-6f5e-4814-a64c-8ecfa9c9755c\") " pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:22.016374 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:22.016353    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/40286131-6f5e-4814-a64c-8ecfa9c9755c-console-oauth-config\") pod \"console-7f6777d646-v9f7d\" (UID: \"40286131-6f5e-4814-a64c-8ecfa9c9755c\") " pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:22.016620 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:22.016598    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/40286131-6f5e-4814-a64c-8ecfa9c9755c-console-serving-cert\") pod \"console-7f6777d646-v9f7d\" (UID: \"40286131-6f5e-4814-a64c-8ecfa9c9755c\") " pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:22.021943 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:22.021927    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6wf5\" (UniqueName: \"kubernetes.io/projected/40286131-6f5e-4814-a64c-8ecfa9c9755c-kube-api-access-k6wf5\") pod \"console-7f6777d646-v9f7d\" (UID: \"40286131-6f5e-4814-a64c-8ecfa9c9755c\") " pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:22.049942 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:22.049912    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:22.321578 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:22.321553    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f6777d646-v9f7d"]
Sep 16 12:08:22.324023 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:08:22.323995    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40286131_6f5e_4814_a64c_8ecfa9c9755c.slice/crio-58802c3571f027969251ad3ac5ac924e5dd51945a13ccdf69b0ad2c7cbe7d03e WatchSource:0}: Error finding container 58802c3571f027969251ad3ac5ac924e5dd51945a13ccdf69b0ad2c7cbe7d03e: Status 404 returned error can't find the container with id 58802c3571f027969251ad3ac5ac924e5dd51945a13ccdf69b0ad2c7cbe7d03e
Sep 16 12:08:23.144661 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:23.144625    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f6777d646-v9f7d" event={"ID":"40286131-6f5e-4814-a64c-8ecfa9c9755c","Type":"ContainerStarted","Data":"9784746082ce5d83f6488d82ef1abc7ccf32b36ba144133a0ae59323e354e29a"}
Sep 16 12:08:23.145065 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:23.144681    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f6777d646-v9f7d" event={"ID":"40286131-6f5e-4814-a64c-8ecfa9c9755c","Type":"ContainerStarted","Data":"58802c3571f027969251ad3ac5ac924e5dd51945a13ccdf69b0ad2c7cbe7d03e"}
Sep 16 12:08:23.162806 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:23.162761    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f6777d646-v9f7d" podStartSLOduration=2.162742538 podStartE2EDuration="2.162742538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:08:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:08:23.161667533 +0000 UTC m=+369.330632243" watchObservedRunningTime="2026-09-16 12:08:23.162742538 +0000 UTC m=+369.331707244"
Sep 16 12:08:32.051011 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:32.050971    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:32.051429 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:32.051035    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:32.055835 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:32.055812    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:32.190033 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:32.190006    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f6777d646-v9f7d"
Sep 16 12:08:49.141980 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:49.141944    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-bwjw9"]
Sep 16 12:08:49.145550 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:49.145530    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-bwjw9"
Sep 16 12:08:49.148077 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:49.148055    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 16 12:08:49.148157 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:49.148059    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 16 12:08:49.148157 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:49.148061    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-5zxsm\""
Sep 16 12:08:49.148998 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:49.148984    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 16 12:08:49.155716 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:49.155698    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-bwjw9"]
Sep 16 12:08:49.254589 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:49.254558    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-864wz\" (UniqueName: \"kubernetes.io/projected/a785d79d-e71e-44ac-8887-91a5f0178c95-kube-api-access-864wz\") pod \"dns-operator-controller-manager-7b84cd7c9c-bwjw9\" (UID: \"a785d79d-e71e-44ac-8887-91a5f0178c95\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-bwjw9"
Sep 16 12:08:49.355833 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:49.355803    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-864wz\" (UniqueName: \"kubernetes.io/projected/a785d79d-e71e-44ac-8887-91a5f0178c95-kube-api-access-864wz\") pod \"dns-operator-controller-manager-7b84cd7c9c-bwjw9\" (UID: \"a785d79d-e71e-44ac-8887-91a5f0178c95\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-bwjw9"
Sep 16 12:08:49.364328 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:49.364292    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-864wz\" (UniqueName: \"kubernetes.io/projected/a785d79d-e71e-44ac-8887-91a5f0178c95-kube-api-access-864wz\") pod \"dns-operator-controller-manager-7b84cd7c9c-bwjw9\" (UID: \"a785d79d-e71e-44ac-8887-91a5f0178c95\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-bwjw9"
Sep 16 12:08:49.456688 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:49.456621    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-bwjw9"
Sep 16 12:08:49.730619 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:49.730597    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-bwjw9"]
Sep 16 12:08:49.733275 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:08:49.733249    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda785d79d_e71e_44ac_8887_91a5f0178c95.slice/crio-b1de609d1798858c74542da6d5a3c482cc783d938a1e517d5264789f1c8efdc8 WatchSource:0}: Error finding container b1de609d1798858c74542da6d5a3c482cc783d938a1e517d5264789f1c8efdc8: Status 404 returned error can't find the container with id b1de609d1798858c74542da6d5a3c482cc783d938a1e517d5264789f1c8efdc8
Sep 16 12:08:50.268226 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:50.268192    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-bwjw9" event={"ID":"a785d79d-e71e-44ac-8887-91a5f0178c95","Type":"ContainerStarted","Data":"b1de609d1798858c74542da6d5a3c482cc783d938a1e517d5264789f1c8efdc8"}
Sep 16 12:08:53.286564 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:53.286525    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-bwjw9" event={"ID":"a785d79d-e71e-44ac-8887-91a5f0178c95","Type":"ContainerStarted","Data":"fd31dadae24dad55039e69c2e9107e853e424aa9d096001481b08a86d1a85b76"}
Sep 16 12:08:53.286957 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:53.286610    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-bwjw9"
Sep 16 12:08:53.308375 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:53.308328    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-bwjw9" podStartSLOduration=1.628260124 podStartE2EDuration="4.308298032s" totalImagesPullingTime="2.680037908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:08:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:08:53.307779746 +0000 UTC m=+399.476744452" watchObservedRunningTime="2026-09-16 12:08:53.308298032 +0000 UTC m=+399.477262739"
Sep 16 12:08:53.871033 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:53.870999    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-x69w7"]
Sep 16 12:08:53.874831 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:53.874809    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-x69w7"
Sep 16 12:08:53.878166 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:53.877973    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-qmhhb\""
Sep 16 12:08:53.886178 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:53.886156    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-x69w7"]
Sep 16 12:08:53.996162 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:53.996129    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b45zp\" (UniqueName: \"kubernetes.io/projected/3856504b-72e4-4c0e-b205-48f4c65483c3-kube-api-access-b45zp\") pod \"authorino-operator-76b478bd78-x69w7\" (UID: \"3856504b-72e4-4c0e-b205-48f4c65483c3\") " pod="kuadrant-system/authorino-operator-76b478bd78-x69w7"
Sep 16 12:08:54.096621 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:54.096589    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b45zp\" (UniqueName: \"kubernetes.io/projected/3856504b-72e4-4c0e-b205-48f4c65483c3-kube-api-access-b45zp\") pod \"authorino-operator-76b478bd78-x69w7\" (UID: \"3856504b-72e4-4c0e-b205-48f4c65483c3\") " pod="kuadrant-system/authorino-operator-76b478bd78-x69w7"
Sep 16 12:08:54.105517 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:54.105489    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b45zp\" (UniqueName: \"kubernetes.io/projected/3856504b-72e4-4c0e-b205-48f4c65483c3-kube-api-access-b45zp\") pod \"authorino-operator-76b478bd78-x69w7\" (UID: \"3856504b-72e4-4c0e-b205-48f4c65483c3\") " pod="kuadrant-system/authorino-operator-76b478bd78-x69w7"
Sep 16 12:08:54.189708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:54.189640    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-x69w7"
Sep 16 12:08:54.472060 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:54.472009    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-x69w7"]
Sep 16 12:08:54.475003 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:08:54.474981    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3856504b_72e4_4c0e_b205_48f4c65483c3.slice/crio-d02e25d666a3f9a3f573a189beaf2247484b14d506ef6ab094025213ad816cf4 WatchSource:0}: Error finding container d02e25d666a3f9a3f573a189beaf2247484b14d506ef6ab094025213ad816cf4: Status 404 returned error can't find the container with id d02e25d666a3f9a3f573a189beaf2247484b14d506ef6ab094025213ad816cf4
Sep 16 12:08:55.299238 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:55.299197    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-x69w7" event={"ID":"3856504b-72e4-4c0e-b205-48f4c65483c3","Type":"ContainerStarted","Data":"d02e25d666a3f9a3f573a189beaf2247484b14d506ef6ab094025213ad816cf4"}
Sep 16 12:08:56.305674 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:56.305575    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-x69w7" event={"ID":"3856504b-72e4-4c0e-b205-48f4c65483c3","Type":"ContainerStarted","Data":"220f96137f5fd8961267afff9d42d631bbac28da44383d4a2af62b99f89427f0"}
Sep 16 12:08:56.305674 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:56.305661    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-x69w7"
Sep 16 12:08:56.324143 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:08:56.324094    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-x69w7" podStartSLOduration=1.9042356630000001 podStartE2EDuration="3.324078679s" totalImagesPullingTime="1.419843016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:08:56.322768221 +0000 UTC m=+402.491732930" watchObservedRunningTime="2026-09-16 12:08:56.324078679 +0000 UTC m=+402.493043391"
Sep 16 12:09:04.293666 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:04.293628    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-bwjw9"
Sep 16 12:09:07.313349 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:07.313175    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-x69w7"
Sep 16 12:09:16.589371 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:16.589333    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7vc5"]
Sep 16 12:09:16.592964 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:16.592949    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7vc5"
Sep 16 12:09:16.595849 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:16.595831    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ktrdp\""
Sep 16 12:09:16.610084 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:16.610065    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7vc5"]
Sep 16 12:09:16.696164 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:16.696131    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f844406b-1b18-4847-ac49-d425937b854d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-r7vc5\" (UID: \"f844406b-1b18-4847-ac49-d425937b854d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7vc5"
Sep 16 12:09:16.696350 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:16.696201    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j84mv\" (UniqueName: \"kubernetes.io/projected/f844406b-1b18-4847-ac49-d425937b854d-kube-api-access-j84mv\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-r7vc5\" (UID: \"f844406b-1b18-4847-ac49-d425937b854d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7vc5"
Sep 16 12:09:16.797101 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:16.797071    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j84mv\" (UniqueName: \"kubernetes.io/projected/f844406b-1b18-4847-ac49-d425937b854d-kube-api-access-j84mv\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-r7vc5\" (UID: \"f844406b-1b18-4847-ac49-d425937b854d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7vc5"
Sep 16 12:09:16.797274 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:16.797149    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f844406b-1b18-4847-ac49-d425937b854d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-r7vc5\" (UID: \"f844406b-1b18-4847-ac49-d425937b854d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7vc5"
Sep 16 12:09:16.797510 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:16.797493    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f844406b-1b18-4847-ac49-d425937b854d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-r7vc5\" (UID: \"f844406b-1b18-4847-ac49-d425937b854d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7vc5"
Sep 16 12:09:16.806124 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:16.806104    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j84mv\" (UniqueName: \"kubernetes.io/projected/f844406b-1b18-4847-ac49-d425937b854d-kube-api-access-j84mv\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-r7vc5\" (UID: \"f844406b-1b18-4847-ac49-d425937b854d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7vc5"
Sep 16 12:09:16.903439 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:16.903411    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7vc5"
Sep 16 12:09:17.096659 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:17.096631    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7vc5"]
Sep 16 12:09:17.102988 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:17.102957    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7vc5"]
Sep 16 12:09:17.129719 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:17.129682    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-q7zjj"]
Sep 16 12:09:17.133856 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:17.133829    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-q7zjj"
Sep 16 12:09:17.154850 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:17.154783    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-q7zjj"]
Sep 16 12:09:17.201014 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:17.200976    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/91d5d538-1786-4299-a216-ad59fec730b9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-q7zjj\" (UID: \"91d5d538-1786-4299-a216-ad59fec730b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-q7zjj"
Sep 16 12:09:17.201181 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:17.201019    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7dhj\" (UniqueName: \"kubernetes.io/projected/91d5d538-1786-4299-a216-ad59fec730b9-kube-api-access-d7dhj\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-q7zjj\" (UID: \"91d5d538-1786-4299-a216-ad59fec730b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-q7zjj"
Sep 16 12:09:17.290755 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:09:17.290724    2576 log.go:32] "RunPodSandbox from runtime service failed" err=<
Sep 16 12:09:17.290755 ip-10-0-137-240 kubenswrapper[2576]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-r7vc5_kuadrant-system_f844406b-1b18-4847-ac49-d425937b854d_0(50e2710c4411fd4784ebfb2fc1efc5962dd965a8ce9ee112e56684c6a14e529f): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-r7vc5 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"50e2710c4411fd4784ebfb2fc1efc5962dd965a8ce9ee112e56684c6a14e529f" Netns:"/var/run/netns/5f4f70cc-0ac6-4993-9a52-e1b7c624bcb0" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-7978cbdfbc-r7vc5;K8S_POD_INFRA_CONTAINER_ID=50e2710c4411fd4784ebfb2fc1efc5962dd965a8ce9ee112e56684c6a14e529f;K8S_POD_UID=f844406b-1b18-4847-ac49-d425937b854d" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7vc5] networking: [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7vc5/f844406b-1b18-4847-ac49-d425937b854d:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7vc5 50e2710c4411fd4784ebfb2fc1efc5962dd965a8ce9ee112e56684c6a14e529f network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:86:00:21 [10.134.0.33/23]
Sep 16 12:09:17.290755 ip-10-0-137-240 kubenswrapper[2576]:         '
Sep 16 12:09:17.290755 ip-10-0-137-240 kubenswrapper[2576]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 16 12:09:17.290755 ip-10-0-137-240 kubenswrapper[2576]:  >
Sep 16 12:09:17.290987 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:09:17.290781    2576 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Sep 16 12:09:17.290987 ip-10-0-137-240 kubenswrapper[2576]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-r7vc5_kuadrant-system_f844406b-1b18-4847-ac49-d425937b854d_0(50e2710c4411fd4784ebfb2fc1efc5962dd965a8ce9ee112e56684c6a14e529f): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-r7vc5 to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"50e2710c4411fd4784ebfb2fc1efc5962dd965a8ce9ee112e56684c6a14e529f" Netns:"/var/run/netns/5f4f70cc-0ac6-4993-9a52-e1b7c624bcb0" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-7978cbdfbc-r7vc5;K8S_POD_INFRA_CONTAINER_ID=50e2710c4411fd4784ebfb2fc1efc5962dd965a8ce9ee112e56684c6a14e529f;K8S_POD_UID=f844406b-1b18-4847-ac49-d425937b854d" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7vc5] networking: [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7vc5/f844406b-1b18-4847-ac49-d425937b854d:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7vc5 50e2710c4411fd4784ebfb2fc1efc5962dd965a8ce9ee112e56684c6a14e529f network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:86:00:21 [10.134.0.33/23]
Sep 16 12:09:17.290987 ip-10-0-137-240 kubenswrapper[2576]:         '
Sep 16 12:09:17.290987 ip-10-0-137-240 kubenswrapper[2576]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 16 12:09:17.290987 ip-10-0-137-240 kubenswrapper[2576]:  > pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7vc5"
Sep 16 12:09:17.301919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:17.301891    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/91d5d538-1786-4299-a216-ad59fec730b9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-q7zjj\" (UID: \"91d5d538-1786-4299-a216-ad59fec730b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-q7zjj"
Sep 16 12:09:17.302024 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:17.301921    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7dhj\" (UniqueName: \"kubernetes.io/projected/91d5d538-1786-4299-a216-ad59fec730b9-kube-api-access-d7dhj\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-q7zjj\" (UID: \"91d5d538-1786-4299-a216-ad59fec730b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-q7zjj"
Sep 16 12:09:17.302254 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:17.302237    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/91d5d538-1786-4299-a216-ad59fec730b9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-q7zjj\" (UID: \"91d5d538-1786-4299-a216-ad59fec730b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-q7zjj"
Sep 16 12:09:17.310285 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:17.310263    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7dhj\" (UniqueName: \"kubernetes.io/projected/91d5d538-1786-4299-a216-ad59fec730b9-kube-api-access-d7dhj\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-q7zjj\" (UID: \"91d5d538-1786-4299-a216-ad59fec730b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-q7zjj"
Sep 16 12:09:17.407573 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:17.407497    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7vc5"
Sep 16 12:09:17.409741 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:09:17.409703    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-r7vc5\" is forbidden: User \"system:node:ip-10-0-137-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-240.ec2.internal' and this object" podUID="f844406b-1b18-4847-ac49-d425937b854d" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7vc5"
Sep 16 12:09:17.416113 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:17.416085    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7vc5"
Sep 16 12:09:17.420177 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:09:17.420151    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-r7vc5\" is forbidden: User \"system:node:ip-10-0-137-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-240.ec2.internal' and this object" podUID="f844406b-1b18-4847-ac49-d425937b854d" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7vc5"
Sep 16 12:09:17.445394 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:17.445366    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-q7zjj"
Sep 16 12:09:17.503984 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:17.503886    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j84mv\" (UniqueName: \"kubernetes.io/projected/f844406b-1b18-4847-ac49-d425937b854d-kube-api-access-j84mv\") pod \"f844406b-1b18-4847-ac49-d425937b854d\" (UID: \"f844406b-1b18-4847-ac49-d425937b854d\") "
Sep 16 12:09:17.503984 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:17.503965    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f844406b-1b18-4847-ac49-d425937b854d-extensions-socket-volume\") pod \"f844406b-1b18-4847-ac49-d425937b854d\" (UID: \"f844406b-1b18-4847-ac49-d425937b854d\") "
Sep 16 12:09:17.504470 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:17.504444    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f844406b-1b18-4847-ac49-d425937b854d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f844406b-1b18-4847-ac49-d425937b854d" (UID: "f844406b-1b18-4847-ac49-d425937b854d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:09:17.507853 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:17.507827    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f844406b-1b18-4847-ac49-d425937b854d-kube-api-access-j84mv" (OuterVolumeSpecName: "kube-api-access-j84mv") pod "f844406b-1b18-4847-ac49-d425937b854d" (UID: "f844406b-1b18-4847-ac49-d425937b854d"). InnerVolumeSpecName "kube-api-access-j84mv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:09:17.605582 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:17.605546    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j84mv\" (UniqueName: \"kubernetes.io/projected/f844406b-1b18-4847-ac49-d425937b854d-kube-api-access-j84mv\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:09:17.605582 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:17.605574    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f844406b-1b18-4847-ac49-d425937b854d-extensions-socket-volume\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:09:17.724202 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:17.724175    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-q7zjj"]
Sep 16 12:09:17.726696 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:09:17.726668    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91d5d538_1786_4299_a216_ad59fec730b9.slice/crio-63e21193e9154ab4214f6ace9e30353d9d4e22585c7697b8dc044399f1e61fd9 WatchSource:0}: Error finding container 63e21193e9154ab4214f6ace9e30353d9d4e22585c7697b8dc044399f1e61fd9: Status 404 returned error can't find the container with id 63e21193e9154ab4214f6ace9e30353d9d4e22585c7697b8dc044399f1e61fd9
Sep 16 12:09:18.395534 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:18.395499    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f844406b-1b18-4847-ac49-d425937b854d" path="/var/lib/kubelet/pods/f844406b-1b18-4847-ac49-d425937b854d/volumes"
Sep 16 12:09:18.418220 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:18.418194    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7vc5"
Sep 16 12:09:18.418394 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:18.418219    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-q7zjj" event={"ID":"91d5d538-1786-4299-a216-ad59fec730b9","Type":"ContainerStarted","Data":"63e21193e9154ab4214f6ace9e30353d9d4e22585c7697b8dc044399f1e61fd9"}
Sep 16 12:09:18.422980 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:09:18.422955    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-r7vc5\" is forbidden: User \"system:node:ip-10-0-137-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-240.ec2.internal' and this object" podUID="f844406b-1b18-4847-ac49-d425937b854d" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7vc5"
Sep 16 12:09:21.435773 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:21.435738    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-q7zjj" event={"ID":"91d5d538-1786-4299-a216-ad59fec730b9","Type":"ContainerStarted","Data":"e82e7fb2f6f1e331a68dcae9acb13600c605146a98fc855deae5a8b5c5953ab4"}
Sep 16 12:09:21.436153 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:21.435878    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-q7zjj"
Sep 16 12:09:21.459915 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:21.459867    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-q7zjj" podStartSLOduration=0.95244334 podStartE2EDuration="4.459851498s" totalImagesPullingTime="3.507408158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:09:21.457301604 +0000 UTC m=+427.626266323" watchObservedRunningTime="2026-09-16 12:09:21.459851498 +0000 UTC m=+427.628816204"
Sep 16 12:09:32.442756 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:32.442728    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-q7zjj"
Sep 16 12:09:45.027863 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:45.027773    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-q7zjj"]
Sep 16 12:09:45.028289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:45.028014    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-q7zjj" podUID="91d5d538-1786-4299-a216-ad59fec730b9" containerName="manager" containerID="cri-o://e82e7fb2f6f1e331a68dcae9acb13600c605146a98fc855deae5a8b5c5953ab4" gracePeriod=10
Sep 16 12:09:45.275194 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:45.275172    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-q7zjj"
Sep 16 12:09:45.383651 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:45.383625    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/91d5d538-1786-4299-a216-ad59fec730b9-extensions-socket-volume\") pod \"91d5d538-1786-4299-a216-ad59fec730b9\" (UID: \"91d5d538-1786-4299-a216-ad59fec730b9\") "
Sep 16 12:09:45.383802 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:45.383669    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7dhj\" (UniqueName: \"kubernetes.io/projected/91d5d538-1786-4299-a216-ad59fec730b9-kube-api-access-d7dhj\") pod \"91d5d538-1786-4299-a216-ad59fec730b9\" (UID: \"91d5d538-1786-4299-a216-ad59fec730b9\") "
Sep 16 12:09:45.384138 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:45.384116    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91d5d538-1786-4299-a216-ad59fec730b9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "91d5d538-1786-4299-a216-ad59fec730b9" (UID: "91d5d538-1786-4299-a216-ad59fec730b9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:09:45.385952 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:45.385927    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91d5d538-1786-4299-a216-ad59fec730b9-kube-api-access-d7dhj" (OuterVolumeSpecName: "kube-api-access-d7dhj") pod "91d5d538-1786-4299-a216-ad59fec730b9" (UID: "91d5d538-1786-4299-a216-ad59fec730b9"). InnerVolumeSpecName "kube-api-access-d7dhj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:09:45.484767 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:45.484739    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7dhj\" (UniqueName: \"kubernetes.io/projected/91d5d538-1786-4299-a216-ad59fec730b9-kube-api-access-d7dhj\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:09:45.484767 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:45.484763    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/91d5d538-1786-4299-a216-ad59fec730b9-extensions-socket-volume\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:09:45.553210 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:45.553176    2576 generic.go:356] "Generic (PLEG): container finished" podID="91d5d538-1786-4299-a216-ad59fec730b9" containerID="e82e7fb2f6f1e331a68dcae9acb13600c605146a98fc855deae5a8b5c5953ab4" exitCode=0
Sep 16 12:09:45.553347 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:45.553235    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-q7zjj"
Sep 16 12:09:45.553347 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:45.553238    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-q7zjj" event={"ID":"91d5d538-1786-4299-a216-ad59fec730b9","Type":"ContainerDied","Data":"e82e7fb2f6f1e331a68dcae9acb13600c605146a98fc855deae5a8b5c5953ab4"}
Sep 16 12:09:45.553347 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:45.553290    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-q7zjj" event={"ID":"91d5d538-1786-4299-a216-ad59fec730b9","Type":"ContainerDied","Data":"63e21193e9154ab4214f6ace9e30353d9d4e22585c7697b8dc044399f1e61fd9"}
Sep 16 12:09:45.553347 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:45.553345    2576 scope.go:117] "RemoveContainer" containerID="e82e7fb2f6f1e331a68dcae9acb13600c605146a98fc855deae5a8b5c5953ab4"
Sep 16 12:09:45.562190 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:45.562172    2576 scope.go:117] "RemoveContainer" containerID="e82e7fb2f6f1e331a68dcae9acb13600c605146a98fc855deae5a8b5c5953ab4"
Sep 16 12:09:45.562527 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:09:45.562507    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e82e7fb2f6f1e331a68dcae9acb13600c605146a98fc855deae5a8b5c5953ab4\": container with ID starting with e82e7fb2f6f1e331a68dcae9acb13600c605146a98fc855deae5a8b5c5953ab4 not found: ID does not exist" containerID="e82e7fb2f6f1e331a68dcae9acb13600c605146a98fc855deae5a8b5c5953ab4"
Sep 16 12:09:45.562571 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:45.562537    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e82e7fb2f6f1e331a68dcae9acb13600c605146a98fc855deae5a8b5c5953ab4"} err="failed to get container status \"e82e7fb2f6f1e331a68dcae9acb13600c605146a98fc855deae5a8b5c5953ab4\": rpc error: code = NotFound desc = could not find container \"e82e7fb2f6f1e331a68dcae9acb13600c605146a98fc855deae5a8b5c5953ab4\": container with ID starting with e82e7fb2f6f1e331a68dcae9acb13600c605146a98fc855deae5a8b5c5953ab4 not found: ID does not exist"
Sep 16 12:09:45.576901 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:45.576871    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-q7zjj"]
Sep 16 12:09:45.583576 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:45.583553    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-q7zjj"]
Sep 16 12:09:46.393384 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:46.393357    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91d5d538-1786-4299-a216-ad59fec730b9" path="/var/lib/kubelet/pods/91d5d538-1786-4299-a216-ad59fec730b9/volumes"
Sep 16 12:09:48.963102 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:48.959338    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"]
Sep 16 12:09:48.963102 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:48.960307    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91d5d538-1786-4299-a216-ad59fec730b9" containerName="manager"
Sep 16 12:09:48.963102 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:48.960346    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="91d5d538-1786-4299-a216-ad59fec730b9" containerName="manager"
Sep 16 12:09:48.963102 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:48.960595    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="91d5d538-1786-4299-a216-ad59fec730b9" containerName="manager"
Sep 16 12:09:48.966652 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:48.966631    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:48.969440 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:48.969419    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-mpt9t\""
Sep 16 12:09:48.972573 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:48.972552    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"]
Sep 16 12:09:49.015399 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.015368    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8ca5c0e-e21e-432c-8e61-d18e876bb904-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.015550 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.015404    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8ca5c0e-e21e-432c-8e61-d18e876bb904-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.015550 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.015475    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8ca5c0e-e21e-432c-8e61-d18e876bb904-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.015667 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.015546    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz46h\" (UniqueName: \"kubernetes.io/projected/f8ca5c0e-e21e-432c-8e61-d18e876bb904-kube-api-access-pz46h\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.015667 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.015571    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8ca5c0e-e21e-432c-8e61-d18e876bb904-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.015667 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.015611    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8ca5c0e-e21e-432c-8e61-d18e876bb904-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.015815 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.015665    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8ca5c0e-e21e-432c-8e61-d18e876bb904-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.015815 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.015688    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8ca5c0e-e21e-432c-8e61-d18e876bb904-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.015815 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.015765    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8ca5c0e-e21e-432c-8e61-d18e876bb904-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.116851 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.116814    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8ca5c0e-e21e-432c-8e61-d18e876bb904-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.116851 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.116853    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8ca5c0e-e21e-432c-8e61-d18e876bb904-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.117097 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.116877    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8ca5c0e-e21e-432c-8e61-d18e876bb904-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.117097 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.116923    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8ca5c0e-e21e-432c-8e61-d18e876bb904-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.117097 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.116959    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz46h\" (UniqueName: \"kubernetes.io/projected/f8ca5c0e-e21e-432c-8e61-d18e876bb904-kube-api-access-pz46h\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.117097 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.116982    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8ca5c0e-e21e-432c-8e61-d18e876bb904-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.117305 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.117205    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8ca5c0e-e21e-432c-8e61-d18e876bb904-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.117305 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.117271    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8ca5c0e-e21e-432c-8e61-d18e876bb904-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.117305 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.117276    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8ca5c0e-e21e-432c-8e61-d18e876bb904-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.117305 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.117299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8ca5c0e-e21e-432c-8e61-d18e876bb904-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.117583 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.117345    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8ca5c0e-e21e-432c-8e61-d18e876bb904-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.117634 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.117585    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8ca5c0e-e21e-432c-8e61-d18e876bb904-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.117670 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.117637    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8ca5c0e-e21e-432c-8e61-d18e876bb904-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.117886 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.117868    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8ca5c0e-e21e-432c-8e61-d18e876bb904-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.119889 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.119862    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8ca5c0e-e21e-432c-8e61-d18e876bb904-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.120042 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.120027    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8ca5c0e-e21e-432c-8e61-d18e876bb904-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.124737 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.124714    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz46h\" (UniqueName: \"kubernetes.io/projected/f8ca5c0e-e21e-432c-8e61-d18e876bb904-kube-api-access-pz46h\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.124822 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.124759    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8ca5c0e-e21e-432c-8e61-d18e876bb904-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-xtdcn\" (UID: \"f8ca5c0e-e21e-432c-8e61-d18e876bb904\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.278543 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.278463    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:49.555477 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.555451    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"]
Sep 16 12:09:49.557304 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:09:49.557274    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8ca5c0e_e21e_432c_8e61_d18e876bb904.slice/crio-e1c85ea365a465c06041ea22de4670026258bdfebbc9cd60d9045c4f6c02701f WatchSource:0}: Error finding container e1c85ea365a465c06041ea22de4670026258bdfebbc9cd60d9045c4f6c02701f: Status 404 returned error can't find the container with id e1c85ea365a465c06041ea22de4670026258bdfebbc9cd60d9045c4f6c02701f
Sep 16 12:09:49.559454 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.559421    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:09:49.559561 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.559501    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:09:49.559561 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.559545    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:09:49.575861 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:49.575829    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn" event={"ID":"f8ca5c0e-e21e-432c-8e61-d18e876bb904","Type":"ContainerStarted","Data":"e1c85ea365a465c06041ea22de4670026258bdfebbc9cd60d9045c4f6c02701f"}
Sep 16 12:09:50.581869 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:50.581830    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn" event={"ID":"f8ca5c0e-e21e-432c-8e61-d18e876bb904","Type":"ContainerStarted","Data":"fc6360d4b502be5791b5ba0d4e9753d59fd21055857d2f6e07df3c7d25cb0c2f"}
Sep 16 12:09:50.603685 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:50.603632    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn" podStartSLOduration=2.603616208 podStartE2EDuration="2.603616208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:09:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:09:50.601460545 +0000 UTC m=+456.770425277" watchObservedRunningTime="2026-09-16 12:09:50.603616208 +0000 UTC m=+456.772580914"
Sep 16 12:09:51.279197 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:51.279162    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:51.283714 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:51.283688    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:51.586790 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:51.586714    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:09:51.587725 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:09:51.587704    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:10:02.967615 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:02.967586    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-f6nn8"]
Sep 16 12:10:02.970989 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:02.970972    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-f6nn8"
Sep 16 12:10:02.973518 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:02.973499    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 16 12:10:02.973607 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:02.973595    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4k8h2\""
Sep 16 12:10:02.978293 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:02.978268    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-f6nn8"]
Sep 16 12:10:03.044505 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:03.044460    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj527\" (UniqueName: \"kubernetes.io/projected/a64fb847-e2fd-4daf-be27-ec09ad6c7914-kube-api-access-dj527\") pod \"limitador-limitador-8588749977-f6nn8\" (UID: \"a64fb847-e2fd-4daf-be27-ec09ad6c7914\") " pod="kuadrant-system/limitador-limitador-8588749977-f6nn8"
Sep 16 12:10:03.044658 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:03.044542    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a64fb847-e2fd-4daf-be27-ec09ad6c7914-config-file\") pod \"limitador-limitador-8588749977-f6nn8\" (UID: \"a64fb847-e2fd-4daf-be27-ec09ad6c7914\") " pod="kuadrant-system/limitador-limitador-8588749977-f6nn8"
Sep 16 12:10:03.069971 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:03.069934    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-f6nn8"]
Sep 16 12:10:03.146033 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:03.146003    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj527\" (UniqueName: \"kubernetes.io/projected/a64fb847-e2fd-4daf-be27-ec09ad6c7914-kube-api-access-dj527\") pod \"limitador-limitador-8588749977-f6nn8\" (UID: \"a64fb847-e2fd-4daf-be27-ec09ad6c7914\") " pod="kuadrant-system/limitador-limitador-8588749977-f6nn8"
Sep 16 12:10:03.146257 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:03.146060    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a64fb847-e2fd-4daf-be27-ec09ad6c7914-config-file\") pod \"limitador-limitador-8588749977-f6nn8\" (UID: \"a64fb847-e2fd-4daf-be27-ec09ad6c7914\") " pod="kuadrant-system/limitador-limitador-8588749977-f6nn8"
Sep 16 12:10:03.146699 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:03.146684    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a64fb847-e2fd-4daf-be27-ec09ad6c7914-config-file\") pod \"limitador-limitador-8588749977-f6nn8\" (UID: \"a64fb847-e2fd-4daf-be27-ec09ad6c7914\") " pod="kuadrant-system/limitador-limitador-8588749977-f6nn8"
Sep 16 12:10:03.155032 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:03.155004    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj527\" (UniqueName: \"kubernetes.io/projected/a64fb847-e2fd-4daf-be27-ec09ad6c7914-kube-api-access-dj527\") pod \"limitador-limitador-8588749977-f6nn8\" (UID: \"a64fb847-e2fd-4daf-be27-ec09ad6c7914\") " pod="kuadrant-system/limitador-limitador-8588749977-f6nn8"
Sep 16 12:10:03.282550 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:03.282459    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-f6nn8"
Sep 16 12:10:03.552734 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:03.552710    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-f6nn8"]
Sep 16 12:10:03.555081 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:10:03.555058    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda64fb847_e2fd_4daf_be27_ec09ad6c7914.slice/crio-531e32b538fad53b6bf25397ea84cbd28fd79d6fbe05c10ff4780d8470bda592 WatchSource:0}: Error finding container 531e32b538fad53b6bf25397ea84cbd28fd79d6fbe05c10ff4780d8470bda592: Status 404 returned error can't find the container with id 531e32b538fad53b6bf25397ea84cbd28fd79d6fbe05c10ff4780d8470bda592
Sep 16 12:10:03.647804 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:03.647777    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-f6nn8" event={"ID":"a64fb847-e2fd-4daf-be27-ec09ad6c7914","Type":"ContainerStarted","Data":"531e32b538fad53b6bf25397ea84cbd28fd79d6fbe05c10ff4780d8470bda592"}
Sep 16 12:10:05.659412 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:05.659377    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-f6nn8" event={"ID":"a64fb847-e2fd-4daf-be27-ec09ad6c7914","Type":"ContainerStarted","Data":"7c11058ff40bb40bb43f2fbb0988bde235ff68d5c06f209a1d286a9f06b34097"}
Sep 16 12:10:05.659808 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:05.659529    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-f6nn8"
Sep 16 12:10:05.676166 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:05.676121    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-f6nn8" podStartSLOduration=2.380489387 podStartE2EDuration="3.676102053s" totalImagesPullingTime="1.295612666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:10:05.673543273 +0000 UTC m=+471.842507980" watchObservedRunningTime="2026-09-16 12:10:05.676102053 +0000 UTC m=+471.845067250"
Sep 16 12:10:16.153977 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:16.153946    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-f6nn8"]
Sep 16 12:10:16.154440 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:16.154169    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-f6nn8" podUID="a64fb847-e2fd-4daf-be27-ec09ad6c7914" containerName="limitador" containerID="cri-o://7c11058ff40bb40bb43f2fbb0988bde235ff68d5c06f209a1d286a9f06b34097" gracePeriod=30
Sep 16 12:10:16.155172 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:16.154828    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-f6nn8"
Sep 16 12:10:16.714111 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:16.714073    2576 generic.go:356] "Generic (PLEG): container finished" podID="a64fb847-e2fd-4daf-be27-ec09ad6c7914" containerID="7c11058ff40bb40bb43f2fbb0988bde235ff68d5c06f209a1d286a9f06b34097" exitCode=0
Sep 16 12:10:16.714286 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:16.714148    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-f6nn8" event={"ID":"a64fb847-e2fd-4daf-be27-ec09ad6c7914","Type":"ContainerDied","Data":"7c11058ff40bb40bb43f2fbb0988bde235ff68d5c06f209a1d286a9f06b34097"}
Sep 16 12:10:17.093080 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:17.093058    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-f6nn8"
Sep 16 12:10:17.160984 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:17.160957    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dj527\" (UniqueName: \"kubernetes.io/projected/a64fb847-e2fd-4daf-be27-ec09ad6c7914-kube-api-access-dj527\") pod \"a64fb847-e2fd-4daf-be27-ec09ad6c7914\" (UID: \"a64fb847-e2fd-4daf-be27-ec09ad6c7914\") "
Sep 16 12:10:17.161306 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:17.160998    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a64fb847-e2fd-4daf-be27-ec09ad6c7914-config-file\") pod \"a64fb847-e2fd-4daf-be27-ec09ad6c7914\" (UID: \"a64fb847-e2fd-4daf-be27-ec09ad6c7914\") "
Sep 16 12:10:17.161405 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:17.161382    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a64fb847-e2fd-4daf-be27-ec09ad6c7914-config-file" (OuterVolumeSpecName: "config-file") pod "a64fb847-e2fd-4daf-be27-ec09ad6c7914" (UID: "a64fb847-e2fd-4daf-be27-ec09ad6c7914"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:10:17.163127 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:17.163108    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a64fb847-e2fd-4daf-be27-ec09ad6c7914-kube-api-access-dj527" (OuterVolumeSpecName: "kube-api-access-dj527") pod "a64fb847-e2fd-4daf-be27-ec09ad6c7914" (UID: "a64fb847-e2fd-4daf-be27-ec09ad6c7914"). InnerVolumeSpecName "kube-api-access-dj527". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:10:17.262461 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:17.262381    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dj527\" (UniqueName: \"kubernetes.io/projected/a64fb847-e2fd-4daf-be27-ec09ad6c7914-kube-api-access-dj527\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:10:17.262461 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:17.262415    2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a64fb847-e2fd-4daf-be27-ec09ad6c7914-config-file\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:10:17.720246 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:17.720218    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-f6nn8"
Sep 16 12:10:17.720246 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:17.720235    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-f6nn8" event={"ID":"a64fb847-e2fd-4daf-be27-ec09ad6c7914","Type":"ContainerDied","Data":"531e32b538fad53b6bf25397ea84cbd28fd79d6fbe05c10ff4780d8470bda592"}
Sep 16 12:10:17.720498 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:17.720300    2576 scope.go:117] "RemoveContainer" containerID="7c11058ff40bb40bb43f2fbb0988bde235ff68d5c06f209a1d286a9f06b34097"
Sep 16 12:10:17.740888 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:17.740858    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-f6nn8"]
Sep 16 12:10:17.742637 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:17.742618    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-f6nn8"]
Sep 16 12:10:18.393428 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:18.393394    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a64fb847-e2fd-4daf-be27-ec09ad6c7914" path="/var/lib/kubelet/pods/a64fb847-e2fd-4daf-be27-ec09ad6c7914/volumes"
Sep 16 12:10:18.649426 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:18.649347    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rs4mt"]
Sep 16 12:10:18.649773 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:18.649759    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a64fb847-e2fd-4daf-be27-ec09ad6c7914" containerName="limitador"
Sep 16 12:10:18.649818 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:18.649775    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a64fb847-e2fd-4daf-be27-ec09ad6c7914" containerName="limitador"
Sep 16 12:10:18.649864 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:18.649855    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a64fb847-e2fd-4daf-be27-ec09ad6c7914" containerName="limitador"
Sep 16 12:10:18.654193 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:18.654176    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rs4mt"
Sep 16 12:10:18.657382 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:18.657363    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 16 12:10:18.658062 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:18.658044    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 16 12:10:18.658359 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:18.658342    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 12:10:18.658467 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:18.658348    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-48wr2\""
Sep 16 12:10:18.661074 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:18.661023    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rs4mt"]
Sep 16 12:10:18.776713 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:18.776684    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5e3af338-dccc-40fc-abcb-b0ccd1be4e19-data\") pod \"postgres-69fb4594cf-rs4mt\" (UID: \"5e3af338-dccc-40fc-abcb-b0ccd1be4e19\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rs4mt"
Sep 16 12:10:18.776852 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:18.776770    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djstr\" (UniqueName: \"kubernetes.io/projected/5e3af338-dccc-40fc-abcb-b0ccd1be4e19-kube-api-access-djstr\") pod \"postgres-69fb4594cf-rs4mt\" (UID: \"5e3af338-dccc-40fc-abcb-b0ccd1be4e19\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rs4mt"
Sep 16 12:10:18.877331 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:18.877292    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5e3af338-dccc-40fc-abcb-b0ccd1be4e19-data\") pod \"postgres-69fb4594cf-rs4mt\" (UID: \"5e3af338-dccc-40fc-abcb-b0ccd1be4e19\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rs4mt"
Sep 16 12:10:18.877477 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:18.877368    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djstr\" (UniqueName: \"kubernetes.io/projected/5e3af338-dccc-40fc-abcb-b0ccd1be4e19-kube-api-access-djstr\") pod \"postgres-69fb4594cf-rs4mt\" (UID: \"5e3af338-dccc-40fc-abcb-b0ccd1be4e19\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rs4mt"
Sep 16 12:10:18.877653 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:18.877635    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5e3af338-dccc-40fc-abcb-b0ccd1be4e19-data\") pod \"postgres-69fb4594cf-rs4mt\" (UID: \"5e3af338-dccc-40fc-abcb-b0ccd1be4e19\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rs4mt"
Sep 16 12:10:18.885533 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:18.885509    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djstr\" (UniqueName: \"kubernetes.io/projected/5e3af338-dccc-40fc-abcb-b0ccd1be4e19-kube-api-access-djstr\") pod \"postgres-69fb4594cf-rs4mt\" (UID: \"5e3af338-dccc-40fc-abcb-b0ccd1be4e19\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rs4mt"
Sep 16 12:10:18.965543 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:18.965467    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rs4mt"
Sep 16 12:10:19.234790 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:19.234767    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rs4mt"]
Sep 16 12:10:19.236589 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:10:19.236562    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e3af338_dccc_40fc_abcb_b0ccd1be4e19.slice/crio-68fb4dcbc8d8f945d3e1eb5f75d8e18916e05a6aaaae9f1db25d8fa5ad93fe38 WatchSource:0}: Error finding container 68fb4dcbc8d8f945d3e1eb5f75d8e18916e05a6aaaae9f1db25d8fa5ad93fe38: Status 404 returned error can't find the container with id 68fb4dcbc8d8f945d3e1eb5f75d8e18916e05a6aaaae9f1db25d8fa5ad93fe38
Sep 16 12:10:19.734960 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:19.734922    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rs4mt" event={"ID":"5e3af338-dccc-40fc-abcb-b0ccd1be4e19","Type":"ContainerStarted","Data":"68fb4dcbc8d8f945d3e1eb5f75d8e18916e05a6aaaae9f1db25d8fa5ad93fe38"}
Sep 16 12:10:24.766276 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:24.766243    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rs4mt" event={"ID":"5e3af338-dccc-40fc-abcb-b0ccd1be4e19","Type":"ContainerStarted","Data":"a2024313e479e980185cc9eae3f9ad84a768ec17b9885aa900dfbd67a30df90a"}
Sep 16 12:10:24.766702 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:24.766369    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rs4mt"
Sep 16 12:10:24.783136 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:24.783091    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rs4mt" podStartSLOduration=1.8352267740000001 podStartE2EDuration="6.783076055s" totalImagesPullingTime="4.947849281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:10:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:10:24.781271629 +0000 UTC m=+490.950236336" watchObservedRunningTime="2026-09-16 12:10:24.783076055 +0000 UTC m=+490.952040789"
Sep 16 12:10:30.800611 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:30.800579    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rs4mt"
Sep 16 12:10:38.497276 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:38.497238    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d8575c494-2t7ph"]
Sep 16 12:10:38.500861 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:38.500845    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d8575c494-2t7ph"
Sep 16 12:10:38.502985 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:38.502960    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 16 12:10:38.504005 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:38.503983    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 16 12:10:38.504005 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:38.503999    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ddsz6\""
Sep 16 12:10:38.504153 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:38.504017    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 16 12:10:38.509778 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:38.509758    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d8575c494-2t7ph"]
Sep 16 12:10:38.559826 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:38.559796    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4pnb\" (UniqueName: \"kubernetes.io/projected/8553286a-bc85-4353-8ee9-fcda8c49dad4-kube-api-access-h4pnb\") pod \"maas-controller-d8575c494-2t7ph\" (UID: \"8553286a-bc85-4353-8ee9-fcda8c49dad4\") " pod="opendatahub/maas-controller-d8575c494-2t7ph"
Sep 16 12:10:38.559971 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:38.559885    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8553286a-bc85-4353-8ee9-fcda8c49dad4-webhook-cert\") pod \"maas-controller-d8575c494-2t7ph\" (UID: \"8553286a-bc85-4353-8ee9-fcda8c49dad4\") " pod="opendatahub/maas-controller-d8575c494-2t7ph"
Sep 16 12:10:38.559971 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:38.559904    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8553286a-bc85-4353-8ee9-fcda8c49dad4-metrics-certs\") pod \"maas-controller-d8575c494-2t7ph\" (UID: \"8553286a-bc85-4353-8ee9-fcda8c49dad4\") " pod="opendatahub/maas-controller-d8575c494-2t7ph"
Sep 16 12:10:38.660678 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:38.660648    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8553286a-bc85-4353-8ee9-fcda8c49dad4-webhook-cert\") pod \"maas-controller-d8575c494-2t7ph\" (UID: \"8553286a-bc85-4353-8ee9-fcda8c49dad4\") " pod="opendatahub/maas-controller-d8575c494-2t7ph"
Sep 16 12:10:38.660678 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:38.660678    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8553286a-bc85-4353-8ee9-fcda8c49dad4-metrics-certs\") pod \"maas-controller-d8575c494-2t7ph\" (UID: \"8553286a-bc85-4353-8ee9-fcda8c49dad4\") " pod="opendatahub/maas-controller-d8575c494-2t7ph"
Sep 16 12:10:38.660873 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:38.660709    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4pnb\" (UniqueName: \"kubernetes.io/projected/8553286a-bc85-4353-8ee9-fcda8c49dad4-kube-api-access-h4pnb\") pod \"maas-controller-d8575c494-2t7ph\" (UID: \"8553286a-bc85-4353-8ee9-fcda8c49dad4\") " pod="opendatahub/maas-controller-d8575c494-2t7ph"
Sep 16 12:10:38.663409 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:38.663379    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8553286a-bc85-4353-8ee9-fcda8c49dad4-webhook-cert\") pod \"maas-controller-d8575c494-2t7ph\" (UID: \"8553286a-bc85-4353-8ee9-fcda8c49dad4\") " pod="opendatahub/maas-controller-d8575c494-2t7ph"
Sep 16 12:10:38.663515 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:38.663412    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8553286a-bc85-4353-8ee9-fcda8c49dad4-metrics-certs\") pod \"maas-controller-d8575c494-2t7ph\" (UID: \"8553286a-bc85-4353-8ee9-fcda8c49dad4\") " pod="opendatahub/maas-controller-d8575c494-2t7ph"
Sep 16 12:10:38.667802 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:38.667779    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4pnb\" (UniqueName: \"kubernetes.io/projected/8553286a-bc85-4353-8ee9-fcda8c49dad4-kube-api-access-h4pnb\") pod \"maas-controller-d8575c494-2t7ph\" (UID: \"8553286a-bc85-4353-8ee9-fcda8c49dad4\") " pod="opendatahub/maas-controller-d8575c494-2t7ph"
Sep 16 12:10:38.812233 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:38.812150    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d8575c494-2t7ph"
Sep 16 12:10:39.083520 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:39.083491    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d8575c494-2t7ph"]
Sep 16 12:10:39.085213 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:10:39.085185    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8553286a_bc85_4353_8ee9_fcda8c49dad4.slice/crio-aebce5057931d3575ec7697dea8461af0c6522318323c61e74e443e5f27f6df1 WatchSource:0}: Error finding container aebce5057931d3575ec7697dea8461af0c6522318323c61e74e443e5f27f6df1: Status 404 returned error can't find the container with id aebce5057931d3575ec7697dea8461af0c6522318323c61e74e443e5f27f6df1
Sep 16 12:10:39.840390 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:39.840349    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d8575c494-2t7ph" event={"ID":"8553286a-bc85-4353-8ee9-fcda8c49dad4","Type":"ContainerStarted","Data":"aebce5057931d3575ec7697dea8461af0c6522318323c61e74e443e5f27f6df1"}
Sep 16 12:10:42.859970 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:42.859936    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d8575c494-2t7ph" event={"ID":"8553286a-bc85-4353-8ee9-fcda8c49dad4","Type":"ContainerStarted","Data":"7ed2d362f4477ce5511e0581790dff54ae9e7a39978fc2ff696cdec8ebbdf3e0"}
Sep 16 12:10:42.860374 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:42.860070    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d8575c494-2t7ph"
Sep 16 12:10:42.877361 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:42.877299    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d8575c494-2t7ph" podStartSLOduration=1.914816383 podStartE2EDuration="4.877285292s" totalImagesPullingTime="2.962468909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:10:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:10:42.875801791 +0000 UTC m=+509.044766499" watchObservedRunningTime="2026-09-16 12:10:42.877285292 +0000 UTC m=+509.046250025"
Sep 16 12:10:53.868555 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:10:53.868529    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d8575c494-2t7ph"
Sep 16 12:11:16.659082 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:16.659047    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-4hfft"]
Sep 16 12:11:16.667270 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:16.667248    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4hfft"
Sep 16 12:11:16.669855 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:16.669825    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 16 12:11:16.669988 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:16.669962    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kqt6f\""
Sep 16 12:11:16.675973 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:16.675952    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-4hfft"]
Sep 16 12:11:16.688504 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:16.688479    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-pgdkq"]
Sep 16 12:11:16.692347 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:16.692291    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-pgdkq"
Sep 16 12:11:16.701742 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:16.701720    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-pgdkq"]
Sep 16 12:11:16.723157 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:16.723126    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhtcw\" (UniqueName: \"kubernetes.io/projected/b34262c2-533f-4c3b-b82f-f52f256fbaec-kube-api-access-nhtcw\") pod \"payload-processing-5b54b7fbb7-pgdkq\" (UID: \"b34262c2-533f-4c3b-b82f-f52f256fbaec\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pgdkq"
Sep 16 12:11:16.723310 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:16.723166    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40cd11db-3c75-4f28-aba7-caee4cd3d952-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-4hfft\" (UID: \"40cd11db-3c75-4f28-aba7-caee4cd3d952\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4hfft"
Sep 16 12:11:16.723310 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:16.723217    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b34262c2-533f-4c3b-b82f-f52f256fbaec-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-pgdkq\" (UID: \"b34262c2-533f-4c3b-b82f-f52f256fbaec\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pgdkq"
Sep 16 12:11:16.723310 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:16.723258    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bwng\" (UniqueName: \"kubernetes.io/projected/40cd11db-3c75-4f28-aba7-caee4cd3d952-kube-api-access-5bwng\") pod \"payload-pre-processing-59fbc47bf8-4hfft\" (UID: \"40cd11db-3c75-4f28-aba7-caee4cd3d952\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4hfft"
Sep 16 12:11:16.823845 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:16.823800    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhtcw\" (UniqueName: \"kubernetes.io/projected/b34262c2-533f-4c3b-b82f-f52f256fbaec-kube-api-access-nhtcw\") pod \"payload-processing-5b54b7fbb7-pgdkq\" (UID: \"b34262c2-533f-4c3b-b82f-f52f256fbaec\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pgdkq"
Sep 16 12:11:16.823845 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:16.823854    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40cd11db-3c75-4f28-aba7-caee4cd3d952-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-4hfft\" (UID: \"40cd11db-3c75-4f28-aba7-caee4cd3d952\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4hfft"
Sep 16 12:11:16.824105 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:16.823885    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b34262c2-533f-4c3b-b82f-f52f256fbaec-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-pgdkq\" (UID: \"b34262c2-533f-4c3b-b82f-f52f256fbaec\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pgdkq"
Sep 16 12:11:16.824105 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:16.823912    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bwng\" (UniqueName: \"kubernetes.io/projected/40cd11db-3c75-4f28-aba7-caee4cd3d952-kube-api-access-5bwng\") pod \"payload-pre-processing-59fbc47bf8-4hfft\" (UID: \"40cd11db-3c75-4f28-aba7-caee4cd3d952\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4hfft"
Sep 16 12:11:16.824762 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:16.824738    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b34262c2-533f-4c3b-b82f-f52f256fbaec-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-pgdkq\" (UID: \"b34262c2-533f-4c3b-b82f-f52f256fbaec\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pgdkq"
Sep 16 12:11:16.824918 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:16.824894    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40cd11db-3c75-4f28-aba7-caee4cd3d952-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-4hfft\" (UID: \"40cd11db-3c75-4f28-aba7-caee4cd3d952\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4hfft"
Sep 16 12:11:16.832404 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:16.832372    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bwng\" (UniqueName: \"kubernetes.io/projected/40cd11db-3c75-4f28-aba7-caee4cd3d952-kube-api-access-5bwng\") pod \"payload-pre-processing-59fbc47bf8-4hfft\" (UID: \"40cd11db-3c75-4f28-aba7-caee4cd3d952\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4hfft"
Sep 16 12:11:16.832542 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:16.832425    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhtcw\" (UniqueName: \"kubernetes.io/projected/b34262c2-533f-4c3b-b82f-f52f256fbaec-kube-api-access-nhtcw\") pod \"payload-processing-5b54b7fbb7-pgdkq\" (UID: \"b34262c2-533f-4c3b-b82f-f52f256fbaec\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pgdkq"
Sep 16 12:11:16.979240 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:16.979143    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4hfft"
Sep 16 12:11:17.003761 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:17.003735    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-pgdkq"
Sep 16 12:11:17.251847 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:17.251821    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-4hfft"]
Sep 16 12:11:17.254071 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:11:17.254034    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40cd11db_3c75_4f28_aba7_caee4cd3d952.slice/crio-f410a0cf32d49564b69ab597346d96e84466763bc80810bcf4f3e18e57e7309a WatchSource:0}: Error finding container f410a0cf32d49564b69ab597346d96e84466763bc80810bcf4f3e18e57e7309a: Status 404 returned error can't find the container with id f410a0cf32d49564b69ab597346d96e84466763bc80810bcf4f3e18e57e7309a
Sep 16 12:11:17.288104 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:17.288015    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-pgdkq"]
Sep 16 12:11:17.292275 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:11:17.292242    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb34262c2_533f_4c3b_b82f_f52f256fbaec.slice/crio-2b8a508996b6371a3b135723c34f6b789aac8b9ddd59503c57177531f87e734e WatchSource:0}: Error finding container 2b8a508996b6371a3b135723c34f6b789aac8b9ddd59503c57177531f87e734e: Status 404 returned error can't find the container with id 2b8a508996b6371a3b135723c34f6b789aac8b9ddd59503c57177531f87e734e
Sep 16 12:11:18.040860 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:18.040794    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4hfft" event={"ID":"40cd11db-3c75-4f28-aba7-caee4cd3d952","Type":"ContainerStarted","Data":"f410a0cf32d49564b69ab597346d96e84466763bc80810bcf4f3e18e57e7309a"}
Sep 16 12:11:18.043059 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:18.043030    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-pgdkq" event={"ID":"b34262c2-533f-4c3b-b82f-f52f256fbaec","Type":"ContainerStarted","Data":"2b8a508996b6371a3b135723c34f6b789aac8b9ddd59503c57177531f87e734e"}
Sep 16 12:11:19.052093 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:19.052051    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-pgdkq" event={"ID":"b34262c2-533f-4c3b-b82f-f52f256fbaec","Type":"ContainerStarted","Data":"983b7671b9e9362eaa35fb4cb3e3a56d500ce288516284d1366e3dfa37ff80cd"}
Sep 16 12:11:19.052458 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:19.052378    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-pgdkq"
Sep 16 12:11:19.054159 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:19.054092    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4hfft" event={"ID":"40cd11db-3c75-4f28-aba7-caee4cd3d952","Type":"ContainerStarted","Data":"9915e46f841dde1fbbad4a5028bf9d81c40e47a6f2c51800dc34d2ec161d6b3e"}
Sep 16 12:11:19.054348 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:19.054303    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4hfft"
Sep 16 12:11:19.070365 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:19.070276    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-pgdkq" podStartSLOduration=1.434564226 podStartE2EDuration="3.070262838s" totalImagesPullingTime="1.635698612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:11:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:11:19.067890231 +0000 UTC m=+545.236854939" watchObservedRunningTime="2026-09-16 12:11:19.070262838 +0000 UTC m=+545.239227545"
Sep 16 12:11:19.083394 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:19.083343    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4hfft" podStartSLOduration=1.405951221 podStartE2EDuration="3.083302994s" totalImagesPullingTime="1.677351773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:11:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:11:19.081861519 +0000 UTC m=+545.250826239" watchObservedRunningTime="2026-09-16 12:11:19.083302994 +0000 UTC m=+545.252267729"
Sep 16 12:11:26.091215 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:26.091127    2576 generic.go:356] "Generic (PLEG): container finished" podID="f8ca5c0e-e21e-432c-8e61-d18e876bb904" containerID="fc6360d4b502be5791b5ba0d4e9753d59fd21055857d2f6e07df3c7d25cb0c2f" exitCode=0
Sep 16 12:11:26.091640 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:26.091209    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn" event={"ID":"f8ca5c0e-e21e-432c-8e61-d18e876bb904","Type":"ContainerDied","Data":"fc6360d4b502be5791b5ba0d4e9753d59fd21055857d2f6e07df3c7d25cb0c2f"}
Sep 16 12:11:26.091640 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:26.091624    2576 scope.go:117] "RemoveContainer" containerID="fc6360d4b502be5791b5ba0d4e9753d59fd21055857d2f6e07df3c7d25cb0c2f"
Sep 16 12:11:26.092694 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:26.092668    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:11:26.092761 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:26.092740    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:11:26.092798 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:26.092770    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:11:27.101706 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:27.101661    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn" event={"ID":"f8ca5c0e-e21e-432c-8e61-d18e876bb904","Type":"ContainerStarted","Data":"e1da7e614144858bc0a32e74d9ab95a8074744c2f0f2567807f6d89804db518e"}
Sep 16 12:11:27.279377 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:27.279339    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:11:27.279544 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:27.279527    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-xtdcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 16 12:11:27.279595 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:27.279572    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn" podUID="f8ca5c0e-e21e-432c-8e61-d18e876bb904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 16 12:11:28.279611 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:28.279574    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-xtdcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 16 12:11:28.280027 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:28.279625    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn" podUID="f8ca5c0e-e21e-432c-8e61-d18e876bb904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 16 12:11:29.279518 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:29.279481    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-xtdcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 16 12:11:29.279712 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:29.279547    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn" podUID="f8ca5c0e-e21e-432c-8e61-d18e876bb904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 16 12:11:30.061783 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:30.061752    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-4hfft"
Sep 16 12:11:30.061956 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:30.061827    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-pgdkq"
Sep 16 12:11:30.279708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:30.279668    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-xtdcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 16 12:11:30.280098 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:30.279720    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn" podUID="f8ca5c0e-e21e-432c-8e61-d18e876bb904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 16 12:11:31.279753 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:31.279717    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-xtdcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 16 12:11:31.280148 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:31.279782    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn" podUID="f8ca5c0e-e21e-432c-8e61-d18e876bb904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 16 12:11:32.279229 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:32.279182    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-xtdcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 16 12:11:32.279422 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:32.279259    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn" podUID="f8ca5c0e-e21e-432c-8e61-d18e876bb904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 16 12:11:33.283188 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:33.283153    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:11:33.283600 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:33.283428    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:11:33.284030 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:33.284010    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xtdcn"
Sep 16 12:11:47.951558 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:47.951522    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"]
Sep 16 12:11:47.955595 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:47.955575    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"
Sep 16 12:11:47.959367 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:47.959342    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5j28l\""
Sep 16 12:11:47.959367 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:47.959354    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 16 12:11:47.959560 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:47.959362    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 16 12:11:47.959560 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:47.959390    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 16 12:11:47.962903 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:47.962881    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"]
Sep 16 12:11:48.119514 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:48.119480    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zc45\" (UniqueName: \"kubernetes.io/projected/ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0-kube-api-access-6zc45\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v6s7k\" (UID: \"ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"
Sep 16 12:11:48.119701 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:48.119536    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v6s7k\" (UID: \"ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"
Sep 16 12:11:48.119701 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:48.119649    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v6s7k\" (UID: \"ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"
Sep 16 12:11:48.119701 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:48.119696    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v6s7k\" (UID: \"ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"
Sep 16 12:11:48.119951 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:48.119723    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v6s7k\" (UID: \"ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"
Sep 16 12:11:48.119951 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:48.119757    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v6s7k\" (UID: \"ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"
Sep 16 12:11:48.220524 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:48.220446    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v6s7k\" (UID: \"ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"
Sep 16 12:11:48.220524 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:48.220478    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v6s7k\" (UID: \"ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"
Sep 16 12:11:48.220524 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:48.220497    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v6s7k\" (UID: \"ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"
Sep 16 12:11:48.220784 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:48.220557    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zc45\" (UniqueName: \"kubernetes.io/projected/ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0-kube-api-access-6zc45\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v6s7k\" (UID: \"ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"
Sep 16 12:11:48.220784 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:48.220606    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v6s7k\" (UID: \"ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"
Sep 16 12:11:48.220784 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:48.220677    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v6s7k\" (UID: \"ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"
Sep 16 12:11:48.221560 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:48.220910    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v6s7k\" (UID: \"ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"
Sep 16 12:11:48.221560 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:48.221224    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v6s7k\" (UID: \"ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"
Sep 16 12:11:48.221560 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:48.221263    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v6s7k\" (UID: \"ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"
Sep 16 12:11:48.223889 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:48.223861    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v6s7k\" (UID: \"ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"
Sep 16 12:11:48.224284 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:48.224258    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v6s7k\" (UID: \"ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"
Sep 16 12:11:48.233393 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:48.233372    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zc45\" (UniqueName: \"kubernetes.io/projected/ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0-kube-api-access-6zc45\") pod \"e2e-distinct-simulated-kserve-59975d69f9-v6s7k\" (UID: \"ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"
Sep 16 12:11:48.267441 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:48.267410    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"
Sep 16 12:11:48.539050 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:48.539026    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"]
Sep 16 12:11:48.541603 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:11:48.541576    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae7bc84e_8a7b_4ab7_8b41_3847ef8d0ae0.slice/crio-a719024d24bf67eb0faae9e4e8de547c292ad67bc221ad8ac46197cbf0b31a4c WatchSource:0}: Error finding container a719024d24bf67eb0faae9e4e8de547c292ad67bc221ad8ac46197cbf0b31a4c: Status 404 returned error can't find the container with id a719024d24bf67eb0faae9e4e8de547c292ad67bc221ad8ac46197cbf0b31a4c
Sep 16 12:11:49.237700 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:49.237665    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k" event={"ID":"ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0","Type":"ContainerStarted","Data":"a719024d24bf67eb0faae9e4e8de547c292ad67bc221ad8ac46197cbf0b31a4c"}
Sep 16 12:11:50.245724 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:50.245688    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k" event={"ID":"ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0","Type":"ContainerStarted","Data":"d502b6971e7fa218d211602ee0c899447bb61dfb415b6a02eb33cc929e743533"}
Sep 16 12:11:50.264271 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:50.264225    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k" podStartSLOduration=2.219003584 podStartE2EDuration="3.264209688s" totalImagesPullingTime="1.045206104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:11:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:11:50.262227897 +0000 UTC m=+576.431192599" watchObservedRunningTime="2026-09-16 12:11:50.264209688 +0000 UTC m=+576.433174396"
Sep 16 12:11:58.267742 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:58.267711    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"
Sep 16 12:11:58.268154 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:58.267790    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"
Sep 16 12:11:58.280562 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:58.280539    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"
Sep 16 12:11:58.297088 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:11:58.297066    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-v6s7k"
Sep 16 12:12:14.308748 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:14.308718    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tb7dg_fb6b35a8-78d4-40b2-a087-7b45e92b2234/ovn-acl-logging/0.log"
Sep 16 12:12:14.312051 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:14.312019    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tb7dg_fb6b35a8-78d4-40b2-a087-7b45e92b2234/ovn-acl-logging/0.log"
Sep 16 12:12:14.438902 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:14.438869    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"]
Sep 16 12:12:14.442706 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:14.442683    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"
Sep 16 12:12:14.446620 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:14.445785    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 16 12:12:14.462033 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:14.462011    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"]
Sep 16 12:12:14.477839 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:14.477812    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faf4e17d-bf60-4677-bf01-baae88d52dff-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l\" (UID: \"faf4e17d-bf60-4677-bf01-baae88d52dff\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"
Sep 16 12:12:14.477970 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:14.477928    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faf4e17d-bf60-4677-bf01-baae88d52dff-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l\" (UID: \"faf4e17d-bf60-4677-bf01-baae88d52dff\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"
Sep 16 12:12:14.477970 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:14.477964    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faf4e17d-bf60-4677-bf01-baae88d52dff-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l\" (UID: \"faf4e17d-bf60-4677-bf01-baae88d52dff\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"
Sep 16 12:12:14.478104 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:14.478007    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6279h\" (UniqueName: \"kubernetes.io/projected/faf4e17d-bf60-4677-bf01-baae88d52dff-kube-api-access-6279h\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l\" (UID: \"faf4e17d-bf60-4677-bf01-baae88d52dff\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"
Sep 16 12:12:14.478104 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:14.478081    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faf4e17d-bf60-4677-bf01-baae88d52dff-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l\" (UID: \"faf4e17d-bf60-4677-bf01-baae88d52dff\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"
Sep 16 12:12:14.478192 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:14.478137    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faf4e17d-bf60-4677-bf01-baae88d52dff-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l\" (UID: \"faf4e17d-bf60-4677-bf01-baae88d52dff\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"
Sep 16 12:12:14.579088 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:14.579010    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faf4e17d-bf60-4677-bf01-baae88d52dff-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l\" (UID: \"faf4e17d-bf60-4677-bf01-baae88d52dff\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"
Sep 16 12:12:14.579088 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:14.579044    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faf4e17d-bf60-4677-bf01-baae88d52dff-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l\" (UID: \"faf4e17d-bf60-4677-bf01-baae88d52dff\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"
Sep 16 12:12:14.579088 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:14.579064    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6279h\" (UniqueName: \"kubernetes.io/projected/faf4e17d-bf60-4677-bf01-baae88d52dff-kube-api-access-6279h\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l\" (UID: \"faf4e17d-bf60-4677-bf01-baae88d52dff\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"
Sep 16 12:12:14.579403 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:14.579096    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faf4e17d-bf60-4677-bf01-baae88d52dff-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l\" (UID: \"faf4e17d-bf60-4677-bf01-baae88d52dff\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"
Sep 16 12:12:14.579403 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:14.579125    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faf4e17d-bf60-4677-bf01-baae88d52dff-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l\" (UID: \"faf4e17d-bf60-4677-bf01-baae88d52dff\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"
Sep 16 12:12:14.579403 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:14.579186    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faf4e17d-bf60-4677-bf01-baae88d52dff-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l\" (UID: \"faf4e17d-bf60-4677-bf01-baae88d52dff\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"
Sep 16 12:12:14.579553 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:14.579403    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faf4e17d-bf60-4677-bf01-baae88d52dff-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l\" (UID: \"faf4e17d-bf60-4677-bf01-baae88d52dff\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"
Sep 16 12:12:14.579553 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:14.579483    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faf4e17d-bf60-4677-bf01-baae88d52dff-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l\" (UID: \"faf4e17d-bf60-4677-bf01-baae88d52dff\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"
Sep 16 12:12:14.579623 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:14.579574    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faf4e17d-bf60-4677-bf01-baae88d52dff-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l\" (UID: \"faf4e17d-bf60-4677-bf01-baae88d52dff\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"
Sep 16 12:12:14.581616 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:14.581594    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faf4e17d-bf60-4677-bf01-baae88d52dff-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l\" (UID: \"faf4e17d-bf60-4677-bf01-baae88d52dff\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"
Sep 16 12:12:14.581749 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:14.581734    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faf4e17d-bf60-4677-bf01-baae88d52dff-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l\" (UID: \"faf4e17d-bf60-4677-bf01-baae88d52dff\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"
Sep 16 12:12:14.590184 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:14.590152    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6279h\" (UniqueName: \"kubernetes.io/projected/faf4e17d-bf60-4677-bf01-baae88d52dff-kube-api-access-6279h\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l\" (UID: \"faf4e17d-bf60-4677-bf01-baae88d52dff\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"
Sep 16 12:12:14.755590 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:14.755555    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"
Sep 16 12:12:15.034922 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:15.034898    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"]
Sep 16 12:12:15.037017 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:12:15.036986    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaf4e17d_bf60_4677_bf01_baae88d52dff.slice/crio-4e79ffea5edfaed2bd988b2706058aaf14cde3924bf2fe7ea7f662e2051d6046 WatchSource:0}: Error finding container 4e79ffea5edfaed2bd988b2706058aaf14cde3924bf2fe7ea7f662e2051d6046: Status 404 returned error can't find the container with id 4e79ffea5edfaed2bd988b2706058aaf14cde3924bf2fe7ea7f662e2051d6046
Sep 16 12:12:15.369889 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:15.369858    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l" event={"ID":"faf4e17d-bf60-4677-bf01-baae88d52dff","Type":"ContainerStarted","Data":"1324e8750a42796060eed6dc97405cf14b2dfdce4e81830bda8f843f5c8e72c9"}
Sep 16 12:12:15.370369 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:15.369910    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l" event={"ID":"faf4e17d-bf60-4677-bf01-baae88d52dff","Type":"ContainerStarted","Data":"4e79ffea5edfaed2bd988b2706058aaf14cde3924bf2fe7ea7f662e2051d6046"}
Sep 16 12:12:15.387463 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:15.387409    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l" podStartSLOduration=1.205426624 podStartE2EDuration="1.387391496s" totalImagesPullingTime="181.964872ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:12:15.386039329 +0000 UTC m=+601.555004050" watchObservedRunningTime="2026-09-16 12:12:15.387391496 +0000 UTC m=+601.556356203"
Sep 16 12:12:24.755954 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:24.755922    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"
Sep 16 12:12:24.756595 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:24.755993    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"
Sep 16 12:12:24.768682 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:24.768658    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"
Sep 16 12:12:25.442049 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:12:25.442022    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l"
Sep 16 12:14:06.325511 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.325431    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"]
Sep 16 12:14:06.329214 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.329190    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.331893 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.331873    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-556077-openshift-default-dockercfg-6vczz\""
Sep 16 12:14:06.341743 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.341717    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"]
Sep 16 12:14:06.398265 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.398234    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"]
Sep 16 12:14:06.402027 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.402006    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.404639 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.404619    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-ff057a-openshift-default-dockercfg-jgqz7\""
Sep 16 12:14:06.413276 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.413254    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"]
Sep 16 12:14:06.456155 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.456121    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-istio-envoy\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.456362 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.456166    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24ff1f9f-5599-445c-9aff-46d84155f985-istio-podinfo\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.456362 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.456204    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-istio-data\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.456362 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.456269    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-workload-certs\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.456362 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.456304    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwd5x\" (UniqueName: \"kubernetes.io/projected/24ff1f9f-5599-445c-9aff-46d84155f985-kube-api-access-qwd5x\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.456362 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.456352    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-workload-socket\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.456577 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.456487    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24ff1f9f-5599-445c-9aff-46d84155f985-istiod-ca-cert\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.456577 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.456541    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35be3a8f-570c-4921-a90c-3195445dff07-istio-podinfo\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.456577 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.456570    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-credential-socket\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.456694 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.456596    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59lpj\" (UniqueName: \"kubernetes.io/projected/35be3a8f-570c-4921-a90c-3195445dff07-kube-api-access-59lpj\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.456732 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.456693    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24ff1f9f-5599-445c-9aff-46d84155f985-istio-token\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.456776 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.456731    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-workload-socket\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.456812 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.456783    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35be3a8f-570c-4921-a90c-3195445dff07-istio-token\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.456846 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.456811    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35be3a8f-570c-4921-a90c-3195445dff07-istiod-ca-cert\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.456891 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.456850    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-istio-data\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.456932 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.456894    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-istio-envoy\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.456979 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.456927    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-credential-socket\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.456979 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.456955    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-workload-certs\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.477688 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.477655    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"]
Sep 16 12:14:06.482051 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.482028    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.484650 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.484616    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-641983-openshift-default-dockercfg-qnrrk\""
Sep 16 12:14:06.493880 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.493858    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"]
Sep 16 12:14:06.558255 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.558220    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-workload-certs\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.558493 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.558261    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwd5x\" (UniqueName: \"kubernetes.io/projected/24ff1f9f-5599-445c-9aff-46d84155f985-kube-api-access-qwd5x\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.558493 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.558398    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-workload-socket\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.558493 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.558451    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istio-token\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.558493 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.558483    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istio-envoy\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.558766 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.558569    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-workload-certs\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.558766 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.558617    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24ff1f9f-5599-445c-9aff-46d84155f985-istiod-ca-cert\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.558766 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.558657    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35be3a8f-570c-4921-a90c-3195445dff07-istio-podinfo\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.558766 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.558687    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-workload-certs\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.558766 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.558689    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-credential-socket\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.558766 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.558742    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59lpj\" (UniqueName: \"kubernetes.io/projected/35be3a8f-570c-4921-a90c-3195445dff07-kube-api-access-59lpj\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.559200 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.558689    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-workload-socket\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.559200 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.558773    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istio-podinfo\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.559200 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.558848    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24ff1f9f-5599-445c-9aff-46d84155f985-istio-token\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.559200 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.558883    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-workload-socket\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.559200 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.558922    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35be3a8f-570c-4921-a90c-3195445dff07-istio-token\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.559200 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.558953    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35be3a8f-570c-4921-a90c-3195445dff07-istiod-ca-cert\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.559200 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.558977    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istiod-ca-cert\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.559200 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.559030    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-istio-data\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.559200 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.559059    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-credential-socket\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.559200 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.559083    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-credential-socket\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.559200 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.559105    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-istio-envoy\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.559200 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.559138    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istio-data\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.559200 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.559172    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qghxr\" (UniqueName: \"kubernetes.io/projected/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-kube-api-access-qghxr\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.559200 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.559203    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-credential-socket\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.559959 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.559232    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-workload-certs\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.559959 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.559282    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-istio-envoy\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.559959 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.559353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24ff1f9f-5599-445c-9aff-46d84155f985-istio-podinfo\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.559959 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.559359    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24ff1f9f-5599-445c-9aff-46d84155f985-istiod-ca-cert\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.559959 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.559392    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-istio-data\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.559959 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.559439    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-workload-socket\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.559959 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.559523    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-workload-socket\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.559959 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.559927    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-istio-data\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.560420 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.560012    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-credential-socket\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.560420 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.560387    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35be3a8f-570c-4921-a90c-3195445dff07-istiod-ca-cert\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.560986 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.560862    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-istio-data\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.562185 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.562166    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-workload-certs\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.563696 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.563104    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24ff1f9f-5599-445c-9aff-46d84155f985-istio-podinfo\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.564050 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.563879    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35be3a8f-570c-4921-a90c-3195445dff07-istio-podinfo\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.564050 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.563914    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-istio-envoy\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.564050 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.563994    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-istio-envoy\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.570013 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.569980    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24ff1f9f-5599-445c-9aff-46d84155f985-istio-token\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.570127 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.570108    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59lpj\" (UniqueName: \"kubernetes.io/projected/35be3a8f-570c-4921-a90c-3195445dff07-kube-api-access-59lpj\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.570380 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.570359    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35be3a8f-570c-4921-a90c-3195445dff07-istio-token\") pod \"e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") " pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.570506 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.570491    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwd5x\" (UniqueName: \"kubernetes.io/projected/24ff1f9f-5599-445c-9aff-46d84155f985-kube-api-access-qwd5x\") pod \"e2e-worker-w4-556077-openshift-default-58b9874496-nb486\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") " pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.640543 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.640517    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:06.666528 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.661212    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-credential-socket\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.666528 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.661472    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istio-data\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.666528 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.661512    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qghxr\" (UniqueName: \"kubernetes.io/projected/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-kube-api-access-qghxr\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.666528 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.661583    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-workload-socket\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.666528 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.661659    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istio-token\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.666528 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.661682    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istio-envoy\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.666528 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.661724    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-workload-certs\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.666528 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.661774    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istio-podinfo\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.666528 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.661843    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istiod-ca-cert\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.666528 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.662454    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-workload-socket\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.666528 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.662739    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istiod-ca-cert\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.666528 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.662833    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istio-data\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.666528 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.663288    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-credential-socket\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.666528 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.663454    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-workload-certs\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.666528 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.666467    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istio-envoy\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.667485 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.666894    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istio-podinfo\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.672184 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.672128    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qghxr\" (UniqueName: \"kubernetes.io/projected/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-kube-api-access-qghxr\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.674108 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.674064    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istio-token\") pod \"e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") " pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.716417 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.716177    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:06.795658 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.795628    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:06.930809 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.930783    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"]
Sep 16 12:14:06.932125 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:14:06.932098    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24ff1f9f_5599_445c_9aff_46d84155f985.slice/crio-8c062e727c5f7e947fcb2d32afa1b82e38fb7789a910539b1747092d5c7a3717 WatchSource:0}: Error finding container 8c062e727c5f7e947fcb2d32afa1b82e38fb7789a910539b1747092d5c7a3717: Status 404 returned error can't find the container with id 8c062e727c5f7e947fcb2d32afa1b82e38fb7789a910539b1747092d5c7a3717
Sep 16 12:14:06.934387 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.934350    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:14:06.934495 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.934424    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:14:06.934495 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.934464    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:14:06.960736 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.960714    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486" event={"ID":"24ff1f9f-5599-445c-9aff-46d84155f985","Type":"ContainerStarted","Data":"8c062e727c5f7e947fcb2d32afa1b82e38fb7789a910539b1747092d5c7a3717"}
Sep 16 12:14:06.997597 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:06.997568    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"]
Sep 16 12:14:07.000761 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:14:07.000733    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35be3a8f_570c_4921_a90c_3195445dff07.slice/crio-ef056fbff44a5b5abb2478c05d7627c827a81dced815adfed9cf018cc50bb8ce WatchSource:0}: Error finding container ef056fbff44a5b5abb2478c05d7627c827a81dced815adfed9cf018cc50bb8ce: Status 404 returned error can't find the container with id ef056fbff44a5b5abb2478c05d7627c827a81dced815adfed9cf018cc50bb8ce
Sep 16 12:14:07.002914 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:07.002885    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:14:07.003031 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:07.002959    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:14:07.003031 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:07.003004    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:14:07.074358 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:07.074329    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"]
Sep 16 12:14:07.075942 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:14:07.075912    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9e8c1b0_66b9_4230_b489_bc5d5712a8c7.slice/crio-ee3ef0ca2a85fdf39f9d2f464a8c70a62f6e967eaadd28a7adfe55eb38d1b357 WatchSource:0}: Error finding container ee3ef0ca2a85fdf39f9d2f464a8c70a62f6e967eaadd28a7adfe55eb38d1b357: Status 404 returned error can't find the container with id ee3ef0ca2a85fdf39f9d2f464a8c70a62f6e967eaadd28a7adfe55eb38d1b357
Sep 16 12:14:07.078787 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:07.078754    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:14:07.078872 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:07.078832    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:14:07.078913 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:07.078871    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:14:07.967861 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:07.967825    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt" event={"ID":"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7","Type":"ContainerStarted","Data":"53c98440d3fed79339fcb7039dad103690acc0856a2e31df6b7c6cc2b0db6a61"}
Sep 16 12:14:07.968291 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:07.967885    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt" event={"ID":"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7","Type":"ContainerStarted","Data":"ee3ef0ca2a85fdf39f9d2f464a8c70a62f6e967eaadd28a7adfe55eb38d1b357"}
Sep 16 12:14:07.969540 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:07.969507    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz" event={"ID":"35be3a8f-570c-4921-a90c-3195445dff07","Type":"ContainerStarted","Data":"c98f28fc0cc6d94aac56497af5b313940371c6dbbad46b1d675e692ad8e23dec"}
Sep 16 12:14:07.969664 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:07.969574    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz" event={"ID":"35be3a8f-570c-4921-a90c-3195445dff07","Type":"ContainerStarted","Data":"ef056fbff44a5b5abb2478c05d7627c827a81dced815adfed9cf018cc50bb8ce"}
Sep 16 12:14:07.978109 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:07.971427    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486" event={"ID":"24ff1f9f-5599-445c-9aff-46d84155f985","Type":"ContainerStarted","Data":"122b2cb1788a572f9e8f8d175dbc33c7955c37b4a22d02b887e4e7541ede30e8"}
Sep 16 12:14:07.998261 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:07.998208    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt" podStartSLOduration=1.998193418 podStartE2EDuration="1.998193418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:14:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:14:07.995680653 +0000 UTC m=+714.164645361" watchObservedRunningTime="2026-09-16 12:14:07.998193418 +0000 UTC m=+714.167158124"
Sep 16 12:14:08.019559 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:08.019511    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz" podStartSLOduration=2.019497 podStartE2EDuration="2.019497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:14:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:14:08.016850825 +0000 UTC m=+714.185815533" watchObservedRunningTime="2026-09-16 12:14:08.019497 +0000 UTC m=+714.188461706"
Sep 16 12:14:08.040648 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:08.040603    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486" podStartSLOduration=2.040588647 podStartE2EDuration="2.040588647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:14:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:14:08.038840912 +0000 UTC m=+714.207805632" watchObservedRunningTime="2026-09-16 12:14:08.040588647 +0000 UTC m=+714.209553354"
Sep 16 12:14:08.641412 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:08.641369    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:08.647042 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:08.647018    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:08.716910 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:08.716874    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:08.721811 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:08.721788    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:08.796770 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:08.796735    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:08.802081 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:08.802055    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:08.977624 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:08.977527    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:08.978068 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:08.977946    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:08.978068 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:08.977991    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:08.978398 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:08.978376    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:08.978510 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:08.978433    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:08.978510 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:08.978471    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:12.333975 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:12.333942    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs"]
Sep 16 12:14:12.338215 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:12.338189    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs"
Sep 16 12:14:12.340850 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:12.340822    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-641983-dockercfg-pnv5l\""
Sep 16 12:14:12.341004 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:12.340936    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-641983\""
Sep 16 12:14:12.346926 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:12.346900    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs"]
Sep 16 12:14:12.427042 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:12.427012    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7ebde485-25be-49fc-b980-9730767fa52b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs\" (UID: \"7ebde485-25be-49fc-b980-9730767fa52b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs"
Sep 16 12:14:12.427230 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:12.427156    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mktv9\" (UniqueName: \"kubernetes.io/projected/7ebde485-25be-49fc-b980-9730767fa52b-kube-api-access-mktv9\") pod \"payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs\" (UID: \"7ebde485-25be-49fc-b980-9730767fa52b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs"
Sep 16 12:14:12.528270 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:12.528234    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7ebde485-25be-49fc-b980-9730767fa52b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs\" (UID: \"7ebde485-25be-49fc-b980-9730767fa52b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs"
Sep 16 12:14:12.528467 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:12.528400    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mktv9\" (UniqueName: \"kubernetes.io/projected/7ebde485-25be-49fc-b980-9730767fa52b-kube-api-access-mktv9\") pod \"payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs\" (UID: \"7ebde485-25be-49fc-b980-9730767fa52b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs"
Sep 16 12:14:12.528955 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:12.528937    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7ebde485-25be-49fc-b980-9730767fa52b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs\" (UID: \"7ebde485-25be-49fc-b980-9730767fa52b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs"
Sep 16 12:14:12.537032 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:12.537007    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mktv9\" (UniqueName: \"kubernetes.io/projected/7ebde485-25be-49fc-b980-9730767fa52b-kube-api-access-mktv9\") pod \"payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs\" (UID: \"7ebde485-25be-49fc-b980-9730767fa52b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs"
Sep 16 12:14:12.653009 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:12.652976    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs"
Sep 16 12:14:12.956584 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:12.956559    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs"]
Sep 16 12:14:12.958830 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:14:12.958793    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ebde485_25be_49fc_b980_9730767fa52b.slice/crio-11dc489497a58d371e9ce4ea2c36924960c154c31cb34a4fe82efc968ed70b56 WatchSource:0}: Error finding container 11dc489497a58d371e9ce4ea2c36924960c154c31cb34a4fe82efc968ed70b56: Status 404 returned error can't find the container with id 11dc489497a58d371e9ce4ea2c36924960c154c31cb34a4fe82efc968ed70b56
Sep 16 12:14:13.002729 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:13.002699    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs" event={"ID":"7ebde485-25be-49fc-b980-9730767fa52b","Type":"ContainerStarted","Data":"11dc489497a58d371e9ce4ea2c36924960c154c31cb34a4fe82efc968ed70b56"}
Sep 16 12:14:13.405280 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:13.405240    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5"]
Sep 16 12:14:13.409782 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:13.409758    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5"
Sep 16 12:14:13.418042 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:13.418018    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-556077\""
Sep 16 12:14:13.418373 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:13.418357    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-556077-dockercfg-whlcg\""
Sep 16 12:14:13.476859 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:13.476824    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5"]
Sep 16 12:14:13.541222 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:13.541050    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcwrf\" (UniqueName: \"kubernetes.io/projected/5202f93f-3683-475c-81ee-4c9ad642c1e0-kube-api-access-mcwrf\") pod \"payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5\" (UID: \"5202f93f-3683-475c-81ee-4c9ad642c1e0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5"
Sep 16 12:14:13.541222 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:13.541102    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5202f93f-3683-475c-81ee-4c9ad642c1e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5\" (UID: \"5202f93f-3683-475c-81ee-4c9ad642c1e0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5"
Sep 16 12:14:13.642495 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:13.642459    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcwrf\" (UniqueName: \"kubernetes.io/projected/5202f93f-3683-475c-81ee-4c9ad642c1e0-kube-api-access-mcwrf\") pod \"payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5\" (UID: \"5202f93f-3683-475c-81ee-4c9ad642c1e0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5"
Sep 16 12:14:13.642495 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:13.642511    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5202f93f-3683-475c-81ee-4c9ad642c1e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5\" (UID: \"5202f93f-3683-475c-81ee-4c9ad642c1e0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5"
Sep 16 12:14:13.643345 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:13.643300    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5202f93f-3683-475c-81ee-4c9ad642c1e0-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5\" (UID: \"5202f93f-3683-475c-81ee-4c9ad642c1e0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5"
Sep 16 12:14:13.657856 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:13.657785    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcwrf\" (UniqueName: \"kubernetes.io/projected/5202f93f-3683-475c-81ee-4c9ad642c1e0-kube-api-access-mcwrf\") pod \"payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5\" (UID: \"5202f93f-3683-475c-81ee-4c9ad642c1e0\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5"
Sep 16 12:14:13.720736 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:13.720697    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5"
Sep 16 12:14:14.004025 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:14.003898    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5"]
Sep 16 12:14:14.007855 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:14:14.007818    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5202f93f_3683_475c_81ee_4c9ad642c1e0.slice/crio-ed25ea4768a8108c5fe7f532efa32105a1f4d80a1335d75161cd946583468b6b WatchSource:0}: Error finding container ed25ea4768a8108c5fe7f532efa32105a1f4d80a1335d75161cd946583468b6b: Status 404 returned error can't find the container with id ed25ea4768a8108c5fe7f532efa32105a1f4d80a1335d75161cd946583468b6b
Sep 16 12:14:14.013623 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:14.013593    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs" event={"ID":"7ebde485-25be-49fc-b980-9730767fa52b","Type":"ContainerStarted","Data":"fea0f109828b06742ca6205b7227a16d24a6d60cd903f4e739fa0879d7e488f3"}
Sep 16 12:14:14.014521 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:14.014449    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs"
Sep 16 12:14:14.046743 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:14.046695    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs" podStartSLOduration=2.046678526 podStartE2EDuration="2.046678526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:14:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:14:14.044761505 +0000 UTC m=+720.213726210" watchObservedRunningTime="2026-09-16 12:14:14.046678526 +0000 UTC m=+720.215643233"
Sep 16 12:14:14.510038 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:14.510002    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g"]
Sep 16 12:14:14.514387 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:14.514364    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g"
Sep 16 12:14:14.518577 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:14.517665    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-ff057a\""
Sep 16 12:14:14.518577 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:14.517687    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-ff057a-dockercfg-grw5g\""
Sep 16 12:14:14.532693 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:14.532667    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g"]
Sep 16 12:14:14.633917 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:14.633891    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4"]
Sep 16 12:14:14.637769 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:14.637751    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4"
Sep 16 12:14:14.651922 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:14.651896    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4"]
Sep 16 12:14:14.652326 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:14.652295    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl54p\" (UniqueName: \"kubernetes.io/projected/5957aadf-0d0e-4877-a886-9be00ff13a82-kube-api-access-hl54p\") pod \"payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g\" (UID: \"5957aadf-0d0e-4877-a886-9be00ff13a82\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g"
Sep 16 12:14:14.652443 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:14.652430    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5957aadf-0d0e-4877-a886-9be00ff13a82-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g\" (UID: \"5957aadf-0d0e-4877-a886-9be00ff13a82\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g"
Sep 16 12:14:14.753598 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:14.753562    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sts58\" (UniqueName: \"kubernetes.io/projected/fdf9d313-1e9d-436c-9eed-cafeea130bde-kube-api-access-sts58\") pod \"payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4\" (UID: \"fdf9d313-1e9d-436c-9eed-cafeea130bde\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4"
Sep 16 12:14:14.753772 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:14.753610    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdf9d313-1e9d-436c-9eed-cafeea130bde-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4\" (UID: \"fdf9d313-1e9d-436c-9eed-cafeea130bde\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4"
Sep 16 12:14:14.753772 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:14.753696    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl54p\" (UniqueName: \"kubernetes.io/projected/5957aadf-0d0e-4877-a886-9be00ff13a82-kube-api-access-hl54p\") pod \"payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g\" (UID: \"5957aadf-0d0e-4877-a886-9be00ff13a82\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g"
Sep 16 12:14:14.753772 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:14.753760    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5957aadf-0d0e-4877-a886-9be00ff13a82-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g\" (UID: \"5957aadf-0d0e-4877-a886-9be00ff13a82\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g"
Sep 16 12:14:14.754496 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:14.754479    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5957aadf-0d0e-4877-a886-9be00ff13a82-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g\" (UID: \"5957aadf-0d0e-4877-a886-9be00ff13a82\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g"
Sep 16 12:14:14.761863 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:14.761803    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl54p\" (UniqueName: \"kubernetes.io/projected/5957aadf-0d0e-4877-a886-9be00ff13a82-kube-api-access-hl54p\") pod \"payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g\" (UID: \"5957aadf-0d0e-4877-a886-9be00ff13a82\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g"
Sep 16 12:14:14.828790 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:14.828755    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g"
Sep 16 12:14:14.854405 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:14.854374    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sts58\" (UniqueName: \"kubernetes.io/projected/fdf9d313-1e9d-436c-9eed-cafeea130bde-kube-api-access-sts58\") pod \"payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4\" (UID: \"fdf9d313-1e9d-436c-9eed-cafeea130bde\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4"
Sep 16 12:14:14.854530 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:14.854420    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdf9d313-1e9d-436c-9eed-cafeea130bde-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4\" (UID: \"fdf9d313-1e9d-436c-9eed-cafeea130bde\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4"
Sep 16 12:14:14.855099 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:14.855069    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdf9d313-1e9d-436c-9eed-cafeea130bde-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4\" (UID: \"fdf9d313-1e9d-436c-9eed-cafeea130bde\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4"
Sep 16 12:14:14.862700 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:14.862675    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sts58\" (UniqueName: \"kubernetes.io/projected/fdf9d313-1e9d-436c-9eed-cafeea130bde-kube-api-access-sts58\") pod \"payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4\" (UID: \"fdf9d313-1e9d-436c-9eed-cafeea130bde\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4"
Sep 16 12:14:14.948730 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:14.948701    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4"
Sep 16 12:14:15.026363 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:15.026270    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5" event={"ID":"5202f93f-3683-475c-81ee-4c9ad642c1e0","Type":"ContainerStarted","Data":"e660f387bda620eade18a676e07df0ed6b92f92ce17f5f2bcb2a20cd71e40c1c"}
Sep 16 12:14:15.026363 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:15.026356    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5" event={"ID":"5202f93f-3683-475c-81ee-4c9ad642c1e0","Type":"ContainerStarted","Data":"ed25ea4768a8108c5fe7f532efa32105a1f4d80a1335d75161cd946583468b6b"}
Sep 16 12:14:15.026768 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:15.026749    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5"
Sep 16 12:14:15.045096 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:15.045047    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5" podStartSLOduration=2.04503334 podStartE2EDuration="2.04503334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:14:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:14:15.04343247 +0000 UTC m=+721.212397179" watchObservedRunningTime="2026-09-16 12:14:15.04503334 +0000 UTC m=+721.213998048"
Sep 16 12:14:15.108581 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:15.108211    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g"]
Sep 16 12:14:15.112192 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:14:15.112154    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5957aadf_0d0e_4877_a886_9be00ff13a82.slice/crio-894aae7d6dd6a89e31c0ffbf9b29fa0b010f61a863bb20e11ee2ec58348c4a68 WatchSource:0}: Error finding container 894aae7d6dd6a89e31c0ffbf9b29fa0b010f61a863bb20e11ee2ec58348c4a68: Status 404 returned error can't find the container with id 894aae7d6dd6a89e31c0ffbf9b29fa0b010f61a863bb20e11ee2ec58348c4a68
Sep 16 12:14:15.233871 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:15.233762    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4"]
Sep 16 12:14:16.034308 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:16.034271    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g" event={"ID":"5957aadf-0d0e-4877-a886-9be00ff13a82","Type":"ContainerStarted","Data":"0a502f904e984632f93fd6056c5c4fea3b267e62c9d232c38b7cabdf9b515ffe"}
Sep 16 12:14:16.034751 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:16.034355    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g" event={"ID":"5957aadf-0d0e-4877-a886-9be00ff13a82","Type":"ContainerStarted","Data":"894aae7d6dd6a89e31c0ffbf9b29fa0b010f61a863bb20e11ee2ec58348c4a68"}
Sep 16 12:14:16.034751 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:16.034527    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g"
Sep 16 12:14:16.036130 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:16.036102    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4" event={"ID":"fdf9d313-1e9d-436c-9eed-cafeea130bde","Type":"ContainerStarted","Data":"d9ea388f397da5ee99ea1b678fe4b879c15abcf0e5fab0dd491486bd95893a76"}
Sep 16 12:14:16.036272 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:16.036149    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4" event={"ID":"fdf9d313-1e9d-436c-9eed-cafeea130bde","Type":"ContainerStarted","Data":"3237f567119a03f4c90155ac7dd42c4cbda7e698a8d857ff7f5adc4c8f9ac202"}
Sep 16 12:14:16.036272 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:16.036262    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4"
Sep 16 12:14:16.053486 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:16.053422    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g" podStartSLOduration=2.053408031 podStartE2EDuration="2.053408031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:14:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:14:16.050851098 +0000 UTC m=+722.219815809" watchObservedRunningTime="2026-09-16 12:14:16.053408031 +0000 UTC m=+722.222372740"
Sep 16 12:14:16.068125 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:16.068081    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4" podStartSLOduration=2.068069798 podStartE2EDuration="2.068069798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:14:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:14:16.067613691 +0000 UTC m=+722.236578399" watchObservedRunningTime="2026-09-16 12:14:16.068069798 +0000 UTC m=+722.237034504"
Sep 16 12:14:25.436626 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.436540    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"]
Sep 16 12:14:25.442965 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.442940    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.451037 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.450847    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-08170a-openshift-default-dockercfg-9q55n\""
Sep 16 12:14:25.451750 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.451725    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"]
Sep 16 12:14:25.493661 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.493627    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87f7efb4-7641-4852-a18c-db75ef0f054f-istiod-ca-cert\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.493837 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.493668    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87f7efb4-7641-4852-a18c-db75ef0f054f-istio-podinfo\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.493837 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.493703    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-istio-envoy\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.493837 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.493811    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-credential-socket\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.494015 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.493860    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-workload-socket\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.494015 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.493983    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-workload-certs\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.494123 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.494013    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87f7efb4-7641-4852-a18c-db75ef0f054f-istio-token\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.494123 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.494047    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wsgq\" (UniqueName: \"kubernetes.io/projected/87f7efb4-7641-4852-a18c-db75ef0f054f-kube-api-access-9wsgq\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.494123 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.494087    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-istio-data\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.598257 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.598212    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-workload-socket\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.598450 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.598357    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-workload-certs\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.598450 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.598389    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87f7efb4-7641-4852-a18c-db75ef0f054f-istio-token\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.598450 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.598422    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wsgq\" (UniqueName: \"kubernetes.io/projected/87f7efb4-7641-4852-a18c-db75ef0f054f-kube-api-access-9wsgq\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.598649 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.598463    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-istio-data\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.598649 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.598522    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87f7efb4-7641-4852-a18c-db75ef0f054f-istiod-ca-cert\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.598649 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.598562    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87f7efb4-7641-4852-a18c-db75ef0f054f-istio-podinfo\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.598649 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.598603    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-istio-envoy\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.598863 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.598671    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-credential-socket\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.599151 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.599119    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-credential-socket\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.599420 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.599393    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-workload-socket\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.599620 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.599596    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-istio-data\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.599855 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.599828    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-workload-certs\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.600017 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.599996    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87f7efb4-7641-4852-a18c-db75ef0f054f-istiod-ca-cert\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.603243 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.603211    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87f7efb4-7641-4852-a18c-db75ef0f054f-istio-podinfo\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.603457 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.603437    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-istio-envoy\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.608658 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.608627    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87f7efb4-7641-4852-a18c-db75ef0f054f-istio-token\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.610928 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.610899    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wsgq\" (UniqueName: \"kubernetes.io/projected/87f7efb4-7641-4852-a18c-db75ef0f054f-kube-api-access-9wsgq\") pod \"e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") " pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:25.762081 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:25.761994    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:26.039403 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:26.039294    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs"
Sep 16 12:14:26.074869 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:26.074590    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"]
Sep 16 12:14:26.084902 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:14:26.084858    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87f7efb4_7641_4852_a18c_db75ef0f054f.slice/crio-7617b72c159df2f3def335018c49e60cb6f0a75ff54935f4f665304db686c9cc WatchSource:0}: Error finding container 7617b72c159df2f3def335018c49e60cb6f0a75ff54935f4f665304db686c9cc: Status 404 returned error can't find the container with id 7617b72c159df2f3def335018c49e60cb6f0a75ff54935f4f665304db686c9cc
Sep 16 12:14:26.088436 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:26.087939    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:14:26.088685 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:26.088398    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:14:26.088844 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:26.088787    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:14:26.115755 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:26.115682    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc" event={"ID":"87f7efb4-7641-4852-a18c-db75ef0f054f","Type":"ContainerStarted","Data":"7617b72c159df2f3def335018c49e60cb6f0a75ff54935f4f665304db686c9cc"}
Sep 16 12:14:27.047633 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:27.047573    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4"
Sep 16 12:14:27.048120 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:27.047669    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g"
Sep 16 12:14:27.048483 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:27.048305    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5"
Sep 16 12:14:27.130013 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:27.129977    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc" event={"ID":"87f7efb4-7641-4852-a18c-db75ef0f054f","Type":"ContainerStarted","Data":"869f3ff0ecfd614a7a13ecf385a3ce060624fa954a1ce3161d3921c2b1f8755d"}
Sep 16 12:14:27.230774 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:27.230362    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc" podStartSLOduration=2.230300535 podStartE2EDuration="2.230300535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:14:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:14:27.227001916 +0000 UTC m=+733.395966625" watchObservedRunningTime="2026-09-16 12:14:27.230300535 +0000 UTC m=+733.399265257"
Sep 16 12:14:27.762888 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:27.762848    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:27.768553 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:27.768525    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:28.135839 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:28.135796    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:28.137200 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:28.137173    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:28.461393 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:28.461254    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt"]
Sep 16 12:14:28.496340 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:28.496147    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt"]
Sep 16 12:14:28.496340 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:28.496284    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt"
Sep 16 12:14:28.501686 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:28.499184    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9"]
Sep 16 12:14:28.503541 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:28.503212    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-dc3e2c-dockercfg-xm6cd\""
Sep 16 12:14:28.503541 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:28.503335    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-dc3e2c\""
Sep 16 12:14:28.531354 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:28.531298    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9"]
Sep 16 12:14:28.531536 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:28.531389    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9"
Sep 16 12:14:28.541794 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:28.541767    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdlwm\" (UniqueName: \"kubernetes.io/projected/2b866262-a5c0-4fb4-aa0e-c66a4ad630f6-kube-api-access-jdlwm\") pod \"payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt\" (UID: \"2b866262-a5c0-4fb4-aa0e-c66a4ad630f6\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt"
Sep 16 12:14:28.541935 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:28.541898    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b866262-a5c0-4fb4-aa0e-c66a4ad630f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt\" (UID: \"2b866262-a5c0-4fb4-aa0e-c66a4ad630f6\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt"
Sep 16 12:14:28.643193 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:28.643148    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hswbd\" (UniqueName: \"kubernetes.io/projected/0e49524b-de34-4246-8dc3-9fdb1f496785-kube-api-access-hswbd\") pod \"payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9\" (UID: \"0e49524b-de34-4246-8dc3-9fdb1f496785\") " pod="openshift-ingress/payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9"
Sep 16 12:14:28.643443 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:28.643283    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e49524b-de34-4246-8dc3-9fdb1f496785-plugins-config-volume\") pod \"payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9\" (UID: \"0e49524b-de34-4246-8dc3-9fdb1f496785\") " pod="openshift-ingress/payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9"
Sep 16 12:14:28.643443 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:28.643350    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdlwm\" (UniqueName: \"kubernetes.io/projected/2b866262-a5c0-4fb4-aa0e-c66a4ad630f6-kube-api-access-jdlwm\") pod \"payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt\" (UID: \"2b866262-a5c0-4fb4-aa0e-c66a4ad630f6\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt"
Sep 16 12:14:28.643585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:28.643452    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b866262-a5c0-4fb4-aa0e-c66a4ad630f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt\" (UID: \"2b866262-a5c0-4fb4-aa0e-c66a4ad630f6\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt"
Sep 16 12:14:28.644268 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:28.644218    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b866262-a5c0-4fb4-aa0e-c66a4ad630f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt\" (UID: \"2b866262-a5c0-4fb4-aa0e-c66a4ad630f6\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt"
Sep 16 12:14:28.654103 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:28.654068    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdlwm\" (UniqueName: \"kubernetes.io/projected/2b866262-a5c0-4fb4-aa0e-c66a4ad630f6-kube-api-access-jdlwm\") pod \"payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt\" (UID: \"2b866262-a5c0-4fb4-aa0e-c66a4ad630f6\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt"
Sep 16 12:14:28.744362 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:28.744249    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hswbd\" (UniqueName: \"kubernetes.io/projected/0e49524b-de34-4246-8dc3-9fdb1f496785-kube-api-access-hswbd\") pod \"payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9\" (UID: \"0e49524b-de34-4246-8dc3-9fdb1f496785\") " pod="openshift-ingress/payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9"
Sep 16 12:14:28.744561 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:28.744390    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e49524b-de34-4246-8dc3-9fdb1f496785-plugins-config-volume\") pod \"payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9\" (UID: \"0e49524b-de34-4246-8dc3-9fdb1f496785\") " pod="openshift-ingress/payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9"
Sep 16 12:14:28.745418 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:28.745395    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e49524b-de34-4246-8dc3-9fdb1f496785-plugins-config-volume\") pod \"payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9\" (UID: \"0e49524b-de34-4246-8dc3-9fdb1f496785\") " pod="openshift-ingress/payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9"
Sep 16 12:14:28.753118 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:28.753090    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hswbd\" (UniqueName: \"kubernetes.io/projected/0e49524b-de34-4246-8dc3-9fdb1f496785-kube-api-access-hswbd\") pod \"payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9\" (UID: \"0e49524b-de34-4246-8dc3-9fdb1f496785\") " pod="openshift-ingress/payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9"
Sep 16 12:14:28.815115 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:28.815074    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt"
Sep 16 12:14:28.844428 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:28.844403    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9"
Sep 16 12:14:29.137384 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:29.137358    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt"]
Sep 16 12:14:29.139441 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:14:29.139415    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b866262_a5c0_4fb4_aa0e_c66a4ad630f6.slice/crio-f93b2e119c0a8cff5ae093764bc2618be253ed1c5a78832b1b6ac6d7974ce065 WatchSource:0}: Error finding container f93b2e119c0a8cff5ae093764bc2618be253ed1c5a78832b1b6ac6d7974ce065: Status 404 returned error can't find the container with id f93b2e119c0a8cff5ae093764bc2618be253ed1c5a78832b1b6ac6d7974ce065
Sep 16 12:14:29.173644 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:29.173620    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9"]
Sep 16 12:14:29.174920 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:14:29.174884    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e49524b_de34_4246_8dc3_9fdb1f496785.slice/crio-af7e5f4120e8544886f3e71d118483c054d20f8d556a82c25052cdf8866b751c WatchSource:0}: Error finding container af7e5f4120e8544886f3e71d118483c054d20f8d556a82c25052cdf8866b751c: Status 404 returned error can't find the container with id af7e5f4120e8544886f3e71d118483c054d20f8d556a82c25052cdf8866b751c
Sep 16 12:14:30.309937 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:30.150688    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9" event={"ID":"0e49524b-de34-4246-8dc3-9fdb1f496785","Type":"ContainerStarted","Data":"bfe05e0263e6cd6959198c40101533ac89e5a61e9b1b2977a5e55e6052fd4365"}
Sep 16 12:14:30.309937 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:30.150747    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9" event={"ID":"0e49524b-de34-4246-8dc3-9fdb1f496785","Type":"ContainerStarted","Data":"af7e5f4120e8544886f3e71d118483c054d20f8d556a82c25052cdf8866b751c"}
Sep 16 12:14:30.309937 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:30.150777    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9"
Sep 16 12:14:30.309937 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:30.152646    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt" event={"ID":"2b866262-a5c0-4fb4-aa0e-c66a4ad630f6","Type":"ContainerStarted","Data":"e838ee49ea8f22b422e931f88b6c6679591aeb781a65025d902d94c0d84926de"}
Sep 16 12:14:30.309937 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:30.152707    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt" event={"ID":"2b866262-a5c0-4fb4-aa0e-c66a4ad630f6","Type":"ContainerStarted","Data":"f93b2e119c0a8cff5ae093764bc2618be253ed1c5a78832b1b6ac6d7974ce065"}
Sep 16 12:14:30.309937 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:30.190145    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9" podStartSLOduration=2.190124047 podStartE2EDuration="2.190124047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:14:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:14:30.186010856 +0000 UTC m=+736.354975593" watchObservedRunningTime="2026-09-16 12:14:30.190124047 +0000 UTC m=+736.359088755"
Sep 16 12:14:30.309937 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:30.225270    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt" podStartSLOduration=2.225251321 podStartE2EDuration="2.225251321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:14:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:14:30.219698306 +0000 UTC m=+736.388663025" watchObservedRunningTime="2026-09-16 12:14:30.225251321 +0000 UTC m=+736.394216029"
Sep 16 12:14:31.159838 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:31.159804    2576 generic.go:356] "Generic (PLEG): container finished" podID="24ff1f9f-5599-445c-9aff-46d84155f985" containerID="122b2cb1788a572f9e8f8d175dbc33c7955c37b4a22d02b887e4e7541ede30e8" exitCode=0
Sep 16 12:14:31.160262 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:31.159880    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486" event={"ID":"24ff1f9f-5599-445c-9aff-46d84155f985","Type":"ContainerDied","Data":"122b2cb1788a572f9e8f8d175dbc33c7955c37b4a22d02b887e4e7541ede30e8"}
Sep 16 12:14:31.160439 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:31.160418    2576 scope.go:117] "RemoveContainer" containerID="122b2cb1788a572f9e8f8d175dbc33c7955c37b4a22d02b887e4e7541ede30e8"
Sep 16 12:14:31.161819 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:31.161788    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:14:31.161934 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:31.161876    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:14:31.161934 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:31.161917    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:14:31.162050 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:31.162008    2576 generic.go:356] "Generic (PLEG): container finished" podID="f9e8c1b0-66b9-4230-b489-bc5d5712a8c7" containerID="53c98440d3fed79339fcb7039dad103690acc0856a2e31df6b7c6cc2b0db6a61" exitCode=0
Sep 16 12:14:31.162106 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:31.162076    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt" event={"ID":"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7","Type":"ContainerDied","Data":"53c98440d3fed79339fcb7039dad103690acc0856a2e31df6b7c6cc2b0db6a61"}
Sep 16 12:14:31.162551 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:31.162536    2576 scope.go:117] "RemoveContainer" containerID="53c98440d3fed79339fcb7039dad103690acc0856a2e31df6b7c6cc2b0db6a61"
Sep 16 12:14:31.163773 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:31.163710    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:14:31.163868 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:31.163790    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:14:31.163868 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:31.163838    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:14:31.164148 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:31.164129    2576 generic.go:356] "Generic (PLEG): container finished" podID="35be3a8f-570c-4921-a90c-3195445dff07" containerID="c98f28fc0cc6d94aac56497af5b313940371c6dbbad46b1d675e692ad8e23dec" exitCode=0
Sep 16 12:14:31.164230 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:31.164198    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz" event={"ID":"35be3a8f-570c-4921-a90c-3195445dff07","Type":"ContainerDied","Data":"c98f28fc0cc6d94aac56497af5b313940371c6dbbad46b1d675e692ad8e23dec"}
Sep 16 12:14:31.165239 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:31.164563    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt"
Sep 16 12:14:31.165239 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:31.164886    2576 scope.go:117] "RemoveContainer" containerID="c98f28fc0cc6d94aac56497af5b313940371c6dbbad46b1d675e692ad8e23dec"
Sep 16 12:14:31.170057 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:31.170028    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:14:31.170127 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:31.170111    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:14:31.170194 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:31.170178    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:14:32.176620 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:32.176587    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486" event={"ID":"24ff1f9f-5599-445c-9aff-46d84155f985","Type":"ContainerStarted","Data":"2e761fde5cc724c23bd995ffbb201f9b7486c9be2fd02c6bf6555141a78360a3"}
Sep 16 12:14:32.178889 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:32.178863    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt" event={"ID":"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7","Type":"ContainerStarted","Data":"c0664f46e92b5518810a9170f9801f98942ae698a14c2d586bd7b3f4418cd094"}
Sep 16 12:14:32.183810 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:32.183785    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz" event={"ID":"35be3a8f-570c-4921-a90c-3195445dff07","Type":"ContainerStarted","Data":"8b4d6ed3ae061cf68abcffb0e264b33c1aaefa340c47f32ff0e224eae1d0b7ab"}
Sep 16 12:14:32.641163 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:32.641121    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:32.641649 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:32.641611    2576 patch_prober.go:28] interesting pod/e2e-worker-w4-556077-openshift-default-58b9874496-nb486 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 16 12:14:32.641781 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:32.641676    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486" podUID="24ff1f9f-5599-445c-9aff-46d84155f985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 16 12:14:32.717342 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:32.717280    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:32.717567 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:32.717440    2576 patch_prober.go:28] interesting pod/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 12:14:32.717567 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:32.717489    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz" podUID="35be3a8f-570c-4921-a90c-3195445dff07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 12:14:32.797204 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:32.797161    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:32.797440 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:32.797304    2576 patch_prober.go:28] interesting pod/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 16 12:14:32.797440 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:32.797373    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt" podUID="f9e8c1b0-66b9-4230-b489-bc5d5712a8c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 16 12:14:33.641797 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:33.641752    2576 patch_prober.go:28] interesting pod/e2e-worker-w4-556077-openshift-default-58b9874496-nb486 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 16 12:14:33.642336 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:33.641822    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486" podUID="24ff1f9f-5599-445c-9aff-46d84155f985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 16 12:14:33.717782 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:33.717739    2576 patch_prober.go:28] interesting pod/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 12:14:33.717989 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:33.717807    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz" podUID="35be3a8f-570c-4921-a90c-3195445dff07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 12:14:33.796557 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:33.796522    2576 patch_prober.go:28] interesting pod/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 16 12:14:33.796862 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:33.796823    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt" podUID="f9e8c1b0-66b9-4230-b489-bc5d5712a8c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 16 12:14:34.647659 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:34.647623    2576 patch_prober.go:28] interesting pod/e2e-worker-w4-556077-openshift-default-58b9874496-nb486 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 16 12:14:34.648234 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:34.648201    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486" podUID="24ff1f9f-5599-445c-9aff-46d84155f985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 16 12:14:34.720346 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:34.716765    2576 patch_prober.go:28] interesting pod/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 12:14:34.720346 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:34.716860    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz" podUID="35be3a8f-570c-4921-a90c-3195445dff07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 12:14:34.810339 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:34.801735    2576 patch_prober.go:28] interesting pod/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 16 12:14:34.810339 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:34.801818    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt" podUID="f9e8c1b0-66b9-4230-b489-bc5d5712a8c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 16 12:14:35.641419 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:35.641375    2576 patch_prober.go:28] interesting pod/e2e-worker-w4-556077-openshift-default-58b9874496-nb486 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 16 12:14:35.641639 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:35.641441    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486" podUID="24ff1f9f-5599-445c-9aff-46d84155f985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 16 12:14:35.717120 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:35.717076    2576 patch_prober.go:28] interesting pod/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 12:14:35.717661 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:35.717144    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz" podUID="35be3a8f-570c-4921-a90c-3195445dff07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 12:14:35.799344 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:35.798547    2576 patch_prober.go:28] interesting pod/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 16 12:14:35.799344 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:35.798606    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt" podUID="f9e8c1b0-66b9-4230-b489-bc5d5712a8c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 16 12:14:36.642279 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:36.641774    2576 patch_prober.go:28] interesting pod/e2e-worker-w4-556077-openshift-default-58b9874496-nb486 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 16 12:14:36.642279 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:36.641853    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486" podUID="24ff1f9f-5599-445c-9aff-46d84155f985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 16 12:14:36.717340 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:36.717282    2576 patch_prober.go:28] interesting pod/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 12:14:36.717850 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:36.717374    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz" podUID="35be3a8f-570c-4921-a90c-3195445dff07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 12:14:36.797822 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:36.797787    2576 patch_prober.go:28] interesting pod/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 16 12:14:36.798163 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:36.798115    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt" podUID="f9e8c1b0-66b9-4230-b489-bc5d5712a8c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 16 12:14:37.730740 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:37.730700    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:37.731424 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:37.731106    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:37.732459 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:37.732426    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:14:37.779046 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:37.779012    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:37.779534 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:37.779465    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:37.780736 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:37.780711    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:14:37.804920 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:37.804890    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:37.806411 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:37.806388    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:37.808023 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:37.807996    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:14:41.166635 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:41.166604    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9"
Sep 16 12:14:42.186100 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:42.186070    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt"
Sep 16 12:14:56.349998 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:56.349965    2576 generic.go:356] "Generic (PLEG): container finished" podID="87f7efb4-7641-4852-a18c-db75ef0f054f" containerID="869f3ff0ecfd614a7a13ecf385a3ce060624fa954a1ce3161d3921c2b1f8755d" exitCode=0
Sep 16 12:14:56.350452 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:56.350036    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc" event={"ID":"87f7efb4-7641-4852-a18c-db75ef0f054f","Type":"ContainerDied","Data":"869f3ff0ecfd614a7a13ecf385a3ce060624fa954a1ce3161d3921c2b1f8755d"}
Sep 16 12:14:56.350512 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:56.350495    2576 scope.go:117] "RemoveContainer" containerID="869f3ff0ecfd614a7a13ecf385a3ce060624fa954a1ce3161d3921c2b1f8755d"
Sep 16 12:14:56.351649 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:56.351625    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:14:56.351725 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:56.351688    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:14:56.351725 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:56.351721    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:14:57.358866 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:57.358832    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc" event={"ID":"87f7efb4-7641-4852-a18c-db75ef0f054f","Type":"ContainerStarted","Data":"cff4125c626686b0a59984205c65bd9e343c766f850f964bc21fabe57c750f61"}
Sep 16 12:14:57.762301 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:57.762211    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:57.763188 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:57.763165    2576 patch_prober.go:28] interesting pod/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 16 12:14:57.763295 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:57.763209    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc" podUID="87f7efb4-7641-4852-a18c-db75ef0f054f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 16 12:14:58.135829 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:58.135792    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:14:58.762473 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:58.762439    2576 patch_prober.go:28] interesting pod/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 16 12:14:58.762865 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:58.762493    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc" podUID="87f7efb4-7641-4852-a18c-db75ef0f054f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 16 12:14:59.763077 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:59.763044    2576 patch_prober.go:28] interesting pod/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 16 12:14:59.763467 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:14:59.763102    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc" podUID="87f7efb4-7641-4852-a18c-db75ef0f054f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 16 12:15:00.138488 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:00.138451    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-ff057a-29826015-cl5n4"]
Sep 16 12:15:00.142878 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:00.142853    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-08170a-29826015-pcv62"]
Sep 16 12:15:00.143027 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:00.142970    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-ff057a-29826015-cl5n4"
Sep 16 12:15:00.145472 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:00.145445    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9lc86\""
Sep 16 12:15:00.146714 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:00.146694    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-08170a-29826015-pcv62"
Sep 16 12:15:00.153583 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:00.153372    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-ff057a-29826015-cl5n4"]
Sep 16 12:15:00.158089 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:00.158066    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-08170a-29826015-pcv62"]
Sep 16 12:15:00.161077 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:00.160414    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-ff057a-29826015-cl5n4"
Sep 16 12:15:00.167464 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:00.167283    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-641983-29826015-87kj7"]
Sep 16 12:15:00.172845 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:00.172828    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-08170a-29826015-pcv62"
Sep 16 12:15:00.173822 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:00.173801    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-641983-29826015-87kj7"
Sep 16 12:15:00.183415 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:00.183393    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-641983-29826015-87kj7"]
Sep 16 12:15:00.250383 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:00.250356    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-641983-29826015-87kj7"
Sep 16 12:15:00.522571 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:00.517702    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-08170a-29826015-pcv62"]
Sep 16 12:15:00.522912 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:00.522805    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-ff057a-29826015-cl5n4"]
Sep 16 12:15:00.525001 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:00.524977    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 12:15:00.566115 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:00.566095    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-641983-29826015-87kj7"]
Sep 16 12:15:00.567644 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:15:00.567596    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod912f7333_2309_42ca_aa85_56930d0b7b71.slice/crio-6d4e000b1c909c0b4b79a27cf3ed2086ee255d0b685115dab5e749d119ae4459 WatchSource:0}: Error finding container 6d4e000b1c909c0b4b79a27cf3ed2086ee255d0b685115dab5e749d119ae4459: Status 404 returned error can't find the container with id 6d4e000b1c909c0b4b79a27cf3ed2086ee255d0b685115dab5e749d119ae4459
Sep 16 12:15:00.763045 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:00.762970    2576 patch_prober.go:28] interesting pod/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 16 12:15:00.763045 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:00.763022    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc" podUID="87f7efb4-7641-4852-a18c-db75ef0f054f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 16 12:15:01.384211 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:01.384170    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-641983-29826015-87kj7" event={"ID":"912f7333-2309-42ca-aa85-56930d0b7b71","Type":"ContainerStarted","Data":"6d4e000b1c909c0b4b79a27cf3ed2086ee255d0b685115dab5e749d119ae4459"}
Sep 16 12:15:01.385277 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:01.385256    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-ff057a-29826015-cl5n4" event={"ID":"2028fdc3-85f6-4d9b-97f4-4de77c473375","Type":"ContainerStarted","Data":"cd014de8cf14e4134d9b743e67602088501ea91b8be2827f411b370e6fc5f9f5"}
Sep 16 12:15:01.386427 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:01.386404    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-08170a-29826015-pcv62" event={"ID":"19cae082-1bc2-45cc-a04f-826066425ca9","Type":"ContainerStarted","Data":"e38719a874ac8e8257d5143743a33fb4ed022f8874f4a63630d042dddb86a4af"}
Sep 16 12:15:01.763010 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:01.762886    2576 patch_prober.go:28] interesting pod/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 16 12:15:01.763010 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:01.762950    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc" podUID="87f7efb4-7641-4852-a18c-db75ef0f054f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 16 12:15:02.767903 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:02.767874    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:15:02.769178 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:02.769149    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:15:04.433387 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:04.433352    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-641983-29826015-87kj7" event={"ID":"912f7333-2309-42ca-aa85-56930d0b7b71","Type":"ContainerStarted","Data":"1053ca1141943c62a16ce6ded396728571362eaacd0247cedf6eb571f16171a1"}
Sep 16 12:15:04.435094 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:04.435062    2576 generic.go:356] "Generic (PLEG): container finished" podID="2028fdc3-85f6-4d9b-97f4-4de77c473375" containerID="4dc0d328122cc96084dda6bd1984e18129f710d444d2aea3780c80f264ecad44" exitCode=0
Sep 16 12:15:04.435207 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:04.435130    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-ff057a-29826015-cl5n4" event={"ID":"2028fdc3-85f6-4d9b-97f4-4de77c473375","Type":"ContainerDied","Data":"4dc0d328122cc96084dda6bd1984e18129f710d444d2aea3780c80f264ecad44"}
Sep 16 12:15:04.436836 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:04.436809    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-08170a-29826015-pcv62" event={"ID":"19cae082-1bc2-45cc-a04f-826066425ca9","Type":"ContainerStarted","Data":"84bf8a4001fc0b42655e32bc78b00222a941d02457904409ecc163d677582cbe"}
Sep 16 12:15:04.449830 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:04.449792    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-641983-29826015-87kj7" podStartSLOduration=1.629298597 podStartE2EDuration="4.449780861s" totalImagesPullingTime="2.820482264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:15:04.447692983 +0000 UTC m=+770.616657690" watchObservedRunningTime="2026-09-16 12:15:04.449780861 +0000 UTC m=+770.618745567"
Sep 16 12:15:05.445602 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:05.445566    2576 generic.go:356] "Generic (PLEG): container finished" podID="912f7333-2309-42ca-aa85-56930d0b7b71" containerID="1053ca1141943c62a16ce6ded396728571362eaacd0247cedf6eb571f16171a1" exitCode=0
Sep 16 12:15:05.446050 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:05.445651    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-641983-29826015-87kj7" event={"ID":"912f7333-2309-42ca-aa85-56930d0b7b71","Type":"ContainerDied","Data":"1053ca1141943c62a16ce6ded396728571362eaacd0247cedf6eb571f16171a1"}
Sep 16 12:15:05.447185 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:05.447164    2576 generic.go:356] "Generic (PLEG): container finished" podID="19cae082-1bc2-45cc-a04f-826066425ca9" containerID="84bf8a4001fc0b42655e32bc78b00222a941d02457904409ecc163d677582cbe" exitCode=0
Sep 16 12:15:05.447297 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:05.447240    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-08170a-29826015-pcv62" event={"ID":"19cae082-1bc2-45cc-a04f-826066425ca9","Type":"ContainerDied","Data":"84bf8a4001fc0b42655e32bc78b00222a941d02457904409ecc163d677582cbe"}
Sep 16 12:15:05.483683 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:05.483620    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-08170a-29826015-pcv62" podStartSLOduration=2.605849187 podStartE2EDuration="5.483596554s" totalImagesPullingTime="2.877747367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:15:04.481572846 +0000 UTC m=+770.650537551" watchObservedRunningTime="2026-09-16 12:15:05.483596554 +0000 UTC m=+771.652561266"
Sep 16 12:15:05.597790 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:05.597764    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-ff057a-29826015-cl5n4"
Sep 16 12:15:06.454028 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:06.453996    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-ff057a-29826015-cl5n4"
Sep 16 12:15:06.454507 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:06.454025    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-ff057a-29826015-cl5n4" event={"ID":"2028fdc3-85f6-4d9b-97f4-4de77c473375","Type":"ContainerDied","Data":"cd014de8cf14e4134d9b743e67602088501ea91b8be2827f411b370e6fc5f9f5"}
Sep 16 12:15:06.454507 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:06.454082    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd014de8cf14e4134d9b743e67602088501ea91b8be2827f411b370e6fc5f9f5"
Sep 16 12:15:06.625661 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:06.625634    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-641983-29826015-87kj7"
Sep 16 12:15:06.662600 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:06.662538    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-08170a-29826015-pcv62"
Sep 16 12:15:07.461154 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:07.461124    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-641983-29826015-87kj7"
Sep 16 12:15:07.461662 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:07.461154    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-641983-29826015-87kj7" event={"ID":"912f7333-2309-42ca-aa85-56930d0b7b71","Type":"ContainerDied","Data":"6d4e000b1c909c0b4b79a27cf3ed2086ee255d0b685115dab5e749d119ae4459"}
Sep 16 12:15:07.461662 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:07.461205    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d4e000b1c909c0b4b79a27cf3ed2086ee255d0b685115dab5e749d119ae4459"
Sep 16 12:15:07.462570 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:07.462550    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-08170a-29826015-pcv62" event={"ID":"19cae082-1bc2-45cc-a04f-826066425ca9","Type":"ContainerDied","Data":"e38719a874ac8e8257d5143743a33fb4ed022f8874f4a63630d042dddb86a4af"}
Sep 16 12:15:07.462570 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:07.462561    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-08170a-29826015-pcv62"
Sep 16 12:15:07.462707 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:15:07.462584    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e38719a874ac8e8257d5143743a33fb4ed022f8874f4a63630d042dddb86a4af"
Sep 16 12:16:24.110047 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:24.110011    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2"]
Sep 16 12:16:24.110572 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:24.110557    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19cae082-1bc2-45cc-a04f-826066425ca9" containerName="cleanup"
Sep 16 12:16:24.110628 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:24.110574    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="19cae082-1bc2-45cc-a04f-826066425ca9" containerName="cleanup"
Sep 16 12:16:24.110628 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:24.110596    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2028fdc3-85f6-4d9b-97f4-4de77c473375" containerName="cleanup"
Sep 16 12:16:24.110628 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:24.110602    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2028fdc3-85f6-4d9b-97f4-4de77c473375" containerName="cleanup"
Sep 16 12:16:24.110628 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:24.110613    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="912f7333-2309-42ca-aa85-56930d0b7b71" containerName="cleanup"
Sep 16 12:16:24.110628 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:24.110619    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="912f7333-2309-42ca-aa85-56930d0b7b71" containerName="cleanup"
Sep 16 12:16:24.110783 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:24.110696    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="912f7333-2309-42ca-aa85-56930d0b7b71" containerName="cleanup"
Sep 16 12:16:24.110783 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:24.110706    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2028fdc3-85f6-4d9b-97f4-4de77c473375" containerName="cleanup"
Sep 16 12:16:24.110783 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:24.110714    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="19cae082-1bc2-45cc-a04f-826066425ca9" containerName="cleanup"
Sep 16 12:16:24.113938 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:24.113924    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2"
Sep 16 12:16:24.116670 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:24.116631    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-a1d14a87-dockercfg-p7wcv\""
Sep 16 12:16:24.116815 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:24.116736    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-a1d14a87\""
Sep 16 12:16:24.124420 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:24.124396    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2"]
Sep 16 12:16:24.198261 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:24.198024    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpvt4\" (UniqueName: \"kubernetes.io/projected/1ce4dcab-1cb4-421f-a346-da3c2689cd91-kube-api-access-tpvt4\") pod \"payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2\" (UID: \"1ce4dcab-1cb4-421f-a346-da3c2689cd91\") " pod="openshift-ingress/payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2"
Sep 16 12:16:24.198261 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:24.198122    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ce4dcab-1cb4-421f-a346-da3c2689cd91-plugins-config-volume\") pod \"payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2\" (UID: \"1ce4dcab-1cb4-421f-a346-da3c2689cd91\") " pod="openshift-ingress/payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2"
Sep 16 12:16:24.299115 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:24.299075    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpvt4\" (UniqueName: \"kubernetes.io/projected/1ce4dcab-1cb4-421f-a346-da3c2689cd91-kube-api-access-tpvt4\") pod \"payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2\" (UID: \"1ce4dcab-1cb4-421f-a346-da3c2689cd91\") " pod="openshift-ingress/payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2"
Sep 16 12:16:24.299310 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:24.299154    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ce4dcab-1cb4-421f-a346-da3c2689cd91-plugins-config-volume\") pod \"payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2\" (UID: \"1ce4dcab-1cb4-421f-a346-da3c2689cd91\") " pod="openshift-ingress/payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2"
Sep 16 12:16:24.299844 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:24.299822    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ce4dcab-1cb4-421f-a346-da3c2689cd91-plugins-config-volume\") pod \"payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2\" (UID: \"1ce4dcab-1cb4-421f-a346-da3c2689cd91\") " pod="openshift-ingress/payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2"
Sep 16 12:16:24.310649 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:24.310614    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpvt4\" (UniqueName: \"kubernetes.io/projected/1ce4dcab-1cb4-421f-a346-da3c2689cd91-kube-api-access-tpvt4\") pod \"payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2\" (UID: \"1ce4dcab-1cb4-421f-a346-da3c2689cd91\") " pod="openshift-ingress/payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2"
Sep 16 12:16:24.427441 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:24.427363    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2"
Sep 16 12:16:24.704524 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:24.704498    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2"]
Sep 16 12:16:24.706377 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:16:24.706345    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce4dcab_1cb4_421f_a346_da3c2689cd91.slice/crio-4a2908cbc10f40f7e787c6bedc936534a9fbd0c59a0638061f057211e0d1a029 WatchSource:0}: Error finding container 4a2908cbc10f40f7e787c6bedc936534a9fbd0c59a0638061f057211e0d1a029: Status 404 returned error can't find the container with id 4a2908cbc10f40f7e787c6bedc936534a9fbd0c59a0638061f057211e0d1a029
Sep 16 12:16:24.945631 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:24.945593    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2" event={"ID":"1ce4dcab-1cb4-421f-a346-da3c2689cd91","Type":"ContainerStarted","Data":"759efddc4e6b9065f80566d658d9d4472be933b82823b69d73be6c5aaa6d0226"}
Sep 16 12:16:24.945817 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:24.945645    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2" event={"ID":"1ce4dcab-1cb4-421f-a346-da3c2689cd91","Type":"ContainerStarted","Data":"4a2908cbc10f40f7e787c6bedc936534a9fbd0c59a0638061f057211e0d1a029"}
Sep 16 12:16:24.945817 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:24.945787    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2"
Sep 16 12:16:24.962429 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:24.962335    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2" podStartSLOduration=0.962306889 podStartE2EDuration="962.306889ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:16:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:16:24.960306289 +0000 UTC m=+851.129270997" watchObservedRunningTime="2026-09-16 12:16:24.962306889 +0000 UTC m=+851.131271596"
Sep 16 12:16:35.952999 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:35.952967    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2"
Sep 16 12:16:44.977515 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:44.977477    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc3e2c-zgf8t"]
Sep 16 12:16:44.981432 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:44.981413    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc3e2c-zgf8t"
Sep 16 12:16:44.984754 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:44.984728    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9lc86\""
Sep 16 12:16:44.987771 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:44.987746    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc3e2c-zgf8t"]
Sep 16 12:16:45.011033 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:45.010988    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b62ccea2-663d-4912-8466-6f311ac755bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-dc3e2c-zgf8t\" (UID: \"b62ccea2-663d-4912-8466-6f311ac755bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc3e2c-zgf8t"
Sep 16 12:16:45.111865 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:45.111830    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b62ccea2-663d-4912-8466-6f311ac755bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-dc3e2c-zgf8t\" (UID: \"b62ccea2-663d-4912-8466-6f311ac755bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc3e2c-zgf8t"
Sep 16 12:16:45.112509 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:45.112490    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b62ccea2-663d-4912-8466-6f311ac755bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-dc3e2c-zgf8t\" (UID: \"b62ccea2-663d-4912-8466-6f311ac755bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc3e2c-zgf8t"
Sep 16 12:16:45.294824 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:45.294730    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc3e2c-zgf8t"
Sep 16 12:16:45.576911 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:45.575263    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc3e2c-zgf8t"]
Sep 16 12:16:45.578799 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:16:45.578758    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb62ccea2_663d_4912_8466_6f311ac755bb.slice/crio-cbb51860f424d4e9fd40996d223488d22f369a3d27e67280d4dd61e91df9f12c WatchSource:0}: Error finding container cbb51860f424d4e9fd40996d223488d22f369a3d27e67280d4dd61e91df9f12c: Status 404 returned error can't find the container with id cbb51860f424d4e9fd40996d223488d22f369a3d27e67280d4dd61e91df9f12c
Sep 16 12:16:46.067988 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:46.067951    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc3e2c-zgf8t" event={"ID":"b62ccea2-663d-4912-8466-6f311ac755bb","Type":"ContainerStarted","Data":"c7d4ef99ad59a1cdfda478f1720819b9ef91b355828a453435fd287da3487b0c"}
Sep 16 12:16:46.068408 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:46.068004    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc3e2c-zgf8t" event={"ID":"b62ccea2-663d-4912-8466-6f311ac755bb","Type":"ContainerStarted","Data":"cbb51860f424d4e9fd40996d223488d22f369a3d27e67280d4dd61e91df9f12c"}
Sep 16 12:16:46.084812 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:46.084766    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc3e2c-zgf8t" podStartSLOduration=2.084748729 podStartE2EDuration="2.084748729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:16:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:16:46.08207601 +0000 UTC m=+872.251040744" watchObservedRunningTime="2026-09-16 12:16:46.084748729 +0000 UTC m=+872.253713506"
Sep 16 12:16:47.075301 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:47.075266    2576 generic.go:356] "Generic (PLEG): container finished" podID="b62ccea2-663d-4912-8466-6f311ac755bb" containerID="c7d4ef99ad59a1cdfda478f1720819b9ef91b355828a453435fd287da3487b0c" exitCode=0
Sep 16 12:16:47.075701 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:47.075353    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc3e2c-zgf8t" event={"ID":"b62ccea2-663d-4912-8466-6f311ac755bb","Type":"ContainerDied","Data":"c7d4ef99ad59a1cdfda478f1720819b9ef91b355828a453435fd287da3487b0c"}
Sep 16 12:16:48.228199 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:48.228171    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc3e2c-zgf8t"
Sep 16 12:16:48.244990 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:48.244960    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b62ccea2-663d-4912-8466-6f311ac755bb-maas-api-service-ca\") pod \"b62ccea2-663d-4912-8466-6f311ac755bb\" (UID: \"b62ccea2-663d-4912-8466-6f311ac755bb\") "
Sep 16 12:16:48.245278 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:48.245256    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b62ccea2-663d-4912-8466-6f311ac755bb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b62ccea2-663d-4912-8466-6f311ac755bb" (UID: "b62ccea2-663d-4912-8466-6f311ac755bb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:16:48.346280 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:48.346196    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b62ccea2-663d-4912-8466-6f311ac755bb-maas-api-service-ca\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:16:49.088127 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:49.088101    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc3e2c-zgf8t"
Sep 16 12:16:49.088300 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:49.088150    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc3e2c-zgf8t" event={"ID":"b62ccea2-663d-4912-8466-6f311ac755bb","Type":"ContainerDied","Data":"cbb51860f424d4e9fd40996d223488d22f369a3d27e67280d4dd61e91df9f12c"}
Sep 16 12:16:49.088300 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:49.088205    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cbb51860f424d4e9fd40996d223488d22f369a3d27e67280d4dd61e91df9f12c"
Sep 16 12:16:49.440883 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:49.440853    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a1d14a87-xrp66"]
Sep 16 12:16:49.441402 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:49.441386    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b62ccea2-663d-4912-8466-6f311ac755bb" containerName="revoke-keys"
Sep 16 12:16:49.441402 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:49.441403    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b62ccea2-663d-4912-8466-6f311ac755bb" containerName="revoke-keys"
Sep 16 12:16:49.441512 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:49.441481    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b62ccea2-663d-4912-8466-6f311ac755bb" containerName="revoke-keys"
Sep 16 12:16:49.444876 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:49.444861    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a1d14a87-xrp66"
Sep 16 12:16:49.448264 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:49.448238    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9lc86\""
Sep 16 12:16:49.450972 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:49.450948    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a1d14a87-xrp66"]
Sep 16 12:16:49.559079 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:49.559043    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/586d70cc-72f9-463f-868f-b2aca41fbfec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a1d14a87-xrp66\" (UID: \"586d70cc-72f9-463f-868f-b2aca41fbfec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a1d14a87-xrp66"
Sep 16 12:16:49.660131 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:49.660096    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/586d70cc-72f9-463f-868f-b2aca41fbfec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a1d14a87-xrp66\" (UID: \"586d70cc-72f9-463f-868f-b2aca41fbfec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a1d14a87-xrp66"
Sep 16 12:16:49.660736 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:49.660718    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/586d70cc-72f9-463f-868f-b2aca41fbfec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a1d14a87-xrp66\" (UID: \"586d70cc-72f9-463f-868f-b2aca41fbfec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a1d14a87-xrp66"
Sep 16 12:16:49.756856 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:49.756770    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a1d14a87-xrp66"
Sep 16 12:16:50.030582 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:50.030556    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a1d14a87-xrp66"]
Sep 16 12:16:50.032664 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:16:50.032643    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod586d70cc_72f9_463f_868f_b2aca41fbfec.slice/crio-6c7a6ec57b3b6fe81ff3cd4845cce4b692580617298877342b797607c86439ed WatchSource:0}: Error finding container 6c7a6ec57b3b6fe81ff3cd4845cce4b692580617298877342b797607c86439ed: Status 404 returned error can't find the container with id 6c7a6ec57b3b6fe81ff3cd4845cce4b692580617298877342b797607c86439ed
Sep 16 12:16:50.095379 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:50.095351    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a1d14a87-xrp66" event={"ID":"586d70cc-72f9-463f-868f-b2aca41fbfec","Type":"ContainerStarted","Data":"6c7a6ec57b3b6fe81ff3cd4845cce4b692580617298877342b797607c86439ed"}
Sep 16 12:16:51.103563 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:51.103532    2576 generic.go:356] "Generic (PLEG): container finished" podID="586d70cc-72f9-463f-868f-b2aca41fbfec" containerID="b2455a9519cf98c67c45d800bb3bd34b2a38dc856332896506668aa24b456c53" exitCode=0
Sep 16 12:16:51.103987 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:51.103581    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a1d14a87-xrp66" event={"ID":"586d70cc-72f9-463f-868f-b2aca41fbfec","Type":"ContainerDied","Data":"b2455a9519cf98c67c45d800bb3bd34b2a38dc856332896506668aa24b456c53"}
Sep 16 12:16:52.254414 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:52.254387    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a1d14a87-xrp66"
Sep 16 12:16:52.289049 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:52.289017    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/586d70cc-72f9-463f-868f-b2aca41fbfec-maas-api-service-ca\") pod \"586d70cc-72f9-463f-868f-b2aca41fbfec\" (UID: \"586d70cc-72f9-463f-868f-b2aca41fbfec\") "
Sep 16 12:16:52.289358 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:52.289337    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/586d70cc-72f9-463f-868f-b2aca41fbfec-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "586d70cc-72f9-463f-868f-b2aca41fbfec" (UID: "586d70cc-72f9-463f-868f-b2aca41fbfec"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:16:52.289595 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:52.289575    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/586d70cc-72f9-463f-868f-b2aca41fbfec-maas-api-service-ca\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:16:53.116641 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:53.116614    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a1d14a87-xrp66"
Sep 16 12:16:53.116849 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:53.116606    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a1d14a87-xrp66" event={"ID":"586d70cc-72f9-463f-868f-b2aca41fbfec","Type":"ContainerDied","Data":"6c7a6ec57b3b6fe81ff3cd4845cce4b692580617298877342b797607c86439ed"}
Sep 16 12:16:53.116849 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:53.116796    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c7a6ec57b3b6fe81ff3cd4845cce4b692580617298877342b797607c86439ed"
Sep 16 12:16:55.633367 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:55.633332    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9"]
Sep 16 12:16:55.633844 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:55.633621    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9" podUID="0e49524b-de34-4246-8dc3-9fdb1f496785" containerName="payload-processing" containerID="cri-o://bfe05e0263e6cd6959198c40101533ac89e5a61e9b1b2977a5e55e6052fd4365" gracePeriod=30
Sep 16 12:16:55.642704 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:55.642650    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt"]
Sep 16 12:16:55.642978 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:55.642899    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt" podUID="2b866262-a5c0-4fb4-aa0e-c66a4ad630f6" containerName="payload-pre-processing" containerID="cri-o://e838ee49ea8f22b422e931f88b6c6679591aeb781a65025d902d94c0d84926de" gracePeriod=30
Sep 16 12:16:55.767193 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:55.767158    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc3e2c-zgf8t"]
Sep 16 12:16:55.770406 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:55.770379    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc3e2c-zgf8t"]
Sep 16 12:16:55.924025 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:55.923995    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9"
Sep 16 12:16:55.981393 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:55.981372    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt"
Sep 16 12:16:56.028075 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.028032    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e49524b-de34-4246-8dc3-9fdb1f496785-plugins-config-volume\") pod \"0e49524b-de34-4246-8dc3-9fdb1f496785\" (UID: \"0e49524b-de34-4246-8dc3-9fdb1f496785\") "
Sep 16 12:16:56.028276 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.028095    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hswbd\" (UniqueName: \"kubernetes.io/projected/0e49524b-de34-4246-8dc3-9fdb1f496785-kube-api-access-hswbd\") pod \"0e49524b-de34-4246-8dc3-9fdb1f496785\" (UID: \"0e49524b-de34-4246-8dc3-9fdb1f496785\") "
Sep 16 12:16:56.028276 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.028183    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdlwm\" (UniqueName: \"kubernetes.io/projected/2b866262-a5c0-4fb4-aa0e-c66a4ad630f6-kube-api-access-jdlwm\") pod \"2b866262-a5c0-4fb4-aa0e-c66a4ad630f6\" (UID: \"2b866262-a5c0-4fb4-aa0e-c66a4ad630f6\") "
Sep 16 12:16:56.028276 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.028227    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b866262-a5c0-4fb4-aa0e-c66a4ad630f6-plugins-config-volume\") pod \"2b866262-a5c0-4fb4-aa0e-c66a4ad630f6\" (UID: \"2b866262-a5c0-4fb4-aa0e-c66a4ad630f6\") "
Sep 16 12:16:56.028637 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.028605    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e49524b-de34-4246-8dc3-9fdb1f496785-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0e49524b-de34-4246-8dc3-9fdb1f496785" (UID: "0e49524b-de34-4246-8dc3-9fdb1f496785"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:16:56.028756 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.028700    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b866262-a5c0-4fb4-aa0e-c66a4ad630f6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2b866262-a5c0-4fb4-aa0e-c66a4ad630f6" (UID: "2b866262-a5c0-4fb4-aa0e-c66a4ad630f6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:16:56.028981 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.028854    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e49524b-de34-4246-8dc3-9fdb1f496785-plugins-config-volume\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:16:56.028981 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.028873    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b866262-a5c0-4fb4-aa0e-c66a4ad630f6-plugins-config-volume\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:16:56.030463 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.030440    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e49524b-de34-4246-8dc3-9fdb1f496785-kube-api-access-hswbd" (OuterVolumeSpecName: "kube-api-access-hswbd") pod "0e49524b-de34-4246-8dc3-9fdb1f496785" (UID: "0e49524b-de34-4246-8dc3-9fdb1f496785"). InnerVolumeSpecName "kube-api-access-hswbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:16:56.030825 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.030793    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b866262-a5c0-4fb4-aa0e-c66a4ad630f6-kube-api-access-jdlwm" (OuterVolumeSpecName: "kube-api-access-jdlwm") pod "2b866262-a5c0-4fb4-aa0e-c66a4ad630f6" (UID: "2b866262-a5c0-4fb4-aa0e-c66a4ad630f6"). InnerVolumeSpecName "kube-api-access-jdlwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:16:56.129783 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.129751    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hswbd\" (UniqueName: \"kubernetes.io/projected/0e49524b-de34-4246-8dc3-9fdb1f496785-kube-api-access-hswbd\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:16:56.129783 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.129782    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdlwm\" (UniqueName: \"kubernetes.io/projected/2b866262-a5c0-4fb4-aa0e-c66a4ad630f6-kube-api-access-jdlwm\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:16:56.136039 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.135998    2576 generic.go:356] "Generic (PLEG): container finished" podID="2b866262-a5c0-4fb4-aa0e-c66a4ad630f6" containerID="e838ee49ea8f22b422e931f88b6c6679591aeb781a65025d902d94c0d84926de" exitCode=0
Sep 16 12:16:56.136181 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.136041    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt" event={"ID":"2b866262-a5c0-4fb4-aa0e-c66a4ad630f6","Type":"ContainerDied","Data":"e838ee49ea8f22b422e931f88b6c6679591aeb781a65025d902d94c0d84926de"}
Sep 16 12:16:56.136181 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.136060    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt"
Sep 16 12:16:56.136181 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.136150    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt" event={"ID":"2b866262-a5c0-4fb4-aa0e-c66a4ad630f6","Type":"ContainerDied","Data":"f93b2e119c0a8cff5ae093764bc2618be253ed1c5a78832b1b6ac6d7974ce065"}
Sep 16 12:16:56.136348 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.136185    2576 scope.go:117] "RemoveContainer" containerID="e838ee49ea8f22b422e931f88b6c6679591aeb781a65025d902d94c0d84926de"
Sep 16 12:16:56.138023 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.137997    2576 generic.go:356] "Generic (PLEG): container finished" podID="0e49524b-de34-4246-8dc3-9fdb1f496785" containerID="bfe05e0263e6cd6959198c40101533ac89e5a61e9b1b2977a5e55e6052fd4365" exitCode=0
Sep 16 12:16:56.138127 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.138079    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9" event={"ID":"0e49524b-de34-4246-8dc3-9fdb1f496785","Type":"ContainerDied","Data":"bfe05e0263e6cd6959198c40101533ac89e5a61e9b1b2977a5e55e6052fd4365"}
Sep 16 12:16:56.138194 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.138126    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9" event={"ID":"0e49524b-de34-4246-8dc3-9fdb1f496785","Type":"ContainerDied","Data":"af7e5f4120e8544886f3e71d118483c054d20f8d556a82c25052cdf8866b751c"}
Sep 16 12:16:56.138251 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.138209    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9"
Sep 16 12:16:56.147067 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.147046    2576 scope.go:117] "RemoveContainer" containerID="e838ee49ea8f22b422e931f88b6c6679591aeb781a65025d902d94c0d84926de"
Sep 16 12:16:56.147462 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:16:56.147437    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e838ee49ea8f22b422e931f88b6c6679591aeb781a65025d902d94c0d84926de\": container with ID starting with e838ee49ea8f22b422e931f88b6c6679591aeb781a65025d902d94c0d84926de not found: ID does not exist" containerID="e838ee49ea8f22b422e931f88b6c6679591aeb781a65025d902d94c0d84926de"
Sep 16 12:16:56.147575 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.147471    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e838ee49ea8f22b422e931f88b6c6679591aeb781a65025d902d94c0d84926de"} err="failed to get container status \"e838ee49ea8f22b422e931f88b6c6679591aeb781a65025d902d94c0d84926de\": rpc error: code = NotFound desc = could not find container \"e838ee49ea8f22b422e931f88b6c6679591aeb781a65025d902d94c0d84926de\": container with ID starting with e838ee49ea8f22b422e931f88b6c6679591aeb781a65025d902d94c0d84926de not found: ID does not exist"
Sep 16 12:16:56.147575 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.147493    2576 scope.go:117] "RemoveContainer" containerID="bfe05e0263e6cd6959198c40101533ac89e5a61e9b1b2977a5e55e6052fd4365"
Sep 16 12:16:56.156531 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.156511    2576 scope.go:117] "RemoveContainer" containerID="bfe05e0263e6cd6959198c40101533ac89e5a61e9b1b2977a5e55e6052fd4365"
Sep 16 12:16:56.156797 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:16:56.156780    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfe05e0263e6cd6959198c40101533ac89e5a61e9b1b2977a5e55e6052fd4365\": container with ID starting with bfe05e0263e6cd6959198c40101533ac89e5a61e9b1b2977a5e55e6052fd4365 not found: ID does not exist" containerID="bfe05e0263e6cd6959198c40101533ac89e5a61e9b1b2977a5e55e6052fd4365"
Sep 16 12:16:56.156856 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.156803    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfe05e0263e6cd6959198c40101533ac89e5a61e9b1b2977a5e55e6052fd4365"} err="failed to get container status \"bfe05e0263e6cd6959198c40101533ac89e5a61e9b1b2977a5e55e6052fd4365\": rpc error: code = NotFound desc = could not find container \"bfe05e0263e6cd6959198c40101533ac89e5a61e9b1b2977a5e55e6052fd4365\": container with ID starting with bfe05e0263e6cd6959198c40101533ac89e5a61e9b1b2977a5e55e6052fd4365 not found: ID does not exist"
Sep 16 12:16:56.161542 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.161521    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9"]
Sep 16 12:16:56.167274 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.167249    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-dc3e2c-589b59f45c-mwwp9"]
Sep 16 12:16:56.179450 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.179426    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt"]
Sep 16 12:16:56.183143 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.183120    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-dc3e2c-86866bffd-nxclt"]
Sep 16 12:16:56.394794 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.394759    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e49524b-de34-4246-8dc3-9fdb1f496785" path="/var/lib/kubelet/pods/0e49524b-de34-4246-8dc3-9fdb1f496785/volumes"
Sep 16 12:16:56.395288 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.395264    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b866262-a5c0-4fb4-aa0e-c66a4ad630f6" path="/var/lib/kubelet/pods/2b866262-a5c0-4fb4-aa0e-c66a4ad630f6/volumes"
Sep 16 12:16:56.395691 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:16:56.395670    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b62ccea2-663d-4912-8466-6f311ac755bb" path="/var/lib/kubelet/pods/b62ccea2-663d-4912-8466-6f311ac755bb/volumes"
Sep 16 12:17:01.244802 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:01.244763    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2"]
Sep 16 12:17:01.245722 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:01.245686    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2" podUID="1ce4dcab-1cb4-421f-a346-da3c2689cd91" containerName="payload-processing" containerID="cri-o://759efddc4e6b9065f80566d658d9d4472be933b82823b69d73be6c5aaa6d0226" gracePeriod=30
Sep 16 12:17:01.388396 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:01.388364    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a1d14a87-xrp66"]
Sep 16 12:17:01.391086 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:01.391061    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a1d14a87-xrp66"]
Sep 16 12:17:01.535060 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:01.534944    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2"
Sep 16 12:17:01.602655 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:01.602619    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ce4dcab-1cb4-421f-a346-da3c2689cd91-plugins-config-volume\") pod \"1ce4dcab-1cb4-421f-a346-da3c2689cd91\" (UID: \"1ce4dcab-1cb4-421f-a346-da3c2689cd91\") "
Sep 16 12:17:01.602839 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:01.602707    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpvt4\" (UniqueName: \"kubernetes.io/projected/1ce4dcab-1cb4-421f-a346-da3c2689cd91-kube-api-access-tpvt4\") pod \"1ce4dcab-1cb4-421f-a346-da3c2689cd91\" (UID: \"1ce4dcab-1cb4-421f-a346-da3c2689cd91\") "
Sep 16 12:17:01.603079 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:01.603051    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ce4dcab-1cb4-421f-a346-da3c2689cd91-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1ce4dcab-1cb4-421f-a346-da3c2689cd91" (UID: "1ce4dcab-1cb4-421f-a346-da3c2689cd91"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:17:01.604982 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:01.604957    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ce4dcab-1cb4-421f-a346-da3c2689cd91-kube-api-access-tpvt4" (OuterVolumeSpecName: "kube-api-access-tpvt4") pod "1ce4dcab-1cb4-421f-a346-da3c2689cd91" (UID: "1ce4dcab-1cb4-421f-a346-da3c2689cd91"). InnerVolumeSpecName "kube-api-access-tpvt4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:17:01.704139 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:01.704107    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ce4dcab-1cb4-421f-a346-da3c2689cd91-plugins-config-volume\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:17:01.704139 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:01.704136    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpvt4\" (UniqueName: \"kubernetes.io/projected/1ce4dcab-1cb4-421f-a346-da3c2689cd91-kube-api-access-tpvt4\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:17:02.178384 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:02.178346    2576 generic.go:356] "Generic (PLEG): container finished" podID="1ce4dcab-1cb4-421f-a346-da3c2689cd91" containerID="759efddc4e6b9065f80566d658d9d4472be933b82823b69d73be6c5aaa6d0226" exitCode=0
Sep 16 12:17:02.178384 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:02.178380    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2"
Sep 16 12:17:02.178599 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:02.178431    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2" event={"ID":"1ce4dcab-1cb4-421f-a346-da3c2689cd91","Type":"ContainerDied","Data":"759efddc4e6b9065f80566d658d9d4472be933b82823b69d73be6c5aaa6d0226"}
Sep 16 12:17:02.178599 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:02.178486    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2" event={"ID":"1ce4dcab-1cb4-421f-a346-da3c2689cd91","Type":"ContainerDied","Data":"4a2908cbc10f40f7e787c6bedc936534a9fbd0c59a0638061f057211e0d1a029"}
Sep 16 12:17:02.178599 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:02.178510    2576 scope.go:117] "RemoveContainer" containerID="759efddc4e6b9065f80566d658d9d4472be933b82823b69d73be6c5aaa6d0226"
Sep 16 12:17:02.188749 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:02.188722    2576 scope.go:117] "RemoveContainer" containerID="759efddc4e6b9065f80566d658d9d4472be933b82823b69d73be6c5aaa6d0226"
Sep 16 12:17:02.189019 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:17:02.189001    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"759efddc4e6b9065f80566d658d9d4472be933b82823b69d73be6c5aaa6d0226\": container with ID starting with 759efddc4e6b9065f80566d658d9d4472be933b82823b69d73be6c5aaa6d0226 not found: ID does not exist" containerID="759efddc4e6b9065f80566d658d9d4472be933b82823b69d73be6c5aaa6d0226"
Sep 16 12:17:02.189083 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:02.189026    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"759efddc4e6b9065f80566d658d9d4472be933b82823b69d73be6c5aaa6d0226"} err="failed to get container status \"759efddc4e6b9065f80566d658d9d4472be933b82823b69d73be6c5aaa6d0226\": rpc error: code = NotFound desc = could not find container \"759efddc4e6b9065f80566d658d9d4472be933b82823b69d73be6c5aaa6d0226\": container with ID starting with 759efddc4e6b9065f80566d658d9d4472be933b82823b69d73be6c5aaa6d0226 not found: ID does not exist"
Sep 16 12:17:02.202203 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:02.202182    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2"]
Sep 16 12:17:02.206282 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:02.206259    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a1d14a87-848d878fc7-7wjt2"]
Sep 16 12:17:02.395060 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:02.395021    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ce4dcab-1cb4-421f-a346-da3c2689cd91" path="/var/lib/kubelet/pods/1ce4dcab-1cb4-421f-a346-da3c2689cd91/volumes"
Sep 16 12:17:02.395563 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:02.395396    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="586d70cc-72f9-463f-868f-b2aca41fbfec" path="/var/lib/kubelet/pods/586d70cc-72f9-463f-868f-b2aca41fbfec/volumes"
Sep 16 12:17:14.360661 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:14.360632    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tb7dg_fb6b35a8-78d4-40b2-a087-7b45e92b2234/ovn-acl-logging/0.log"
Sep 16 12:17:14.362516 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:14.362488    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tb7dg_fb6b35a8-78d4-40b2-a087-7b45e92b2234/ovn-acl-logging/0.log"
Sep 16 12:17:14.726123 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:14.726048    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx"]
Sep 16 12:17:14.726581 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:14.726567    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ce4dcab-1cb4-421f-a346-da3c2689cd91" containerName="payload-processing"
Sep 16 12:17:14.726631 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:14.726583    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ce4dcab-1cb4-421f-a346-da3c2689cd91" containerName="payload-processing"
Sep 16 12:17:14.726631 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:14.726602    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b866262-a5c0-4fb4-aa0e-c66a4ad630f6" containerName="payload-pre-processing"
Sep 16 12:17:14.726631 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:14.726608    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b866262-a5c0-4fb4-aa0e-c66a4ad630f6" containerName="payload-pre-processing"
Sep 16 12:17:14.726631 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:14.726615    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="586d70cc-72f9-463f-868f-b2aca41fbfec" containerName="revoke-keys"
Sep 16 12:17:14.726631 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:14.726620    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="586d70cc-72f9-463f-868f-b2aca41fbfec" containerName="revoke-keys"
Sep 16 12:17:14.726793 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:14.726633    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e49524b-de34-4246-8dc3-9fdb1f496785" containerName="payload-processing"
Sep 16 12:17:14.726793 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:14.726638    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e49524b-de34-4246-8dc3-9fdb1f496785" containerName="payload-processing"
Sep 16 12:17:14.726793 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:14.726711    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b866262-a5c0-4fb4-aa0e-c66a4ad630f6" containerName="payload-pre-processing"
Sep 16 12:17:14.726793 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:14.726719    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ce4dcab-1cb4-421f-a346-da3c2689cd91" containerName="payload-processing"
Sep 16 12:17:14.726793 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:14.726725    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e49524b-de34-4246-8dc3-9fdb1f496785" containerName="payload-processing"
Sep 16 12:17:14.726793 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:14.726731    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="586d70cc-72f9-463f-868f-b2aca41fbfec" containerName="revoke-keys"
Sep 16 12:17:14.731206 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:14.731190    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx"
Sep 16 12:17:14.733643 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:14.733625    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-7810a5-dockercfg-wdmth\""
Sep 16 12:17:14.733752 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:14.733665    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-7810a5\""
Sep 16 12:17:14.739933 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:14.739916    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx"]
Sep 16 12:17:14.742864 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:14.742839    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3-plugins-config-volume\") pod \"payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx\" (UID: \"4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3\") " pod="openshift-ingress/payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx"
Sep 16 12:17:14.743001 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:14.742982    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7zk7\" (UniqueName: \"kubernetes.io/projected/4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3-kube-api-access-t7zk7\") pod \"payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx\" (UID: \"4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3\") " pod="openshift-ingress/payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx"
Sep 16 12:17:14.844449 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:14.844416    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3-plugins-config-volume\") pod \"payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx\" (UID: \"4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3\") " pod="openshift-ingress/payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx"
Sep 16 12:17:14.844654 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:14.844507    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7zk7\" (UniqueName: \"kubernetes.io/projected/4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3-kube-api-access-t7zk7\") pod \"payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx\" (UID: \"4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3\") " pod="openshift-ingress/payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx"
Sep 16 12:17:14.845160 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:14.845136    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3-plugins-config-volume\") pod \"payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx\" (UID: \"4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3\") " pod="openshift-ingress/payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx"
Sep 16 12:17:14.856011 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:14.855989    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7zk7\" (UniqueName: \"kubernetes.io/projected/4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3-kube-api-access-t7zk7\") pod \"payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx\" (UID: \"4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3\") " pod="openshift-ingress/payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx"
Sep 16 12:17:15.044487 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:15.044402    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx"
Sep 16 12:17:15.318892 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:15.318862    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx"]
Sep 16 12:17:15.320225 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:17:15.320187    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4abc9fd2_024c_4d43_a8b8_9e6f26bcf6d3.slice/crio-e6a5733407a2001e031439ddddc49958377659c42f429027b41d4fc8341857e0 WatchSource:0}: Error finding container e6a5733407a2001e031439ddddc49958377659c42f429027b41d4fc8341857e0: Status 404 returned error can't find the container with id e6a5733407a2001e031439ddddc49958377659c42f429027b41d4fc8341857e0
Sep 16 12:17:16.275325 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:16.275275    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx" event={"ID":"4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3","Type":"ContainerStarted","Data":"8cc15835f9aa876041bad78fc9d7ca91a91d948a5a522a90e6fd28e9b60da0f2"}
Sep 16 12:17:16.275730 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:16.275363    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx"
Sep 16 12:17:16.275730 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:16.275388    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx" event={"ID":"4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3","Type":"ContainerStarted","Data":"e6a5733407a2001e031439ddddc49958377659c42f429027b41d4fc8341857e0"}
Sep 16 12:17:16.291751 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:16.291707    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx" podStartSLOduration=2.291692431 podStartE2EDuration="2.291692431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:17:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:17:16.290912448 +0000 UTC m=+902.459877155" watchObservedRunningTime="2026-09-16 12:17:16.291692431 +0000 UTC m=+902.460657134"
Sep 16 12:17:27.284929 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:17:27.284899    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx"
Sep 16 12:18:38.645904 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.645815    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"]
Sep 16 12:18:38.650102 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.650078    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.652600 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.652578    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f916d574-openshift-default-dockercfg-mbpf9\""
Sep 16 12:18:38.660457 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.660431    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"]
Sep 16 12:18:38.740125 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.740051    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-workload-socket\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.740601 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.740556    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-workload-certs\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.740842 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.740825    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-credential-socket\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.741079 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.741061    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28vsh\" (UniqueName: \"kubernetes.io/projected/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-kube-api-access-28vsh\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.741293 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.741258    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istio-data\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.741534 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.741517    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istio-token\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.741757 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.741719    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istio-envoy\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.741998 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.741980    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istio-podinfo\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.742192 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.742175    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istiod-ca-cert\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.842982 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.842940    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-credential-socket\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.843171 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.843027    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28vsh\" (UniqueName: \"kubernetes.io/projected/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-kube-api-access-28vsh\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.843171 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.843079    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istio-data\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.843295 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.843262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istio-token\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.843409 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.843310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istio-envoy\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.843409 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.843365    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-credential-socket\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.843518 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.843411    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istio-podinfo\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.843518 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.843434    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istio-data\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.843518 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.843439    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istiod-ca-cert\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.843670 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.843542    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-workload-socket\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.843670 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.843581    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-workload-certs\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.843905 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.843864    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-workload-socket\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.844030 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.843930    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-workload-certs\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.844650 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.844622    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istiod-ca-cert\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.845841 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.845820    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istio-envoy\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.846076 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.846061    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istio-podinfo\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.850595 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.850574    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istio-token\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.851225 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.851203    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28vsh\" (UniqueName: \"kubernetes.io/projected/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-kube-api-access-28vsh\") pod \"e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") " pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:38.962503 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:38.962416    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:39.247807 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:18:39.247761    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17ad4548_2aba_4c7e_84a0_dffe18e76fdf.slice/crio-88d391ea79a7622fc9c2ca17354dd325a4e602b9fffeb6524a659a375731ffad WatchSource:0}: Error finding container 88d391ea79a7622fc9c2ca17354dd325a4e602b9fffeb6524a659a375731ffad: Status 404 returned error can't find the container with id 88d391ea79a7622fc9c2ca17354dd325a4e602b9fffeb6524a659a375731ffad
Sep 16 12:18:39.250079 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:39.250049    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:18:39.250151 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:39.250138    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:18:39.250187 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:39.250172    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:18:39.263869 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:39.263845    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"]
Sep 16 12:18:39.793145 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:39.793106    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t" event={"ID":"17ad4548-2aba-4c7e-84a0-dffe18e76fdf","Type":"ContainerStarted","Data":"4e43c1ed17f72ea28a3b7a38475d27318e34ed1a548e8793a95453c34540ec22"}
Sep 16 12:18:39.793628 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:39.793163    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t" event={"ID":"17ad4548-2aba-4c7e-84a0-dffe18e76fdf","Type":"ContainerStarted","Data":"88d391ea79a7622fc9c2ca17354dd325a4e602b9fffeb6524a659a375731ffad"}
Sep 16 12:18:39.814919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:39.814864    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t" podStartSLOduration=1.8148483149999999 podStartE2EDuration="1.814848315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:18:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:18:39.813205469 +0000 UTC m=+985.982170200" watchObservedRunningTime="2026-09-16 12:18:39.814848315 +0000 UTC m=+985.983813022"
Sep 16 12:18:39.963420 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:39.963381    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:40.968475 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:40.968448    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:41.807228 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:41.807197    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:18:41.808285 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:18:41.808261    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:19:00.651288 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:00.651217    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"]
Sep 16 12:19:00.655645 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:00.655629    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"
Sep 16 12:19:00.658401 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:00.658379    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-556077\"/\"default-dockercfg-46bj7\""
Sep 16 12:19:00.659490 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:00.659469    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-556077\"/\"kube-root-ca.crt\""
Sep 16 12:19:00.659600 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:00.659513    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-556077\"/\"e2e-conflict-a-067c87d4-kserve-self-signed-certs\""
Sep 16 12:19:00.659600 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:00.659558    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-556077\"/\"openshift-service-ca.crt\""
Sep 16 12:19:00.669465 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:00.669440    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"]
Sep 16 12:19:00.784993 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:00.784962    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/085caffd-d02c-4d23-89dd-d518894cbcfd-home\") pod \"e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7\" (UID: \"085caffd-d02c-4d23-89dd-d518894cbcfd\") " pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"
Sep 16 12:19:00.785151 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:00.785006    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7mcw\" (UniqueName: \"kubernetes.io/projected/085caffd-d02c-4d23-89dd-d518894cbcfd-kube-api-access-c7mcw\") pod \"e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7\" (UID: \"085caffd-d02c-4d23-89dd-d518894cbcfd\") " pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"
Sep 16 12:19:00.785151 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:00.785036    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/085caffd-d02c-4d23-89dd-d518894cbcfd-model-cache\") pod \"e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7\" (UID: \"085caffd-d02c-4d23-89dd-d518894cbcfd\") " pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"
Sep 16 12:19:00.785151 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:00.785094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/085caffd-d02c-4d23-89dd-d518894cbcfd-tls-certs\") pod \"e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7\" (UID: \"085caffd-d02c-4d23-89dd-d518894cbcfd\") " pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"
Sep 16 12:19:00.785264 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:00.785144    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/085caffd-d02c-4d23-89dd-d518894cbcfd-dshm\") pod \"e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7\" (UID: \"085caffd-d02c-4d23-89dd-d518894cbcfd\") " pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"
Sep 16 12:19:00.785264 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:00.785191    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/085caffd-d02c-4d23-89dd-d518894cbcfd-tmp-dir\") pod \"e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7\" (UID: \"085caffd-d02c-4d23-89dd-d518894cbcfd\") " pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"
Sep 16 12:19:00.886500 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:00.886469    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/085caffd-d02c-4d23-89dd-d518894cbcfd-home\") pod \"e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7\" (UID: \"085caffd-d02c-4d23-89dd-d518894cbcfd\") " pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"
Sep 16 12:19:00.886664 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:00.886514    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7mcw\" (UniqueName: \"kubernetes.io/projected/085caffd-d02c-4d23-89dd-d518894cbcfd-kube-api-access-c7mcw\") pod \"e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7\" (UID: \"085caffd-d02c-4d23-89dd-d518894cbcfd\") " pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"
Sep 16 12:19:00.886664 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:00.886557    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/085caffd-d02c-4d23-89dd-d518894cbcfd-model-cache\") pod \"e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7\" (UID: \"085caffd-d02c-4d23-89dd-d518894cbcfd\") " pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"
Sep 16 12:19:00.886664 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:00.886637    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/085caffd-d02c-4d23-89dd-d518894cbcfd-tls-certs\") pod \"e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7\" (UID: \"085caffd-d02c-4d23-89dd-d518894cbcfd\") " pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"
Sep 16 12:19:00.886664 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:00.886663    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/085caffd-d02c-4d23-89dd-d518894cbcfd-dshm\") pod \"e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7\" (UID: \"085caffd-d02c-4d23-89dd-d518894cbcfd\") " pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"
Sep 16 12:19:00.886888 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:00.886701    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/085caffd-d02c-4d23-89dd-d518894cbcfd-tmp-dir\") pod \"e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7\" (UID: \"085caffd-d02c-4d23-89dd-d518894cbcfd\") " pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"
Sep 16 12:19:00.886946 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:00.886912    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/085caffd-d02c-4d23-89dd-d518894cbcfd-home\") pod \"e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7\" (UID: \"085caffd-d02c-4d23-89dd-d518894cbcfd\") " pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"
Sep 16 12:19:00.887003 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:00.886984    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/085caffd-d02c-4d23-89dd-d518894cbcfd-model-cache\") pod \"e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7\" (UID: \"085caffd-d02c-4d23-89dd-d518894cbcfd\") " pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"
Sep 16 12:19:00.887119 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:00.887098    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/085caffd-d02c-4d23-89dd-d518894cbcfd-tmp-dir\") pod \"e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7\" (UID: \"085caffd-d02c-4d23-89dd-d518894cbcfd\") " pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"
Sep 16 12:19:00.889099 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:00.889077    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/085caffd-d02c-4d23-89dd-d518894cbcfd-dshm\") pod \"e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7\" (UID: \"085caffd-d02c-4d23-89dd-d518894cbcfd\") " pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"
Sep 16 12:19:00.889221 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:00.889211    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/085caffd-d02c-4d23-89dd-d518894cbcfd-tls-certs\") pod \"e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7\" (UID: \"085caffd-d02c-4d23-89dd-d518894cbcfd\") " pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"
Sep 16 12:19:00.902024 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:00.901957    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7mcw\" (UniqueName: \"kubernetes.io/projected/085caffd-d02c-4d23-89dd-d518894cbcfd-kube-api-access-c7mcw\") pod \"e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7\" (UID: \"085caffd-d02c-4d23-89dd-d518894cbcfd\") " pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"
Sep 16 12:19:00.965696 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:00.965670    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"
Sep 16 12:19:01.245142 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:01.245108    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"]
Sep 16 12:19:01.246726 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:19:01.246696    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod085caffd_d02c_4d23_89dd_d518894cbcfd.slice/crio-c2003f4ec7e79042ea4a799e2bfc5889bb4368f2989fe4564a96f442da6b7bad WatchSource:0}: Error finding container c2003f4ec7e79042ea4a799e2bfc5889bb4368f2989fe4564a96f442da6b7bad: Status 404 returned error can't find the container with id c2003f4ec7e79042ea4a799e2bfc5889bb4368f2989fe4564a96f442da6b7bad
Sep 16 12:19:01.936841 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:01.936808    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7" event={"ID":"085caffd-d02c-4d23-89dd-d518894cbcfd","Type":"ContainerStarted","Data":"4078ad78cf66ac809751f696d91063d55c2b1390d42cf03b876580c5c684550e"}
Sep 16 12:19:01.937243 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:01.936849    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7" event={"ID":"085caffd-d02c-4d23-89dd-d518894cbcfd","Type":"ContainerStarted","Data":"c2003f4ec7e79042ea4a799e2bfc5889bb4368f2989fe4564a96f442da6b7bad"}
Sep 16 12:19:01.955817 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:01.955767    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7" podStartSLOduration=1.9557516179999999 podStartE2EDuration="1.955751618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:19:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:19:01.953690464 +0000 UTC m=+1008.122655172" watchObservedRunningTime="2026-09-16 12:19:01.955751618 +0000 UTC m=+1008.124716325"
Sep 16 12:19:03.574327 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:03.574290    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7810a5-vgndt"]
Sep 16 12:19:03.578484 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:03.578466    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7810a5-vgndt"
Sep 16 12:19:03.581602 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:03.581579    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9lc86\""
Sep 16 12:19:03.584413 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:03.584390    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7810a5-vgndt"]
Sep 16 12:19:03.720889 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:03.720857    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8acadda9-9da3-4ffe-b738-113128a5eff9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-7810a5-vgndt\" (UID: \"8acadda9-9da3-4ffe-b738-113128a5eff9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7810a5-vgndt"
Sep 16 12:19:03.821765 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:03.821730    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8acadda9-9da3-4ffe-b738-113128a5eff9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-7810a5-vgndt\" (UID: \"8acadda9-9da3-4ffe-b738-113128a5eff9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7810a5-vgndt"
Sep 16 12:19:03.822406 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:03.822387    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8acadda9-9da3-4ffe-b738-113128a5eff9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-7810a5-vgndt\" (UID: \"8acadda9-9da3-4ffe-b738-113128a5eff9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7810a5-vgndt"
Sep 16 12:19:03.892265 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:03.892233    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7810a5-vgndt"
Sep 16 12:19:04.165115 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:04.165087    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7810a5-vgndt"]
Sep 16 12:19:04.166939 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:19:04.166914    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8acadda9_9da3_4ffe_b738_113128a5eff9.slice/crio-6ce8de9d834ec53d0ca02cc28a7ebcab8c04eaf98478ad7101e6fc8b0c5cbce7 WatchSource:0}: Error finding container 6ce8de9d834ec53d0ca02cc28a7ebcab8c04eaf98478ad7101e6fc8b0c5cbce7: Status 404 returned error can't find the container with id 6ce8de9d834ec53d0ca02cc28a7ebcab8c04eaf98478ad7101e6fc8b0c5cbce7
Sep 16 12:19:04.960424 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:04.960393    2576 generic.go:356] "Generic (PLEG): container finished" podID="8acadda9-9da3-4ffe-b738-113128a5eff9" containerID="db54f1ccf33a41f44adbb76b86d78a02f5fdd791ce94fff0731d336072447bdb" exitCode=0
Sep 16 12:19:04.960795 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:04.960478    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7810a5-vgndt" event={"ID":"8acadda9-9da3-4ffe-b738-113128a5eff9","Type":"ContainerDied","Data":"db54f1ccf33a41f44adbb76b86d78a02f5fdd791ce94fff0731d336072447bdb"}
Sep 16 12:19:04.960795 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:04.960543    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7810a5-vgndt" event={"ID":"8acadda9-9da3-4ffe-b738-113128a5eff9","Type":"ContainerStarted","Data":"6ce8de9d834ec53d0ca02cc28a7ebcab8c04eaf98478ad7101e6fc8b0c5cbce7"}
Sep 16 12:19:06.115472 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:06.115446    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7810a5-vgndt"
Sep 16 12:19:06.250929 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:06.250847    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8acadda9-9da3-4ffe-b738-113128a5eff9-maas-api-service-ca\") pod \"8acadda9-9da3-4ffe-b738-113128a5eff9\" (UID: \"8acadda9-9da3-4ffe-b738-113128a5eff9\") "
Sep 16 12:19:06.251180 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:06.251156    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8acadda9-9da3-4ffe-b738-113128a5eff9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8acadda9-9da3-4ffe-b738-113128a5eff9" (UID: "8acadda9-9da3-4ffe-b738-113128a5eff9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:19:06.352401 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:06.352360    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8acadda9-9da3-4ffe-b738-113128a5eff9-maas-api-service-ca\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:19:06.975211 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:06.975184    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7810a5-vgndt"
Sep 16 12:19:06.975395 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:06.975183    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7810a5-vgndt" event={"ID":"8acadda9-9da3-4ffe-b738-113128a5eff9","Type":"ContainerDied","Data":"6ce8de9d834ec53d0ca02cc28a7ebcab8c04eaf98478ad7101e6fc8b0c5cbce7"}
Sep 16 12:19:06.975395 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:06.975337    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ce8de9d834ec53d0ca02cc28a7ebcab8c04eaf98478ad7101e6fc8b0c5cbce7"
Sep 16 12:19:10.966239 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:10.966205    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"
Sep 16 12:19:10.966775 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:10.966265    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"
Sep 16 12:19:10.979166 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:10.979135    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"
Sep 16 12:19:11.012605 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:11.012579    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"
Sep 16 12:19:13.863286 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:13.863256    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx"]
Sep 16 12:19:13.863839 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:13.863469    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx" podUID="4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3" containerName="payload-processing" containerID="cri-o://8cc15835f9aa876041bad78fc9d7ca91a91d948a5a522a90e6fd28e9b60da0f2" gracePeriod=30
Sep 16 12:19:14.029878 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:14.029832    2576 generic.go:356] "Generic (PLEG): container finished" podID="4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3" containerID="8cc15835f9aa876041bad78fc9d7ca91a91d948a5a522a90e6fd28e9b60da0f2" exitCode=0
Sep 16 12:19:14.030063 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:14.029928    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx" event={"ID":"4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3","Type":"ContainerDied","Data":"8cc15835f9aa876041bad78fc9d7ca91a91d948a5a522a90e6fd28e9b60da0f2"}
Sep 16 12:19:14.050585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:14.050552    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7810a5-vgndt"]
Sep 16 12:19:14.067499 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:14.067467    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-7810a5-vgndt"]
Sep 16 12:19:14.240581 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:14.240551    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx"
Sep 16 12:19:14.359679 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:14.359645    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3-plugins-config-volume\") pod \"4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3\" (UID: \"4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3\") "
Sep 16 12:19:14.359874 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:14.359782    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7zk7\" (UniqueName: \"kubernetes.io/projected/4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3-kube-api-access-t7zk7\") pod \"4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3\" (UID: \"4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3\") "
Sep 16 12:19:14.359993 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:14.359966    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3" (UID: "4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:19:14.360168 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:14.360150    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3-plugins-config-volume\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:19:14.361929 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:14.361909    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3-kube-api-access-t7zk7" (OuterVolumeSpecName: "kube-api-access-t7zk7") pod "4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3" (UID: "4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3"). InnerVolumeSpecName "kube-api-access-t7zk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:19:14.395161 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:14.395130    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8acadda9-9da3-4ffe-b738-113128a5eff9" path="/var/lib/kubelet/pods/8acadda9-9da3-4ffe-b738-113128a5eff9/volumes"
Sep 16 12:19:14.461203 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:14.461116    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7zk7\" (UniqueName: \"kubernetes.io/projected/4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3-kube-api-access-t7zk7\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:19:15.037375 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:15.037345    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx"
Sep 16 12:19:15.037794 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:15.037347    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx" event={"ID":"4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3","Type":"ContainerDied","Data":"e6a5733407a2001e031439ddddc49958377659c42f429027b41d4fc8341857e0"}
Sep 16 12:19:15.037794 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:15.037482    2576 scope.go:117] "RemoveContainer" containerID="8cc15835f9aa876041bad78fc9d7ca91a91d948a5a522a90e6fd28e9b60da0f2"
Sep 16 12:19:15.055818 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:15.055796    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx"]
Sep 16 12:19:15.061353 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:15.061308    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-7810a5-64774b44cc-t4crx"]
Sep 16 12:19:16.394115 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:16.394080    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3" path="/var/lib/kubelet/pods/4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3/volumes"
Sep 16 12:19:20.069697 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:20.069598    2576 generic.go:356] "Generic (PLEG): container finished" podID="17ad4548-2aba-4c7e-84a0-dffe18e76fdf" containerID="4e43c1ed17f72ea28a3b7a38475d27318e34ed1a548e8793a95453c34540ec22" exitCode=0
Sep 16 12:19:20.069697 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:20.069672    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t" event={"ID":"17ad4548-2aba-4c7e-84a0-dffe18e76fdf","Type":"ContainerDied","Data":"4e43c1ed17f72ea28a3b7a38475d27318e34ed1a548e8793a95453c34540ec22"}
Sep 16 12:19:20.070243 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:20.070218    2576 scope.go:117] "RemoveContainer" containerID="4e43c1ed17f72ea28a3b7a38475d27318e34ed1a548e8793a95453c34540ec22"
Sep 16 12:19:20.071514 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:20.071486    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:19:20.071614 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:20.071557    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:19:20.071614 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:20.071591    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:19:21.078018 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:21.077988    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t" event={"ID":"17ad4548-2aba-4c7e-84a0-dffe18e76fdf","Type":"ContainerStarted","Data":"e4cfd3d123c8fb2988c6ae902878aa107b5fadbf6fbcd3b5d46159d35a417345"}
Sep 16 12:19:21.963390 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:21.963356    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:19:21.963655 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:21.963633    2576 patch_prober.go:28] interesting pod/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 16 12:19:21.963758 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:21.963688    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t" podUID="17ad4548-2aba-4c7e-84a0-dffe18e76fdf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 16 12:19:22.963651 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:22.963610    2576 patch_prober.go:28] interesting pod/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 16 12:19:22.964056 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:22.963666    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t" podUID="17ad4548-2aba-4c7e-84a0-dffe18e76fdf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 16 12:19:23.963198 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:23.963161    2576 patch_prober.go:28] interesting pod/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 16 12:19:23.963419 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:23.963229    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t" podUID="17ad4548-2aba-4c7e-84a0-dffe18e76fdf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 16 12:19:24.963159 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:24.963119    2576 patch_prober.go:28] interesting pod/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 16 12:19:24.963616 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:24.963175    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t" podUID="17ad4548-2aba-4c7e-84a0-dffe18e76fdf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 16 12:19:25.963380 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:25.963345    2576 patch_prober.go:28] interesting pod/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 16 12:19:25.963764 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:25.963399    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t" podUID="17ad4548-2aba-4c7e-84a0-dffe18e76fdf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 16 12:19:26.807557 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:26.807509    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:19:26.966947 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:26.966917    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:19:27.148231 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:27.148205    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:19:54.734448 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:54.734411    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"]
Sep 16 12:19:54.734998 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:54.734675    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t" podUID="17ad4548-2aba-4c7e-84a0-dffe18e76fdf" containerName="istio-proxy" containerID="cri-o://e4cfd3d123c8fb2988c6ae902878aa107b5fadbf6fbcd3b5d46159d35a417345" gracePeriod=30
Sep 16 12:19:57.150396 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:57.150355    2576 patch_prober.go:28] interesting pod/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 12:19:57.150844 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:57.150436    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t" podUID="17ad4548-2aba-4c7e-84a0-dffe18e76fdf" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 12:19:59.990837 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:19:59.990808    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:20:00.062813 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.062729    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28vsh\" (UniqueName: \"kubernetes.io/projected/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-kube-api-access-28vsh\") pod \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") "
Sep 16 12:20:00.062950 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.062876    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istio-envoy\") pod \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") "
Sep 16 12:20:00.062950 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.062928    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istio-data\") pod \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") "
Sep 16 12:20:00.063034 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.062951    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istio-token\") pod \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") "
Sep 16 12:20:00.063034 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.062978    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istiod-ca-cert\") pod \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") "
Sep 16 12:20:00.063125 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.063039    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istio-podinfo\") pod \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") "
Sep 16 12:20:00.063125 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.063089    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-workload-certs\") pod \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") "
Sep 16 12:20:00.063125 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.063116    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-credential-socket\") pod \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") "
Sep 16 12:20:00.063282 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.063167    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-workload-socket\") pod \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\" (UID: \"17ad4548-2aba-4c7e-84a0-dffe18e76fdf\") "
Sep 16 12:20:00.063282 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.063250    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istio-data" (OuterVolumeSpecName: "istio-data") pod "17ad4548-2aba-4c7e-84a0-dffe18e76fdf" (UID: "17ad4548-2aba-4c7e-84a0-dffe18e76fdf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:20:00.063442 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.063365    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "17ad4548-2aba-4c7e-84a0-dffe18e76fdf" (UID: "17ad4548-2aba-4c7e-84a0-dffe18e76fdf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:20:00.063516 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.063464    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "17ad4548-2aba-4c7e-84a0-dffe18e76fdf" (UID: "17ad4548-2aba-4c7e-84a0-dffe18e76fdf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:20:00.063813 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.063750    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istio-data\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:00.063813 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.063778    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istiod-ca-cert\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:00.063813 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.063791    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-workload-certs\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:00.063813 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.063828    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "17ad4548-2aba-4c7e-84a0-dffe18e76fdf" (UID: "17ad4548-2aba-4c7e-84a0-dffe18e76fdf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:20:00.064203 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.064010    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "17ad4548-2aba-4c7e-84a0-dffe18e76fdf" (UID: "17ad4548-2aba-4c7e-84a0-dffe18e76fdf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:20:00.065216 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.065193    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-kube-api-access-28vsh" (OuterVolumeSpecName: "kube-api-access-28vsh") pod "17ad4548-2aba-4c7e-84a0-dffe18e76fdf" (UID: "17ad4548-2aba-4c7e-84a0-dffe18e76fdf"). InnerVolumeSpecName "kube-api-access-28vsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:20:00.065515 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.065494    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "17ad4548-2aba-4c7e-84a0-dffe18e76fdf" (UID: "17ad4548-2aba-4c7e-84a0-dffe18e76fdf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:20:00.065780 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.065757    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "17ad4548-2aba-4c7e-84a0-dffe18e76fdf" (UID: "17ad4548-2aba-4c7e-84a0-dffe18e76fdf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:20:00.065847 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.065760    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istio-token" (OuterVolumeSpecName: "istio-token") pod "17ad4548-2aba-4c7e-84a0-dffe18e76fdf" (UID: "17ad4548-2aba-4c7e-84a0-dffe18e76fdf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:20:00.165292 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.165257    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istio-podinfo\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:00.165292 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.165288    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-credential-socket\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:00.165292 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.165299    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-workload-socket\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:00.165525 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.165307    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28vsh\" (UniqueName: \"kubernetes.io/projected/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-kube-api-access-28vsh\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:00.165525 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.165344    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istio-envoy\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:00.165525 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.165356    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17ad4548-2aba-4c7e-84a0-dffe18e76fdf-istio-token\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:00.397404 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.397362    2576 generic.go:356] "Generic (PLEG): container finished" podID="17ad4548-2aba-4c7e-84a0-dffe18e76fdf" containerID="e4cfd3d123c8fb2988c6ae902878aa107b5fadbf6fbcd3b5d46159d35a417345" exitCode=0
Sep 16 12:20:00.397589 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.397418    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"
Sep 16 12:20:00.397589 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.397449    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t" event={"ID":"17ad4548-2aba-4c7e-84a0-dffe18e76fdf","Type":"ContainerDied","Data":"e4cfd3d123c8fb2988c6ae902878aa107b5fadbf6fbcd3b5d46159d35a417345"}
Sep 16 12:20:00.397589 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.397494    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t" event={"ID":"17ad4548-2aba-4c7e-84a0-dffe18e76fdf","Type":"ContainerDied","Data":"88d391ea79a7622fc9c2ca17354dd325a4e602b9fffeb6524a659a375731ffad"}
Sep 16 12:20:00.397589 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.397513    2576 scope.go:117] "RemoveContainer" containerID="e4cfd3d123c8fb2988c6ae902878aa107b5fadbf6fbcd3b5d46159d35a417345"
Sep 16 12:20:00.407842 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.407824    2576 scope.go:117] "RemoveContainer" containerID="4e43c1ed17f72ea28a3b7a38475d27318e34ed1a548e8793a95453c34540ec22"
Sep 16 12:20:00.417474 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.417449    2576 scope.go:117] "RemoveContainer" containerID="e4cfd3d123c8fb2988c6ae902878aa107b5fadbf6fbcd3b5d46159d35a417345"
Sep 16 12:20:00.417992 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:20:00.417867    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4cfd3d123c8fb2988c6ae902878aa107b5fadbf6fbcd3b5d46159d35a417345\": container with ID starting with e4cfd3d123c8fb2988c6ae902878aa107b5fadbf6fbcd3b5d46159d35a417345 not found: ID does not exist" containerID="e4cfd3d123c8fb2988c6ae902878aa107b5fadbf6fbcd3b5d46159d35a417345"
Sep 16 12:20:00.417992 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.417925    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4cfd3d123c8fb2988c6ae902878aa107b5fadbf6fbcd3b5d46159d35a417345"} err="failed to get container status \"e4cfd3d123c8fb2988c6ae902878aa107b5fadbf6fbcd3b5d46159d35a417345\": rpc error: code = NotFound desc = could not find container \"e4cfd3d123c8fb2988c6ae902878aa107b5fadbf6fbcd3b5d46159d35a417345\": container with ID starting with e4cfd3d123c8fb2988c6ae902878aa107b5fadbf6fbcd3b5d46159d35a417345 not found: ID does not exist"
Sep 16 12:20:00.417992 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.417948    2576 scope.go:117] "RemoveContainer" containerID="4e43c1ed17f72ea28a3b7a38475d27318e34ed1a548e8793a95453c34540ec22"
Sep 16 12:20:00.418448 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:20:00.418418    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e43c1ed17f72ea28a3b7a38475d27318e34ed1a548e8793a95453c34540ec22\": container with ID starting with 4e43c1ed17f72ea28a3b7a38475d27318e34ed1a548e8793a95453c34540ec22 not found: ID does not exist" containerID="4e43c1ed17f72ea28a3b7a38475d27318e34ed1a548e8793a95453c34540ec22"
Sep 16 12:20:00.418448 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.418454    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e43c1ed17f72ea28a3b7a38475d27318e34ed1a548e8793a95453c34540ec22"} err="failed to get container status \"4e43c1ed17f72ea28a3b7a38475d27318e34ed1a548e8793a95453c34540ec22\": rpc error: code = NotFound desc = could not find container \"4e43c1ed17f72ea28a3b7a38475d27318e34ed1a548e8793a95453c34540ec22\": container with ID starting with 4e43c1ed17f72ea28a3b7a38475d27318e34ed1a548e8793a95453c34540ec22 not found: ID does not exist"
Sep 16 12:20:00.421238 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.421220    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"]
Sep 16 12:20:00.427036 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:00.427014    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f916d574-openshift-default-7f4dd7f7f6-t5r6t"]
Sep 16 12:20:02.397122 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:02.397087    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17ad4548-2aba-4c7e-84a0-dffe18e76fdf" path="/var/lib/kubelet/pods/17ad4548-2aba-4c7e-84a0-dffe18e76fdf/volumes"
Sep 16 12:20:17.512119 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.512087    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24"]
Sep 16 12:20:17.512830 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.512807    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17ad4548-2aba-4c7e-84a0-dffe18e76fdf" containerName="istio-proxy"
Sep 16 12:20:17.512936 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.512832    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="17ad4548-2aba-4c7e-84a0-dffe18e76fdf" containerName="istio-proxy"
Sep 16 12:20:17.512936 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.512847    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3" containerName="payload-processing"
Sep 16 12:20:17.512936 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.512856    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3" containerName="payload-processing"
Sep 16 12:20:17.512936 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.512871    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17ad4548-2aba-4c7e-84a0-dffe18e76fdf" containerName="istio-proxy"
Sep 16 12:20:17.512936 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.512880    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="17ad4548-2aba-4c7e-84a0-dffe18e76fdf" containerName="istio-proxy"
Sep 16 12:20:17.512936 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.512908    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8acadda9-9da3-4ffe-b738-113128a5eff9" containerName="revoke-keys"
Sep 16 12:20:17.512936 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.512915    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8acadda9-9da3-4ffe-b738-113128a5eff9" containerName="revoke-keys"
Sep 16 12:20:17.513282 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.513045    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4abc9fd2-024c-4d43-a8b8-9e6f26bcf6d3" containerName="payload-processing"
Sep 16 12:20:17.513282 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.513060    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8acadda9-9da3-4ffe-b738-113128a5eff9" containerName="revoke-keys"
Sep 16 12:20:17.513282 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.513071    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="17ad4548-2aba-4c7e-84a0-dffe18e76fdf" containerName="istio-proxy"
Sep 16 12:20:17.513282 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.513091    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="17ad4548-2aba-4c7e-84a0-dffe18e76fdf" containerName="istio-proxy"
Sep 16 12:20:17.516579 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.516557    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24"
Sep 16 12:20:17.522727 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.522702    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-867202\""
Sep 16 12:20:17.522836 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.522703    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-867202-dockercfg-xjb8r\""
Sep 16 12:20:17.530003 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.529982    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24"]
Sep 16 12:20:17.548048 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.547946    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv"]
Sep 16 12:20:17.552724 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.552704    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv"
Sep 16 12:20:17.560692 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.560669    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv"]
Sep 16 12:20:17.560809 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.560668    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqrzx\" (UniqueName: \"kubernetes.io/projected/41edceca-35d9-4a38-81b9-d460ed9d7b85-kube-api-access-hqrzx\") pod \"payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24\" (UID: \"41edceca-35d9-4a38-81b9-d460ed9d7b85\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24"
Sep 16 12:20:17.560896 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.560874    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2fxg\" (UniqueName: \"kubernetes.io/projected/36ac8185-4fbd-4d0d-a883-a539e6425d12-kube-api-access-l2fxg\") pod \"payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv\" (UID: \"36ac8185-4fbd-4d0d-a883-a539e6425d12\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv"
Sep 16 12:20:17.561020 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.560992    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36ac8185-4fbd-4d0d-a883-a539e6425d12-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv\" (UID: \"36ac8185-4fbd-4d0d-a883-a539e6425d12\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv"
Sep 16 12:20:17.561130 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.561065    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41edceca-35d9-4a38-81b9-d460ed9d7b85-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24\" (UID: \"41edceca-35d9-4a38-81b9-d460ed9d7b85\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24"
Sep 16 12:20:17.662373 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.662304    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2fxg\" (UniqueName: \"kubernetes.io/projected/36ac8185-4fbd-4d0d-a883-a539e6425d12-kube-api-access-l2fxg\") pod \"payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv\" (UID: \"36ac8185-4fbd-4d0d-a883-a539e6425d12\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv"
Sep 16 12:20:17.662559 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.662442    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36ac8185-4fbd-4d0d-a883-a539e6425d12-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv\" (UID: \"36ac8185-4fbd-4d0d-a883-a539e6425d12\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv"
Sep 16 12:20:17.662559 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.662494    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41edceca-35d9-4a38-81b9-d460ed9d7b85-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24\" (UID: \"41edceca-35d9-4a38-81b9-d460ed9d7b85\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24"
Sep 16 12:20:17.662559 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.662521    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqrzx\" (UniqueName: \"kubernetes.io/projected/41edceca-35d9-4a38-81b9-d460ed9d7b85-kube-api-access-hqrzx\") pod \"payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24\" (UID: \"41edceca-35d9-4a38-81b9-d460ed9d7b85\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24"
Sep 16 12:20:17.663270 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.663247    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41edceca-35d9-4a38-81b9-d460ed9d7b85-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24\" (UID: \"41edceca-35d9-4a38-81b9-d460ed9d7b85\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24"
Sep 16 12:20:17.663426 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.663397    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36ac8185-4fbd-4d0d-a883-a539e6425d12-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv\" (UID: \"36ac8185-4fbd-4d0d-a883-a539e6425d12\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv"
Sep 16 12:20:17.670583 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.670561    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqrzx\" (UniqueName: \"kubernetes.io/projected/41edceca-35d9-4a38-81b9-d460ed9d7b85-kube-api-access-hqrzx\") pod \"payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24\" (UID: \"41edceca-35d9-4a38-81b9-d460ed9d7b85\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24"
Sep 16 12:20:17.670731 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.670613    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2fxg\" (UniqueName: \"kubernetes.io/projected/36ac8185-4fbd-4d0d-a883-a539e6425d12-kube-api-access-l2fxg\") pod \"payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv\" (UID: \"36ac8185-4fbd-4d0d-a883-a539e6425d12\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv"
Sep 16 12:20:17.828294 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.828209    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24"
Sep 16 12:20:17.866861 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:17.866816    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv"
Sep 16 12:20:18.117726 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:18.117696    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24"]
Sep 16 12:20:18.118979 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:20:18.118944    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41edceca_35d9_4a38_81b9_d460ed9d7b85.slice/crio-30107a0e7dae15493ee193004aff2baa9d37a58a6bb150b6913b818868e0a89b WatchSource:0}: Error finding container 30107a0e7dae15493ee193004aff2baa9d37a58a6bb150b6913b818868e0a89b: Status 404 returned error can't find the container with id 30107a0e7dae15493ee193004aff2baa9d37a58a6bb150b6913b818868e0a89b
Sep 16 12:20:18.159017 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:18.158987    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv"]
Sep 16 12:20:18.160398 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:20:18.160367    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36ac8185_4fbd_4d0d_a883_a539e6425d12.slice/crio-f369fcbdd8f35670d1ca030ed34fec05805c78c73410767728b387ce314a5150 WatchSource:0}: Error finding container f369fcbdd8f35670d1ca030ed34fec05805c78c73410767728b387ce314a5150: Status 404 returned error can't find the container with id f369fcbdd8f35670d1ca030ed34fec05805c78c73410767728b387ce314a5150
Sep 16 12:20:18.526453 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:18.526345    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24" event={"ID":"41edceca-35d9-4a38-81b9-d460ed9d7b85","Type":"ContainerStarted","Data":"b8946d699385adf5f350b32ccee7f86ee11217180c7fcf71ccac53ae99ccca40"}
Sep 16 12:20:18.526453 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:18.526402    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24" event={"ID":"41edceca-35d9-4a38-81b9-d460ed9d7b85","Type":"ContainerStarted","Data":"30107a0e7dae15493ee193004aff2baa9d37a58a6bb150b6913b818868e0a89b"}
Sep 16 12:20:18.526952 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:18.526647    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24"
Sep 16 12:20:18.528190 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:18.528164    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv" event={"ID":"36ac8185-4fbd-4d0d-a883-a539e6425d12","Type":"ContainerStarted","Data":"4473600adb8f6c1bb6f5e82650e7ece764d95688aedab1ec0835415f7e68b3bc"}
Sep 16 12:20:18.528297 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:18.528198    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv" event={"ID":"36ac8185-4fbd-4d0d-a883-a539e6425d12","Type":"ContainerStarted","Data":"f369fcbdd8f35670d1ca030ed34fec05805c78c73410767728b387ce314a5150"}
Sep 16 12:20:18.528297 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:18.528231    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv"
Sep 16 12:20:18.551901 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:18.551820    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24" podStartSLOduration=1.551804893 podStartE2EDuration="1.551804893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:20:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:20:18.548497738 +0000 UTC m=+1084.717462445" watchObservedRunningTime="2026-09-16 12:20:18.551804893 +0000 UTC m=+1084.720769600"
Sep 16 12:20:18.571102 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:18.571051    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv" podStartSLOduration=1.571034786 podStartE2EDuration="1.571034786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:20:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:20:18.568300736 +0000 UTC m=+1084.737265445" watchObservedRunningTime="2026-09-16 12:20:18.571034786 +0000 UTC m=+1084.739999521"
Sep 16 12:20:19.020779 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:19.020745    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-641983-29826015-87kj7"]
Sep 16 12:20:19.023352 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:19.023309    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-641983-29826015-87kj7"]
Sep 16 12:20:19.056954 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:19.056923    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs"]
Sep 16 12:20:19.057180 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:19.057156    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs" podUID="7ebde485-25be-49fc-b980-9730767fa52b" containerName="payload-pre-processing" containerID="cri-o://fea0f109828b06742ca6205b7227a16d24a6d60cd903f4e739fa0879d7e488f3" gracePeriod=30
Sep 16 12:20:19.351656 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:19.351633    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs"
Sep 16 12:20:19.402080 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:19.402041    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7ebde485-25be-49fc-b980-9730767fa52b-plugins-config-volume\") pod \"7ebde485-25be-49fc-b980-9730767fa52b\" (UID: \"7ebde485-25be-49fc-b980-9730767fa52b\") "
Sep 16 12:20:19.402438 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:19.402418    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mktv9\" (UniqueName: \"kubernetes.io/projected/7ebde485-25be-49fc-b980-9730767fa52b-kube-api-access-mktv9\") pod \"7ebde485-25be-49fc-b980-9730767fa52b\" (UID: \"7ebde485-25be-49fc-b980-9730767fa52b\") "
Sep 16 12:20:19.413340 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:19.412781    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ebde485-25be-49fc-b980-9730767fa52b-kube-api-access-mktv9" (OuterVolumeSpecName: "kube-api-access-mktv9") pod "7ebde485-25be-49fc-b980-9730767fa52b" (UID: "7ebde485-25be-49fc-b980-9730767fa52b"). InnerVolumeSpecName "kube-api-access-mktv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:20:19.413763 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:19.413738    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ebde485-25be-49fc-b980-9730767fa52b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7ebde485-25be-49fc-b980-9730767fa52b" (UID: "7ebde485-25be-49fc-b980-9730767fa52b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:20:19.504069 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:19.504032    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7ebde485-25be-49fc-b980-9730767fa52b-plugins-config-volume\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:19.504069 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:19.504066    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mktv9\" (UniqueName: \"kubernetes.io/projected/7ebde485-25be-49fc-b980-9730767fa52b-kube-api-access-mktv9\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:19.537719 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:19.537686    2576 generic.go:356] "Generic (PLEG): container finished" podID="7ebde485-25be-49fc-b980-9730767fa52b" containerID="fea0f109828b06742ca6205b7227a16d24a6d60cd903f4e739fa0879d7e488f3" exitCode=0
Sep 16 12:20:19.538169 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:19.537747    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs"
Sep 16 12:20:19.538169 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:19.537774    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs" event={"ID":"7ebde485-25be-49fc-b980-9730767fa52b","Type":"ContainerDied","Data":"fea0f109828b06742ca6205b7227a16d24a6d60cd903f4e739fa0879d7e488f3"}
Sep 16 12:20:19.538169 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:19.537832    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs" event={"ID":"7ebde485-25be-49fc-b980-9730767fa52b","Type":"ContainerDied","Data":"11dc489497a58d371e9ce4ea2c36924960c154c31cb34a4fe82efc968ed70b56"}
Sep 16 12:20:19.538169 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:19.537864    2576 scope.go:117] "RemoveContainer" containerID="fea0f109828b06742ca6205b7227a16d24a6d60cd903f4e739fa0879d7e488f3"
Sep 16 12:20:19.548396 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:19.548375    2576 scope.go:117] "RemoveContainer" containerID="fea0f109828b06742ca6205b7227a16d24a6d60cd903f4e739fa0879d7e488f3"
Sep 16 12:20:19.548704 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:20:19.548684    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fea0f109828b06742ca6205b7227a16d24a6d60cd903f4e739fa0879d7e488f3\": container with ID starting with fea0f109828b06742ca6205b7227a16d24a6d60cd903f4e739fa0879d7e488f3 not found: ID does not exist" containerID="fea0f109828b06742ca6205b7227a16d24a6d60cd903f4e739fa0879d7e488f3"
Sep 16 12:20:19.548771 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:19.548714    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fea0f109828b06742ca6205b7227a16d24a6d60cd903f4e739fa0879d7e488f3"} err="failed to get container status \"fea0f109828b06742ca6205b7227a16d24a6d60cd903f4e739fa0879d7e488f3\": rpc error: code = NotFound desc = could not find container \"fea0f109828b06742ca6205b7227a16d24a6d60cd903f4e739fa0879d7e488f3\": container with ID starting with fea0f109828b06742ca6205b7227a16d24a6d60cd903f4e739fa0879d7e488f3 not found: ID does not exist"
Sep 16 12:20:19.567906 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:19.567865    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs"]
Sep 16 12:20:19.574515 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:19.574487    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-641983-8c9f56678-nhggs"]
Sep 16 12:20:20.394654 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:20.394619    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ebde485-25be-49fc-b980-9730767fa52b" path="/var/lib/kubelet/pods/7ebde485-25be-49fc-b980-9730767fa52b/volumes"
Sep 16 12:20:20.395032 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:20.395011    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="912f7333-2309-42ca-aa85-56930d0b7b71" path="/var/lib/kubelet/pods/912f7333-2309-42ca-aa85-56930d0b7b71/volumes"
Sep 16 12:20:25.787827 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:25.787797    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"]
Sep 16 12:20:25.788371 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:25.788005    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt" podUID="f9e8c1b0-66b9-4230-b489-bc5d5712a8c7" containerName="istio-proxy" containerID="cri-o://c0664f46e92b5518810a9170f9801f98942ae698a14c2d586bd7b3f4418cd094" gracePeriod=30
Sep 16 12:20:26.208686 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:26.208640    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08170a-qzc76"]
Sep 16 12:20:26.209495 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:26.209474    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ebde485-25be-49fc-b980-9730767fa52b" containerName="payload-pre-processing"
Sep 16 12:20:26.209577 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:26.209500    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ebde485-25be-49fc-b980-9730767fa52b" containerName="payload-pre-processing"
Sep 16 12:20:26.209644 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:26.209632    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ebde485-25be-49fc-b980-9730767fa52b" containerName="payload-pre-processing"
Sep 16 12:20:26.214220 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:26.214202    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08170a-qzc76"
Sep 16 12:20:26.217077 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:26.217052    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9lc86\""
Sep 16 12:20:26.220222 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:26.220199    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08170a-qzc76"]
Sep 16 12:20:26.278292 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:26.278260    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c8e8cdf-8b2a-4a59-8771-7ff8df0bfd3e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-08170a-qzc76\" (UID: \"7c8e8cdf-8b2a-4a59-8771-7ff8df0bfd3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08170a-qzc76"
Sep 16 12:20:26.379696 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:26.379661    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c8e8cdf-8b2a-4a59-8771-7ff8df0bfd3e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-08170a-qzc76\" (UID: \"7c8e8cdf-8b2a-4a59-8771-7ff8df0bfd3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08170a-qzc76"
Sep 16 12:20:26.380269 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:26.380251    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c8e8cdf-8b2a-4a59-8771-7ff8df0bfd3e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-08170a-qzc76\" (UID: \"7c8e8cdf-8b2a-4a59-8771-7ff8df0bfd3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08170a-qzc76"
Sep 16 12:20:26.527209 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:26.527125    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08170a-qzc76"
Sep 16 12:20:26.825300 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:20:26.825270    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c8e8cdf_8b2a_4a59_8771_7ff8df0bfd3e.slice/crio-a84055871bf3755a4e0c6d41c3d0afc95fd164bde00c4d2620dcaced52941d89 WatchSource:0}: Error finding container a84055871bf3755a4e0c6d41c3d0afc95fd164bde00c4d2620dcaced52941d89: Status 404 returned error can't find the container with id a84055871bf3755a4e0c6d41c3d0afc95fd164bde00c4d2620dcaced52941d89
Sep 16 12:20:26.826191 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:26.826165    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08170a-qzc76"]
Sep 16 12:20:27.591829 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:27.591796    2576 generic.go:356] "Generic (PLEG): container finished" podID="7c8e8cdf-8b2a-4a59-8771-7ff8df0bfd3e" containerID="3329329fa2b6f4c5702be13b3499780f7b707b00a544cd0e5e53ab3602b77ac8" exitCode=0
Sep 16 12:20:27.592013 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:27.591881    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08170a-qzc76" event={"ID":"7c8e8cdf-8b2a-4a59-8771-7ff8df0bfd3e","Type":"ContainerDied","Data":"3329329fa2b6f4c5702be13b3499780f7b707b00a544cd0e5e53ab3602b77ac8"}
Sep 16 12:20:27.592013 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:27.591964    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08170a-qzc76" event={"ID":"7c8e8cdf-8b2a-4a59-8771-7ff8df0bfd3e","Type":"ContainerStarted","Data":"a84055871bf3755a4e0c6d41c3d0afc95fd164bde00c4d2620dcaced52941d89"}
Sep 16 12:20:28.749698 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:28.749669    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08170a-qzc76"
Sep 16 12:20:28.905064 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:28.905031    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c8e8cdf-8b2a-4a59-8771-7ff8df0bfd3e-maas-api-service-ca\") pod \"7c8e8cdf-8b2a-4a59-8771-7ff8df0bfd3e\" (UID: \"7c8e8cdf-8b2a-4a59-8771-7ff8df0bfd3e\") "
Sep 16 12:20:28.905422 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:28.905398    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c8e8cdf-8b2a-4a59-8771-7ff8df0bfd3e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7c8e8cdf-8b2a-4a59-8771-7ff8df0bfd3e" (UID: "7c8e8cdf-8b2a-4a59-8771-7ff8df0bfd3e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:20:29.006964 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:29.006930    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c8e8cdf-8b2a-4a59-8771-7ff8df0bfd3e-maas-api-service-ca\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:29.540413 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:29.540382    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24"
Sep 16 12:20:29.540607 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:29.540464    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv"
Sep 16 12:20:29.608469 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:29.608437    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08170a-qzc76"
Sep 16 12:20:29.608645 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:29.608483    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08170a-qzc76" event={"ID":"7c8e8cdf-8b2a-4a59-8771-7ff8df0bfd3e","Type":"ContainerDied","Data":"a84055871bf3755a4e0c6d41c3d0afc95fd164bde00c4d2620dcaced52941d89"}
Sep 16 12:20:29.608645 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:29.608533    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a84055871bf3755a4e0c6d41c3d0afc95fd164bde00c4d2620dcaced52941d89"
Sep 16 12:20:31.058277 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.058217    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:20:31.128512 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.128483    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-credential-socket\") pod \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") "
Sep 16 12:20:31.128663 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.128532    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istio-envoy\") pod \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") "
Sep 16 12:20:31.128663 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.128554    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istiod-ca-cert\") pod \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") "
Sep 16 12:20:31.128663 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.128595    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qghxr\" (UniqueName: \"kubernetes.io/projected/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-kube-api-access-qghxr\") pod \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") "
Sep 16 12:20:31.128663 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.128637    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istio-podinfo\") pod \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") "
Sep 16 12:20:31.128908 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.128747    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f9e8c1b0-66b9-4230-b489-bc5d5712a8c7" (UID: "f9e8c1b0-66b9-4230-b489-bc5d5712a8c7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:20:31.128908 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.128773    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istio-data\") pod \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") "
Sep 16 12:20:31.128908 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.128834    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-workload-socket\") pod \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") "
Sep 16 12:20:31.128908 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.128871    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istio-token\") pod \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") "
Sep 16 12:20:31.129095 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.128940    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-workload-certs\") pod \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\" (UID: \"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7\") "
Sep 16 12:20:31.129095 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.129025    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istio-data" (OuterVolumeSpecName: "istio-data") pod "f9e8c1b0-66b9-4230-b489-bc5d5712a8c7" (UID: "f9e8c1b0-66b9-4230-b489-bc5d5712a8c7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:20:31.129095 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.129035    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f9e8c1b0-66b9-4230-b489-bc5d5712a8c7" (UID: "f9e8c1b0-66b9-4230-b489-bc5d5712a8c7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:20:31.129095 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.129056    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f9e8c1b0-66b9-4230-b489-bc5d5712a8c7" (UID: "f9e8c1b0-66b9-4230-b489-bc5d5712a8c7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:20:31.129349 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.129300    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f9e8c1b0-66b9-4230-b489-bc5d5712a8c7" (UID: "f9e8c1b0-66b9-4230-b489-bc5d5712a8c7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:20:31.129480 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.129445    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-credential-socket\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:31.129480 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.129464    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istiod-ca-cert\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:31.129480 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.129477    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istio-data\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:31.129627 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.129489    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-workload-socket\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:31.129627 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.129501    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-workload-certs\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:31.131011 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.130984    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f9e8c1b0-66b9-4230-b489-bc5d5712a8c7" (UID: "f9e8c1b0-66b9-4230-b489-bc5d5712a8c7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:20:31.131293 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.131275    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istio-token" (OuterVolumeSpecName: "istio-token") pod "f9e8c1b0-66b9-4230-b489-bc5d5712a8c7" (UID: "f9e8c1b0-66b9-4230-b489-bc5d5712a8c7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:20:31.131492 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.131470    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f9e8c1b0-66b9-4230-b489-bc5d5712a8c7" (UID: "f9e8c1b0-66b9-4230-b489-bc5d5712a8c7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:20:31.131575 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.131492    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-kube-api-access-qghxr" (OuterVolumeSpecName: "kube-api-access-qghxr") pod "f9e8c1b0-66b9-4230-b489-bc5d5712a8c7" (UID: "f9e8c1b0-66b9-4230-b489-bc5d5712a8c7"). InnerVolumeSpecName "kube-api-access-qghxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:20:31.230254 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.230219    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istio-envoy\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:31.230254 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.230248    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qghxr\" (UniqueName: \"kubernetes.io/projected/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-kube-api-access-qghxr\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:31.230458 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.230262    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istio-podinfo\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:31.230458 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.230276    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7-istio-token\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:31.622523 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.622483    2576 generic.go:356] "Generic (PLEG): container finished" podID="f9e8c1b0-66b9-4230-b489-bc5d5712a8c7" containerID="c0664f46e92b5518810a9170f9801f98942ae698a14c2d586bd7b3f4418cd094" exitCode=0
Sep 16 12:20:31.622727 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.622528    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"
Sep 16 12:20:31.622727 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.622569    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt" event={"ID":"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7","Type":"ContainerDied","Data":"c0664f46e92b5518810a9170f9801f98942ae698a14c2d586bd7b3f4418cd094"}
Sep 16 12:20:31.622727 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.622633    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt" event={"ID":"f9e8c1b0-66b9-4230-b489-bc5d5712a8c7","Type":"ContainerDied","Data":"ee3ef0ca2a85fdf39f9d2f464a8c70a62f6e967eaadd28a7adfe55eb38d1b357"}
Sep 16 12:20:31.622727 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.622664    2576 scope.go:117] "RemoveContainer" containerID="c0664f46e92b5518810a9170f9801f98942ae698a14c2d586bd7b3f4418cd094"
Sep 16 12:20:31.633307 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.633290    2576 scope.go:117] "RemoveContainer" containerID="53c98440d3fed79339fcb7039dad103690acc0856a2e31df6b7c6cc2b0db6a61"
Sep 16 12:20:31.642362 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.642345    2576 scope.go:117] "RemoveContainer" containerID="c0664f46e92b5518810a9170f9801f98942ae698a14c2d586bd7b3f4418cd094"
Sep 16 12:20:31.642610 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:20:31.642591    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0664f46e92b5518810a9170f9801f98942ae698a14c2d586bd7b3f4418cd094\": container with ID starting with c0664f46e92b5518810a9170f9801f98942ae698a14c2d586bd7b3f4418cd094 not found: ID does not exist" containerID="c0664f46e92b5518810a9170f9801f98942ae698a14c2d586bd7b3f4418cd094"
Sep 16 12:20:31.642675 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.642617    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0664f46e92b5518810a9170f9801f98942ae698a14c2d586bd7b3f4418cd094"} err="failed to get container status \"c0664f46e92b5518810a9170f9801f98942ae698a14c2d586bd7b3f4418cd094\": rpc error: code = NotFound desc = could not find container \"c0664f46e92b5518810a9170f9801f98942ae698a14c2d586bd7b3f4418cd094\": container with ID starting with c0664f46e92b5518810a9170f9801f98942ae698a14c2d586bd7b3f4418cd094 not found: ID does not exist"
Sep 16 12:20:31.642675 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.642633    2576 scope.go:117] "RemoveContainer" containerID="53c98440d3fed79339fcb7039dad103690acc0856a2e31df6b7c6cc2b0db6a61"
Sep 16 12:20:31.642901 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:20:31.642878    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53c98440d3fed79339fcb7039dad103690acc0856a2e31df6b7c6cc2b0db6a61\": container with ID starting with 53c98440d3fed79339fcb7039dad103690acc0856a2e31df6b7c6cc2b0db6a61 not found: ID does not exist" containerID="53c98440d3fed79339fcb7039dad103690acc0856a2e31df6b7c6cc2b0db6a61"
Sep 16 12:20:31.643000 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.642911    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53c98440d3fed79339fcb7039dad103690acc0856a2e31df6b7c6cc2b0db6a61"} err="failed to get container status \"53c98440d3fed79339fcb7039dad103690acc0856a2e31df6b7c6cc2b0db6a61\": rpc error: code = NotFound desc = could not find container \"53c98440d3fed79339fcb7039dad103690acc0856a2e31df6b7c6cc2b0db6a61\": container with ID starting with 53c98440d3fed79339fcb7039dad103690acc0856a2e31df6b7c6cc2b0db6a61 not found: ID does not exist"
Sep 16 12:20:31.646164 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.646143    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"]
Sep 16 12:20:31.650680 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:31.650658    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-641983-openshift-default-fc56db57b-4fwrt"]
Sep 16 12:20:32.394502 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:32.394471    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9e8c1b0-66b9-4230-b489-bc5d5712a8c7" path="/var/lib/kubelet/pods/f9e8c1b0-66b9-4230-b489-bc5d5712a8c7/volumes"
Sep 16 12:20:39.130221 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:39.130179    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-08170a-29826015-pcv62"]
Sep 16 12:20:39.132818 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:39.132791    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-08170a-29826015-pcv62"]
Sep 16 12:20:39.323509 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:39.323478    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08170a-qzc76"]
Sep 16 12:20:39.328293 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:39.328265    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-08170a-qzc76"]
Sep 16 12:20:40.398021 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:40.397987    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19cae082-1bc2-45cc-a04f-826066425ca9" path="/var/lib/kubelet/pods/19cae082-1bc2-45cc-a04f-826066425ca9/volumes"
Sep 16 12:20:40.398701 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:40.398360    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c8e8cdf-8b2a-4a59-8771-7ff8df0bfd3e" path="/var/lib/kubelet/pods/7c8e8cdf-8b2a-4a59-8771-7ff8df0bfd3e/volumes"
Sep 16 12:20:45.828994 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:45.828963    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"]
Sep 16 12:20:45.829405 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:45.829203    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc" podUID="87f7efb4-7641-4852-a18c-db75ef0f054f" containerName="istio-proxy" containerID="cri-o://cff4125c626686b0a59984205c65bd9e343c766f850f964bc21fabe57c750f61" gracePeriod=30
Sep 16 12:20:47.771256 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:47.771221    2576 patch_prober.go:28] interesting pod/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 12:20:47.771672 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:47.771298    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc" podUID="87f7efb4-7641-4852-a18c-db75ef0f054f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 12:20:51.091567 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.091505    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:20:51.157177 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.157143    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-istio-envoy\") pod \"87f7efb4-7641-4852-a18c-db75ef0f054f\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") "
Sep 16 12:20:51.157382 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.157202    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87f7efb4-7641-4852-a18c-db75ef0f054f-istiod-ca-cert\") pod \"87f7efb4-7641-4852-a18c-db75ef0f054f\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") "
Sep 16 12:20:51.157382 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.157245    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-workload-socket\") pod \"87f7efb4-7641-4852-a18c-db75ef0f054f\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") "
Sep 16 12:20:51.157382 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.157350    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87f7efb4-7641-4852-a18c-db75ef0f054f-istio-token\") pod \"87f7efb4-7641-4852-a18c-db75ef0f054f\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") "
Sep 16 12:20:51.157579 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.157473    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-credential-socket\") pod \"87f7efb4-7641-4852-a18c-db75ef0f054f\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") "
Sep 16 12:20:51.157579 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.157547    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-workload-certs\") pod \"87f7efb4-7641-4852-a18c-db75ef0f054f\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") "
Sep 16 12:20:51.157679 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.157616    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wsgq\" (UniqueName: \"kubernetes.io/projected/87f7efb4-7641-4852-a18c-db75ef0f054f-kube-api-access-9wsgq\") pod \"87f7efb4-7641-4852-a18c-db75ef0f054f\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") "
Sep 16 12:20:51.157679 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.157653    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87f7efb4-7641-4852-a18c-db75ef0f054f-istio-podinfo\") pod \"87f7efb4-7641-4852-a18c-db75ef0f054f\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") "
Sep 16 12:20:51.157786 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.157682    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-istio-data\") pod \"87f7efb4-7641-4852-a18c-db75ef0f054f\" (UID: \"87f7efb4-7641-4852-a18c-db75ef0f054f\") "
Sep 16 12:20:51.157786 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.157731    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "87f7efb4-7641-4852-a18c-db75ef0f054f" (UID: "87f7efb4-7641-4852-a18c-db75ef0f054f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:20:51.157786 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.157662    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87f7efb4-7641-4852-a18c-db75ef0f054f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "87f7efb4-7641-4852-a18c-db75ef0f054f" (UID: "87f7efb4-7641-4852-a18c-db75ef0f054f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:20:51.158257 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.158232    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-credential-socket\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:51.158398 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.158261    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87f7efb4-7641-4852-a18c-db75ef0f054f-istiod-ca-cert\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:51.158398 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.158305    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "87f7efb4-7641-4852-a18c-db75ef0f054f" (UID: "87f7efb4-7641-4852-a18c-db75ef0f054f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:20:51.158398 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.158359    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-istio-data" (OuterVolumeSpecName: "istio-data") pod "87f7efb4-7641-4852-a18c-db75ef0f054f" (UID: "87f7efb4-7641-4852-a18c-db75ef0f054f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:20:51.158595 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.158470    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "87f7efb4-7641-4852-a18c-db75ef0f054f" (UID: "87f7efb4-7641-4852-a18c-db75ef0f054f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:20:51.159753 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.159725    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "87f7efb4-7641-4852-a18c-db75ef0f054f" (UID: "87f7efb4-7641-4852-a18c-db75ef0f054f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:20:51.160179 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.160150    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87f7efb4-7641-4852-a18c-db75ef0f054f-kube-api-access-9wsgq" (OuterVolumeSpecName: "kube-api-access-9wsgq") pod "87f7efb4-7641-4852-a18c-db75ef0f054f" (UID: "87f7efb4-7641-4852-a18c-db75ef0f054f"). InnerVolumeSpecName "kube-api-access-9wsgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:20:51.160299 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.160246    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87f7efb4-7641-4852-a18c-db75ef0f054f-istio-token" (OuterVolumeSpecName: "istio-token") pod "87f7efb4-7641-4852-a18c-db75ef0f054f" (UID: "87f7efb4-7641-4852-a18c-db75ef0f054f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:20:51.160496 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.160475    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/87f7efb4-7641-4852-a18c-db75ef0f054f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "87f7efb4-7641-4852-a18c-db75ef0f054f" (UID: "87f7efb4-7641-4852-a18c-db75ef0f054f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:20:51.258931 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.258903    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87f7efb4-7641-4852-a18c-db75ef0f054f-istio-podinfo\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:51.258931 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.258928    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-istio-data\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:51.258931 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.258939    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-istio-envoy\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:51.259170 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.258949    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-workload-socket\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:51.259170 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.258957    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87f7efb4-7641-4852-a18c-db75ef0f054f-istio-token\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:51.259170 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.258965    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87f7efb4-7641-4852-a18c-db75ef0f054f-workload-certs\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:51.259170 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.258973    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wsgq\" (UniqueName: \"kubernetes.io/projected/87f7efb4-7641-4852-a18c-db75ef0f054f-kube-api-access-9wsgq\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:20:51.751081 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.751042    2576 generic.go:356] "Generic (PLEG): container finished" podID="87f7efb4-7641-4852-a18c-db75ef0f054f" containerID="cff4125c626686b0a59984205c65bd9e343c766f850f964bc21fabe57c750f61" exitCode=0
Sep 16 12:20:51.751254 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.751099    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"
Sep 16 12:20:51.751254 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.751124    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc" event={"ID":"87f7efb4-7641-4852-a18c-db75ef0f054f","Type":"ContainerDied","Data":"cff4125c626686b0a59984205c65bd9e343c766f850f964bc21fabe57c750f61"}
Sep 16 12:20:51.751254 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.751182    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc" event={"ID":"87f7efb4-7641-4852-a18c-db75ef0f054f","Type":"ContainerDied","Data":"7617b72c159df2f3def335018c49e60cb6f0a75ff54935f4f665304db686c9cc"}
Sep 16 12:20:51.751254 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.751204    2576 scope.go:117] "RemoveContainer" containerID="cff4125c626686b0a59984205c65bd9e343c766f850f964bc21fabe57c750f61"
Sep 16 12:20:51.761602 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.761584    2576 scope.go:117] "RemoveContainer" containerID="869f3ff0ecfd614a7a13ecf385a3ce060624fa954a1ce3161d3921c2b1f8755d"
Sep 16 12:20:51.770302 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.770285    2576 scope.go:117] "RemoveContainer" containerID="cff4125c626686b0a59984205c65bd9e343c766f850f964bc21fabe57c750f61"
Sep 16 12:20:51.770613 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:20:51.770576    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cff4125c626686b0a59984205c65bd9e343c766f850f964bc21fabe57c750f61\": container with ID starting with cff4125c626686b0a59984205c65bd9e343c766f850f964bc21fabe57c750f61 not found: ID does not exist" containerID="cff4125c626686b0a59984205c65bd9e343c766f850f964bc21fabe57c750f61"
Sep 16 12:20:51.770699 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.770623    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cff4125c626686b0a59984205c65bd9e343c766f850f964bc21fabe57c750f61"} err="failed to get container status \"cff4125c626686b0a59984205c65bd9e343c766f850f964bc21fabe57c750f61\": rpc error: code = NotFound desc = could not find container \"cff4125c626686b0a59984205c65bd9e343c766f850f964bc21fabe57c750f61\": container with ID starting with cff4125c626686b0a59984205c65bd9e343c766f850f964bc21fabe57c750f61 not found: ID does not exist"
Sep 16 12:20:51.770699 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.770647    2576 scope.go:117] "RemoveContainer" containerID="869f3ff0ecfd614a7a13ecf385a3ce060624fa954a1ce3161d3921c2b1f8755d"
Sep 16 12:20:51.770913 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:20:51.770893    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"869f3ff0ecfd614a7a13ecf385a3ce060624fa954a1ce3161d3921c2b1f8755d\": container with ID starting with 869f3ff0ecfd614a7a13ecf385a3ce060624fa954a1ce3161d3921c2b1f8755d not found: ID does not exist" containerID="869f3ff0ecfd614a7a13ecf385a3ce060624fa954a1ce3161d3921c2b1f8755d"
Sep 16 12:20:51.770960 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.770921    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"869f3ff0ecfd614a7a13ecf385a3ce060624fa954a1ce3161d3921c2b1f8755d"} err="failed to get container status \"869f3ff0ecfd614a7a13ecf385a3ce060624fa954a1ce3161d3921c2b1f8755d\": rpc error: code = NotFound desc = could not find container \"869f3ff0ecfd614a7a13ecf385a3ce060624fa954a1ce3161d3921c2b1f8755d\": container with ID starting with 869f3ff0ecfd614a7a13ecf385a3ce060624fa954a1ce3161d3921c2b1f8755d not found: ID does not exist"
Sep 16 12:20:51.777176 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.777153    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"]
Sep 16 12:20:51.783515 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:51.783494    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-08170a-openshift-default-65cc5c7cc8-zb9rc"]
Sep 16 12:20:52.369162 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:52.369129    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7481-676f68"]
Sep 16 12:20:52.369652 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:52.369638    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9e8c1b0-66b9-4230-b489-bc5d5712a8c7" containerName="istio-proxy"
Sep 16 12:20:52.369697 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:52.369654    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9e8c1b0-66b9-4230-b489-bc5d5712a8c7" containerName="istio-proxy"
Sep 16 12:20:52.369697 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:52.369666    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f7efb4-7641-4852-a18c-db75ef0f054f" containerName="istio-proxy"
Sep 16 12:20:52.369697 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:52.369671    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f7efb4-7641-4852-a18c-db75ef0f054f" containerName="istio-proxy"
Sep 16 12:20:52.369697 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:52.369682    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f7efb4-7641-4852-a18c-db75ef0f054f" containerName="istio-proxy"
Sep 16 12:20:52.369697 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:52.369688    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f7efb4-7641-4852-a18c-db75ef0f054f" containerName="istio-proxy"
Sep 16 12:20:52.369697 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:52.369693    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c8e8cdf-8b2a-4a59-8771-7ff8df0bfd3e" containerName="revoke-keys"
Sep 16 12:20:52.369697 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:52.369698    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c8e8cdf-8b2a-4a59-8771-7ff8df0bfd3e" containerName="revoke-keys"
Sep 16 12:20:52.369906 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:52.369773    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9e8c1b0-66b9-4230-b489-bc5d5712a8c7" containerName="istio-proxy"
Sep 16 12:20:52.369906 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:52.369782    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="87f7efb4-7641-4852-a18c-db75ef0f054f" containerName="istio-proxy"
Sep 16 12:20:52.369906 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:52.369790    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="87f7efb4-7641-4852-a18c-db75ef0f054f" containerName="istio-proxy"
Sep 16 12:20:52.369906 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:52.369797    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c8e8cdf-8b2a-4a59-8771-7ff8df0bfd3e" containerName="revoke-keys"
Sep 16 12:20:52.374523 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:52.374506    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7481-676f68"
Sep 16 12:20:52.377003 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:52.376922    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zpzr9\""
Sep 16 12:20:52.379363 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:52.379337    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7481-676f68"]
Sep 16 12:20:52.396222 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:52.396184    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87f7efb4-7641-4852-a18c-db75ef0f054f" path="/var/lib/kubelet/pods/87f7efb4-7641-4852-a18c-db75ef0f054f/volumes"
Sep 16 12:20:52.471384 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:52.471347    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69q2x\" (UniqueName: \"kubernetes.io/projected/e9ead900-3eb8-4b55-ae7e-646d27665b71-kube-api-access-69q2x\") pod \"test-curl-7481-676f68\" (UID: \"e9ead900-3eb8-4b55-ae7e-646d27665b71\") " pod="opendatahub/test-curl-7481-676f68"
Sep 16 12:20:52.572086 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:52.572057    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69q2x\" (UniqueName: \"kubernetes.io/projected/e9ead900-3eb8-4b55-ae7e-646d27665b71-kube-api-access-69q2x\") pod \"test-curl-7481-676f68\" (UID: \"e9ead900-3eb8-4b55-ae7e-646d27665b71\") " pod="opendatahub/test-curl-7481-676f68"
Sep 16 12:20:52.580038 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:52.580014    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69q2x\" (UniqueName: \"kubernetes.io/projected/e9ead900-3eb8-4b55-ae7e-646d27665b71-kube-api-access-69q2x\") pod \"test-curl-7481-676f68\" (UID: \"e9ead900-3eb8-4b55-ae7e-646d27665b71\") " pod="opendatahub/test-curl-7481-676f68"
Sep 16 12:20:52.687422 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:52.687343    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7481-676f68"
Sep 16 12:20:52.963437 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:52.963412    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7481-676f68"]
Sep 16 12:20:52.965635 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:20:52.965604    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9ead900_3eb8_4b55_ae7e_646d27665b71.slice/crio-c6bc118cbad180bd8e6e8f3a79a8b655bb590c25991bb34872a2a3b56632a911 WatchSource:0}: Error finding container c6bc118cbad180bd8e6e8f3a79a8b655bb590c25991bb34872a2a3b56632a911: Status 404 returned error can't find the container with id c6bc118cbad180bd8e6e8f3a79a8b655bb590c25991bb34872a2a3b56632a911
Sep 16 12:20:52.967823 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:52.967808    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 12:20:53.780060 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:53.780016    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7481-676f68" event={"ID":"e9ead900-3eb8-4b55-ae7e-646d27665b71","Type":"ContainerStarted","Data":"c6bc118cbad180bd8e6e8f3a79a8b655bb590c25991bb34872a2a3b56632a911"}
Sep 16 12:20:53.919392 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:53.919360    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd"]
Sep 16 12:20:53.919945 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:53.919928    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9e8c1b0-66b9-4230-b489-bc5d5712a8c7" containerName="istio-proxy"
Sep 16 12:20:53.920044 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:53.919948    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9e8c1b0-66b9-4230-b489-bc5d5712a8c7" containerName="istio-proxy"
Sep 16 12:20:53.920092 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:53.920047    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9e8c1b0-66b9-4230-b489-bc5d5712a8c7" containerName="istio-proxy"
Sep 16 12:20:53.923395 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:53.923370    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd"
Sep 16 12:20:53.925995 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:53.925929    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-db42a6\""
Sep 16 12:20:53.926294 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:53.926273    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-db42a6-dockercfg-lnmnp\""
Sep 16 12:20:53.932997 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:53.932972    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd"]
Sep 16 12:20:53.941275 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:53.941246    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6"]
Sep 16 12:20:53.945663 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:53.945637    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6"
Sep 16 12:20:53.954531 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:53.954049    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6"]
Sep 16 12:20:53.990049 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:53.990016    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bkhb\" (UniqueName: \"kubernetes.io/projected/c1bd305e-6644-49a7-b5c5-f020d2f9495f-kube-api-access-4bkhb\") pod \"payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd\" (UID: \"c1bd305e-6644-49a7-b5c5-f020d2f9495f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd"
Sep 16 12:20:53.990206 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:53.990074    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1bd305e-6644-49a7-b5c5-f020d2f9495f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd\" (UID: \"c1bd305e-6644-49a7-b5c5-f020d2f9495f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd"
Sep 16 12:20:54.090940 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:54.090851    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cef6f9b-52a2-43be-88e4-662ed9a3b45c-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6\" (UID: \"4cef6f9b-52a2-43be-88e4-662ed9a3b45c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6"
Sep 16 12:20:54.091100 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:54.090977    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bkhb\" (UniqueName: \"kubernetes.io/projected/c1bd305e-6644-49a7-b5c5-f020d2f9495f-kube-api-access-4bkhb\") pod \"payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd\" (UID: \"c1bd305e-6644-49a7-b5c5-f020d2f9495f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd"
Sep 16 12:20:54.091100 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:54.091040    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1bd305e-6644-49a7-b5c5-f020d2f9495f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd\" (UID: \"c1bd305e-6644-49a7-b5c5-f020d2f9495f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd"
Sep 16 12:20:54.091218 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:54.091160    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p6gn\" (UniqueName: \"kubernetes.io/projected/4cef6f9b-52a2-43be-88e4-662ed9a3b45c-kube-api-access-4p6gn\") pod \"payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6\" (UID: \"4cef6f9b-52a2-43be-88e4-662ed9a3b45c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6"
Sep 16 12:20:54.091851 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:54.091751    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1bd305e-6644-49a7-b5c5-f020d2f9495f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd\" (UID: \"c1bd305e-6644-49a7-b5c5-f020d2f9495f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd"
Sep 16 12:20:54.103202 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:54.103179    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bkhb\" (UniqueName: \"kubernetes.io/projected/c1bd305e-6644-49a7-b5c5-f020d2f9495f-kube-api-access-4bkhb\") pod \"payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd\" (UID: \"c1bd305e-6644-49a7-b5c5-f020d2f9495f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd"
Sep 16 12:20:54.191962 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:54.191911    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cef6f9b-52a2-43be-88e4-662ed9a3b45c-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6\" (UID: \"4cef6f9b-52a2-43be-88e4-662ed9a3b45c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6"
Sep 16 12:20:54.192156 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:54.192052    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p6gn\" (UniqueName: \"kubernetes.io/projected/4cef6f9b-52a2-43be-88e4-662ed9a3b45c-kube-api-access-4p6gn\") pod \"payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6\" (UID: \"4cef6f9b-52a2-43be-88e4-662ed9a3b45c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6"
Sep 16 12:20:54.192761 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:54.192737    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cef6f9b-52a2-43be-88e4-662ed9a3b45c-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6\" (UID: \"4cef6f9b-52a2-43be-88e4-662ed9a3b45c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6"
Sep 16 12:20:54.201272 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:54.201247    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p6gn\" (UniqueName: \"kubernetes.io/projected/4cef6f9b-52a2-43be-88e4-662ed9a3b45c-kube-api-access-4p6gn\") pod \"payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6\" (UID: \"4cef6f9b-52a2-43be-88e4-662ed9a3b45c\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6"
Sep 16 12:20:54.239327 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:54.239282    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd"
Sep 16 12:20:54.260875 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:54.260849    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6"
Sep 16 12:20:54.540629 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:54.540599    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd"]
Sep 16 12:20:54.566073 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:54.566043    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6"]
Sep 16 12:20:55.227093 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:20:55.227047    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1bd305e_6644_49a7_b5c5_f020d2f9495f.slice/crio-2a7dd43507f06312a8e53cea0a11bb180d2ce03550eef839ec97cdb1db54fb5a WatchSource:0}: Error finding container 2a7dd43507f06312a8e53cea0a11bb180d2ce03550eef839ec97cdb1db54fb5a: Status 404 returned error can't find the container with id 2a7dd43507f06312a8e53cea0a11bb180d2ce03550eef839ec97cdb1db54fb5a
Sep 16 12:20:55.227888 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:20:55.227851    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cef6f9b_52a2_43be_88e4_662ed9a3b45c.slice/crio-6f7d24cf24738c021d40216a10150e7edd6df9458a3bd8778ee2c6bbb53d5079 WatchSource:0}: Error finding container 6f7d24cf24738c021d40216a10150e7edd6df9458a3bd8778ee2c6bbb53d5079: Status 404 returned error can't find the container with id 6f7d24cf24738c021d40216a10150e7edd6df9458a3bd8778ee2c6bbb53d5079
Sep 16 12:20:55.796761 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:55.796714    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6" event={"ID":"4cef6f9b-52a2-43be-88e4-662ed9a3b45c","Type":"ContainerStarted","Data":"e0229b75f3f752ec0cd94616d6d63681f5729c7b3c6d371fff07fd4b84548c50"}
Sep 16 12:20:55.796979 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:55.796837    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6" event={"ID":"4cef6f9b-52a2-43be-88e4-662ed9a3b45c","Type":"ContainerStarted","Data":"6f7d24cf24738c021d40216a10150e7edd6df9458a3bd8778ee2c6bbb53d5079"}
Sep 16 12:20:55.796979 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:55.796874    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6"
Sep 16 12:20:55.798965 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:55.798932    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7481-676f68" event={"ID":"e9ead900-3eb8-4b55-ae7e-646d27665b71","Type":"ContainerStarted","Data":"1263459dd0af35b4a15b80163df8f1aa08aafd9449d79a74920014074c9f2357"}
Sep 16 12:20:55.800748 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:55.800719    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd" event={"ID":"c1bd305e-6644-49a7-b5c5-f020d2f9495f","Type":"ContainerStarted","Data":"f888d0d520db9da8007e9414c592aebbb9144d381b0cd0222a03d63e4038d837"}
Sep 16 12:20:55.800866 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:55.800769    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd" event={"ID":"c1bd305e-6644-49a7-b5c5-f020d2f9495f","Type":"ContainerStarted","Data":"2a7dd43507f06312a8e53cea0a11bb180d2ce03550eef839ec97cdb1db54fb5a"}
Sep 16 12:20:55.800921 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:55.800861    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd"
Sep 16 12:20:55.843071 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:55.843014    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6" podStartSLOduration=2.8429886030000002 podStartE2EDuration="2.842988603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:20:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:20:55.841474213 +0000 UTC m=+1122.010438923" watchObservedRunningTime="2026-09-16 12:20:55.842988603 +0000 UTC m=+1122.011953310"
Sep 16 12:20:55.859475 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:55.859416    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7481-676f68" podStartSLOduration=1.532751766 podStartE2EDuration="3.85939702s" totalImagesPullingTime="2.326645254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:20:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:20:55.857804804 +0000 UTC m=+1122.026769512" watchObservedRunningTime="2026-09-16 12:20:55.85939702 +0000 UTC m=+1122.028361728"
Sep 16 12:20:55.876013 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:55.875968    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd" podStartSLOduration=2.875954256 podStartE2EDuration="2.875954256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:20:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:20:55.87446186 +0000 UTC m=+1122.043426569" watchObservedRunningTime="2026-09-16 12:20:55.875954256 +0000 UTC m=+1122.044918963"
Sep 16 12:20:56.463155 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:56.463120    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7481-676f68"]
Sep 16 12:20:56.468182 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:56.468151    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7481-676f68"]
Sep 16 12:20:56.807121 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:20:56.807090    2576 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7481-676f68" container="test-curl-7481-676f68"
Sep 16 12:20:57.812643 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:57.812606    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7481-676f68" podUID="e9ead900-3eb8-4b55-ae7e-646d27665b71" containerName="test-curl-7481-676f68" containerID="cri-o://1263459dd0af35b4a15b80163df8f1aa08aafd9449d79a74920014074c9f2357" gracePeriod=2
Sep 16 12:20:57.815093 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:20:57.815071    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7481-676f68\" is forbidden: User \"system:node:ip-10-0-137-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-240.ec2.internal' and this object" podUID="e9ead900-3eb8-4b55-ae7e-646d27665b71" pod="opendatahub/test-curl-7481-676f68"
Sep 16 12:20:58.711398 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:58.711365    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7481-21c7d3"]
Sep 16 12:20:58.711870 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:58.711857    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9ead900-3eb8-4b55-ae7e-646d27665b71" containerName="test-curl-7481-676f68"
Sep 16 12:20:58.711928 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:58.711872    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9ead900-3eb8-4b55-ae7e-646d27665b71" containerName="test-curl-7481-676f68"
Sep 16 12:20:58.711972 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:58.711950    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9ead900-3eb8-4b55-ae7e-646d27665b71" containerName="test-curl-7481-676f68"
Sep 16 12:20:58.715439 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:58.715422    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7481-21c7d3"
Sep 16 12:20:58.732988 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:58.732963    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7481-21c7d3"]
Sep 16 12:20:58.843850 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:58.843817    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srtg2\" (UniqueName: \"kubernetes.io/projected/65ff8a7e-d4c8-48b9-96e1-7547abc5922b-kube-api-access-srtg2\") pod \"test-curl-7481-21c7d3\" (UID: \"65ff8a7e-d4c8-48b9-96e1-7547abc5922b\") " pod="opendatahub/test-curl-7481-21c7d3"
Sep 16 12:20:58.945477 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:58.945444    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srtg2\" (UniqueName: \"kubernetes.io/projected/65ff8a7e-d4c8-48b9-96e1-7547abc5922b-kube-api-access-srtg2\") pod \"test-curl-7481-21c7d3\" (UID: \"65ff8a7e-d4c8-48b9-96e1-7547abc5922b\") " pod="opendatahub/test-curl-7481-21c7d3"
Sep 16 12:20:58.955305 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:58.955270    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srtg2\" (UniqueName: \"kubernetes.io/projected/65ff8a7e-d4c8-48b9-96e1-7547abc5922b-kube-api-access-srtg2\") pod \"test-curl-7481-21c7d3\" (UID: \"65ff8a7e-d4c8-48b9-96e1-7547abc5922b\") " pod="opendatahub/test-curl-7481-21c7d3"
Sep 16 12:20:59.025596 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:59.025514    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7481-21c7d3"
Sep 16 12:20:59.297369 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:59.297340    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7481-21c7d3"]
Sep 16 12:20:59.299206 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:20:59.299173    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65ff8a7e_d4c8_48b9_96e1_7547abc5922b.slice/crio-d2ad986919ecfc7c20c3ea1b5bff1f95b16d50c91d4f94aba78e9b1501cfd53f WatchSource:0}: Error finding container d2ad986919ecfc7c20c3ea1b5bff1f95b16d50c91d4f94aba78e9b1501cfd53f: Status 404 returned error can't find the container with id d2ad986919ecfc7c20c3ea1b5bff1f95b16d50c91d4f94aba78e9b1501cfd53f
Sep 16 12:20:59.827224 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:59.827191    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7481-21c7d3" event={"ID":"65ff8a7e-d4c8-48b9-96e1-7547abc5922b","Type":"ContainerStarted","Data":"a1a281e88361bcb568198f07f66ea962bdcf8ddfddfe9d5d3f603c8fa4d2ca5a"}
Sep 16 12:20:59.827358 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:59.827246    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7481-21c7d3" event={"ID":"65ff8a7e-d4c8-48b9-96e1-7547abc5922b","Type":"ContainerStarted","Data":"d2ad986919ecfc7c20c3ea1b5bff1f95b16d50c91d4f94aba78e9b1501cfd53f"}
Sep 16 12:20:59.846208 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:20:59.846166    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7481-21c7d3" podStartSLOduration=1.846148554 podStartE2EDuration="1.846148554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:20:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:20:59.844600948 +0000 UTC m=+1126.013565655" watchObservedRunningTime="2026-09-16 12:20:59.846148554 +0000 UTC m=+1126.015113260"
Sep 16 12:21:00.000264 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:00.000238    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7481-676f68"
Sep 16 12:21:00.158154 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:00.158126    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69q2x\" (UniqueName: \"kubernetes.io/projected/e9ead900-3eb8-4b55-ae7e-646d27665b71-kube-api-access-69q2x\") pod \"e9ead900-3eb8-4b55-ae7e-646d27665b71\" (UID: \"e9ead900-3eb8-4b55-ae7e-646d27665b71\") "
Sep 16 12:21:00.160393 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:00.160360    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9ead900-3eb8-4b55-ae7e-646d27665b71-kube-api-access-69q2x" (OuterVolumeSpecName: "kube-api-access-69q2x") pod "e9ead900-3eb8-4b55-ae7e-646d27665b71" (UID: "e9ead900-3eb8-4b55-ae7e-646d27665b71"). InnerVolumeSpecName "kube-api-access-69q2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:21:00.260178 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:00.260149    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69q2x\" (UniqueName: \"kubernetes.io/projected/e9ead900-3eb8-4b55-ae7e-646d27665b71-kube-api-access-69q2x\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:21:00.394523 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:00.394489    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9ead900-3eb8-4b55-ae7e-646d27665b71" path="/var/lib/kubelet/pods/e9ead900-3eb8-4b55-ae7e-646d27665b71/volumes"
Sep 16 12:21:00.460605 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:00.460511    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7481-21c7d3"]
Sep 16 12:21:00.463611 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:00.463586    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7481-21c7d3"]
Sep 16 12:21:00.581536 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:00.581500    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7481-57db97"]
Sep 16 12:21:00.582219 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:00.582200    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65ff8a7e-d4c8-48b9-96e1-7547abc5922b" containerName="test-curl-7481-21c7d3"
Sep 16 12:21:00.582219 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:00.582219    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="65ff8a7e-d4c8-48b9-96e1-7547abc5922b" containerName="test-curl-7481-21c7d3"
Sep 16 12:21:00.582368 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:00.582290    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="65ff8a7e-d4c8-48b9-96e1-7547abc5922b" containerName="test-curl-7481-21c7d3"
Sep 16 12:21:00.585677 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:00.585658    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7481-57db97"
Sep 16 12:21:00.590613 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:00.590582    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7481-57db97"]
Sep 16 12:21:00.665339 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:00.665279    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxqcq\" (UniqueName: \"kubernetes.io/projected/e91e56da-6c88-4d49-8b72-bb0567c055ec-kube-api-access-vxqcq\") pod \"test-curl-7481-57db97\" (UID: \"e91e56da-6c88-4d49-8b72-bb0567c055ec\") " pod="opendatahub/test-curl-7481-57db97"
Sep 16 12:21:00.766921 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:00.766829    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxqcq\" (UniqueName: \"kubernetes.io/projected/e91e56da-6c88-4d49-8b72-bb0567c055ec-kube-api-access-vxqcq\") pod \"test-curl-7481-57db97\" (UID: \"e91e56da-6c88-4d49-8b72-bb0567c055ec\") " pod="opendatahub/test-curl-7481-57db97"
Sep 16 12:21:00.776101 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:00.776071    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxqcq\" (UniqueName: \"kubernetes.io/projected/e91e56da-6c88-4d49-8b72-bb0567c055ec-kube-api-access-vxqcq\") pod \"test-curl-7481-57db97\" (UID: \"e91e56da-6c88-4d49-8b72-bb0567c055ec\") " pod="opendatahub/test-curl-7481-57db97"
Sep 16 12:21:00.836515 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:00.836475    2576 generic.go:356] "Generic (PLEG): container finished" podID="e9ead900-3eb8-4b55-ae7e-646d27665b71" containerID="1263459dd0af35b4a15b80163df8f1aa08aafd9449d79a74920014074c9f2357" exitCode=137
Sep 16 12:21:00.836711 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:00.836535    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7481-676f68"
Sep 16 12:21:00.836855 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:21:00.836835    2576 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7481-21c7d3" container="test-curl-7481-21c7d3"
Sep 16 12:21:00.836855 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:00.836843    2576 scope.go:117] "RemoveContainer" containerID="1263459dd0af35b4a15b80163df8f1aa08aafd9449d79a74920014074c9f2357"
Sep 16 12:21:00.848762 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:00.848744    2576 scope.go:117] "RemoveContainer" containerID="1263459dd0af35b4a15b80163df8f1aa08aafd9449d79a74920014074c9f2357"
Sep 16 12:21:00.849115 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:21:00.849072    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1263459dd0af35b4a15b80163df8f1aa08aafd9449d79a74920014074c9f2357\": container with ID starting with 1263459dd0af35b4a15b80163df8f1aa08aafd9449d79a74920014074c9f2357 not found: ID does not exist" containerID="1263459dd0af35b4a15b80163df8f1aa08aafd9449d79a74920014074c9f2357"
Sep 16 12:21:00.849188 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:00.849133    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1263459dd0af35b4a15b80163df8f1aa08aafd9449d79a74920014074c9f2357"} err="failed to get container status \"1263459dd0af35b4a15b80163df8f1aa08aafd9449d79a74920014074c9f2357\": rpc error: code = NotFound desc = could not find container \"1263459dd0af35b4a15b80163df8f1aa08aafd9449d79a74920014074c9f2357\": container with ID starting with 1263459dd0af35b4a15b80163df8f1aa08aafd9449d79a74920014074c9f2357 not found: ID does not exist"
Sep 16 12:21:00.897766 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:00.897733    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7481-57db97"
Sep 16 12:21:01.172980 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:01.172952    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7481-57db97"]
Sep 16 12:21:01.174387 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:21:01.174359    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode91e56da_6c88_4d49_8b72_bb0567c055ec.slice/crio-59d37f94c8ced1187c53c7a47b50a8320e585316de2a6174112deb6b74a197b2 WatchSource:0}: Error finding container 59d37f94c8ced1187c53c7a47b50a8320e585316de2a6174112deb6b74a197b2: Status 404 returned error can't find the container with id 59d37f94c8ced1187c53c7a47b50a8320e585316de2a6174112deb6b74a197b2
Sep 16 12:21:01.845187 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:01.845155    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7481-57db97" event={"ID":"e91e56da-6c88-4d49-8b72-bb0567c055ec","Type":"ContainerStarted","Data":"30539261aca9c9c7d10971b54c9dce9799a3b73244d8d8a8c7398ec3548fdbd3"}
Sep 16 12:21:01.845400 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:01.845196    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7481-57db97" event={"ID":"e91e56da-6c88-4d49-8b72-bb0567c055ec","Type":"ContainerStarted","Data":"59d37f94c8ced1187c53c7a47b50a8320e585316de2a6174112deb6b74a197b2"}
Sep 16 12:21:01.845400 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:01.845270    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7481-21c7d3" podUID="65ff8a7e-d4c8-48b9-96e1-7547abc5922b" containerName="test-curl-7481-21c7d3" containerID="cri-o://a1a281e88361bcb568198f07f66ea962bdcf8ddfddfe9d5d3f603c8fa4d2ca5a" gracePeriod=2
Sep 16 12:21:01.861568 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:01.861518    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7481-57db97" podStartSLOduration=1.861502193 podStartE2EDuration="1.861502193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:21:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:21:01.859610731 +0000 UTC m=+1128.028575439" watchObservedRunningTime="2026-09-16 12:21:01.861502193 +0000 UTC m=+1128.030466899"
Sep 16 12:21:01.861901 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:21:01.861764    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7481-21c7d3\" is forbidden: User \"system:node:ip-10-0-137-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-240.ec2.internal' and this object" podUID="65ff8a7e-d4c8-48b9-96e1-7547abc5922b" pod="opendatahub/test-curl-7481-21c7d3"
Sep 16 12:21:02.445328 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:02.445288    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7481-57db97"]
Sep 16 12:21:02.449762 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:02.449737    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7481-57db97"]
Sep 16 12:21:02.851650 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:21:02.851614    2576 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7481-57db97" container="test-curl-7481-57db97"
Sep 16 12:21:03.366087 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.366053    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"]
Sep 16 12:21:03.366671 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.366653    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e91e56da-6c88-4d49-8b72-bb0567c055ec" containerName="test-curl-7481-57db97"
Sep 16 12:21:03.366671 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.366673    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e91e56da-6c88-4d49-8b72-bb0567c055ec" containerName="test-curl-7481-57db97"
Sep 16 12:21:03.366792 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.366761    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e91e56da-6c88-4d49-8b72-bb0567c055ec" containerName="test-curl-7481-57db97"
Sep 16 12:21:03.370202 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.370184    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.372856 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.372839    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-8f9e6d9e-openshift-default-dockercfg-l7q5f\""
Sep 16 12:21:03.380983 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.380963    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"]
Sep 16 12:21:03.495670 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.495626    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-workload-certs\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.495872 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.495693    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-credential-socket\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.495872 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.495723    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-istio-data\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.495872 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.495810    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/323c9bc0-1d10-46eb-aa42-447b15758729-istio-podinfo\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.495872 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.495834    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/323c9bc0-1d10-46eb-aa42-447b15758729-istiod-ca-cert\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.496098 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.495881    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-workload-socket\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.496098 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.495905    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/323c9bc0-1d10-46eb-aa42-447b15758729-istio-token\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.496098 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.495959    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89q8b\" (UniqueName: \"kubernetes.io/projected/323c9bc0-1d10-46eb-aa42-447b15758729-kube-api-access-89q8b\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.496098 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.495998    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-istio-envoy\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.597129 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.597084    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/323c9bc0-1d10-46eb-aa42-447b15758729-istio-podinfo\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.597129 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.597132    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/323c9bc0-1d10-46eb-aa42-447b15758729-istiod-ca-cert\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.597408 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.597175    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-workload-socket\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.597408 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.597201    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/323c9bc0-1d10-46eb-aa42-447b15758729-istio-token\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.597408 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.597249    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89q8b\" (UniqueName: \"kubernetes.io/projected/323c9bc0-1d10-46eb-aa42-447b15758729-kube-api-access-89q8b\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.597408 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.597287    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-istio-envoy\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.597408 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.597376    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-workload-certs\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.597693 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.597416    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-credential-socket\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.597693 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.597443    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-istio-data\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.597693 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.597683    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-workload-socket\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.597856 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.597752    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-workload-certs\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.597911 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.597865    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-istio-data\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.597983 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.597952    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-credential-socket\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.598350 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.598301    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/323c9bc0-1d10-46eb-aa42-447b15758729-istiod-ca-cert\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.599919 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.599899    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/323c9bc0-1d10-46eb-aa42-447b15758729-istio-podinfo\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.600017 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.600000    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-istio-envoy\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.605256 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.605232    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/323c9bc0-1d10-46eb-aa42-447b15758729-istio-token\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.605575 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.605558    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89q8b\" (UniqueName: \"kubernetes.io/projected/323c9bc0-1d10-46eb-aa42-447b15758729-kube-api-access-89q8b\") pod \"e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") " pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.682937 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.682866    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:03.858783 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.858747    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7481-57db97" podUID="e91e56da-6c88-4d49-8b72-bb0567c055ec" containerName="test-curl-7481-57db97" containerID="cri-o://30539261aca9c9c7d10971b54c9dce9799a3b73244d8d8a8c7398ec3548fdbd3" gracePeriod=2
Sep 16 12:21:03.861106 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:21:03.861066    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7481-57db97\" is forbidden: User \"system:node:ip-10-0-137-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-240.ec2.internal' and this object" podUID="e91e56da-6c88-4d49-8b72-bb0567c055ec" pod="opendatahub/test-curl-7481-57db97"
Sep 16 12:21:03.962304 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.962275    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"]
Sep 16 12:21:03.963166 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:21:03.963142    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod323c9bc0_1d10_46eb_aa42_447b15758729.slice/crio-7c5f1af7a484a08369ff0416d82677ac32e8449fea2b3fae9bdc8e10f0e27576 WatchSource:0}: Error finding container 7c5f1af7a484a08369ff0416d82677ac32e8449fea2b3fae9bdc8e10f0e27576: Status 404 returned error can't find the container with id 7c5f1af7a484a08369ff0416d82677ac32e8449fea2b3fae9bdc8e10f0e27576
Sep 16 12:21:03.965785 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.965755    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:21:03.965878 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.965820    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:21:03.965878 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:03.965848    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:21:04.005511 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:04.005492    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7481-21c7d3"
Sep 16 12:21:04.007619 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:21:04.007593    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7481-57db97\" is forbidden: User \"system:node:ip-10-0-137-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-240.ec2.internal' and this object" podUID="e91e56da-6c88-4d49-8b72-bb0567c055ec" pod="opendatahub/test-curl-7481-57db97"
Sep 16 12:21:04.102716 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:04.102681    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srtg2\" (UniqueName: \"kubernetes.io/projected/65ff8a7e-d4c8-48b9-96e1-7547abc5922b-kube-api-access-srtg2\") pod \"65ff8a7e-d4c8-48b9-96e1-7547abc5922b\" (UID: \"65ff8a7e-d4c8-48b9-96e1-7547abc5922b\") "
Sep 16 12:21:04.104989 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:04.104961    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65ff8a7e-d4c8-48b9-96e1-7547abc5922b-kube-api-access-srtg2" (OuterVolumeSpecName: "kube-api-access-srtg2") pod "65ff8a7e-d4c8-48b9-96e1-7547abc5922b" (UID: "65ff8a7e-d4c8-48b9-96e1-7547abc5922b"). InnerVolumeSpecName "kube-api-access-srtg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:21:04.204388 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:04.204352    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srtg2\" (UniqueName: \"kubernetes.io/projected/65ff8a7e-d4c8-48b9-96e1-7547abc5922b-kube-api-access-srtg2\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:21:04.392449 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:21:04.392416    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7481-57db97\" is forbidden: User \"system:node:ip-10-0-137-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-240.ec2.internal' and this object" podUID="e91e56da-6c88-4d49-8b72-bb0567c055ec" pod="opendatahub/test-curl-7481-57db97"
Sep 16 12:21:04.395303 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:04.395266    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65ff8a7e-d4c8-48b9-96e1-7547abc5922b" path="/var/lib/kubelet/pods/65ff8a7e-d4c8-48b9-96e1-7547abc5922b/volumes"
Sep 16 12:21:04.865714 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:04.865678    2576 generic.go:356] "Generic (PLEG): container finished" podID="65ff8a7e-d4c8-48b9-96e1-7547abc5922b" containerID="a1a281e88361bcb568198f07f66ea962bdcf8ddfddfe9d5d3f603c8fa4d2ca5a" exitCode=137
Sep 16 12:21:04.865915 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:04.865730    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7481-21c7d3"
Sep 16 12:21:04.865915 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:04.865778    2576 scope.go:117] "RemoveContainer" containerID="a1a281e88361bcb568198f07f66ea962bdcf8ddfddfe9d5d3f603c8fa4d2ca5a"
Sep 16 12:21:04.867837 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:04.867805    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n" event={"ID":"323c9bc0-1d10-46eb-aa42-447b15758729","Type":"ContainerStarted","Data":"06d4a6235fccda0d9204a8ba46db65ec0f2b53a6337136647ab6fccd23e84098"}
Sep 16 12:21:04.867993 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:04.867903    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n" event={"ID":"323c9bc0-1d10-46eb-aa42-447b15758729","Type":"ContainerStarted","Data":"7c5f1af7a484a08369ff0416d82677ac32e8449fea2b3fae9bdc8e10f0e27576"}
Sep 16 12:21:04.875624 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:04.875604    2576 scope.go:117] "RemoveContainer" containerID="a1a281e88361bcb568198f07f66ea962bdcf8ddfddfe9d5d3f603c8fa4d2ca5a"
Sep 16 12:21:04.875885 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:21:04.875866    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1a281e88361bcb568198f07f66ea962bdcf8ddfddfe9d5d3f603c8fa4d2ca5a\": container with ID starting with a1a281e88361bcb568198f07f66ea962bdcf8ddfddfe9d5d3f603c8fa4d2ca5a not found: ID does not exist" containerID="a1a281e88361bcb568198f07f66ea962bdcf8ddfddfe9d5d3f603c8fa4d2ca5a"
Sep 16 12:21:04.875928 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:04.875899    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1a281e88361bcb568198f07f66ea962bdcf8ddfddfe9d5d3f603c8fa4d2ca5a"} err="failed to get container status \"a1a281e88361bcb568198f07f66ea962bdcf8ddfddfe9d5d3f603c8fa4d2ca5a\": rpc error: code = NotFound desc = could not find container \"a1a281e88361bcb568198f07f66ea962bdcf8ddfddfe9d5d3f603c8fa4d2ca5a\": container with ID starting with a1a281e88361bcb568198f07f66ea962bdcf8ddfddfe9d5d3f603c8fa4d2ca5a not found: ID does not exist"
Sep 16 12:21:04.891184 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:04.891144    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n" podStartSLOduration=1.8911303510000002 podStartE2EDuration="1.891130351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:21:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:21:04.888734329 +0000 UTC m=+1131.057699073" watchObservedRunningTime="2026-09-16 12:21:04.891130351 +0000 UTC m=+1131.060095058"
Sep 16 12:21:05.683487 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:05.683453    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:05.689331 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:05.689285    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:05.877494 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:05.877467    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:05.878365 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:05.878348    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:06.063607 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:06.063584    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7481-57db97"
Sep 16 12:21:06.226110 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:06.226077    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxqcq\" (UniqueName: \"kubernetes.io/projected/e91e56da-6c88-4d49-8b72-bb0567c055ec-kube-api-access-vxqcq\") pod \"e91e56da-6c88-4d49-8b72-bb0567c055ec\" (UID: \"e91e56da-6c88-4d49-8b72-bb0567c055ec\") "
Sep 16 12:21:06.228393 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:06.228365    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e91e56da-6c88-4d49-8b72-bb0567c055ec-kube-api-access-vxqcq" (OuterVolumeSpecName: "kube-api-access-vxqcq") pod "e91e56da-6c88-4d49-8b72-bb0567c055ec" (UID: "e91e56da-6c88-4d49-8b72-bb0567c055ec"). InnerVolumeSpecName "kube-api-access-vxqcq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:21:06.327883 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:06.327849    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxqcq\" (UniqueName: \"kubernetes.io/projected/e91e56da-6c88-4d49-8b72-bb0567c055ec-kube-api-access-vxqcq\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:21:06.394901 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:06.394868    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e91e56da-6c88-4d49-8b72-bb0567c055ec" path="/var/lib/kubelet/pods/e91e56da-6c88-4d49-8b72-bb0567c055ec/volumes"
Sep 16 12:21:06.809414 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:06.809385    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd"
Sep 16 12:21:06.809890 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:06.809462    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6"
Sep 16 12:21:06.889573 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:06.889529    2576 generic.go:356] "Generic (PLEG): container finished" podID="e91e56da-6c88-4d49-8b72-bb0567c055ec" containerID="30539261aca9c9c7d10971b54c9dce9799a3b73244d8d8a8c7398ec3548fdbd3" exitCode=137
Sep 16 12:21:06.889764 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:06.889594    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7481-57db97"
Sep 16 12:21:06.889764 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:06.889635    2576 scope.go:117] "RemoveContainer" containerID="30539261aca9c9c7d10971b54c9dce9799a3b73244d8d8a8c7398ec3548fdbd3"
Sep 16 12:21:06.905453 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:06.905217    2576 scope.go:117] "RemoveContainer" containerID="30539261aca9c9c7d10971b54c9dce9799a3b73244d8d8a8c7398ec3548fdbd3"
Sep 16 12:21:06.905637 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:21:06.905616    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30539261aca9c9c7d10971b54c9dce9799a3b73244d8d8a8c7398ec3548fdbd3\": container with ID starting with 30539261aca9c9c7d10971b54c9dce9799a3b73244d8d8a8c7398ec3548fdbd3 not found: ID does not exist" containerID="30539261aca9c9c7d10971b54c9dce9799a3b73244d8d8a8c7398ec3548fdbd3"
Sep 16 12:21:06.905712 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:06.905650    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30539261aca9c9c7d10971b54c9dce9799a3b73244d8d8a8c7398ec3548fdbd3"} err="failed to get container status \"30539261aca9c9c7d10971b54c9dce9799a3b73244d8d8a8c7398ec3548fdbd3\": rpc error: code = NotFound desc = could not find container \"30539261aca9c9c7d10971b54c9dce9799a3b73244d8d8a8c7398ec3548fdbd3\": container with ID starting with 30539261aca9c9c7d10971b54c9dce9799a3b73244d8d8a8c7398ec3548fdbd3 not found: ID does not exist"
Sep 16 12:21:11.174658 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:11.174575    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws"]
Sep 16 12:21:11.178435 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:11.178412    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws"
Sep 16 12:21:11.181038 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:11.181018    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-8f9e6d9e-dockercfg-gjx9n\""
Sep 16 12:21:11.181142 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:11.181062    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-8f9e6d9e\""
Sep 16 12:21:11.185069 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:11.184890    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cebeb4b1-a9e8-470d-9780-8c55f9ee73da-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws\" (UID: \"cebeb4b1-a9e8-470d-9780-8c55f9ee73da\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws"
Sep 16 12:21:11.185069 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:11.185020    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fprv\" (UniqueName: \"kubernetes.io/projected/cebeb4b1-a9e8-470d-9780-8c55f9ee73da-kube-api-access-6fprv\") pod \"payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws\" (UID: \"cebeb4b1-a9e8-470d-9780-8c55f9ee73da\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws"
Sep 16 12:21:11.186552 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:11.186229    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws"]
Sep 16 12:21:11.287764 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:11.287704    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cebeb4b1-a9e8-470d-9780-8c55f9ee73da-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws\" (UID: \"cebeb4b1-a9e8-470d-9780-8c55f9ee73da\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws"
Sep 16 12:21:11.289224 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:11.289201    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fprv\" (UniqueName: \"kubernetes.io/projected/cebeb4b1-a9e8-470d-9780-8c55f9ee73da-kube-api-access-6fprv\") pod \"payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws\" (UID: \"cebeb4b1-a9e8-470d-9780-8c55f9ee73da\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws"
Sep 16 12:21:11.289816 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:11.289081    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cebeb4b1-a9e8-470d-9780-8c55f9ee73da-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws\" (UID: \"cebeb4b1-a9e8-470d-9780-8c55f9ee73da\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws"
Sep 16 12:21:11.301597 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:11.300008    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fprv\" (UniqueName: \"kubernetes.io/projected/cebeb4b1-a9e8-470d-9780-8c55f9ee73da-kube-api-access-6fprv\") pod \"payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws\" (UID: \"cebeb4b1-a9e8-470d-9780-8c55f9ee73da\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws"
Sep 16 12:21:11.490953 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:11.490865    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws"
Sep 16 12:21:11.779862 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:11.779839    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws"]
Sep 16 12:21:11.781420 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:21:11.781392    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcebeb4b1_a9e8_470d_9780_8c55f9ee73da.slice/crio-1476d198602d644c10bd6255b9ef4f26e337b34d8c5a0c84ec25491d288b13c8 WatchSource:0}: Error finding container 1476d198602d644c10bd6255b9ef4f26e337b34d8c5a0c84ec25491d288b13c8: Status 404 returned error can't find the container with id 1476d198602d644c10bd6255b9ef4f26e337b34d8c5a0c84ec25491d288b13c8
Sep 16 12:21:11.928210 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:11.928163    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws" event={"ID":"cebeb4b1-a9e8-470d-9780-8c55f9ee73da","Type":"ContainerStarted","Data":"31078f149be534e36c06f1a42724bc0e11d318418dc5dde02c345f02d3d6a794"}
Sep 16 12:21:11.928408 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:11.928224    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws" event={"ID":"cebeb4b1-a9e8-470d-9780-8c55f9ee73da","Type":"ContainerStarted","Data":"1476d198602d644c10bd6255b9ef4f26e337b34d8c5a0c84ec25491d288b13c8"}
Sep 16 12:21:11.928408 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:11.928250    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws"
Sep 16 12:21:11.943080 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:11.943035    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws" podStartSLOduration=0.943019963 podStartE2EDuration="943.019963ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:21:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:21:11.942512746 +0000 UTC m=+1138.111477453" watchObservedRunningTime="2026-09-16 12:21:11.943019963 +0000 UTC m=+1138.111984669"
Sep 16 12:21:14.453273 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:14.453241    2576 scope.go:117] "RemoveContainer" containerID="1053ca1141943c62a16ce6ded396728571362eaacd0247cedf6eb571f16171a1"
Sep 16 12:21:14.462348 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:14.462325    2576 scope.go:117] "RemoveContainer" containerID="84bf8a4001fc0b42655e32bc78b00222a941d02457904409ecc163d677582cbe"
Sep 16 12:21:15.438339 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:15.437694    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"]
Sep 16 12:21:22.938660 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:22.938632    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws"
Sep 16 12:21:23.784370 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:23.784333    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv"]
Sep 16 12:21:23.789956 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:23.789923    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv"
Sep 16 12:21:23.792542 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:23.792340    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-c03953-dockercfg-4jrkb\""
Sep 16 12:21:23.792542 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:23.792392    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-c03953\""
Sep 16 12:21:23.799905 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:23.799879    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv"]
Sep 16 12:21:23.818405 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:23.818379    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5"]
Sep 16 12:21:23.822244 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:23.822226    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5"
Sep 16 12:21:23.829672 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:23.829455    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5"]
Sep 16 12:21:23.934766 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:23.934726    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svx2c\" (UniqueName: \"kubernetes.io/projected/86046ef4-6a68-4453-843d-cf7fd1dd0d71-kube-api-access-svx2c\") pod \"payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5\" (UID: \"86046ef4-6a68-4453-843d-cf7fd1dd0d71\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5"
Sep 16 12:21:23.934962 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:23.934791    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p4dr\" (UniqueName: \"kubernetes.io/projected/e10bb12b-7fda-49ff-9a7d-7f64a9b83732-kube-api-access-5p4dr\") pod \"payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv\" (UID: \"e10bb12b-7fda-49ff-9a7d-7f64a9b83732\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv"
Sep 16 12:21:23.934962 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:23.934835    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e10bb12b-7fda-49ff-9a7d-7f64a9b83732-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv\" (UID: \"e10bb12b-7fda-49ff-9a7d-7f64a9b83732\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv"
Sep 16 12:21:23.934962 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:23.934954    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86046ef4-6a68-4453-843d-cf7fd1dd0d71-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5\" (UID: \"86046ef4-6a68-4453-843d-cf7fd1dd0d71\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5"
Sep 16 12:21:24.035943 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:24.035850    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86046ef4-6a68-4453-843d-cf7fd1dd0d71-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5\" (UID: \"86046ef4-6a68-4453-843d-cf7fd1dd0d71\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5"
Sep 16 12:21:24.036296 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:24.035945    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svx2c\" (UniqueName: \"kubernetes.io/projected/86046ef4-6a68-4453-843d-cf7fd1dd0d71-kube-api-access-svx2c\") pod \"payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5\" (UID: \"86046ef4-6a68-4453-843d-cf7fd1dd0d71\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5"
Sep 16 12:21:24.036296 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:24.035991    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p4dr\" (UniqueName: \"kubernetes.io/projected/e10bb12b-7fda-49ff-9a7d-7f64a9b83732-kube-api-access-5p4dr\") pod \"payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv\" (UID: \"e10bb12b-7fda-49ff-9a7d-7f64a9b83732\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv"
Sep 16 12:21:24.036296 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:24.036029    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e10bb12b-7fda-49ff-9a7d-7f64a9b83732-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv\" (UID: \"e10bb12b-7fda-49ff-9a7d-7f64a9b83732\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv"
Sep 16 12:21:24.036843 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:24.036820    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86046ef4-6a68-4453-843d-cf7fd1dd0d71-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5\" (UID: \"86046ef4-6a68-4453-843d-cf7fd1dd0d71\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5"
Sep 16 12:21:24.036887 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:24.036820    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e10bb12b-7fda-49ff-9a7d-7f64a9b83732-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv\" (UID: \"e10bb12b-7fda-49ff-9a7d-7f64a9b83732\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv"
Sep 16 12:21:24.045646 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:24.045622    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p4dr\" (UniqueName: \"kubernetes.io/projected/e10bb12b-7fda-49ff-9a7d-7f64a9b83732-kube-api-access-5p4dr\") pod \"payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv\" (UID: \"e10bb12b-7fda-49ff-9a7d-7f64a9b83732\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv"
Sep 16 12:21:24.045780 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:24.045657    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svx2c\" (UniqueName: \"kubernetes.io/projected/86046ef4-6a68-4453-843d-cf7fd1dd0d71-kube-api-access-svx2c\") pod \"payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5\" (UID: \"86046ef4-6a68-4453-843d-cf7fd1dd0d71\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5"
Sep 16 12:21:24.106057 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:24.106022    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv"
Sep 16 12:21:24.135958 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:24.135701    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5"
Sep 16 12:21:24.401795 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:24.401767    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv"]
Sep 16 12:21:24.402853 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:21:24.402828    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode10bb12b_7fda_49ff_9a7d_7f64a9b83732.slice/crio-caf320f00975f35b4058bf85d615866d57c8c56c4864e61b7bb12ce90c1151b5 WatchSource:0}: Error finding container caf320f00975f35b4058bf85d615866d57c8c56c4864e61b7bb12ce90c1151b5: Status 404 returned error can't find the container with id caf320f00975f35b4058bf85d615866d57c8c56c4864e61b7bb12ce90c1151b5
Sep 16 12:21:24.435887 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:24.435863    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5"]
Sep 16 12:21:24.437584 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:21:24.437548    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86046ef4_6a68_4453_843d_cf7fd1dd0d71.slice/crio-1ae8ecda6b62b75f553da787ec25f8e93ec83c222a8a706b17eb409adba07f04 WatchSource:0}: Error finding container 1ae8ecda6b62b75f553da787ec25f8e93ec83c222a8a706b17eb409adba07f04: Status 404 returned error can't find the container with id 1ae8ecda6b62b75f553da787ec25f8e93ec83c222a8a706b17eb409adba07f04
Sep 16 12:21:25.019361 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:25.019299    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5" event={"ID":"86046ef4-6a68-4453-843d-cf7fd1dd0d71","Type":"ContainerStarted","Data":"819c31bb0da0304c3e591f59a7b492e3bc14f5b6ff5ac67c470e6f296a9d1cae"}
Sep 16 12:21:25.019563 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:25.019380    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5" event={"ID":"86046ef4-6a68-4453-843d-cf7fd1dd0d71","Type":"ContainerStarted","Data":"1ae8ecda6b62b75f553da787ec25f8e93ec83c222a8a706b17eb409adba07f04"}
Sep 16 12:21:25.019563 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:25.019410    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5"
Sep 16 12:21:25.021330 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:25.021280    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv" event={"ID":"e10bb12b-7fda-49ff-9a7d-7f64a9b83732","Type":"ContainerStarted","Data":"575ba8c7c43c88a083722f6af28edae52e16372a341d1aa936a457370230047d"}
Sep 16 12:21:25.021471 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:25.021366    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv" event={"ID":"e10bb12b-7fda-49ff-9a7d-7f64a9b83732","Type":"ContainerStarted","Data":"caf320f00975f35b4058bf85d615866d57c8c56c4864e61b7bb12ce90c1151b5"}
Sep 16 12:21:25.021471 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:25.021390    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv"
Sep 16 12:21:25.046415 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:25.046359    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5" podStartSLOduration=2.046339946 podStartE2EDuration="2.046339946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:21:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:21:25.042503114 +0000 UTC m=+1151.211467825" watchObservedRunningTime="2026-09-16 12:21:25.046339946 +0000 UTC m=+1151.215304657"
Sep 16 12:21:25.060491 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:25.060440    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv" podStartSLOduration=2.060416831 podStartE2EDuration="2.060416831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:21:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:21:25.058748092 +0000 UTC m=+1151.227712824" watchObservedRunningTime="2026-09-16 12:21:25.060416831 +0000 UTC m=+1151.229381540"
Sep 16 12:21:30.471955 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:30.471903    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7" podUID="085caffd-d02c-4d23-89dd-d518894cbcfd" containerName="main" containerID="cri-o://4078ad78cf66ac809751f696d91063d55c2b1390d42cf03b876580c5c684550e" gracePeriod=45
Sep 16 12:21:30.773668 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:30.773641    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"
Sep 16 12:21:30.926299 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:30.926262    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/085caffd-d02c-4d23-89dd-d518894cbcfd-tls-certs\") pod \"085caffd-d02c-4d23-89dd-d518894cbcfd\" (UID: \"085caffd-d02c-4d23-89dd-d518894cbcfd\") "
Sep 16 12:21:30.926516 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:30.926329    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/085caffd-d02c-4d23-89dd-d518894cbcfd-dshm\") pod \"085caffd-d02c-4d23-89dd-d518894cbcfd\" (UID: \"085caffd-d02c-4d23-89dd-d518894cbcfd\") "
Sep 16 12:21:30.926516 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:30.926353    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/085caffd-d02c-4d23-89dd-d518894cbcfd-tmp-dir\") pod \"085caffd-d02c-4d23-89dd-d518894cbcfd\" (UID: \"085caffd-d02c-4d23-89dd-d518894cbcfd\") "
Sep 16 12:21:30.926516 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:30.926394    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/085caffd-d02c-4d23-89dd-d518894cbcfd-home\") pod \"085caffd-d02c-4d23-89dd-d518894cbcfd\" (UID: \"085caffd-d02c-4d23-89dd-d518894cbcfd\") "
Sep 16 12:21:30.926516 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:30.926489    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/085caffd-d02c-4d23-89dd-d518894cbcfd-model-cache\") pod \"085caffd-d02c-4d23-89dd-d518894cbcfd\" (UID: \"085caffd-d02c-4d23-89dd-d518894cbcfd\") "
Sep 16 12:21:30.926734 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:30.926543    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7mcw\" (UniqueName: \"kubernetes.io/projected/085caffd-d02c-4d23-89dd-d518894cbcfd-kube-api-access-c7mcw\") pod \"085caffd-d02c-4d23-89dd-d518894cbcfd\" (UID: \"085caffd-d02c-4d23-89dd-d518894cbcfd\") "
Sep 16 12:21:30.926734 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:30.926703    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/085caffd-d02c-4d23-89dd-d518894cbcfd-home" (OuterVolumeSpecName: "home") pod "085caffd-d02c-4d23-89dd-d518894cbcfd" (UID: "085caffd-d02c-4d23-89dd-d518894cbcfd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:21:30.926837 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:30.926737    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/085caffd-d02c-4d23-89dd-d518894cbcfd-model-cache" (OuterVolumeSpecName: "model-cache") pod "085caffd-d02c-4d23-89dd-d518894cbcfd" (UID: "085caffd-d02c-4d23-89dd-d518894cbcfd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:21:30.926923 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:30.926902    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/085caffd-d02c-4d23-89dd-d518894cbcfd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "085caffd-d02c-4d23-89dd-d518894cbcfd" (UID: "085caffd-d02c-4d23-89dd-d518894cbcfd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:21:30.927092 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:30.927024    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/085caffd-d02c-4d23-89dd-d518894cbcfd-home\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:21:30.927192 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:30.927180    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/085caffd-d02c-4d23-89dd-d518894cbcfd-model-cache\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:21:30.928783 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:30.928757    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/085caffd-d02c-4d23-89dd-d518894cbcfd-dshm" (OuterVolumeSpecName: "dshm") pod "085caffd-d02c-4d23-89dd-d518894cbcfd" (UID: "085caffd-d02c-4d23-89dd-d518894cbcfd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:21:30.928872 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:30.928782    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/085caffd-d02c-4d23-89dd-d518894cbcfd-kube-api-access-c7mcw" (OuterVolumeSpecName: "kube-api-access-c7mcw") pod "085caffd-d02c-4d23-89dd-d518894cbcfd" (UID: "085caffd-d02c-4d23-89dd-d518894cbcfd"). InnerVolumeSpecName "kube-api-access-c7mcw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:21:30.928872 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:30.928843    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/085caffd-d02c-4d23-89dd-d518894cbcfd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "085caffd-d02c-4d23-89dd-d518894cbcfd" (UID: "085caffd-d02c-4d23-89dd-d518894cbcfd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:21:31.028304 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:31.028219    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/085caffd-d02c-4d23-89dd-d518894cbcfd-tls-certs\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:21:31.028304 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:31.028250    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/085caffd-d02c-4d23-89dd-d518894cbcfd-dshm\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:21:31.028304 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:31.028259    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/085caffd-d02c-4d23-89dd-d518894cbcfd-tmp-dir\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:21:31.028304 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:31.028273    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7mcw\" (UniqueName: \"kubernetes.io/projected/085caffd-d02c-4d23-89dd-d518894cbcfd-kube-api-access-c7mcw\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:21:31.060246 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:31.060215    2576 generic.go:356] "Generic (PLEG): container finished" podID="085caffd-d02c-4d23-89dd-d518894cbcfd" containerID="4078ad78cf66ac809751f696d91063d55c2b1390d42cf03b876580c5c684550e" exitCode=0
Sep 16 12:21:31.060426 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:31.060257    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"
Sep 16 12:21:31.060426 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:31.060310    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7" event={"ID":"085caffd-d02c-4d23-89dd-d518894cbcfd","Type":"ContainerDied","Data":"4078ad78cf66ac809751f696d91063d55c2b1390d42cf03b876580c5c684550e"}
Sep 16 12:21:31.060426 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:31.060379    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7" event={"ID":"085caffd-d02c-4d23-89dd-d518894cbcfd","Type":"ContainerDied","Data":"c2003f4ec7e79042ea4a799e2bfc5889bb4368f2989fe4564a96f442da6b7bad"}
Sep 16 12:21:31.060426 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:31.060401    2576 scope.go:117] "RemoveContainer" containerID="4078ad78cf66ac809751f696d91063d55c2b1390d42cf03b876580c5c684550e"
Sep 16 12:21:31.070099 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:31.070078    2576 scope.go:117] "RemoveContainer" containerID="4078ad78cf66ac809751f696d91063d55c2b1390d42cf03b876580c5c684550e"
Sep 16 12:21:31.070381 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:21:31.070360    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4078ad78cf66ac809751f696d91063d55c2b1390d42cf03b876580c5c684550e\": container with ID starting with 4078ad78cf66ac809751f696d91063d55c2b1390d42cf03b876580c5c684550e not found: ID does not exist" containerID="4078ad78cf66ac809751f696d91063d55c2b1390d42cf03b876580c5c684550e"
Sep 16 12:21:31.070452 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:31.070396    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4078ad78cf66ac809751f696d91063d55c2b1390d42cf03b876580c5c684550e"} err="failed to get container status \"4078ad78cf66ac809751f696d91063d55c2b1390d42cf03b876580c5c684550e\": rpc error: code = NotFound desc = could not find container \"4078ad78cf66ac809751f696d91063d55c2b1390d42cf03b876580c5c684550e\": container with ID starting with 4078ad78cf66ac809751f696d91063d55c2b1390d42cf03b876580c5c684550e not found: ID does not exist"
Sep 16 12:21:31.081344 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:31.081307    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"]
Sep 16 12:21:31.084894 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:31.084872    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-556077/e2e-conflict-a-067c87d4-kserve-d75f65fd-ptqf7"]
Sep 16 12:21:32.395153 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:32.395104    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="085caffd-d02c-4d23-89dd-d518894cbcfd" path="/var/lib/kubelet/pods/085caffd-d02c-4d23-89dd-d518894cbcfd/volumes"
Sep 16 12:21:36.030936 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:36.030847    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5"
Sep 16 12:21:36.031353 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:36.030968    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv"
Sep 16 12:21:36.579657 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:36.578527    2576 patch_prober.go:28] interesting pod/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": read tcp 10.134.0.2:50030->10.134.0.71:15021: read: connection reset by peer" start-of-body=
Sep 16 12:21:36.579657 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:36.578607    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n" podUID="323c9bc0-1d10-46eb-aa42-447b15758729" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": read tcp 10.134.0.2:50030->10.134.0.71:15021: read: connection reset by peer"
Sep 16 12:21:37.108063 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:37.108025    2576 generic.go:356] "Generic (PLEG): container finished" podID="323c9bc0-1d10-46eb-aa42-447b15758729" containerID="06d4a6235fccda0d9204a8ba46db65ec0f2b53a6337136647ab6fccd23e84098" exitCode=0
Sep 16 12:21:37.108465 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:37.108098    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n" event={"ID":"323c9bc0-1d10-46eb-aa42-447b15758729","Type":"ContainerDied","Data":"06d4a6235fccda0d9204a8ba46db65ec0f2b53a6337136647ab6fccd23e84098"}
Sep 16 12:21:37.108548 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:37.108535    2576 scope.go:117] "RemoveContainer" containerID="06d4a6235fccda0d9204a8ba46db65ec0f2b53a6337136647ab6fccd23e84098"
Sep 16 12:21:37.109716 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:37.109689    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:21:37.109837 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:37.109773    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:21:37.109837 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:37.109822    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:21:38.116378 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:38.116344    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n" event={"ID":"323c9bc0-1d10-46eb-aa42-447b15758729","Type":"ContainerStarted","Data":"61d3ee1125bc8dc49d73c50528c12b06c7171f35827d677335ad4f970f8ba13d"}
Sep 16 12:21:38.683444 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:38.683411    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:38.683636 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:38.683615    2576 patch_prober.go:28] interesting pod/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 16 12:21:38.683687 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:38.683662    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n" podUID="323c9bc0-1d10-46eb-aa42-447b15758729" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 16 12:21:39.683654 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:39.683619    2576 patch_prober.go:28] interesting pod/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 16 12:21:39.684062 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:39.683674    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n" podUID="323c9bc0-1d10-46eb-aa42-447b15758729" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 16 12:21:40.683917 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:40.683884    2576 patch_prober.go:28] interesting pod/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 16 12:21:40.684425 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:40.683939    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n" podUID="323c9bc0-1d10-46eb-aa42-447b15758729" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 16 12:21:41.683515 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:41.683480    2576 patch_prober.go:28] interesting pod/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 16 12:21:41.683676 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:41.683536    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n" podUID="323c9bc0-1d10-46eb-aa42-447b15758729" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 16 12:21:42.683567 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:42.683533    2576 patch_prober.go:28] interesting pod/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 16 12:21:42.683958 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:42.683595    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n" podUID="323c9bc0-1d10-46eb-aa42-447b15758729" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 16 12:21:43.683931 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:43.683900    2576 patch_prober.go:28] interesting pod/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 16 12:21:43.684344 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:43.683959    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n" podUID="323c9bc0-1d10-46eb-aa42-447b15758729" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 16 12:21:44.687302 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:44.687274    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:44.687775 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:44.687656    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:21:44.688286 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:21:44.688265    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:22:14.405959 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:22:14.405929    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tb7dg_fb6b35a8-78d4-40b2-a087-7b45e92b2234/ovn-acl-logging/0.log"
Sep 16 12:22:14.406453 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:22:14.406411    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tb7dg_fb6b35a8-78d4-40b2-a087-7b45e92b2234/ovn-acl-logging/0.log"
Sep 16 12:23:14.532208 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:14.532174    2576 scope.go:117] "RemoveContainer" containerID="b2455a9519cf98c67c45d800bb3bd34b2a38dc856332896506668aa24b456c53"
Sep 16 12:23:14.541384 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:14.541364    2576 scope.go:117] "RemoveContainer" containerID="c7d4ef99ad59a1cdfda478f1720819b9ef91b355828a453435fd287da3487b0c"
Sep 16 12:23:31.949198 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:31.949165    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"]
Sep 16 12:23:31.949745 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:31.949708    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="085caffd-d02c-4d23-89dd-d518894cbcfd" containerName="main"
Sep 16 12:23:31.949745 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:31.949720    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="085caffd-d02c-4d23-89dd-d518894cbcfd" containerName="main"
Sep 16 12:23:31.949825 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:31.949807    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="085caffd-d02c-4d23-89dd-d518894cbcfd" containerName="main"
Sep 16 12:23:31.954840 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:31.954823    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"
Sep 16 12:23:31.957565 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:31.957512    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w2-db42a6\"/\"openshift-service-ca.crt\""
Sep 16 12:23:31.957565 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:31.957552    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w2-db42a6\"/\"default-dockercfg-czqpt\""
Sep 16 12:23:31.957774 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:31.957513    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w2-db42a6\"/\"kube-root-ca.crt\""
Sep 16 12:23:31.957943 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:31.957915    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w2-db42a6\"/\"auth-test-model-db42a6-kserve-self-signed-certs\""
Sep 16 12:23:31.960197 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:31.960173    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"]
Sep 16 12:23:32.091494 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:32.091460    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-tmp-dir\") pod \"auth-test-model-db42a6-kserve-54b87d7d67-4qxph\" (UID: \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\") " pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"
Sep 16 12:23:32.091698 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:32.091520    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-model-cache\") pod \"auth-test-model-db42a6-kserve-54b87d7d67-4qxph\" (UID: \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\") " pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"
Sep 16 12:23:32.091698 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:32.091636    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-tls-certs\") pod \"auth-test-model-db42a6-kserve-54b87d7d67-4qxph\" (UID: \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\") " pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"
Sep 16 12:23:32.091698 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:32.091673    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-home\") pod \"auth-test-model-db42a6-kserve-54b87d7d67-4qxph\" (UID: \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\") " pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"
Sep 16 12:23:32.091880 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:32.091749    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x87rv\" (UniqueName: \"kubernetes.io/projected/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-kube-api-access-x87rv\") pod \"auth-test-model-db42a6-kserve-54b87d7d67-4qxph\" (UID: \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\") " pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"
Sep 16 12:23:32.091880 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:32.091810    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-dshm\") pod \"auth-test-model-db42a6-kserve-54b87d7d67-4qxph\" (UID: \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\") " pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"
Sep 16 12:23:32.193185 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:32.193155    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-tls-certs\") pod \"auth-test-model-db42a6-kserve-54b87d7d67-4qxph\" (UID: \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\") " pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"
Sep 16 12:23:32.193454 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:32.193190    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-home\") pod \"auth-test-model-db42a6-kserve-54b87d7d67-4qxph\" (UID: \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\") " pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"
Sep 16 12:23:32.193454 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:32.193229    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x87rv\" (UniqueName: \"kubernetes.io/projected/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-kube-api-access-x87rv\") pod \"auth-test-model-db42a6-kserve-54b87d7d67-4qxph\" (UID: \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\") " pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"
Sep 16 12:23:32.193454 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:32.193257    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-dshm\") pod \"auth-test-model-db42a6-kserve-54b87d7d67-4qxph\" (UID: \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\") " pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"
Sep 16 12:23:32.193454 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:32.193300    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-tmp-dir\") pod \"auth-test-model-db42a6-kserve-54b87d7d67-4qxph\" (UID: \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\") " pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"
Sep 16 12:23:32.193454 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:32.193377    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-model-cache\") pod \"auth-test-model-db42a6-kserve-54b87d7d67-4qxph\" (UID: \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\") " pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"
Sep 16 12:23:32.193742 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:32.193717    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-home\") pod \"auth-test-model-db42a6-kserve-54b87d7d67-4qxph\" (UID: \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\") " pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"
Sep 16 12:23:32.193794 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:32.193752    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-tmp-dir\") pod \"auth-test-model-db42a6-kserve-54b87d7d67-4qxph\" (UID: \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\") " pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"
Sep 16 12:23:32.193851 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:32.193823    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-model-cache\") pod \"auth-test-model-db42a6-kserve-54b87d7d67-4qxph\" (UID: \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\") " pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"
Sep 16 12:23:32.195927 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:32.195901    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-dshm\") pod \"auth-test-model-db42a6-kserve-54b87d7d67-4qxph\" (UID: \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\") " pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"
Sep 16 12:23:32.196093 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:32.196074    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-tls-certs\") pod \"auth-test-model-db42a6-kserve-54b87d7d67-4qxph\" (UID: \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\") " pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"
Sep 16 12:23:32.201516 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:32.201466    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x87rv\" (UniqueName: \"kubernetes.io/projected/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-kube-api-access-x87rv\") pod \"auth-test-model-db42a6-kserve-54b87d7d67-4qxph\" (UID: \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\") " pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"
Sep 16 12:23:32.266566 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:32.266520    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"
Sep 16 12:23:32.541103 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:32.541083    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"]
Sep 16 12:23:32.544017 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:23:32.543989    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod449ac1c1_1ffd_46ec_aeac_5bb0eb4e1a56.slice/crio-f5442328b09f647f738bd17f6a8941290c8ecca2f12453721959ad331c8408e5 WatchSource:0}: Error finding container f5442328b09f647f738bd17f6a8941290c8ecca2f12453721959ad331c8408e5: Status 404 returned error can't find the container with id f5442328b09f647f738bd17f6a8941290c8ecca2f12453721959ad331c8408e5
Sep 16 12:23:32.821446 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:32.821359    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph" event={"ID":"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56","Type":"ContainerStarted","Data":"1f6165d9cba788375e2888254ede63a580eb3497acb6d3208560bf60fe797b42"}
Sep 16 12:23:32.821446 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:32.821410    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph" event={"ID":"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56","Type":"ContainerStarted","Data":"f5442328b09f647f738bd17f6a8941290c8ecca2f12453721959ad331c8408e5"}
Sep 16 12:23:32.840023 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:32.839972    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph" podStartSLOduration=1.839958497 podStartE2EDuration="1.839958497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:23:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:23:32.838297129 +0000 UTC m=+1279.007261837" watchObservedRunningTime="2026-09-16 12:23:32.839958497 +0000 UTC m=+1279.008923204"
Sep 16 12:23:42.266827 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:42.266788    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"
Sep 16 12:23:42.267388 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:42.267053    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"
Sep 16 12:23:42.279786 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:42.279761    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"
Sep 16 12:23:42.892027 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:23:42.891995    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"
Sep 16 12:24:21.031700 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:21.031670    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f9e6d9e-dbd9c"]
Sep 16 12:24:21.035662 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:21.035646    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f9e6d9e-dbd9c"
Sep 16 12:24:21.038248 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:21.038229    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9lc86\""
Sep 16 12:24:21.042816 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:21.042782    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f9e6d9e-dbd9c"]
Sep 16 12:24:21.122689 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:21.122653    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8e0bdcf-9927-49c7-ac80-bebca1fcab00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8f9e6d9e-dbd9c\" (UID: \"f8e0bdcf-9927-49c7-ac80-bebca1fcab00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f9e6d9e-dbd9c"
Sep 16 12:24:21.223830 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:21.223795    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8e0bdcf-9927-49c7-ac80-bebca1fcab00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8f9e6d9e-dbd9c\" (UID: \"f8e0bdcf-9927-49c7-ac80-bebca1fcab00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f9e6d9e-dbd9c"
Sep 16 12:24:21.224476 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:21.224451    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8e0bdcf-9927-49c7-ac80-bebca1fcab00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8f9e6d9e-dbd9c\" (UID: \"f8e0bdcf-9927-49c7-ac80-bebca1fcab00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f9e6d9e-dbd9c"
Sep 16 12:24:21.347506 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:21.347434    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f9e6d9e-dbd9c"
Sep 16 12:24:21.623959 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:21.623931    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f9e6d9e-dbd9c"]
Sep 16 12:24:21.626705 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:24:21.626662    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8e0bdcf_9927_49c7_ac80_bebca1fcab00.slice/crio-b98725c3a773786026d1064b7b12130b77495fed06f30ceb8ee4a65ffa4a3cd3 WatchSource:0}: Error finding container b98725c3a773786026d1064b7b12130b77495fed06f30ceb8ee4a65ffa4a3cd3: Status 404 returned error can't find the container with id b98725c3a773786026d1064b7b12130b77495fed06f30ceb8ee4a65ffa4a3cd3
Sep 16 12:24:22.131984 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:22.131948    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f9e6d9e-dbd9c" event={"ID":"f8e0bdcf-9927-49c7-ac80-bebca1fcab00","Type":"ContainerStarted","Data":"d9b873a94cc162fe829b18f67255e6cb7a2949fe14b4590289d1620bfd067263"}
Sep 16 12:24:22.132457 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:22.132010    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f9e6d9e-dbd9c" event={"ID":"f8e0bdcf-9927-49c7-ac80-bebca1fcab00","Type":"ContainerStarted","Data":"b98725c3a773786026d1064b7b12130b77495fed06f30ceb8ee4a65ffa4a3cd3"}
Sep 16 12:24:22.148935 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:22.148884    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f9e6d9e-dbd9c" podStartSLOduration=1.148870387 podStartE2EDuration="1.148870387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:24:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:24:22.14659309 +0000 UTC m=+1328.315557796" watchObservedRunningTime="2026-09-16 12:24:22.148870387 +0000 UTC m=+1328.317835093"
Sep 16 12:24:23.139553 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:23.139518    2576 generic.go:356] "Generic (PLEG): container finished" podID="f8e0bdcf-9927-49c7-ac80-bebca1fcab00" containerID="d9b873a94cc162fe829b18f67255e6cb7a2949fe14b4590289d1620bfd067263" exitCode=0
Sep 16 12:24:23.139924 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:23.139600    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f9e6d9e-dbd9c" event={"ID":"f8e0bdcf-9927-49c7-ac80-bebca1fcab00","Type":"ContainerDied","Data":"d9b873a94cc162fe829b18f67255e6cb7a2949fe14b4590289d1620bfd067263"}
Sep 16 12:24:24.296235 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:24.296211    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f9e6d9e-dbd9c"
Sep 16 12:24:24.356044 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:24.356012    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8e0bdcf-9927-49c7-ac80-bebca1fcab00-maas-api-service-ca\") pod \"f8e0bdcf-9927-49c7-ac80-bebca1fcab00\" (UID: \"f8e0bdcf-9927-49c7-ac80-bebca1fcab00\") "
Sep 16 12:24:24.356363 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:24.356340    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8e0bdcf-9927-49c7-ac80-bebca1fcab00-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f8e0bdcf-9927-49c7-ac80-bebca1fcab00" (UID: "f8e0bdcf-9927-49c7-ac80-bebca1fcab00"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:24:24.457097 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:24.457064    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8e0bdcf-9927-49c7-ac80-bebca1fcab00-maas-api-service-ca\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:24:25.152441 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:25.152409    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f9e6d9e-dbd9c"
Sep 16 12:24:25.152603 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:25.152410    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f9e6d9e-dbd9c" event={"ID":"f8e0bdcf-9927-49c7-ac80-bebca1fcab00","Type":"ContainerDied","Data":"b98725c3a773786026d1064b7b12130b77495fed06f30ceb8ee4a65ffa4a3cd3"}
Sep 16 12:24:25.152603 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:25.152561    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b98725c3a773786026d1064b7b12130b77495fed06f30ceb8ee4a65ffa4a3cd3"
Sep 16 12:24:36.541374 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:36.541144    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws"]
Sep 16 12:24:36.542306 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:36.542024    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws" podUID="cebeb4b1-a9e8-470d-9780-8c55f9ee73da" containerName="payload-pre-processing" containerID="cri-o://31078f149be534e36c06f1a42724bc0e11d318418dc5dde02c345f02d3d6a794" gracePeriod=30
Sep 16 12:24:36.699229 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:36.699193    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f9e6d9e-dbd9c"]
Sep 16 12:24:36.704516 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:36.704490    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8f9e6d9e-dbd9c"]
Sep 16 12:24:36.815329 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:36.815297    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws"
Sep 16 12:24:36.891394 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:36.891358    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fprv\" (UniqueName: \"kubernetes.io/projected/cebeb4b1-a9e8-470d-9780-8c55f9ee73da-kube-api-access-6fprv\") pod \"cebeb4b1-a9e8-470d-9780-8c55f9ee73da\" (UID: \"cebeb4b1-a9e8-470d-9780-8c55f9ee73da\") "
Sep 16 12:24:36.891585 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:36.891502    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cebeb4b1-a9e8-470d-9780-8c55f9ee73da-plugins-config-volume\") pod \"cebeb4b1-a9e8-470d-9780-8c55f9ee73da\" (UID: \"cebeb4b1-a9e8-470d-9780-8c55f9ee73da\") "
Sep 16 12:24:36.891914 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:36.891846    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cebeb4b1-a9e8-470d-9780-8c55f9ee73da-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cebeb4b1-a9e8-470d-9780-8c55f9ee73da" (UID: "cebeb4b1-a9e8-470d-9780-8c55f9ee73da"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:24:36.892068 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:36.891969    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cebeb4b1-a9e8-470d-9780-8c55f9ee73da-plugins-config-volume\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:24:36.895269 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:36.895098    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cebeb4b1-a9e8-470d-9780-8c55f9ee73da-kube-api-access-6fprv" (OuterVolumeSpecName: "kube-api-access-6fprv") pod "cebeb4b1-a9e8-470d-9780-8c55f9ee73da" (UID: "cebeb4b1-a9e8-470d-9780-8c55f9ee73da"). InnerVolumeSpecName "kube-api-access-6fprv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:24:36.993626 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:36.993589    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fprv\" (UniqueName: \"kubernetes.io/projected/cebeb4b1-a9e8-470d-9780-8c55f9ee73da-kube-api-access-6fprv\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:24:37.235053 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:37.235016    2576 generic.go:356] "Generic (PLEG): container finished" podID="cebeb4b1-a9e8-470d-9780-8c55f9ee73da" containerID="31078f149be534e36c06f1a42724bc0e11d318418dc5dde02c345f02d3d6a794" exitCode=0
Sep 16 12:24:37.235227 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:37.235065    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws"
Sep 16 12:24:37.235227 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:37.235105    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws" event={"ID":"cebeb4b1-a9e8-470d-9780-8c55f9ee73da","Type":"ContainerDied","Data":"31078f149be534e36c06f1a42724bc0e11d318418dc5dde02c345f02d3d6a794"}
Sep 16 12:24:37.235227 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:37.235165    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws" event={"ID":"cebeb4b1-a9e8-470d-9780-8c55f9ee73da","Type":"ContainerDied","Data":"1476d198602d644c10bd6255b9ef4f26e337b34d8c5a0c84ec25491d288b13c8"}
Sep 16 12:24:37.235227 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:37.235187    2576 scope.go:117] "RemoveContainer" containerID="31078f149be534e36c06f1a42724bc0e11d318418dc5dde02c345f02d3d6a794"
Sep 16 12:24:37.245042 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:37.245020    2576 scope.go:117] "RemoveContainer" containerID="31078f149be534e36c06f1a42724bc0e11d318418dc5dde02c345f02d3d6a794"
Sep 16 12:24:37.245362 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:24:37.245342    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31078f149be534e36c06f1a42724bc0e11d318418dc5dde02c345f02d3d6a794\": container with ID starting with 31078f149be534e36c06f1a42724bc0e11d318418dc5dde02c345f02d3d6a794 not found: ID does not exist" containerID="31078f149be534e36c06f1a42724bc0e11d318418dc5dde02c345f02d3d6a794"
Sep 16 12:24:37.245412 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:37.245372    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31078f149be534e36c06f1a42724bc0e11d318418dc5dde02c345f02d3d6a794"} err="failed to get container status \"31078f149be534e36c06f1a42724bc0e11d318418dc5dde02c345f02d3d6a794\": rpc error: code = NotFound desc = could not find container \"31078f149be534e36c06f1a42724bc0e11d318418dc5dde02c345f02d3d6a794\": container with ID starting with 31078f149be534e36c06f1a42724bc0e11d318418dc5dde02c345f02d3d6a794 not found: ID does not exist"
Sep 16 12:24:37.263437 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:37.263403    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws"]
Sep 16 12:24:37.267127 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:37.267107    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8f9e6d9e-69f7496d78-gfzws"]
Sep 16 12:24:38.395069 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:38.395026    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cebeb4b1-a9e8-470d-9780-8c55f9ee73da" path="/var/lib/kubelet/pods/cebeb4b1-a9e8-470d-9780-8c55f9ee73da/volumes"
Sep 16 12:24:38.395590 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:24:38.395527    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8e0bdcf-9927-49c7-ac80-bebca1fcab00" path="/var/lib/kubelet/pods/f8e0bdcf-9927-49c7-ac80-bebca1fcab00/volumes"
Sep 16 12:25:14.575648 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:14.575619    2576 scope.go:117] "RemoveContainer" containerID="db54f1ccf33a41f44adbb76b86d78a02f5fdd791ce94fff0731d336072447bdb"
Sep 16 12:25:27.958396 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:27.958366    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"]
Sep 16 12:25:27.958850 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:27.958604    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n" podUID="323c9bc0-1d10-46eb-aa42-447b15758729" containerName="istio-proxy" containerID="cri-o://61d3ee1125bc8dc49d73c50528c12b06c7171f35827d677335ad4f970f8ba13d" gracePeriod=30
Sep 16 12:25:29.690953 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:29.690923    2576 patch_prober.go:28] interesting pod/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 12:25:29.691357 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:29.690985    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n" podUID="323c9bc0-1d10-46eb-aa42-447b15758729" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 12:25:33.219048 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.219023    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:25:33.303508 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.303434    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/323c9bc0-1d10-46eb-aa42-447b15758729-istio-token\") pod \"323c9bc0-1d10-46eb-aa42-447b15758729\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") "
Sep 16 12:25:33.303508 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.303467    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-istio-envoy\") pod \"323c9bc0-1d10-46eb-aa42-447b15758729\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") "
Sep 16 12:25:33.303508 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.303509    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-istio-data\") pod \"323c9bc0-1d10-46eb-aa42-447b15758729\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") "
Sep 16 12:25:33.303784 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.303546    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/323c9bc0-1d10-46eb-aa42-447b15758729-istio-podinfo\") pod \"323c9bc0-1d10-46eb-aa42-447b15758729\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") "
Sep 16 12:25:33.303784 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.303594    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/323c9bc0-1d10-46eb-aa42-447b15758729-istiod-ca-cert\") pod \"323c9bc0-1d10-46eb-aa42-447b15758729\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") "
Sep 16 12:25:33.303784 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.303618    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-workload-socket\") pod \"323c9bc0-1d10-46eb-aa42-447b15758729\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") "
Sep 16 12:25:33.303784 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.303682    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89q8b\" (UniqueName: \"kubernetes.io/projected/323c9bc0-1d10-46eb-aa42-447b15758729-kube-api-access-89q8b\") pod \"323c9bc0-1d10-46eb-aa42-447b15758729\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") "
Sep 16 12:25:33.303784 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.303748    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-credential-socket\") pod \"323c9bc0-1d10-46eb-aa42-447b15758729\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") "
Sep 16 12:25:33.303784 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.303773    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-workload-certs\") pod \"323c9bc0-1d10-46eb-aa42-447b15758729\" (UID: \"323c9bc0-1d10-46eb-aa42-447b15758729\") "
Sep 16 12:25:33.304097 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.303850    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-istio-data" (OuterVolumeSpecName: "istio-data") pod "323c9bc0-1d10-46eb-aa42-447b15758729" (UID: "323c9bc0-1d10-46eb-aa42-447b15758729"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:25:33.304097 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.303908    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "323c9bc0-1d10-46eb-aa42-447b15758729" (UID: "323c9bc0-1d10-46eb-aa42-447b15758729"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:25:33.304097 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.303950    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/323c9bc0-1d10-46eb-aa42-447b15758729-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "323c9bc0-1d10-46eb-aa42-447b15758729" (UID: "323c9bc0-1d10-46eb-aa42-447b15758729"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:25:33.304097 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.304061    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "323c9bc0-1d10-46eb-aa42-447b15758729" (UID: "323c9bc0-1d10-46eb-aa42-447b15758729"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:25:33.304503 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.304095    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "323c9bc0-1d10-46eb-aa42-447b15758729" (UID: "323c9bc0-1d10-46eb-aa42-447b15758729"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:25:33.304503 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.304291    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-credential-socket\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:25:33.304503 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.304305    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-workload-certs\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:25:33.304503 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.304344    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-istio-data\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:25:33.304503 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.304353    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/323c9bc0-1d10-46eb-aa42-447b15758729-istiod-ca-cert\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:25:33.304503 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.304361    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-workload-socket\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:25:33.305947 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.305920    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/323c9bc0-1d10-46eb-aa42-447b15758729-istio-token" (OuterVolumeSpecName: "istio-token") pod "323c9bc0-1d10-46eb-aa42-447b15758729" (UID: "323c9bc0-1d10-46eb-aa42-447b15758729"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:25:33.306169 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.306141    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/323c9bc0-1d10-46eb-aa42-447b15758729-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "323c9bc0-1d10-46eb-aa42-447b15758729" (UID: "323c9bc0-1d10-46eb-aa42-447b15758729"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:25:33.306438 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.306422    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "323c9bc0-1d10-46eb-aa42-447b15758729" (UID: "323c9bc0-1d10-46eb-aa42-447b15758729"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:25:33.306516 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.306439    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/323c9bc0-1d10-46eb-aa42-447b15758729-kube-api-access-89q8b" (OuterVolumeSpecName: "kube-api-access-89q8b") pod "323c9bc0-1d10-46eb-aa42-447b15758729" (UID: "323c9bc0-1d10-46eb-aa42-447b15758729"). InnerVolumeSpecName "kube-api-access-89q8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:25:33.405734 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.405700    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/323c9bc0-1d10-46eb-aa42-447b15758729-istio-podinfo\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:25:33.405734 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.405727    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89q8b\" (UniqueName: \"kubernetes.io/projected/323c9bc0-1d10-46eb-aa42-447b15758729-kube-api-access-89q8b\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:25:33.405734 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.405738    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/323c9bc0-1d10-46eb-aa42-447b15758729-istio-token\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:25:33.405968 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.405746    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/323c9bc0-1d10-46eb-aa42-447b15758729-istio-envoy\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:25:33.577712 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.577621    2576 generic.go:356] "Generic (PLEG): container finished" podID="323c9bc0-1d10-46eb-aa42-447b15758729" containerID="61d3ee1125bc8dc49d73c50528c12b06c7171f35827d677335ad4f970f8ba13d" exitCode=0
Sep 16 12:25:33.577712 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.577677    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"
Sep 16 12:25:33.577904 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.577711    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n" event={"ID":"323c9bc0-1d10-46eb-aa42-447b15758729","Type":"ContainerDied","Data":"61d3ee1125bc8dc49d73c50528c12b06c7171f35827d677335ad4f970f8ba13d"}
Sep 16 12:25:33.577904 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.577768    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n" event={"ID":"323c9bc0-1d10-46eb-aa42-447b15758729","Type":"ContainerDied","Data":"7c5f1af7a484a08369ff0416d82677ac32e8449fea2b3fae9bdc8e10f0e27576"}
Sep 16 12:25:33.577904 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.577791    2576 scope.go:117] "RemoveContainer" containerID="61d3ee1125bc8dc49d73c50528c12b06c7171f35827d677335ad4f970f8ba13d"
Sep 16 12:25:33.588268 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.588251    2576 scope.go:117] "RemoveContainer" containerID="06d4a6235fccda0d9204a8ba46db65ec0f2b53a6337136647ab6fccd23e84098"
Sep 16 12:25:33.597409 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.597378    2576 scope.go:117] "RemoveContainer" containerID="61d3ee1125bc8dc49d73c50528c12b06c7171f35827d677335ad4f970f8ba13d"
Sep 16 12:25:33.597941 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:25:33.597911    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61d3ee1125bc8dc49d73c50528c12b06c7171f35827d677335ad4f970f8ba13d\": container with ID starting with 61d3ee1125bc8dc49d73c50528c12b06c7171f35827d677335ad4f970f8ba13d not found: ID does not exist" containerID="61d3ee1125bc8dc49d73c50528c12b06c7171f35827d677335ad4f970f8ba13d"
Sep 16 12:25:33.598062 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.597952    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61d3ee1125bc8dc49d73c50528c12b06c7171f35827d677335ad4f970f8ba13d"} err="failed to get container status \"61d3ee1125bc8dc49d73c50528c12b06c7171f35827d677335ad4f970f8ba13d\": rpc error: code = NotFound desc = could not find container \"61d3ee1125bc8dc49d73c50528c12b06c7171f35827d677335ad4f970f8ba13d\": container with ID starting with 61d3ee1125bc8dc49d73c50528c12b06c7171f35827d677335ad4f970f8ba13d not found: ID does not exist"
Sep 16 12:25:33.598062 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.598002    2576 scope.go:117] "RemoveContainer" containerID="06d4a6235fccda0d9204a8ba46db65ec0f2b53a6337136647ab6fccd23e84098"
Sep 16 12:25:33.598830 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:25:33.598792    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06d4a6235fccda0d9204a8ba46db65ec0f2b53a6337136647ab6fccd23e84098\": container with ID starting with 06d4a6235fccda0d9204a8ba46db65ec0f2b53a6337136647ab6fccd23e84098 not found: ID does not exist" containerID="06d4a6235fccda0d9204a8ba46db65ec0f2b53a6337136647ab6fccd23e84098"
Sep 16 12:25:33.598936 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.598844    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06d4a6235fccda0d9204a8ba46db65ec0f2b53a6337136647ab6fccd23e84098"} err="failed to get container status \"06d4a6235fccda0d9204a8ba46db65ec0f2b53a6337136647ab6fccd23e84098\": rpc error: code = NotFound desc = could not find container \"06d4a6235fccda0d9204a8ba46db65ec0f2b53a6337136647ab6fccd23e84098\": container with ID starting with 06d4a6235fccda0d9204a8ba46db65ec0f2b53a6337136647ab6fccd23e84098 not found: ID does not exist"
Sep 16 12:25:33.600925 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.600902    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"]
Sep 16 12:25:33.605499 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:33.605478    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-8f9e6d9e-openshift-default-6446f54888-k772n"]
Sep 16 12:25:34.394473 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:25:34.394439    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="323c9bc0-1d10-46eb-aa42-447b15758729" path="/var/lib/kubelet/pods/323c9bc0-1d10-46eb-aa42-447b15758729/volumes"
Sep 16 12:26:15.045702 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.045586    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"]
Sep 16 12:26:15.046194 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.046134    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8e0bdcf-9927-49c7-ac80-bebca1fcab00" containerName="revoke-keys"
Sep 16 12:26:15.046194 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.046146    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8e0bdcf-9927-49c7-ac80-bebca1fcab00" containerName="revoke-keys"
Sep 16 12:26:15.046194 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.046168    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="323c9bc0-1d10-46eb-aa42-447b15758729" containerName="istio-proxy"
Sep 16 12:26:15.046194 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.046173    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="323c9bc0-1d10-46eb-aa42-447b15758729" containerName="istio-proxy"
Sep 16 12:26:15.046194 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.046182    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cebeb4b1-a9e8-470d-9780-8c55f9ee73da" containerName="payload-pre-processing"
Sep 16 12:26:15.046194 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.046188    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cebeb4b1-a9e8-470d-9780-8c55f9ee73da" containerName="payload-pre-processing"
Sep 16 12:26:15.046619 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.046270    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="323c9bc0-1d10-46eb-aa42-447b15758729" containerName="istio-proxy"
Sep 16 12:26:15.046619 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.046277    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cebeb4b1-a9e8-470d-9780-8c55f9ee73da" containerName="payload-pre-processing"
Sep 16 12:26:15.046619 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.046285    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8e0bdcf-9927-49c7-ac80-bebca1fcab00" containerName="revoke-keys"
Sep 16 12:26:15.046619 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.046293    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="323c9bc0-1d10-46eb-aa42-447b15758729" containerName="istio-proxy"
Sep 16 12:26:15.050632 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.050610    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"
Sep 16 12:26:15.053577 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.053540    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-ff057a\"/\"default-dockercfg-szmz8\""
Sep 16 12:26:15.054721 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.054699    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-ff057a\"/\"openshift-service-ca.crt\""
Sep 16 12:26:15.055086 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.055066    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-ff057a\"/\"embedding-w0-ff057a-kserve-self-signed-certs\""
Sep 16 12:26:15.055425 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.055388    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-ff057a\"/\"kube-root-ca.crt\""
Sep 16 12:26:15.062444 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.062423    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"]
Sep 16 12:26:15.148279 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.148234    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d62k\" (UniqueName: \"kubernetes.io/projected/a26b4581-3386-42e8-8abc-896d8106cc97-kube-api-access-4d62k\") pod \"embedding-w0-ff057a-kserve-777d7b695c-zjqw9\" (UID: \"a26b4581-3386-42e8-8abc-896d8106cc97\") " pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"
Sep 16 12:26:15.148485 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.148347    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a26b4581-3386-42e8-8abc-896d8106cc97-tls-certs\") pod \"embedding-w0-ff057a-kserve-777d7b695c-zjqw9\" (UID: \"a26b4581-3386-42e8-8abc-896d8106cc97\") " pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"
Sep 16 12:26:15.148485 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.148382    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a26b4581-3386-42e8-8abc-896d8106cc97-home\") pod \"embedding-w0-ff057a-kserve-777d7b695c-zjqw9\" (UID: \"a26b4581-3386-42e8-8abc-896d8106cc97\") " pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"
Sep 16 12:26:15.148562 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.148488    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a26b4581-3386-42e8-8abc-896d8106cc97-tmp-dir\") pod \"embedding-w0-ff057a-kserve-777d7b695c-zjqw9\" (UID: \"a26b4581-3386-42e8-8abc-896d8106cc97\") " pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"
Sep 16 12:26:15.148562 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.148530    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a26b4581-3386-42e8-8abc-896d8106cc97-dshm\") pod \"embedding-w0-ff057a-kserve-777d7b695c-zjqw9\" (UID: \"a26b4581-3386-42e8-8abc-896d8106cc97\") " pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"
Sep 16 12:26:15.148562 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.148553    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a26b4581-3386-42e8-8abc-896d8106cc97-model-cache\") pod \"embedding-w0-ff057a-kserve-777d7b695c-zjqw9\" (UID: \"a26b4581-3386-42e8-8abc-896d8106cc97\") " pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"
Sep 16 12:26:15.249281 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.249245    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a26b4581-3386-42e8-8abc-896d8106cc97-tls-certs\") pod \"embedding-w0-ff057a-kserve-777d7b695c-zjqw9\" (UID: \"a26b4581-3386-42e8-8abc-896d8106cc97\") " pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"
Sep 16 12:26:15.249281 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.249287    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a26b4581-3386-42e8-8abc-896d8106cc97-home\") pod \"embedding-w0-ff057a-kserve-777d7b695c-zjqw9\" (UID: \"a26b4581-3386-42e8-8abc-896d8106cc97\") " pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"
Sep 16 12:26:15.249540 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.249373    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a26b4581-3386-42e8-8abc-896d8106cc97-tmp-dir\") pod \"embedding-w0-ff057a-kserve-777d7b695c-zjqw9\" (UID: \"a26b4581-3386-42e8-8abc-896d8106cc97\") " pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"
Sep 16 12:26:15.249540 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.249403    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a26b4581-3386-42e8-8abc-896d8106cc97-dshm\") pod \"embedding-w0-ff057a-kserve-777d7b695c-zjqw9\" (UID: \"a26b4581-3386-42e8-8abc-896d8106cc97\") " pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"
Sep 16 12:26:15.249540 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.249433    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a26b4581-3386-42e8-8abc-896d8106cc97-model-cache\") pod \"embedding-w0-ff057a-kserve-777d7b695c-zjqw9\" (UID: \"a26b4581-3386-42e8-8abc-896d8106cc97\") " pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"
Sep 16 12:26:15.249540 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.249508    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d62k\" (UniqueName: \"kubernetes.io/projected/a26b4581-3386-42e8-8abc-896d8106cc97-kube-api-access-4d62k\") pod \"embedding-w0-ff057a-kserve-777d7b695c-zjqw9\" (UID: \"a26b4581-3386-42e8-8abc-896d8106cc97\") " pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"
Sep 16 12:26:15.249842 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.249817    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a26b4581-3386-42e8-8abc-896d8106cc97-home\") pod \"embedding-w0-ff057a-kserve-777d7b695c-zjqw9\" (UID: \"a26b4581-3386-42e8-8abc-896d8106cc97\") " pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"
Sep 16 12:26:15.249924 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.249829    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a26b4581-3386-42e8-8abc-896d8106cc97-model-cache\") pod \"embedding-w0-ff057a-kserve-777d7b695c-zjqw9\" (UID: \"a26b4581-3386-42e8-8abc-896d8106cc97\") " pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"
Sep 16 12:26:15.249924 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.249903    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a26b4581-3386-42e8-8abc-896d8106cc97-tmp-dir\") pod \"embedding-w0-ff057a-kserve-777d7b695c-zjqw9\" (UID: \"a26b4581-3386-42e8-8abc-896d8106cc97\") " pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"
Sep 16 12:26:15.251798 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.251774    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a26b4581-3386-42e8-8abc-896d8106cc97-dshm\") pod \"embedding-w0-ff057a-kserve-777d7b695c-zjqw9\" (UID: \"a26b4581-3386-42e8-8abc-896d8106cc97\") " pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"
Sep 16 12:26:15.252050 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.252032    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a26b4581-3386-42e8-8abc-896d8106cc97-tls-certs\") pod \"embedding-w0-ff057a-kserve-777d7b695c-zjqw9\" (UID: \"a26b4581-3386-42e8-8abc-896d8106cc97\") " pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"
Sep 16 12:26:15.257627 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.257609    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d62k\" (UniqueName: \"kubernetes.io/projected/a26b4581-3386-42e8-8abc-896d8106cc97-kube-api-access-4d62k\") pod \"embedding-w0-ff057a-kserve-777d7b695c-zjqw9\" (UID: \"a26b4581-3386-42e8-8abc-896d8106cc97\") " pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"
Sep 16 12:26:15.363487 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.363456    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"
Sep 16 12:26:15.671676 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.671654    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"]
Sep 16 12:26:15.673295 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:26:15.673261    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda26b4581_3386_42e8_8abc_896d8106cc97.slice/crio-65d9325d2bf7ff5f9415ae3f8901fe025d0282ff97e70edc9932c3c3b0e67b2b WatchSource:0}: Error finding container 65d9325d2bf7ff5f9415ae3f8901fe025d0282ff97e70edc9932c3c3b0e67b2b: Status 404 returned error can't find the container with id 65d9325d2bf7ff5f9415ae3f8901fe025d0282ff97e70edc9932c3c3b0e67b2b
Sep 16 12:26:15.835018 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.834979    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9" event={"ID":"a26b4581-3386-42e8-8abc-896d8106cc97","Type":"ContainerStarted","Data":"7eb5bbe089d7107ba658ed36f7b183ccb8b5071dfdd0afbf74adb34b84d0c052"}
Sep 16 12:26:15.835210 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.835029    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9" event={"ID":"a26b4581-3386-42e8-8abc-896d8106cc97","Type":"ContainerStarted","Data":"65d9325d2bf7ff5f9415ae3f8901fe025d0282ff97e70edc9932c3c3b0e67b2b"}
Sep 16 12:26:15.854862 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:15.854814    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9" podStartSLOduration=0.854799062 podStartE2EDuration="854.799062ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:26:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:26:15.853006412 +0000 UTC m=+1442.021971120" watchObservedRunningTime="2026-09-16 12:26:15.854799062 +0000 UTC m=+1442.023763797"
Sep 16 12:26:25.364089 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:25.364050    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"
Sep 16 12:26:25.364698 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:25.364098    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"
Sep 16 12:26:25.377534 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:25.377488    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"
Sep 16 12:26:25.910242 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:25.910212    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"
Sep 16 12:26:32.055155 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.055117    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh"]
Sep 16 12:26:32.055925 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.055904    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="323c9bc0-1d10-46eb-aa42-447b15758729" containerName="istio-proxy"
Sep 16 12:26:32.056024 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.055927    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="323c9bc0-1d10-46eb-aa42-447b15758729" containerName="istio-proxy"
Sep 16 12:26:32.059498 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.059477    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh"
Sep 16 12:26:32.061958 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.061938    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-a6f57e\""
Sep 16 12:26:32.062131 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.062110    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-a6f57e-dockercfg-b49mf\""
Sep 16 12:26:32.067601 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.067579    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh"]
Sep 16 12:26:32.074962 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.074938    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2"]
Sep 16 12:26:32.078768 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.078749    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2"
Sep 16 12:26:32.088208 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.088183    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2"]
Sep 16 12:26:32.133841 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.133804    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpb4d\" (UniqueName: \"kubernetes.io/projected/86eb185f-5d28-45be-baca-fa586952acf2-kube-api-access-zpb4d\") pod \"payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh\" (UID: \"86eb185f-5d28-45be-baca-fa586952acf2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh"
Sep 16 12:26:32.134034 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.133868    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlswk\" (UniqueName: \"kubernetes.io/projected/af66dad4-51da-4705-9c93-853cb46e4ee0-kube-api-access-mlswk\") pod \"payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2\" (UID: \"af66dad4-51da-4705-9c93-853cb46e4ee0\") " pod="openshift-ingress/payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2"
Sep 16 12:26:32.134034 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.133934    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86eb185f-5d28-45be-baca-fa586952acf2-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh\" (UID: \"86eb185f-5d28-45be-baca-fa586952acf2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh"
Sep 16 12:26:32.134034 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.133975    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af66dad4-51da-4705-9c93-853cb46e4ee0-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2\" (UID: \"af66dad4-51da-4705-9c93-853cb46e4ee0\") " pod="openshift-ingress/payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2"
Sep 16 12:26:32.235205 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.235171    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpb4d\" (UniqueName: \"kubernetes.io/projected/86eb185f-5d28-45be-baca-fa586952acf2-kube-api-access-zpb4d\") pod \"payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh\" (UID: \"86eb185f-5d28-45be-baca-fa586952acf2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh"
Sep 16 12:26:32.235394 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.235231    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlswk\" (UniqueName: \"kubernetes.io/projected/af66dad4-51da-4705-9c93-853cb46e4ee0-kube-api-access-mlswk\") pod \"payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2\" (UID: \"af66dad4-51da-4705-9c93-853cb46e4ee0\") " pod="openshift-ingress/payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2"
Sep 16 12:26:32.235394 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.235249    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86eb185f-5d28-45be-baca-fa586952acf2-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh\" (UID: \"86eb185f-5d28-45be-baca-fa586952acf2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh"
Sep 16 12:26:32.235394 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.235276    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af66dad4-51da-4705-9c93-853cb46e4ee0-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2\" (UID: \"af66dad4-51da-4705-9c93-853cb46e4ee0\") " pod="openshift-ingress/payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2"
Sep 16 12:26:32.236052 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.236033    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86eb185f-5d28-45be-baca-fa586952acf2-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh\" (UID: \"86eb185f-5d28-45be-baca-fa586952acf2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh"
Sep 16 12:26:32.236202 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.236179    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af66dad4-51da-4705-9c93-853cb46e4ee0-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2\" (UID: \"af66dad4-51da-4705-9c93-853cb46e4ee0\") " pod="openshift-ingress/payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2"
Sep 16 12:26:32.243181 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.243153    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpb4d\" (UniqueName: \"kubernetes.io/projected/86eb185f-5d28-45be-baca-fa586952acf2-kube-api-access-zpb4d\") pod \"payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh\" (UID: \"86eb185f-5d28-45be-baca-fa586952acf2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh"
Sep 16 12:26:32.243396 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.243375    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlswk\" (UniqueName: \"kubernetes.io/projected/af66dad4-51da-4705-9c93-853cb46e4ee0-kube-api-access-mlswk\") pod \"payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2\" (UID: \"af66dad4-51da-4705-9c93-853cb46e4ee0\") " pod="openshift-ingress/payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2"
Sep 16 12:26:32.372761 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.372726    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh"
Sep 16 12:26:32.391382 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.391355    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2"
Sep 16 12:26:32.656530 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.656507    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh"]
Sep 16 12:26:32.659001 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:26:32.658971    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86eb185f_5d28_45be_baca_fa586952acf2.slice/crio-8143f30ed2bdd0f50a6c5d00a2476bc7757e1a59c9dc108c38205f0f6ceb953e WatchSource:0}: Error finding container 8143f30ed2bdd0f50a6c5d00a2476bc7757e1a59c9dc108c38205f0f6ceb953e: Status 404 returned error can't find the container with id 8143f30ed2bdd0f50a6c5d00a2476bc7757e1a59c9dc108c38205f0f6ceb953e
Sep 16 12:26:32.677886 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.677858    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2"]
Sep 16 12:26:32.678933 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:26:32.678908    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf66dad4_51da_4705_9c93_853cb46e4ee0.slice/crio-039bd8da0ef3c6976560dbb747412a2215e8e3ae242ebdcc58c130477650393a WatchSource:0}: Error finding container 039bd8da0ef3c6976560dbb747412a2215e8e3ae242ebdcc58c130477650393a: Status 404 returned error can't find the container with id 039bd8da0ef3c6976560dbb747412a2215e8e3ae242ebdcc58c130477650393a
Sep 16 12:26:32.943169 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.943068    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2" event={"ID":"af66dad4-51da-4705-9c93-853cb46e4ee0","Type":"ContainerStarted","Data":"7750d92fabcd456fb28f99b104d4665a5abd65fa68a8c3474e6fa9fdfca7d35d"}
Sep 16 12:26:32.943169 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.943137    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2" event={"ID":"af66dad4-51da-4705-9c93-853cb46e4ee0","Type":"ContainerStarted","Data":"039bd8da0ef3c6976560dbb747412a2215e8e3ae242ebdcc58c130477650393a"}
Sep 16 12:26:32.943445 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.943264    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2"
Sep 16 12:26:32.944726 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.944707    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh" event={"ID":"86eb185f-5d28-45be-baca-fa586952acf2","Type":"ContainerStarted","Data":"1a2a77ff1ab75026acf10ecf668586670a88f1d685c507bf4d027767b593b004"}
Sep 16 12:26:32.944838 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.944741    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh" event={"ID":"86eb185f-5d28-45be-baca-fa586952acf2","Type":"ContainerStarted","Data":"8143f30ed2bdd0f50a6c5d00a2476bc7757e1a59c9dc108c38205f0f6ceb953e"}
Sep 16 12:26:32.944838 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.944770    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh"
Sep 16 12:26:32.959783 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.959720    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2" podStartSLOduration=0.959703241 podStartE2EDuration="959.703241ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:26:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:26:32.958571204 +0000 UTC m=+1459.127535913" watchObservedRunningTime="2026-09-16 12:26:32.959703241 +0000 UTC m=+1459.128667948"
Sep 16 12:26:32.975537 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:32.975492    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh" podStartSLOduration=0.975478275 podStartE2EDuration="975.478275ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:26:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:26:32.974254223 +0000 UTC m=+1459.143218934" watchObservedRunningTime="2026-09-16 12:26:32.975478275 +0000 UTC m=+1459.144442982"
Sep 16 12:26:43.953893 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:43.953863    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2"
Sep 16 12:26:43.956393 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:26:43.953935    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh"
Sep 16 12:27:07.261530 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:07.261498    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb"]
Sep 16 12:27:07.266148 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:07.266131    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb"
Sep 16 12:27:07.274723 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:07.274705    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-30f927\""
Sep 16 12:27:07.274813 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:07.274765    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-30f927-dockercfg-x4rjv\""
Sep 16 12:27:07.280615 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:07.280595    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb"]
Sep 16 12:27:07.299239 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:07.299204    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz"]
Sep 16 12:27:07.303626 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:07.303607    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz"
Sep 16 12:27:07.311644 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:07.311620    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz"]
Sep 16 12:27:07.317887 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:07.317862    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6w2f\" (UniqueName: \"kubernetes.io/projected/fecc32cb-dd2d-4125-9411-d4dff27e602c-kube-api-access-m6w2f\") pod \"payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb\" (UID: \"fecc32cb-dd2d-4125-9411-d4dff27e602c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb"
Sep 16 12:27:07.318003 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:07.317914    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fecc32cb-dd2d-4125-9411-d4dff27e602c-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb\" (UID: \"fecc32cb-dd2d-4125-9411-d4dff27e602c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb"
Sep 16 12:27:07.419108 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:07.419072    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjd67\" (UniqueName: \"kubernetes.io/projected/f10b1235-9e5d-411f-9cb0-a585fbe0ea3a-kube-api-access-hjd67\") pod \"payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz\" (UID: \"f10b1235-9e5d-411f-9cb0-a585fbe0ea3a\") " pod="openshift-ingress/payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz"
Sep 16 12:27:07.419305 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:07.419150    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6w2f\" (UniqueName: \"kubernetes.io/projected/fecc32cb-dd2d-4125-9411-d4dff27e602c-kube-api-access-m6w2f\") pod \"payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb\" (UID: \"fecc32cb-dd2d-4125-9411-d4dff27e602c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb"
Sep 16 12:27:07.419305 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:07.419200    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fecc32cb-dd2d-4125-9411-d4dff27e602c-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb\" (UID: \"fecc32cb-dd2d-4125-9411-d4dff27e602c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb"
Sep 16 12:27:07.419305 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:07.419271    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f10b1235-9e5d-411f-9cb0-a585fbe0ea3a-plugins-config-volume\") pod \"payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz\" (UID: \"f10b1235-9e5d-411f-9cb0-a585fbe0ea3a\") " pod="openshift-ingress/payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz"
Sep 16 12:27:07.419972 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:07.419953    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fecc32cb-dd2d-4125-9411-d4dff27e602c-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb\" (UID: \"fecc32cb-dd2d-4125-9411-d4dff27e602c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb"
Sep 16 12:27:07.438831 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:07.438800    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6w2f\" (UniqueName: \"kubernetes.io/projected/fecc32cb-dd2d-4125-9411-d4dff27e602c-kube-api-access-m6w2f\") pod \"payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb\" (UID: \"fecc32cb-dd2d-4125-9411-d4dff27e602c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb"
Sep 16 12:27:07.520237 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:07.520141    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjd67\" (UniqueName: \"kubernetes.io/projected/f10b1235-9e5d-411f-9cb0-a585fbe0ea3a-kube-api-access-hjd67\") pod \"payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz\" (UID: \"f10b1235-9e5d-411f-9cb0-a585fbe0ea3a\") " pod="openshift-ingress/payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz"
Sep 16 12:27:07.520469 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:07.520410    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f10b1235-9e5d-411f-9cb0-a585fbe0ea3a-plugins-config-volume\") pod \"payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz\" (UID: \"f10b1235-9e5d-411f-9cb0-a585fbe0ea3a\") " pod="openshift-ingress/payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz"
Sep 16 12:27:07.521603 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:07.521576    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f10b1235-9e5d-411f-9cb0-a585fbe0ea3a-plugins-config-volume\") pod \"payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz\" (UID: \"f10b1235-9e5d-411f-9cb0-a585fbe0ea3a\") " pod="openshift-ingress/payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz"
Sep 16 12:27:07.530441 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:07.530416    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjd67\" (UniqueName: \"kubernetes.io/projected/f10b1235-9e5d-411f-9cb0-a585fbe0ea3a-kube-api-access-hjd67\") pod \"payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz\" (UID: \"f10b1235-9e5d-411f-9cb0-a585fbe0ea3a\") " pod="openshift-ingress/payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz"
Sep 16 12:27:07.578363 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:07.578284    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb"
Sep 16 12:27:07.617041 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:07.617009    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz"
Sep 16 12:27:07.862891 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:07.862864    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb"]
Sep 16 12:27:07.864533 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:27:07.864506    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfecc32cb_dd2d_4125_9411_d4dff27e602c.slice/crio-93d8ffb0da11b6efe3f97f76bf0ab76f73c7a78925dfa12ff28b1ddf1e2a7464 WatchSource:0}: Error finding container 93d8ffb0da11b6efe3f97f76bf0ab76f73c7a78925dfa12ff28b1ddf1e2a7464: Status 404 returned error can't find the container with id 93d8ffb0da11b6efe3f97f76bf0ab76f73c7a78925dfa12ff28b1ddf1e2a7464
Sep 16 12:27:07.916606 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:07.916576    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz"]
Sep 16 12:27:07.917567 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:27:07.917545    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf10b1235_9e5d_411f_9cb0_a585fbe0ea3a.slice/crio-dc8dd652cb0355cbcf60b8fc7f9af69aaa005dccac25403459a2896f35df542d WatchSource:0}: Error finding container dc8dd652cb0355cbcf60b8fc7f9af69aaa005dccac25403459a2896f35df542d: Status 404 returned error can't find the container with id dc8dd652cb0355cbcf60b8fc7f9af69aaa005dccac25403459a2896f35df542d
Sep 16 12:27:08.167428 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:08.167330    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb" event={"ID":"fecc32cb-dd2d-4125-9411-d4dff27e602c","Type":"ContainerStarted","Data":"885a16c94c09941911a212463b283255ab906d45d8172bea2ae215193c7a8f1b"}
Sep 16 12:27:08.167428 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:08.167398    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb"
Sep 16 12:27:08.167428 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:08.167422    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb" event={"ID":"fecc32cb-dd2d-4125-9411-d4dff27e602c","Type":"ContainerStarted","Data":"93d8ffb0da11b6efe3f97f76bf0ab76f73c7a78925dfa12ff28b1ddf1e2a7464"}
Sep 16 12:27:08.169129 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:08.169105    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz" event={"ID":"f10b1235-9e5d-411f-9cb0-a585fbe0ea3a","Type":"ContainerStarted","Data":"7d2c622baf199c5caf7718f92cc5cc9f48afae139445814ea39964781399bf87"}
Sep 16 12:27:08.169238 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:08.169150    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz" event={"ID":"f10b1235-9e5d-411f-9cb0-a585fbe0ea3a","Type":"ContainerStarted","Data":"dc8dd652cb0355cbcf60b8fc7f9af69aaa005dccac25403459a2896f35df542d"}
Sep 16 12:27:08.169238 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:08.169191    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz"
Sep 16 12:27:08.190471 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:08.190426    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb" podStartSLOduration=1.190410751 podStartE2EDuration="1.190410751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:27:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:27:08.187795066 +0000 UTC m=+1494.356759772" watchObservedRunningTime="2026-09-16 12:27:08.190410751 +0000 UTC m=+1494.359375458"
Sep 16 12:27:08.212809 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:08.212758    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz" podStartSLOduration=1.212741918 podStartE2EDuration="1.212741918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:27:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:27:08.209855307 +0000 UTC m=+1494.378820013" watchObservedRunningTime="2026-09-16 12:27:08.212741918 +0000 UTC m=+1494.381706627"
Sep 16 12:27:08.412134 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:08.412089    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-556077-t9d46"]
Sep 16 12:27:08.416997 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:08.416970    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-556077-t9d46"
Sep 16 12:27:08.419814 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:08.419748    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9lc86\""
Sep 16 12:27:08.424974 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:08.424951    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-556077-t9d46"]
Sep 16 12:27:08.533424 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:08.533388    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5639665-3154-477d-b103-94d3167bcf23-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-556077-t9d46\" (UID: \"d5639665-3154-477d-b103-94d3167bcf23\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-556077-t9d46"
Sep 16 12:27:08.635196 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:08.635152    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5639665-3154-477d-b103-94d3167bcf23-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-556077-t9d46\" (UID: \"d5639665-3154-477d-b103-94d3167bcf23\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-556077-t9d46"
Sep 16 12:27:08.635798 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:08.635776    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5639665-3154-477d-b103-94d3167bcf23-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-556077-t9d46\" (UID: \"d5639665-3154-477d-b103-94d3167bcf23\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-556077-t9d46"
Sep 16 12:27:08.731606 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:08.731519    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-556077-t9d46"
Sep 16 12:27:09.027047 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:09.027015    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-556077-t9d46"]
Sep 16 12:27:09.028785 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:27:09.028752    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5639665_3154_477d_b103_94d3167bcf23.slice/crio-2b59b1d1450148bd1b0b213eec061dce0889c1b5e72859696f6c0c9a39b513bf WatchSource:0}: Error finding container 2b59b1d1450148bd1b0b213eec061dce0889c1b5e72859696f6c0c9a39b513bf: Status 404 returned error can't find the container with id 2b59b1d1450148bd1b0b213eec061dce0889c1b5e72859696f6c0c9a39b513bf
Sep 16 12:27:09.177836 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:09.177794    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-556077-t9d46" event={"ID":"d5639665-3154-477d-b103-94d3167bcf23","Type":"ContainerStarted","Data":"2b59b1d1450148bd1b0b213eec061dce0889c1b5e72859696f6c0c9a39b513bf"}
Sep 16 12:27:10.186985 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:10.186945    2576 generic.go:356] "Generic (PLEG): container finished" podID="d5639665-3154-477d-b103-94d3167bcf23" containerID="014fae944f54693bb96999b257437caa3b5dbc3acdbfb81b8971d905b7cc73c1" exitCode=0
Sep 16 12:27:10.187456 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:10.187034    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-556077-t9d46" event={"ID":"d5639665-3154-477d-b103-94d3167bcf23","Type":"ContainerDied","Data":"014fae944f54693bb96999b257437caa3b5dbc3acdbfb81b8971d905b7cc73c1"}
Sep 16 12:27:11.346783 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:11.346753    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-556077-t9d46"
Sep 16 12:27:11.466862 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:11.466780    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5639665-3154-477d-b103-94d3167bcf23-maas-api-service-ca\") pod \"d5639665-3154-477d-b103-94d3167bcf23\" (UID: \"d5639665-3154-477d-b103-94d3167bcf23\") "
Sep 16 12:27:11.467131 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:11.467102    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5639665-3154-477d-b103-94d3167bcf23-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d5639665-3154-477d-b103-94d3167bcf23" (UID: "d5639665-3154-477d-b103-94d3167bcf23"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:27:11.467271 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:11.467252    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5639665-3154-477d-b103-94d3167bcf23-maas-api-service-ca\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:12.202196 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:12.202164    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-556077-t9d46"
Sep 16 12:27:12.202379 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:12.202196    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-556077-t9d46" event={"ID":"d5639665-3154-477d-b103-94d3167bcf23","Type":"ContainerDied","Data":"2b59b1d1450148bd1b0b213eec061dce0889c1b5e72859696f6c0c9a39b513bf"}
Sep 16 12:27:12.202379 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:12.202240    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b59b1d1450148bd1b0b213eec061dce0889c1b5e72859696f6c0c9a39b513bf"
Sep 16 12:27:14.456666 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:14.456630    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tb7dg_fb6b35a8-78d4-40b2-a087-7b45e92b2234/ovn-acl-logging/0.log"
Sep 16 12:27:14.458362 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:14.458334    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tb7dg_fb6b35a8-78d4-40b2-a087-7b45e92b2234/ovn-acl-logging/0.log"
Sep 16 12:27:14.620175 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:14.620139    2576 scope.go:117] "RemoveContainer" containerID="3329329fa2b6f4c5702be13b3499780f7b707b00a544cd0e5e53ab3602b77ac8"
Sep 16 12:27:18.758605 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:18.758572    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a6f57e-gkmk6"]
Sep 16 12:27:18.759151 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:18.759138    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5639665-3154-477d-b103-94d3167bcf23" containerName="revoke-keys"
Sep 16 12:27:18.759151 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:18.759153    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5639665-3154-477d-b103-94d3167bcf23" containerName="revoke-keys"
Sep 16 12:27:18.759248 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:18.759237    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5639665-3154-477d-b103-94d3167bcf23" containerName="revoke-keys"
Sep 16 12:27:18.764262 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:18.764243    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a6f57e-gkmk6"
Sep 16 12:27:18.767676 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:18.767402    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9lc86\""
Sep 16 12:27:18.770698 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:18.770669    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a6f57e-gkmk6"]
Sep 16 12:27:18.946018 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:18.945975    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b08ab692-e6ef-4674-b8a7-625e00c3ae90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a6f57e-gkmk6\" (UID: \"b08ab692-e6ef-4674-b8a7-625e00c3ae90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a6f57e-gkmk6"
Sep 16 12:27:19.046726 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:19.046644    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b08ab692-e6ef-4674-b8a7-625e00c3ae90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a6f57e-gkmk6\" (UID: \"b08ab692-e6ef-4674-b8a7-625e00c3ae90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a6f57e-gkmk6"
Sep 16 12:27:19.047498 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:19.047476    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b08ab692-e6ef-4674-b8a7-625e00c3ae90-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a6f57e-gkmk6\" (UID: \"b08ab692-e6ef-4674-b8a7-625e00c3ae90\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a6f57e-gkmk6"
Sep 16 12:27:19.077996 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:19.077965    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a6f57e-gkmk6"
Sep 16 12:27:19.180088 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:19.180060    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb"
Sep 16 12:27:19.181078 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:19.180775    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz"
Sep 16 12:27:19.358269 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:19.358239    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a6f57e-gkmk6"]
Sep 16 12:27:19.359867 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:27:19.359842    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb08ab692_e6ef_4674_b8a7_625e00c3ae90.slice/crio-f46412d4c6955dbad53affeec7fbadf8b1483b93c1acf644f8a3d7da407b2f39 WatchSource:0}: Error finding container f46412d4c6955dbad53affeec7fbadf8b1483b93c1acf644f8a3d7da407b2f39: Status 404 returned error can't find the container with id f46412d4c6955dbad53affeec7fbadf8b1483b93c1acf644f8a3d7da407b2f39
Sep 16 12:27:20.254071 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:20.254037    2576 generic.go:356] "Generic (PLEG): container finished" podID="b08ab692-e6ef-4674-b8a7-625e00c3ae90" containerID="4afe15ecbcfff25a56a7f27e813a7d90c2ba3c6da3c535a9f7426c491dcc7496" exitCode=0
Sep 16 12:27:20.254530 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:20.254119    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a6f57e-gkmk6" event={"ID":"b08ab692-e6ef-4674-b8a7-625e00c3ae90","Type":"ContainerDied","Data":"4afe15ecbcfff25a56a7f27e813a7d90c2ba3c6da3c535a9f7426c491dcc7496"}
Sep 16 12:27:20.254530 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:20.254182    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a6f57e-gkmk6" event={"ID":"b08ab692-e6ef-4674-b8a7-625e00c3ae90","Type":"ContainerStarted","Data":"f46412d4c6955dbad53affeec7fbadf8b1483b93c1acf644f8a3d7da407b2f39"}
Sep 16 12:27:21.417496 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:21.417464    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a6f57e-gkmk6"
Sep 16 12:27:21.577546 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:21.577456    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b08ab692-e6ef-4674-b8a7-625e00c3ae90-maas-api-service-ca\") pod \"b08ab692-e6ef-4674-b8a7-625e00c3ae90\" (UID: \"b08ab692-e6ef-4674-b8a7-625e00c3ae90\") "
Sep 16 12:27:21.577823 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:21.577801    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b08ab692-e6ef-4674-b8a7-625e00c3ae90-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b08ab692-e6ef-4674-b8a7-625e00c3ae90" (UID: "b08ab692-e6ef-4674-b8a7-625e00c3ae90"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:27:21.679295 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:21.679258    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b08ab692-e6ef-4674-b8a7-625e00c3ae90-maas-api-service-ca\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:22.268174 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:22.268137    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a6f57e-gkmk6" event={"ID":"b08ab692-e6ef-4674-b8a7-625e00c3ae90","Type":"ContainerDied","Data":"f46412d4c6955dbad53affeec7fbadf8b1483b93c1acf644f8a3d7da407b2f39"}
Sep 16 12:27:22.268174 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:22.268169    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a6f57e-gkmk6"
Sep 16 12:27:22.268474 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:22.268187    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f46412d4c6955dbad53affeec7fbadf8b1483b93c1acf644f8a3d7da407b2f39"
Sep 16 12:27:27.047345 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:27.047282    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5"]
Sep 16 12:27:27.047815 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:27.047548    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5" podUID="5202f93f-3683-475c-81ee-4c9ad642c1e0" containerName="payload-pre-processing" containerID="cri-o://e660f387bda620eade18a676e07df0ed6b92f92ce17f5f2bcb2a20cd71e40c1c" gracePeriod=30
Sep 16 12:27:27.206301 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:27.206260    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-556077-t9d46"]
Sep 16 12:27:27.211203 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:27.211171    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-556077-t9d46"]
Sep 16 12:27:27.322786 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:27.322688    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5" event={"ID":"5202f93f-3683-475c-81ee-4c9ad642c1e0","Type":"ContainerDied","Data":"e660f387bda620eade18a676e07df0ed6b92f92ce17f5f2bcb2a20cd71e40c1c"}
Sep 16 12:27:27.323008 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:27.322981    2576 generic.go:356] "Generic (PLEG): container finished" podID="5202f93f-3683-475c-81ee-4c9ad642c1e0" containerID="e660f387bda620eade18a676e07df0ed6b92f92ce17f5f2bcb2a20cd71e40c1c" exitCode=0
Sep 16 12:27:27.354845 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:27.354819    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5"
Sep 16 12:27:27.442851 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:27.442822    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcwrf\" (UniqueName: \"kubernetes.io/projected/5202f93f-3683-475c-81ee-4c9ad642c1e0-kube-api-access-mcwrf\") pod \"5202f93f-3683-475c-81ee-4c9ad642c1e0\" (UID: \"5202f93f-3683-475c-81ee-4c9ad642c1e0\") "
Sep 16 12:27:27.443016 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:27.442967    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5202f93f-3683-475c-81ee-4c9ad642c1e0-plugins-config-volume\") pod \"5202f93f-3683-475c-81ee-4c9ad642c1e0\" (UID: \"5202f93f-3683-475c-81ee-4c9ad642c1e0\") "
Sep 16 12:27:27.443350 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:27.443295    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5202f93f-3683-475c-81ee-4c9ad642c1e0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5202f93f-3683-475c-81ee-4c9ad642c1e0" (UID: "5202f93f-3683-475c-81ee-4c9ad642c1e0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:27:27.445118 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:27.445096    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5202f93f-3683-475c-81ee-4c9ad642c1e0-kube-api-access-mcwrf" (OuterVolumeSpecName: "kube-api-access-mcwrf") pod "5202f93f-3683-475c-81ee-4c9ad642c1e0" (UID: "5202f93f-3683-475c-81ee-4c9ad642c1e0"). InnerVolumeSpecName "kube-api-access-mcwrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:27:27.543885 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:27.543851    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcwrf\" (UniqueName: \"kubernetes.io/projected/5202f93f-3683-475c-81ee-4c9ad642c1e0-kube-api-access-mcwrf\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:27.543885 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:27.543882    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5202f93f-3683-475c-81ee-4c9ad642c1e0-plugins-config-volume\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:28.330960 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:28.330932    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5"
Sep 16 12:27:28.331384 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:28.330958    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5" event={"ID":"5202f93f-3683-475c-81ee-4c9ad642c1e0","Type":"ContainerDied","Data":"ed25ea4768a8108c5fe7f532efa32105a1f4d80a1335d75161cd946583468b6b"}
Sep 16 12:27:28.331384 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:28.331018    2576 scope.go:117] "RemoveContainer" containerID="e660f387bda620eade18a676e07df0ed6b92f92ce17f5f2bcb2a20cd71e40c1c"
Sep 16 12:27:28.353694 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:28.353662    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5"]
Sep 16 12:27:28.357260 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:28.357232    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-556077-57c68b8cd6-2g2n5"]
Sep 16 12:27:28.395092 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:28.395063    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5202f93f-3683-475c-81ee-4c9ad642c1e0" path="/var/lib/kubelet/pods/5202f93f-3683-475c-81ee-4c9ad642c1e0/volumes"
Sep 16 12:27:28.395501 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:28.395484    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5639665-3154-477d-b103-94d3167bcf23" path="/var/lib/kubelet/pods/d5639665-3154-477d-b103-94d3167bcf23/volumes"
Sep 16 12:27:32.114390 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:32.114360    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ff057a-gqw5c"]
Sep 16 12:27:32.114908 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:32.114894    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b08ab692-e6ef-4674-b8a7-625e00c3ae90" containerName="revoke-keys"
Sep 16 12:27:32.114959 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:32.114909    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b08ab692-e6ef-4674-b8a7-625e00c3ae90" containerName="revoke-keys"
Sep 16 12:27:32.114959 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:32.114923    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5202f93f-3683-475c-81ee-4c9ad642c1e0" containerName="payload-pre-processing"
Sep 16 12:27:32.114959 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:32.114928    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5202f93f-3683-475c-81ee-4c9ad642c1e0" containerName="payload-pre-processing"
Sep 16 12:27:32.115052 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:32.115021    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5202f93f-3683-475c-81ee-4c9ad642c1e0" containerName="payload-pre-processing"
Sep 16 12:27:32.115052 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:32.115031    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b08ab692-e6ef-4674-b8a7-625e00c3ae90" containerName="revoke-keys"
Sep 16 12:27:32.119766 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:32.119743    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ff057a-gqw5c"
Sep 16 12:27:32.122529 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:32.122510    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9lc86\""
Sep 16 12:27:32.127627 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:32.127591    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ff057a-gqw5c"]
Sep 16 12:27:32.196940 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:32.196905    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a75ce06d-d38a-40bc-b2dc-e9281006222f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-ff057a-gqw5c\" (UID: \"a75ce06d-d38a-40bc-b2dc-e9281006222f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ff057a-gqw5c"
Sep 16 12:27:32.298391 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:32.298350    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a75ce06d-d38a-40bc-b2dc-e9281006222f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-ff057a-gqw5c\" (UID: \"a75ce06d-d38a-40bc-b2dc-e9281006222f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ff057a-gqw5c"
Sep 16 12:27:32.299094 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:32.299069    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a75ce06d-d38a-40bc-b2dc-e9281006222f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-ff057a-gqw5c\" (UID: \"a75ce06d-d38a-40bc-b2dc-e9281006222f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ff057a-gqw5c"
Sep 16 12:27:32.433705 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:32.433620    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ff057a-gqw5c"
Sep 16 12:27:32.712630 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:32.712597    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ff057a-gqw5c"]
Sep 16 12:27:32.715444 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:27:32.715419    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda75ce06d_d38a_40bc_b2dc_e9281006222f.slice/crio-69853d2e16d9377b5792ce297a11cd36ae3ee2655f69b579a6ae83da7acbfa64 WatchSource:0}: Error finding container 69853d2e16d9377b5792ce297a11cd36ae3ee2655f69b579a6ae83da7acbfa64: Status 404 returned error can't find the container with id 69853d2e16d9377b5792ce297a11cd36ae3ee2655f69b579a6ae83da7acbfa64
Sep 16 12:27:33.366252 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:33.366218    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ff057a-gqw5c" event={"ID":"a75ce06d-d38a-40bc-b2dc-e9281006222f","Type":"ContainerStarted","Data":"9e7a0c7d40f12f01e76adb9994035ce0655631c4d640beb2a9b7a22e50dccfb6"}
Sep 16 12:27:33.366658 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:33.366275    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ff057a-gqw5c" event={"ID":"a75ce06d-d38a-40bc-b2dc-e9281006222f","Type":"ContainerStarted","Data":"69853d2e16d9377b5792ce297a11cd36ae3ee2655f69b579a6ae83da7acbfa64"}
Sep 16 12:27:33.381504 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:33.381430    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ff057a-gqw5c" podStartSLOduration=1.381411988 podStartE2EDuration="1.381411988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:27:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:27:33.380723762 +0000 UTC m=+1519.549688469" watchObservedRunningTime="2026-09-16 12:27:33.381411988 +0000 UTC m=+1519.550376695"
Sep 16 12:27:34.306194 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:34.306156    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"]
Sep 16 12:27:34.306449 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:34.306422    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486" podUID="24ff1f9f-5599-445c-9aff-46d84155f985" containerName="istio-proxy" containerID="cri-o://2e761fde5cc724c23bd995ffbb201f9b7486c9be2fd02c6bf6555141a78360a3" gracePeriod=30
Sep 16 12:27:34.374708 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:34.374672    2576 generic.go:356] "Generic (PLEG): container finished" podID="a75ce06d-d38a-40bc-b2dc-e9281006222f" containerID="9e7a0c7d40f12f01e76adb9994035ce0655631c4d640beb2a9b7a22e50dccfb6" exitCode=0
Sep 16 12:27:34.375228 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:34.374712    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ff057a-gqw5c" event={"ID":"a75ce06d-d38a-40bc-b2dc-e9281006222f","Type":"ContainerDied","Data":"9e7a0c7d40f12f01e76adb9994035ce0655631c4d640beb2a9b7a22e50dccfb6"}
Sep 16 12:27:35.532202 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:35.532169    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ff057a-gqw5c"
Sep 16 12:27:35.635729 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:35.635654    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a75ce06d-d38a-40bc-b2dc-e9281006222f-maas-api-service-ca\") pod \"a75ce06d-d38a-40bc-b2dc-e9281006222f\" (UID: \"a75ce06d-d38a-40bc-b2dc-e9281006222f\") "
Sep 16 12:27:35.636014 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:35.635989    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a75ce06d-d38a-40bc-b2dc-e9281006222f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a75ce06d-d38a-40bc-b2dc-e9281006222f" (UID: "a75ce06d-d38a-40bc-b2dc-e9281006222f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:27:35.736764 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:35.736732    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a75ce06d-d38a-40bc-b2dc-e9281006222f-maas-api-service-ca\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:36.389241 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:36.389214    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ff057a-gqw5c"
Sep 16 12:27:36.395421 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:36.395392    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ff057a-gqw5c" event={"ID":"a75ce06d-d38a-40bc-b2dc-e9281006222f","Type":"ContainerDied","Data":"69853d2e16d9377b5792ce297a11cd36ae3ee2655f69b579a6ae83da7acbfa64"}
Sep 16 12:27:36.395591 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:36.395439    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69853d2e16d9377b5792ce297a11cd36ae3ee2655f69b579a6ae83da7acbfa64"
Sep 16 12:27:37.020130 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:37.020092    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"]
Sep 16 12:27:37.782247 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:37.782213    2576 patch_prober.go:28] interesting pod/e2e-worker-w4-556077-openshift-default-58b9874496-nb486 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 12:27:37.782423 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:37.782289    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486" podUID="24ff1f9f-5599-445c-9aff-46d84155f985" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 12:27:39.148231 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.148185    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2"]
Sep 16 12:27:39.148884 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.148512    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2" podUID="af66dad4-51da-4705-9c93-853cb46e4ee0" containerName="payload-processing" containerID="cri-o://7750d92fabcd456fb28f99b104d4665a5abd65fa68a8c3474e6fa9fdfca7d35d" gracePeriod=30
Sep 16 12:27:39.156459 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.156433    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh"]
Sep 16 12:27:39.156698 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.156667    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh" podUID="86eb185f-5d28-45be-baca-fa586952acf2" containerName="payload-pre-processing" containerID="cri-o://1a2a77ff1ab75026acf10ecf668586670a88f1d685c507bf4d027767b593b004" gracePeriod=30
Sep 16 12:27:39.308101 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.305386    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a6f57e-gkmk6"]
Sep 16 12:27:39.308101 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.308010    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a6f57e-gkmk6"]
Sep 16 12:27:39.413892 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.413790    2576 generic.go:356] "Generic (PLEG): container finished" podID="af66dad4-51da-4705-9c93-853cb46e4ee0" containerID="7750d92fabcd456fb28f99b104d4665a5abd65fa68a8c3474e6fa9fdfca7d35d" exitCode=0
Sep 16 12:27:39.414214 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.413846    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2" event={"ID":"af66dad4-51da-4705-9c93-853cb46e4ee0","Type":"ContainerDied","Data":"7750d92fabcd456fb28f99b104d4665a5abd65fa68a8c3474e6fa9fdfca7d35d"}
Sep 16 12:27:39.418556 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.418526    2576 generic.go:356] "Generic (PLEG): container finished" podID="86eb185f-5d28-45be-baca-fa586952acf2" containerID="1a2a77ff1ab75026acf10ecf668586670a88f1d685c507bf4d027767b593b004" exitCode=0
Sep 16 12:27:39.418662 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.418616    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh" event={"ID":"86eb185f-5d28-45be-baca-fa586952acf2","Type":"ContainerDied","Data":"1a2a77ff1ab75026acf10ecf668586670a88f1d685c507bf4d027767b593b004"}
Sep 16 12:27:39.437053 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.437029    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2"
Sep 16 12:27:39.463613 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.463586    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh"
Sep 16 12:27:39.580395 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.580366    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlswk\" (UniqueName: \"kubernetes.io/projected/af66dad4-51da-4705-9c93-853cb46e4ee0-kube-api-access-mlswk\") pod \"af66dad4-51da-4705-9c93-853cb46e4ee0\" (UID: \"af66dad4-51da-4705-9c93-853cb46e4ee0\") "
Sep 16 12:27:39.580588 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.580512    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86eb185f-5d28-45be-baca-fa586952acf2-plugins-config-volume\") pod \"86eb185f-5d28-45be-baca-fa586952acf2\" (UID: \"86eb185f-5d28-45be-baca-fa586952acf2\") "
Sep 16 12:27:39.580588 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.580536    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpb4d\" (UniqueName: \"kubernetes.io/projected/86eb185f-5d28-45be-baca-fa586952acf2-kube-api-access-zpb4d\") pod \"86eb185f-5d28-45be-baca-fa586952acf2\" (UID: \"86eb185f-5d28-45be-baca-fa586952acf2\") "
Sep 16 12:27:39.580588 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.580581    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af66dad4-51da-4705-9c93-853cb46e4ee0-plugins-config-volume\") pod \"af66dad4-51da-4705-9c93-853cb46e4ee0\" (UID: \"af66dad4-51da-4705-9c93-853cb46e4ee0\") "
Sep 16 12:27:39.580988 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.580957    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86eb185f-5d28-45be-baca-fa586952acf2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "86eb185f-5d28-45be-baca-fa586952acf2" (UID: "86eb185f-5d28-45be-baca-fa586952acf2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:27:39.581275 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.580964    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af66dad4-51da-4705-9c93-853cb46e4ee0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "af66dad4-51da-4705-9c93-853cb46e4ee0" (UID: "af66dad4-51da-4705-9c93-853cb46e4ee0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:27:39.583578 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.583552    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af66dad4-51da-4705-9c93-853cb46e4ee0-kube-api-access-mlswk" (OuterVolumeSpecName: "kube-api-access-mlswk") pod "af66dad4-51da-4705-9c93-853cb46e4ee0" (UID: "af66dad4-51da-4705-9c93-853cb46e4ee0"). InnerVolumeSpecName "kube-api-access-mlswk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:27:39.583699 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.583592    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86eb185f-5d28-45be-baca-fa586952acf2-kube-api-access-zpb4d" (OuterVolumeSpecName: "kube-api-access-zpb4d") pod "86eb185f-5d28-45be-baca-fa586952acf2" (UID: "86eb185f-5d28-45be-baca-fa586952acf2"). InnerVolumeSpecName "kube-api-access-zpb4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:27:39.608948 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.608924    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:27:39.681930 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.681841    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24ff1f9f-5599-445c-9aff-46d84155f985-istiod-ca-cert\") pod \"24ff1f9f-5599-445c-9aff-46d84155f985\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") "
Sep 16 12:27:39.681930 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.681910    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24ff1f9f-5599-445c-9aff-46d84155f985-istio-token\") pod \"24ff1f9f-5599-445c-9aff-46d84155f985\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") "
Sep 16 12:27:39.681930 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.681929    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-istio-data\") pod \"24ff1f9f-5599-445c-9aff-46d84155f985\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") "
Sep 16 12:27:39.682225 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.681955    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24ff1f9f-5599-445c-9aff-46d84155f985-istio-podinfo\") pod \"24ff1f9f-5599-445c-9aff-46d84155f985\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") "
Sep 16 12:27:39.682225 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.682018    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwd5x\" (UniqueName: \"kubernetes.io/projected/24ff1f9f-5599-445c-9aff-46d84155f985-kube-api-access-qwd5x\") pod \"24ff1f9f-5599-445c-9aff-46d84155f985\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") "
Sep 16 12:27:39.682225 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.682039    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-workload-certs\") pod \"24ff1f9f-5599-445c-9aff-46d84155f985\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") "
Sep 16 12:27:39.682225 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.682095    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-istio-envoy\") pod \"24ff1f9f-5599-445c-9aff-46d84155f985\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") "
Sep 16 12:27:39.682225 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.682132    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-workload-socket\") pod \"24ff1f9f-5599-445c-9aff-46d84155f985\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") "
Sep 16 12:27:39.682225 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.682192    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-credential-socket\") pod \"24ff1f9f-5599-445c-9aff-46d84155f985\" (UID: \"24ff1f9f-5599-445c-9aff-46d84155f985\") "
Sep 16 12:27:39.682558 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.682216    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24ff1f9f-5599-445c-9aff-46d84155f985-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "24ff1f9f-5599-445c-9aff-46d84155f985" (UID: "24ff1f9f-5599-445c-9aff-46d84155f985"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:27:39.682558 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.682381    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "24ff1f9f-5599-445c-9aff-46d84155f985" (UID: "24ff1f9f-5599-445c-9aff-46d84155f985"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:39.682558 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.682430    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-istio-data" (OuterVolumeSpecName: "istio-data") pod "24ff1f9f-5599-445c-9aff-46d84155f985" (UID: "24ff1f9f-5599-445c-9aff-46d84155f985"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:39.682558 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.682528    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "24ff1f9f-5599-445c-9aff-46d84155f985" (UID: "24ff1f9f-5599-445c-9aff-46d84155f985"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:39.682934 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.682604    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "24ff1f9f-5599-445c-9aff-46d84155f985" (UID: "24ff1f9f-5599-445c-9aff-46d84155f985"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:39.682934 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.682902    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlswk\" (UniqueName: \"kubernetes.io/projected/af66dad4-51da-4705-9c93-853cb46e4ee0-kube-api-access-mlswk\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:39.682934 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.682923    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-workload-socket\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:39.683103 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.682936    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-credential-socket\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:39.683103 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.682950    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24ff1f9f-5599-445c-9aff-46d84155f985-istiod-ca-cert\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:39.683103 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.682964    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86eb185f-5d28-45be-baca-fa586952acf2-plugins-config-volume\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:39.683103 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.682979    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpb4d\" (UniqueName: \"kubernetes.io/projected/86eb185f-5d28-45be-baca-fa586952acf2-kube-api-access-zpb4d\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:39.683103 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.682992    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-istio-data\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:39.683103 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.683006    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af66dad4-51da-4705-9c93-853cb46e4ee0-plugins-config-volume\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:39.683103 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.683018    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-workload-certs\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:39.684622 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.684598    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/24ff1f9f-5599-445c-9aff-46d84155f985-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "24ff1f9f-5599-445c-9aff-46d84155f985" (UID: "24ff1f9f-5599-445c-9aff-46d84155f985"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:27:39.684622 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.684608    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "24ff1f9f-5599-445c-9aff-46d84155f985" (UID: "24ff1f9f-5599-445c-9aff-46d84155f985"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:39.684622 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.684597    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24ff1f9f-5599-445c-9aff-46d84155f985-istio-token" (OuterVolumeSpecName: "istio-token") pod "24ff1f9f-5599-445c-9aff-46d84155f985" (UID: "24ff1f9f-5599-445c-9aff-46d84155f985"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:27:39.684832 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.684775    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24ff1f9f-5599-445c-9aff-46d84155f985-kube-api-access-qwd5x" (OuterVolumeSpecName: "kube-api-access-qwd5x") pod "24ff1f9f-5599-445c-9aff-46d84155f985" (UID: "24ff1f9f-5599-445c-9aff-46d84155f985"). InnerVolumeSpecName "kube-api-access-qwd5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:27:39.784633 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.784601    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24ff1f9f-5599-445c-9aff-46d84155f985-istio-token\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:39.784633 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.784631    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24ff1f9f-5599-445c-9aff-46d84155f985-istio-podinfo\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:39.784846 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.784641    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwd5x\" (UniqueName: \"kubernetes.io/projected/24ff1f9f-5599-445c-9aff-46d84155f985-kube-api-access-qwd5x\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:39.784846 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:39.784653    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24ff1f9f-5599-445c-9aff-46d84155f985-istio-envoy\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:40.396729 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:40.396689    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b08ab692-e6ef-4674-b8a7-625e00c3ae90" path="/var/lib/kubelet/pods/b08ab692-e6ef-4674-b8a7-625e00c3ae90/volumes"
Sep 16 12:27:40.428081 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:40.428010    2576 generic.go:356] "Generic (PLEG): container finished" podID="24ff1f9f-5599-445c-9aff-46d84155f985" containerID="2e761fde5cc724c23bd995ffbb201f9b7486c9be2fd02c6bf6555141a78360a3" exitCode=0
Sep 16 12:27:40.428227 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:40.428076    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"
Sep 16 12:27:40.428227 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:40.428093    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486" event={"ID":"24ff1f9f-5599-445c-9aff-46d84155f985","Type":"ContainerDied","Data":"2e761fde5cc724c23bd995ffbb201f9b7486c9be2fd02c6bf6555141a78360a3"}
Sep 16 12:27:40.428227 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:40.428157    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486" event={"ID":"24ff1f9f-5599-445c-9aff-46d84155f985","Type":"ContainerDied","Data":"8c062e727c5f7e947fcb2d32afa1b82e38fb7789a910539b1747092d5c7a3717"}
Sep 16 12:27:40.428227 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:40.428186    2576 scope.go:117] "RemoveContainer" containerID="2e761fde5cc724c23bd995ffbb201f9b7486c9be2fd02c6bf6555141a78360a3"
Sep 16 12:27:40.430235 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:40.429811    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2"
Sep 16 12:27:40.430235 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:40.429834    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2" event={"ID":"af66dad4-51da-4705-9c93-853cb46e4ee0","Type":"ContainerDied","Data":"039bd8da0ef3c6976560dbb747412a2215e8e3ae242ebdcc58c130477650393a"}
Sep 16 12:27:40.431540 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:40.431513    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh"
Sep 16 12:27:40.431658 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:40.431534    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh" event={"ID":"86eb185f-5d28-45be-baca-fa586952acf2","Type":"ContainerDied","Data":"8143f30ed2bdd0f50a6c5d00a2476bc7757e1a59c9dc108c38205f0f6ceb953e"}
Sep 16 12:27:40.439792 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:40.439774    2576 scope.go:117] "RemoveContainer" containerID="122b2cb1788a572f9e8f8d175dbc33c7955c37b4a22d02b887e4e7541ede30e8"
Sep 16 12:27:40.448678 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:40.448662    2576 scope.go:117] "RemoveContainer" containerID="2e761fde5cc724c23bd995ffbb201f9b7486c9be2fd02c6bf6555141a78360a3"
Sep 16 12:27:40.448978 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:27:40.448954    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e761fde5cc724c23bd995ffbb201f9b7486c9be2fd02c6bf6555141a78360a3\": container with ID starting with 2e761fde5cc724c23bd995ffbb201f9b7486c9be2fd02c6bf6555141a78360a3 not found: ID does not exist" containerID="2e761fde5cc724c23bd995ffbb201f9b7486c9be2fd02c6bf6555141a78360a3"
Sep 16 12:27:40.449055 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:40.448990    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e761fde5cc724c23bd995ffbb201f9b7486c9be2fd02c6bf6555141a78360a3"} err="failed to get container status \"2e761fde5cc724c23bd995ffbb201f9b7486c9be2fd02c6bf6555141a78360a3\": rpc error: code = NotFound desc = could not find container \"2e761fde5cc724c23bd995ffbb201f9b7486c9be2fd02c6bf6555141a78360a3\": container with ID starting with 2e761fde5cc724c23bd995ffbb201f9b7486c9be2fd02c6bf6555141a78360a3 not found: ID does not exist"
Sep 16 12:27:40.449055 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:40.449013    2576 scope.go:117] "RemoveContainer" containerID="122b2cb1788a572f9e8f8d175dbc33c7955c37b4a22d02b887e4e7541ede30e8"
Sep 16 12:27:40.449294 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:27:40.449268    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"122b2cb1788a572f9e8f8d175dbc33c7955c37b4a22d02b887e4e7541ede30e8\": container with ID starting with 122b2cb1788a572f9e8f8d175dbc33c7955c37b4a22d02b887e4e7541ede30e8 not found: ID does not exist" containerID="122b2cb1788a572f9e8f8d175dbc33c7955c37b4a22d02b887e4e7541ede30e8"
Sep 16 12:27:40.449382 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:40.449301    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"122b2cb1788a572f9e8f8d175dbc33c7955c37b4a22d02b887e4e7541ede30e8"} err="failed to get container status \"122b2cb1788a572f9e8f8d175dbc33c7955c37b4a22d02b887e4e7541ede30e8\": rpc error: code = NotFound desc = could not find container \"122b2cb1788a572f9e8f8d175dbc33c7955c37b4a22d02b887e4e7541ede30e8\": container with ID starting with 122b2cb1788a572f9e8f8d175dbc33c7955c37b4a22d02b887e4e7541ede30e8 not found: ID does not exist"
Sep 16 12:27:40.449438 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:40.449428    2576 scope.go:117] "RemoveContainer" containerID="7750d92fabcd456fb28f99b104d4665a5abd65fa68a8c3474e6fa9fdfca7d35d"
Sep 16 12:27:40.453652 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:40.453631    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh"]
Sep 16 12:27:40.457668 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:40.457648    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a6f57e-57dc7f86c4-w4tbh"]
Sep 16 12:27:40.458682 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:40.458666    2576 scope.go:117] "RemoveContainer" containerID="1a2a77ff1ab75026acf10ecf668586670a88f1d685c507bf4d027767b593b004"
Sep 16 12:27:40.468620 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:40.468598    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2"]
Sep 16 12:27:40.471624 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:40.471605    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a6f57e-f88646875-hhbl2"]
Sep 16 12:27:40.482294 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:40.482272    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"]
Sep 16 12:27:40.486296 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:40.486277    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-556077-openshift-default-58b9874496-nb486"]
Sep 16 12:27:42.394698 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:42.394667    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24ff1f9f-5599-445c-9aff-46d84155f985" path="/var/lib/kubelet/pods/24ff1f9f-5599-445c-9aff-46d84155f985/volumes"
Sep 16 12:27:42.395096 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:42.395082    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86eb185f-5d28-45be-baca-fa586952acf2" path="/var/lib/kubelet/pods/86eb185f-5d28-45be-baca-fa586952acf2/volumes"
Sep 16 12:27:42.395523 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:42.395508    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af66dad4-51da-4705-9c93-853cb46e4ee0" path="/var/lib/kubelet/pods/af66dad4-51da-4705-9c93-853cb46e4ee0/volumes"
Sep 16 12:27:46.293839 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:46.293797    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30f927-f4frt"]
Sep 16 12:27:46.294583 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:46.294561    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af66dad4-51da-4705-9c93-853cb46e4ee0" containerName="payload-processing"
Sep 16 12:27:46.294583 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:46.294584    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="af66dad4-51da-4705-9c93-853cb46e4ee0" containerName="payload-processing"
Sep 16 12:27:46.294751 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:46.294604    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a75ce06d-d38a-40bc-b2dc-e9281006222f" containerName="revoke-keys"
Sep 16 12:27:46.294751 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:46.294613    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a75ce06d-d38a-40bc-b2dc-e9281006222f" containerName="revoke-keys"
Sep 16 12:27:46.294751 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:46.294660    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24ff1f9f-5599-445c-9aff-46d84155f985" containerName="istio-proxy"
Sep 16 12:27:46.294751 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:46.294668    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="24ff1f9f-5599-445c-9aff-46d84155f985" containerName="istio-proxy"
Sep 16 12:27:46.294751 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:46.294682    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86eb185f-5d28-45be-baca-fa586952acf2" containerName="payload-pre-processing"
Sep 16 12:27:46.294751 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:46.294690    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="86eb185f-5d28-45be-baca-fa586952acf2" containerName="payload-pre-processing"
Sep 16 12:27:46.294751 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:46.294700    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24ff1f9f-5599-445c-9aff-46d84155f985" containerName="istio-proxy"
Sep 16 12:27:46.294751 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:46.294708    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="24ff1f9f-5599-445c-9aff-46d84155f985" containerName="istio-proxy"
Sep 16 12:27:46.295150 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:46.294827    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="86eb185f-5d28-45be-baca-fa586952acf2" containerName="payload-pre-processing"
Sep 16 12:27:46.295150 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:46.294846    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="24ff1f9f-5599-445c-9aff-46d84155f985" containerName="istio-proxy"
Sep 16 12:27:46.295150 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:46.294855    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="24ff1f9f-5599-445c-9aff-46d84155f985" containerName="istio-proxy"
Sep 16 12:27:46.295150 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:46.294865    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="af66dad4-51da-4705-9c93-853cb46e4ee0" containerName="payload-processing"
Sep 16 12:27:46.295150 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:46.294873    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a75ce06d-d38a-40bc-b2dc-e9281006222f" containerName="revoke-keys"
Sep 16 12:27:46.298499 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:46.298476    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30f927-f4frt"
Sep 16 12:27:46.301008 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:46.300987    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9lc86\""
Sep 16 12:27:46.307377 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:46.307351    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30f927-f4frt"]
Sep 16 12:27:46.451429 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:46.451395    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdb1eb7e-f914-405d-beae-04702f157f5f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-30f927-f4frt\" (UID: \"fdb1eb7e-f914-405d-beae-04702f157f5f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30f927-f4frt"
Sep 16 12:27:46.552822 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:46.552725    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdb1eb7e-f914-405d-beae-04702f157f5f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-30f927-f4frt\" (UID: \"fdb1eb7e-f914-405d-beae-04702f157f5f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30f927-f4frt"
Sep 16 12:27:46.553456 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:46.553431    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdb1eb7e-f914-405d-beae-04702f157f5f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-30f927-f4frt\" (UID: \"fdb1eb7e-f914-405d-beae-04702f157f5f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30f927-f4frt"
Sep 16 12:27:46.611609 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:46.611577    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30f927-f4frt"
Sep 16 12:27:46.892215 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:46.892194    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30f927-f4frt"]
Sep 16 12:27:46.895283 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:27:46.895245    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdb1eb7e_f914_405d_beae_04702f157f5f.slice/crio-de21ab04494315a18dac1aa86454e1aef56c8e779fa887a6f2bea5d0287125ef WatchSource:0}: Error finding container de21ab04494315a18dac1aa86454e1aef56c8e779fa887a6f2bea5d0287125ef: Status 404 returned error can't find the container with id de21ab04494315a18dac1aa86454e1aef56c8e779fa887a6f2bea5d0287125ef
Sep 16 12:27:47.480154 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:47.480059    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30f927-f4frt" event={"ID":"fdb1eb7e-f914-405d-beae-04702f157f5f","Type":"ContainerStarted","Data":"4b999d366e8e14ca14ad5b139aaf706c2d4cdf4f7952bbd5651db26810a75427"}
Sep 16 12:27:47.480154 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:47.480111    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30f927-f4frt" event={"ID":"fdb1eb7e-f914-405d-beae-04702f157f5f","Type":"ContainerStarted","Data":"de21ab04494315a18dac1aa86454e1aef56c8e779fa887a6f2bea5d0287125ef"}
Sep 16 12:27:47.497816 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:47.497764    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30f927-f4frt" podStartSLOduration=1.497747438 podStartE2EDuration="1.497747438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:27:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:27:47.497087334 +0000 UTC m=+1533.666052042" watchObservedRunningTime="2026-09-16 12:27:47.497747438 +0000 UTC m=+1533.666712145"
Sep 16 12:27:48.013128 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.013098    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-ff057a-29826015-cl5n4"]
Sep 16 12:27:48.016572 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.016545    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-ff057a-29826015-cl5n4"]
Sep 16 12:27:48.038090 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.038056    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4"]
Sep 16 12:27:48.038308 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.038281    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4" podUID="fdf9d313-1e9d-436c-9eed-cafeea130bde" containerName="payload-processing" containerID="cri-o://d9ea388f397da5ee99ea1b678fe4b879c15abcf0e5fab0dd491486bd95893a76" gracePeriod=30
Sep 16 12:27:48.043550 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.043520    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g"]
Sep 16 12:27:48.043767 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.043737    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g" podUID="5957aadf-0d0e-4877-a886-9be00ff13a82" containerName="payload-pre-processing" containerID="cri-o://0a502f904e984632f93fd6056c5c4fea3b267e62c9d232c38b7cabdf9b515ffe" gracePeriod=30
Sep 16 12:27:48.230742 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.230696    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ff057a-gqw5c"]
Sep 16 12:27:48.234650 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.234561    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ff057a-gqw5c"]
Sep 16 12:27:48.315780 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.315750    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4"
Sep 16 12:27:48.338924 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.338903    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g"
Sep 16 12:27:48.398487 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.398447    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2028fdc3-85f6-4d9b-97f4-4de77c473375" path="/var/lib/kubelet/pods/2028fdc3-85f6-4d9b-97f4-4de77c473375/volumes"
Sep 16 12:27:48.399384 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.399360    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a75ce06d-d38a-40bc-b2dc-e9281006222f" path="/var/lib/kubelet/pods/a75ce06d-d38a-40bc-b2dc-e9281006222f/volumes"
Sep 16 12:27:48.472564 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.472530    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5957aadf-0d0e-4877-a886-9be00ff13a82-plugins-config-volume\") pod \"5957aadf-0d0e-4877-a886-9be00ff13a82\" (UID: \"5957aadf-0d0e-4877-a886-9be00ff13a82\") "
Sep 16 12:27:48.472746 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.472576    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sts58\" (UniqueName: \"kubernetes.io/projected/fdf9d313-1e9d-436c-9eed-cafeea130bde-kube-api-access-sts58\") pod \"fdf9d313-1e9d-436c-9eed-cafeea130bde\" (UID: \"fdf9d313-1e9d-436c-9eed-cafeea130bde\") "
Sep 16 12:27:48.472746 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.472629    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdf9d313-1e9d-436c-9eed-cafeea130bde-plugins-config-volume\") pod \"fdf9d313-1e9d-436c-9eed-cafeea130bde\" (UID: \"fdf9d313-1e9d-436c-9eed-cafeea130bde\") "
Sep 16 12:27:48.472746 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.472656    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hl54p\" (UniqueName: \"kubernetes.io/projected/5957aadf-0d0e-4877-a886-9be00ff13a82-kube-api-access-hl54p\") pod \"5957aadf-0d0e-4877-a886-9be00ff13a82\" (UID: \"5957aadf-0d0e-4877-a886-9be00ff13a82\") "
Sep 16 12:27:48.472955 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.472932    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5957aadf-0d0e-4877-a886-9be00ff13a82-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5957aadf-0d0e-4877-a886-9be00ff13a82" (UID: "5957aadf-0d0e-4877-a886-9be00ff13a82"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:27:48.473014 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.472989    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdf9d313-1e9d-436c-9eed-cafeea130bde-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fdf9d313-1e9d-436c-9eed-cafeea130bde" (UID: "fdf9d313-1e9d-436c-9eed-cafeea130bde"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:27:48.473126 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.473110    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5957aadf-0d0e-4877-a886-9be00ff13a82-plugins-config-volume\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:48.473178 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.473128    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fdf9d313-1e9d-436c-9eed-cafeea130bde-plugins-config-volume\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:48.474905 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.474884    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5957aadf-0d0e-4877-a886-9be00ff13a82-kube-api-access-hl54p" (OuterVolumeSpecName: "kube-api-access-hl54p") pod "5957aadf-0d0e-4877-a886-9be00ff13a82" (UID: "5957aadf-0d0e-4877-a886-9be00ff13a82"). InnerVolumeSpecName "kube-api-access-hl54p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:27:48.474978 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.474912    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdf9d313-1e9d-436c-9eed-cafeea130bde-kube-api-access-sts58" (OuterVolumeSpecName: "kube-api-access-sts58") pod "fdf9d313-1e9d-436c-9eed-cafeea130bde" (UID: "fdf9d313-1e9d-436c-9eed-cafeea130bde"). InnerVolumeSpecName "kube-api-access-sts58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:27:48.487354 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.487304    2576 generic.go:356] "Generic (PLEG): container finished" podID="fdb1eb7e-f914-405d-beae-04702f157f5f" containerID="4b999d366e8e14ca14ad5b139aaf706c2d4cdf4f7952bbd5651db26810a75427" exitCode=0
Sep 16 12:27:48.487702 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.487360    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30f927-f4frt" event={"ID":"fdb1eb7e-f914-405d-beae-04702f157f5f","Type":"ContainerDied","Data":"4b999d366e8e14ca14ad5b139aaf706c2d4cdf4f7952bbd5651db26810a75427"}
Sep 16 12:27:48.488721 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.488700    2576 generic.go:356] "Generic (PLEG): container finished" podID="5957aadf-0d0e-4877-a886-9be00ff13a82" containerID="0a502f904e984632f93fd6056c5c4fea3b267e62c9d232c38b7cabdf9b515ffe" exitCode=0
Sep 16 12:27:48.488819 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.488738    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g"
Sep 16 12:27:48.488819 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.488776    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g" event={"ID":"5957aadf-0d0e-4877-a886-9be00ff13a82","Type":"ContainerDied","Data":"0a502f904e984632f93fd6056c5c4fea3b267e62c9d232c38b7cabdf9b515ffe"}
Sep 16 12:27:48.488925 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.488820    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g" event={"ID":"5957aadf-0d0e-4877-a886-9be00ff13a82","Type":"ContainerDied","Data":"894aae7d6dd6a89e31c0ffbf9b29fa0b010f61a863bb20e11ee2ec58348c4a68"}
Sep 16 12:27:48.488925 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.488846    2576 scope.go:117] "RemoveContainer" containerID="0a502f904e984632f93fd6056c5c4fea3b267e62c9d232c38b7cabdf9b515ffe"
Sep 16 12:27:48.490084 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.490067    2576 generic.go:356] "Generic (PLEG): container finished" podID="fdf9d313-1e9d-436c-9eed-cafeea130bde" containerID="d9ea388f397da5ee99ea1b678fe4b879c15abcf0e5fab0dd491486bd95893a76" exitCode=0
Sep 16 12:27:48.490179 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.490098    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4"
Sep 16 12:27:48.490179 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.490105    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4" event={"ID":"fdf9d313-1e9d-436c-9eed-cafeea130bde","Type":"ContainerDied","Data":"d9ea388f397da5ee99ea1b678fe4b879c15abcf0e5fab0dd491486bd95893a76"}
Sep 16 12:27:48.490179 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.490139    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4" event={"ID":"fdf9d313-1e9d-436c-9eed-cafeea130bde","Type":"ContainerDied","Data":"3237f567119a03f4c90155ac7dd42c4cbda7e698a8d857ff7f5adc4c8f9ac202"}
Sep 16 12:27:48.502683 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.500140    2576 scope.go:117] "RemoveContainer" containerID="0a502f904e984632f93fd6056c5c4fea3b267e62c9d232c38b7cabdf9b515ffe"
Sep 16 12:27:48.502683 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:27:48.500804    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a502f904e984632f93fd6056c5c4fea3b267e62c9d232c38b7cabdf9b515ffe\": container with ID starting with 0a502f904e984632f93fd6056c5c4fea3b267e62c9d232c38b7cabdf9b515ffe not found: ID does not exist" containerID="0a502f904e984632f93fd6056c5c4fea3b267e62c9d232c38b7cabdf9b515ffe"
Sep 16 12:27:48.502683 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.500841    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a502f904e984632f93fd6056c5c4fea3b267e62c9d232c38b7cabdf9b515ffe"} err="failed to get container status \"0a502f904e984632f93fd6056c5c4fea3b267e62c9d232c38b7cabdf9b515ffe\": rpc error: code = NotFound desc = could not find container \"0a502f904e984632f93fd6056c5c4fea3b267e62c9d232c38b7cabdf9b515ffe\": container with ID starting with 0a502f904e984632f93fd6056c5c4fea3b267e62c9d232c38b7cabdf9b515ffe not found: ID does not exist"
Sep 16 12:27:48.502683 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.500873    2576 scope.go:117] "RemoveContainer" containerID="d9ea388f397da5ee99ea1b678fe4b879c15abcf0e5fab0dd491486bd95893a76"
Sep 16 12:27:48.521156 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.521131    2576 scope.go:117] "RemoveContainer" containerID="d9ea388f397da5ee99ea1b678fe4b879c15abcf0e5fab0dd491486bd95893a76"
Sep 16 12:27:48.521535 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:27:48.521506    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9ea388f397da5ee99ea1b678fe4b879c15abcf0e5fab0dd491486bd95893a76\": container with ID starting with d9ea388f397da5ee99ea1b678fe4b879c15abcf0e5fab0dd491486bd95893a76 not found: ID does not exist" containerID="d9ea388f397da5ee99ea1b678fe4b879c15abcf0e5fab0dd491486bd95893a76"
Sep 16 12:27:48.521636 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.521545    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9ea388f397da5ee99ea1b678fe4b879c15abcf0e5fab0dd491486bd95893a76"} err="failed to get container status \"d9ea388f397da5ee99ea1b678fe4b879c15abcf0e5fab0dd491486bd95893a76\": rpc error: code = NotFound desc = could not find container \"d9ea388f397da5ee99ea1b678fe4b879c15abcf0e5fab0dd491486bd95893a76\": container with ID starting with d9ea388f397da5ee99ea1b678fe4b879c15abcf0e5fab0dd491486bd95893a76 not found: ID does not exist"
Sep 16 12:27:48.522098 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.522080    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g"]
Sep 16 12:27:48.524819 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.524798    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-ff057a-66dcf65678-mfw8g"]
Sep 16 12:27:48.533463 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.533444    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4"]
Sep 16 12:27:48.535854 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.535831    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ff057a-7c6f588645-z5qh4"]
Sep 16 12:27:48.573738 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.573713    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sts58\" (UniqueName: \"kubernetes.io/projected/fdf9d313-1e9d-436c-9eed-cafeea130bde-kube-api-access-sts58\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:48.573738 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:48.573738    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hl54p\" (UniqueName: \"kubernetes.io/projected/5957aadf-0d0e-4877-a886-9be00ff13a82-kube-api-access-hl54p\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:49.645237 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:49.645214    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30f927-f4frt"
Sep 16 12:27:49.787338 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:49.787228    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdb1eb7e-f914-405d-beae-04702f157f5f-maas-api-service-ca\") pod \"fdb1eb7e-f914-405d-beae-04702f157f5f\" (UID: \"fdb1eb7e-f914-405d-beae-04702f157f5f\") "
Sep 16 12:27:49.787592 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:49.787568    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdb1eb7e-f914-405d-beae-04702f157f5f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fdb1eb7e-f914-405d-beae-04702f157f5f" (UID: "fdb1eb7e-f914-405d-beae-04702f157f5f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:27:49.888920 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:49.888882    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdb1eb7e-f914-405d-beae-04702f157f5f-maas-api-service-ca\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:50.395226 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:50.395186    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5957aadf-0d0e-4877-a886-9be00ff13a82" path="/var/lib/kubelet/pods/5957aadf-0d0e-4877-a886-9be00ff13a82/volumes"
Sep 16 12:27:50.395768 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:50.395738    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdf9d313-1e9d-436c-9eed-cafeea130bde" path="/var/lib/kubelet/pods/fdf9d313-1e9d-436c-9eed-cafeea130bde/volumes"
Sep 16 12:27:50.509890 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:50.509849    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30f927-f4frt" event={"ID":"fdb1eb7e-f914-405d-beae-04702f157f5f","Type":"ContainerDied","Data":"de21ab04494315a18dac1aa86454e1aef56c8e779fa887a6f2bea5d0287125ef"}
Sep 16 12:27:50.510071 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:50.509919    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de21ab04494315a18dac1aa86454e1aef56c8e779fa887a6f2bea5d0287125ef"
Sep 16 12:27:50.510071 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:50.509990    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30f927-f4frt"
Sep 16 12:27:52.041858 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.041820    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9" podUID="a26b4581-3386-42e8-8abc-896d8106cc97" containerName="main" containerID="cri-o://7eb5bbe089d7107ba658ed36f7b183ccb8b5071dfdd0afbf74adb34b84d0c052" gracePeriod=45
Sep 16 12:27:52.323096 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.323072    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"
Sep 16 12:27:52.416011 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.415976    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a26b4581-3386-42e8-8abc-896d8106cc97-model-cache\") pod \"a26b4581-3386-42e8-8abc-896d8106cc97\" (UID: \"a26b4581-3386-42e8-8abc-896d8106cc97\") "
Sep 16 12:27:52.416214 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.416060    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a26b4581-3386-42e8-8abc-896d8106cc97-home\") pod \"a26b4581-3386-42e8-8abc-896d8106cc97\" (UID: \"a26b4581-3386-42e8-8abc-896d8106cc97\") "
Sep 16 12:27:52.416214 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.416095    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a26b4581-3386-42e8-8abc-896d8106cc97-tmp-dir\") pod \"a26b4581-3386-42e8-8abc-896d8106cc97\" (UID: \"a26b4581-3386-42e8-8abc-896d8106cc97\") "
Sep 16 12:27:52.416214 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.416120    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a26b4581-3386-42e8-8abc-896d8106cc97-tls-certs\") pod \"a26b4581-3386-42e8-8abc-896d8106cc97\" (UID: \"a26b4581-3386-42e8-8abc-896d8106cc97\") "
Sep 16 12:27:52.416408 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.416243    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4d62k\" (UniqueName: \"kubernetes.io/projected/a26b4581-3386-42e8-8abc-896d8106cc97-kube-api-access-4d62k\") pod \"a26b4581-3386-42e8-8abc-896d8106cc97\" (UID: \"a26b4581-3386-42e8-8abc-896d8106cc97\") "
Sep 16 12:27:52.416408 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.416255    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a26b4581-3386-42e8-8abc-896d8106cc97-model-cache" (OuterVolumeSpecName: "model-cache") pod "a26b4581-3386-42e8-8abc-896d8106cc97" (UID: "a26b4581-3386-42e8-8abc-896d8106cc97"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:52.416408 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.416270    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a26b4581-3386-42e8-8abc-896d8106cc97-dshm\") pod \"a26b4581-3386-42e8-8abc-896d8106cc97\" (UID: \"a26b4581-3386-42e8-8abc-896d8106cc97\") "
Sep 16 12:27:52.416408 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.416394    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a26b4581-3386-42e8-8abc-896d8106cc97-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a26b4581-3386-42e8-8abc-896d8106cc97" (UID: "a26b4581-3386-42e8-8abc-896d8106cc97"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:52.416613 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.416407    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a26b4581-3386-42e8-8abc-896d8106cc97-home" (OuterVolumeSpecName: "home") pod "a26b4581-3386-42e8-8abc-896d8106cc97" (UID: "a26b4581-3386-42e8-8abc-896d8106cc97"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:52.416805 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.416774    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a26b4581-3386-42e8-8abc-896d8106cc97-home\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:52.416998 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.416983    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a26b4581-3386-42e8-8abc-896d8106cc97-tmp-dir\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:52.417180 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.417136    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a26b4581-3386-42e8-8abc-896d8106cc97-model-cache\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:52.419116 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.419090    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a26b4581-3386-42e8-8abc-896d8106cc97-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a26b4581-3386-42e8-8abc-896d8106cc97" (UID: "a26b4581-3386-42e8-8abc-896d8106cc97"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:27:52.419239 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.419214    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a26b4581-3386-42e8-8abc-896d8106cc97-kube-api-access-4d62k" (OuterVolumeSpecName: "kube-api-access-4d62k") pod "a26b4581-3386-42e8-8abc-896d8106cc97" (UID: "a26b4581-3386-42e8-8abc-896d8106cc97"). InnerVolumeSpecName "kube-api-access-4d62k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:27:52.419403 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.419383    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a26b4581-3386-42e8-8abc-896d8106cc97-dshm" (OuterVolumeSpecName: "dshm") pod "a26b4581-3386-42e8-8abc-896d8106cc97" (UID: "a26b4581-3386-42e8-8abc-896d8106cc97"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:52.518702 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.518672    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a26b4581-3386-42e8-8abc-896d8106cc97-dshm\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:52.518702 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.518699    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a26b4581-3386-42e8-8abc-896d8106cc97-tls-certs\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:52.518702 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.518709    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4d62k\" (UniqueName: \"kubernetes.io/projected/a26b4581-3386-42e8-8abc-896d8106cc97-kube-api-access-4d62k\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:52.525516 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.525479    2576 generic.go:356] "Generic (PLEG): container finished" podID="a26b4581-3386-42e8-8abc-896d8106cc97" containerID="7eb5bbe089d7107ba658ed36f7b183ccb8b5071dfdd0afbf74adb34b84d0c052" exitCode=0
Sep 16 12:27:52.525638 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.525528    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"
Sep 16 12:27:52.525638 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.525563    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9" event={"ID":"a26b4581-3386-42e8-8abc-896d8106cc97","Type":"ContainerDied","Data":"7eb5bbe089d7107ba658ed36f7b183ccb8b5071dfdd0afbf74adb34b84d0c052"}
Sep 16 12:27:52.525638 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.525610    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9" event={"ID":"a26b4581-3386-42e8-8abc-896d8106cc97","Type":"ContainerDied","Data":"65d9325d2bf7ff5f9415ae3f8901fe025d0282ff97e70edc9932c3c3b0e67b2b"}
Sep 16 12:27:52.525638 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.525631    2576 scope.go:117] "RemoveContainer" containerID="7eb5bbe089d7107ba658ed36f7b183ccb8b5071dfdd0afbf74adb34b84d0c052"
Sep 16 12:27:52.536715 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.536695    2576 scope.go:117] "RemoveContainer" containerID="7eb5bbe089d7107ba658ed36f7b183ccb8b5071dfdd0afbf74adb34b84d0c052"
Sep 16 12:27:52.537068 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:27:52.537039    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7eb5bbe089d7107ba658ed36f7b183ccb8b5071dfdd0afbf74adb34b84d0c052\": container with ID starting with 7eb5bbe089d7107ba658ed36f7b183ccb8b5071dfdd0afbf74adb34b84d0c052 not found: ID does not exist" containerID="7eb5bbe089d7107ba658ed36f7b183ccb8b5071dfdd0afbf74adb34b84d0c052"
Sep 16 12:27:52.537172 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.537079    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7eb5bbe089d7107ba658ed36f7b183ccb8b5071dfdd0afbf74adb34b84d0c052"} err="failed to get container status \"7eb5bbe089d7107ba658ed36f7b183ccb8b5071dfdd0afbf74adb34b84d0c052\": rpc error: code = NotFound desc = could not find container \"7eb5bbe089d7107ba658ed36f7b183ccb8b5071dfdd0afbf74adb34b84d0c052\": container with ID starting with 7eb5bbe089d7107ba658ed36f7b183ccb8b5071dfdd0afbf74adb34b84d0c052 not found: ID does not exist"
Sep 16 12:27:52.549468 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.549396    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"]
Sep 16 12:27:52.552450 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:52.552427    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-ff057a/embedding-w0-ff057a-kserve-777d7b695c-zjqw9"]
Sep 16 12:27:54.395462 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:54.395425    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a26b4581-3386-42e8-8abc-896d8106cc97" path="/var/lib/kubelet/pods/a26b4581-3386-42e8-8abc-896d8106cc97/volumes"
Sep 16 12:27:54.598265 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:54.598227    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"]
Sep 16 12:27:54.598829 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:54.598762    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz" podUID="35be3a8f-570c-4921-a90c-3195445dff07" containerName="istio-proxy" containerID="cri-o://8b4d6ed3ae061cf68abcffb0e264b33c1aaefa340c47f32ff0e224eae1d0b7ab" gracePeriod=30
Sep 16 12:27:59.868645 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.868586    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:27:59.893132 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.893097    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35be3a8f-570c-4921-a90c-3195445dff07-istiod-ca-cert\") pod \"35be3a8f-570c-4921-a90c-3195445dff07\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") "
Sep 16 12:27:59.893258 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.893156    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-credential-socket\") pod \"35be3a8f-570c-4921-a90c-3195445dff07\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") "
Sep 16 12:27:59.893258 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.893217    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35be3a8f-570c-4921-a90c-3195445dff07-istio-podinfo\") pod \"35be3a8f-570c-4921-a90c-3195445dff07\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") "
Sep 16 12:27:59.893258 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.893242    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-workload-socket\") pod \"35be3a8f-570c-4921-a90c-3195445dff07\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") "
Sep 16 12:27:59.893443 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.893289    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-workload-certs\") pod \"35be3a8f-570c-4921-a90c-3195445dff07\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") "
Sep 16 12:27:59.893443 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.893343    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-istio-envoy\") pod \"35be3a8f-570c-4921-a90c-3195445dff07\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") "
Sep 16 12:27:59.893443 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.893401    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35be3a8f-570c-4921-a90c-3195445dff07-istio-token\") pod \"35be3a8f-570c-4921-a90c-3195445dff07\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") "
Sep 16 12:27:59.893610 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.893444    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-istio-data\") pod \"35be3a8f-570c-4921-a90c-3195445dff07\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") "
Sep 16 12:27:59.893610 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.893469    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59lpj\" (UniqueName: \"kubernetes.io/projected/35be3a8f-570c-4921-a90c-3195445dff07-kube-api-access-59lpj\") pod \"35be3a8f-570c-4921-a90c-3195445dff07\" (UID: \"35be3a8f-570c-4921-a90c-3195445dff07\") "
Sep 16 12:27:59.893610 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.893537    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35be3a8f-570c-4921-a90c-3195445dff07-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "35be3a8f-570c-4921-a90c-3195445dff07" (UID: "35be3a8f-570c-4921-a90c-3195445dff07"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:27:59.893807 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.893791    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35be3a8f-570c-4921-a90c-3195445dff07-istiod-ca-cert\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:59.894112 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.894049    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "35be3a8f-570c-4921-a90c-3195445dff07" (UID: "35be3a8f-570c-4921-a90c-3195445dff07"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:59.894249 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.894147    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "35be3a8f-570c-4921-a90c-3195445dff07" (UID: "35be3a8f-570c-4921-a90c-3195445dff07"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:59.894308 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.894245    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "35be3a8f-570c-4921-a90c-3195445dff07" (UID: "35be3a8f-570c-4921-a90c-3195445dff07"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:59.894786 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.894758    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-istio-data" (OuterVolumeSpecName: "istio-data") pod "35be3a8f-570c-4921-a90c-3195445dff07" (UID: "35be3a8f-570c-4921-a90c-3195445dff07"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:59.896838 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.896800    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "35be3a8f-570c-4921-a90c-3195445dff07" (UID: "35be3a8f-570c-4921-a90c-3195445dff07"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:27:59.896941 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.896832    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/35be3a8f-570c-4921-a90c-3195445dff07-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "35be3a8f-570c-4921-a90c-3195445dff07" (UID: "35be3a8f-570c-4921-a90c-3195445dff07"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:27:59.897484 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.897454    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35be3a8f-570c-4921-a90c-3195445dff07-kube-api-access-59lpj" (OuterVolumeSpecName: "kube-api-access-59lpj") pod "35be3a8f-570c-4921-a90c-3195445dff07" (UID: "35be3a8f-570c-4921-a90c-3195445dff07"). InnerVolumeSpecName "kube-api-access-59lpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:27:59.897603 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.897486    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35be3a8f-570c-4921-a90c-3195445dff07-istio-token" (OuterVolumeSpecName: "istio-token") pod "35be3a8f-570c-4921-a90c-3195445dff07" (UID: "35be3a8f-570c-4921-a90c-3195445dff07"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:27:59.994457 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.994428    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35be3a8f-570c-4921-a90c-3195445dff07-istio-token\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:59.994457 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.994450    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-istio-data\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:59.994457 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.994459    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59lpj\" (UniqueName: \"kubernetes.io/projected/35be3a8f-570c-4921-a90c-3195445dff07-kube-api-access-59lpj\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:59.994660 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.994469    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-credential-socket\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:59.994660 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.994479    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35be3a8f-570c-4921-a90c-3195445dff07-istio-podinfo\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:59.994660 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.994486    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-workload-socket\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:59.994660 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.994497    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-workload-certs\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:27:59.994660 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:27:59.994505    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35be3a8f-570c-4921-a90c-3195445dff07-istio-envoy\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:28:00.577558 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:00.577524    2576 generic.go:356] "Generic (PLEG): container finished" podID="35be3a8f-570c-4921-a90c-3195445dff07" containerID="8b4d6ed3ae061cf68abcffb0e264b33c1aaefa340c47f32ff0e224eae1d0b7ab" exitCode=0
Sep 16 12:28:00.577730 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:00.577573    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"
Sep 16 12:28:00.577730 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:00.577614    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz" event={"ID":"35be3a8f-570c-4921-a90c-3195445dff07","Type":"ContainerDied","Data":"8b4d6ed3ae061cf68abcffb0e264b33c1aaefa340c47f32ff0e224eae1d0b7ab"}
Sep 16 12:28:00.577730 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:00.577677    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz" event={"ID":"35be3a8f-570c-4921-a90c-3195445dff07","Type":"ContainerDied","Data":"ef056fbff44a5b5abb2478c05d7627c827a81dced815adfed9cf018cc50bb8ce"}
Sep 16 12:28:00.577730 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:00.577709    2576 scope.go:117] "RemoveContainer" containerID="8b4d6ed3ae061cf68abcffb0e264b33c1aaefa340c47f32ff0e224eae1d0b7ab"
Sep 16 12:28:00.587646 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:00.587631    2576 scope.go:117] "RemoveContainer" containerID="c98f28fc0cc6d94aac56497af5b313940371c6dbbad46b1d675e692ad8e23dec"
Sep 16 12:28:00.596649 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:00.596622    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"]
Sep 16 12:28:00.598053 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:00.598034    2576 scope.go:117] "RemoveContainer" containerID="8b4d6ed3ae061cf68abcffb0e264b33c1aaefa340c47f32ff0e224eae1d0b7ab"
Sep 16 12:28:00.598397 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:28:00.598377    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b4d6ed3ae061cf68abcffb0e264b33c1aaefa340c47f32ff0e224eae1d0b7ab\": container with ID starting with 8b4d6ed3ae061cf68abcffb0e264b33c1aaefa340c47f32ff0e224eae1d0b7ab not found: ID does not exist" containerID="8b4d6ed3ae061cf68abcffb0e264b33c1aaefa340c47f32ff0e224eae1d0b7ab"
Sep 16 12:28:00.598470 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:00.598404    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b4d6ed3ae061cf68abcffb0e264b33c1aaefa340c47f32ff0e224eae1d0b7ab"} err="failed to get container status \"8b4d6ed3ae061cf68abcffb0e264b33c1aaefa340c47f32ff0e224eae1d0b7ab\": rpc error: code = NotFound desc = could not find container \"8b4d6ed3ae061cf68abcffb0e264b33c1aaefa340c47f32ff0e224eae1d0b7ab\": container with ID starting with 8b4d6ed3ae061cf68abcffb0e264b33c1aaefa340c47f32ff0e224eae1d0b7ab not found: ID does not exist"
Sep 16 12:28:00.598470 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:00.598421    2576 scope.go:117] "RemoveContainer" containerID="c98f28fc0cc6d94aac56497af5b313940371c6dbbad46b1d675e692ad8e23dec"
Sep 16 12:28:00.598710 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:28:00.598692    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c98f28fc0cc6d94aac56497af5b313940371c6dbbad46b1d675e692ad8e23dec\": container with ID starting with c98f28fc0cc6d94aac56497af5b313940371c6dbbad46b1d675e692ad8e23dec not found: ID does not exist" containerID="c98f28fc0cc6d94aac56497af5b313940371c6dbbad46b1d675e692ad8e23dec"
Sep 16 12:28:00.598781 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:00.598715    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c98f28fc0cc6d94aac56497af5b313940371c6dbbad46b1d675e692ad8e23dec"} err="failed to get container status \"c98f28fc0cc6d94aac56497af5b313940371c6dbbad46b1d675e692ad8e23dec\": rpc error: code = NotFound desc = could not find container \"c98f28fc0cc6d94aac56497af5b313940371c6dbbad46b1d675e692ad8e23dec\": container with ID starting with c98f28fc0cc6d94aac56497af5b313940371c6dbbad46b1d675e692ad8e23dec not found: ID does not exist"
Sep 16 12:28:00.600534 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:00.600515    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-ff057a-openshift-default-56d4787566-fjnjz"]
Sep 16 12:28:01.990797 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:01.990755    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz"]
Sep 16 12:28:01.991270 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:01.990969    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz" podUID="f10b1235-9e5d-411f-9cb0-a585fbe0ea3a" containerName="payload-processing" containerID="cri-o://7d2c622baf199c5caf7718f92cc5cc9f48afae139445814ea39964781399bf87" gracePeriod=30
Sep 16 12:28:02.001087 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.001006    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb"]
Sep 16 12:28:02.001245 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.001192    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb" podUID="fecc32cb-dd2d-4125-9411-d4dff27e602c" containerName="payload-pre-processing" containerID="cri-o://885a16c94c09941911a212463b283255ab906d45d8172bea2ae215193c7a8f1b" gracePeriod=30
Sep 16 12:28:02.175842 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.175788    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30f927-f4frt"]
Sep 16 12:28:02.181407 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.181384    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-30f927-f4frt"]
Sep 16 12:28:02.304391 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.304368    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz"
Sep 16 12:28:02.306410 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.306396    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb"
Sep 16 12:28:02.396392 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.396358    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35be3a8f-570c-4921-a90c-3195445dff07" path="/var/lib/kubelet/pods/35be3a8f-570c-4921-a90c-3195445dff07/volumes"
Sep 16 12:28:02.397118 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.397095    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdb1eb7e-f914-405d-beae-04702f157f5f" path="/var/lib/kubelet/pods/fdb1eb7e-f914-405d-beae-04702f157f5f/volumes"
Sep 16 12:28:02.419130 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.419105    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjd67\" (UniqueName: \"kubernetes.io/projected/f10b1235-9e5d-411f-9cb0-a585fbe0ea3a-kube-api-access-hjd67\") pod \"f10b1235-9e5d-411f-9cb0-a585fbe0ea3a\" (UID: \"f10b1235-9e5d-411f-9cb0-a585fbe0ea3a\") "
Sep 16 12:28:02.419287 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.419183    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fecc32cb-dd2d-4125-9411-d4dff27e602c-plugins-config-volume\") pod \"fecc32cb-dd2d-4125-9411-d4dff27e602c\" (UID: \"fecc32cb-dd2d-4125-9411-d4dff27e602c\") "
Sep 16 12:28:02.419287 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.419256    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f10b1235-9e5d-411f-9cb0-a585fbe0ea3a-plugins-config-volume\") pod \"f10b1235-9e5d-411f-9cb0-a585fbe0ea3a\" (UID: \"f10b1235-9e5d-411f-9cb0-a585fbe0ea3a\") "
Sep 16 12:28:02.419408 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.419336    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6w2f\" (UniqueName: \"kubernetes.io/projected/fecc32cb-dd2d-4125-9411-d4dff27e602c-kube-api-access-m6w2f\") pod \"fecc32cb-dd2d-4125-9411-d4dff27e602c\" (UID: \"fecc32cb-dd2d-4125-9411-d4dff27e602c\") "
Sep 16 12:28:02.419609 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.419579    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fecc32cb-dd2d-4125-9411-d4dff27e602c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fecc32cb-dd2d-4125-9411-d4dff27e602c" (UID: "fecc32cb-dd2d-4125-9411-d4dff27e602c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:28:02.419754 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.419667    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f10b1235-9e5d-411f-9cb0-a585fbe0ea3a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f10b1235-9e5d-411f-9cb0-a585fbe0ea3a" (UID: "f10b1235-9e5d-411f-9cb0-a585fbe0ea3a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:28:02.419824 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.419805    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fecc32cb-dd2d-4125-9411-d4dff27e602c-plugins-config-volume\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:28:02.419890 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.419825    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f10b1235-9e5d-411f-9cb0-a585fbe0ea3a-plugins-config-volume\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:28:02.421469 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.421446    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fecc32cb-dd2d-4125-9411-d4dff27e602c-kube-api-access-m6w2f" (OuterVolumeSpecName: "kube-api-access-m6w2f") pod "fecc32cb-dd2d-4125-9411-d4dff27e602c" (UID: "fecc32cb-dd2d-4125-9411-d4dff27e602c"). InnerVolumeSpecName "kube-api-access-m6w2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:28:02.421553 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.421491    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f10b1235-9e5d-411f-9cb0-a585fbe0ea3a-kube-api-access-hjd67" (OuterVolumeSpecName: "kube-api-access-hjd67") pod "f10b1235-9e5d-411f-9cb0-a585fbe0ea3a" (UID: "f10b1235-9e5d-411f-9cb0-a585fbe0ea3a"). InnerVolumeSpecName "kube-api-access-hjd67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:28:02.521429 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.521341    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjd67\" (UniqueName: \"kubernetes.io/projected/f10b1235-9e5d-411f-9cb0-a585fbe0ea3a-kube-api-access-hjd67\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:28:02.521429 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.521375    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6w2f\" (UniqueName: \"kubernetes.io/projected/fecc32cb-dd2d-4125-9411-d4dff27e602c-kube-api-access-m6w2f\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:28:02.593292 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.593260    2576 generic.go:356] "Generic (PLEG): container finished" podID="fecc32cb-dd2d-4125-9411-d4dff27e602c" containerID="885a16c94c09941911a212463b283255ab906d45d8172bea2ae215193c7a8f1b" exitCode=0
Sep 16 12:28:02.593517 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.593309    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb"
Sep 16 12:28:02.593517 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.593355    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb" event={"ID":"fecc32cb-dd2d-4125-9411-d4dff27e602c","Type":"ContainerDied","Data":"885a16c94c09941911a212463b283255ab906d45d8172bea2ae215193c7a8f1b"}
Sep 16 12:28:02.593517 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.593430    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb" event={"ID":"fecc32cb-dd2d-4125-9411-d4dff27e602c","Type":"ContainerDied","Data":"93d8ffb0da11b6efe3f97f76bf0ab76f73c7a78925dfa12ff28b1ddf1e2a7464"}
Sep 16 12:28:02.593517 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.593460    2576 scope.go:117] "RemoveContainer" containerID="885a16c94c09941911a212463b283255ab906d45d8172bea2ae215193c7a8f1b"
Sep 16 12:28:02.596210 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.596185    2576 generic.go:356] "Generic (PLEG): container finished" podID="f10b1235-9e5d-411f-9cb0-a585fbe0ea3a" containerID="7d2c622baf199c5caf7718f92cc5cc9f48afae139445814ea39964781399bf87" exitCode=0
Sep 16 12:28:02.596409 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.596381    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz" event={"ID":"f10b1235-9e5d-411f-9cb0-a585fbe0ea3a","Type":"ContainerDied","Data":"7d2c622baf199c5caf7718f92cc5cc9f48afae139445814ea39964781399bf87"}
Sep 16 12:28:02.596479 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.596448    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz" event={"ID":"f10b1235-9e5d-411f-9cb0-a585fbe0ea3a","Type":"ContainerDied","Data":"dc8dd652cb0355cbcf60b8fc7f9af69aaa005dccac25403459a2896f35df542d"}
Sep 16 12:28:02.596546 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.596294    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz"
Sep 16 12:28:02.605577 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.605558    2576 scope.go:117] "RemoveContainer" containerID="885a16c94c09941911a212463b283255ab906d45d8172bea2ae215193c7a8f1b"
Sep 16 12:28:02.605908 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:28:02.605886    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"885a16c94c09941911a212463b283255ab906d45d8172bea2ae215193c7a8f1b\": container with ID starting with 885a16c94c09941911a212463b283255ab906d45d8172bea2ae215193c7a8f1b not found: ID does not exist" containerID="885a16c94c09941911a212463b283255ab906d45d8172bea2ae215193c7a8f1b"
Sep 16 12:28:02.606039 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.605918    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"885a16c94c09941911a212463b283255ab906d45d8172bea2ae215193c7a8f1b"} err="failed to get container status \"885a16c94c09941911a212463b283255ab906d45d8172bea2ae215193c7a8f1b\": rpc error: code = NotFound desc = could not find container \"885a16c94c09941911a212463b283255ab906d45d8172bea2ae215193c7a8f1b\": container with ID starting with 885a16c94c09941911a212463b283255ab906d45d8172bea2ae215193c7a8f1b not found: ID does not exist"
Sep 16 12:28:02.606039 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.605942    2576 scope.go:117] "RemoveContainer" containerID="7d2c622baf199c5caf7718f92cc5cc9f48afae139445814ea39964781399bf87"
Sep 16 12:28:02.614712 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.614696    2576 scope.go:117] "RemoveContainer" containerID="7d2c622baf199c5caf7718f92cc5cc9f48afae139445814ea39964781399bf87"
Sep 16 12:28:02.614956 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:28:02.614940    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d2c622baf199c5caf7718f92cc5cc9f48afae139445814ea39964781399bf87\": container with ID starting with 7d2c622baf199c5caf7718f92cc5cc9f48afae139445814ea39964781399bf87 not found: ID does not exist" containerID="7d2c622baf199c5caf7718f92cc5cc9f48afae139445814ea39964781399bf87"
Sep 16 12:28:02.615013 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.614961    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d2c622baf199c5caf7718f92cc5cc9f48afae139445814ea39964781399bf87"} err="failed to get container status \"7d2c622baf199c5caf7718f92cc5cc9f48afae139445814ea39964781399bf87\": rpc error: code = NotFound desc = could not find container \"7d2c622baf199c5caf7718f92cc5cc9f48afae139445814ea39964781399bf87\": container with ID starting with 7d2c622baf199c5caf7718f92cc5cc9f48afae139445814ea39964781399bf87 not found: ID does not exist"
Sep 16 12:28:02.619828 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.619806    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb"]
Sep 16 12:28:02.630462 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.630431    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-30f927-6465956ffd-d85hb"]
Sep 16 12:28:02.637142 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.637100    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz"]
Sep 16 12:28:02.643370 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:02.643329    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-30f927-8469cf77f5-wjrcz"]
Sep 16 12:28:04.394529 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:04.394493    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f10b1235-9e5d-411f-9cb0-a585fbe0ea3a" path="/var/lib/kubelet/pods/f10b1235-9e5d-411f-9cb0-a585fbe0ea3a/volumes"
Sep 16 12:28:04.394971 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:04.394953    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fecc32cb-dd2d-4125-9411-d4dff27e602c" path="/var/lib/kubelet/pods/fecc32cb-dd2d-4125-9411-d4dff27e602c/volumes"
Sep 16 12:28:09.088061 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.088024    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-867202-4vz8r"]
Sep 16 12:28:09.088558 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.088545    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5957aadf-0d0e-4877-a886-9be00ff13a82" containerName="payload-pre-processing"
Sep 16 12:28:09.088602 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.088560    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5957aadf-0d0e-4877-a886-9be00ff13a82" containerName="payload-pre-processing"
Sep 16 12:28:09.088602 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.088574    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdb1eb7e-f914-405d-beae-04702f157f5f" containerName="revoke-keys"
Sep 16 12:28:09.088602 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.088579    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdb1eb7e-f914-405d-beae-04702f157f5f" containerName="revoke-keys"
Sep 16 12:28:09.088602 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.088589    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35be3a8f-570c-4921-a90c-3195445dff07" containerName="istio-proxy"
Sep 16 12:28:09.088602 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.088594    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="35be3a8f-570c-4921-a90c-3195445dff07" containerName="istio-proxy"
Sep 16 12:28:09.088602 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.088603    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdf9d313-1e9d-436c-9eed-cafeea130bde" containerName="payload-processing"
Sep 16 12:28:09.088784 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.088609    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdf9d313-1e9d-436c-9eed-cafeea130bde" containerName="payload-processing"
Sep 16 12:28:09.088784 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.088622    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f10b1235-9e5d-411f-9cb0-a585fbe0ea3a" containerName="payload-processing"
Sep 16 12:28:09.088784 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.088627    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f10b1235-9e5d-411f-9cb0-a585fbe0ea3a" containerName="payload-processing"
Sep 16 12:28:09.088784 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.088637    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a26b4581-3386-42e8-8abc-896d8106cc97" containerName="main"
Sep 16 12:28:09.088784 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.088642    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a26b4581-3386-42e8-8abc-896d8106cc97" containerName="main"
Sep 16 12:28:09.088784 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.088656    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fecc32cb-dd2d-4125-9411-d4dff27e602c" containerName="payload-pre-processing"
Sep 16 12:28:09.088784 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.088661    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fecc32cb-dd2d-4125-9411-d4dff27e602c" containerName="payload-pre-processing"
Sep 16 12:28:09.088784 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.088722    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="35be3a8f-570c-4921-a90c-3195445dff07" containerName="istio-proxy"
Sep 16 12:28:09.088784 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.088732    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f10b1235-9e5d-411f-9cb0-a585fbe0ea3a" containerName="payload-processing"
Sep 16 12:28:09.088784 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.088740    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdf9d313-1e9d-436c-9eed-cafeea130bde" containerName="payload-processing"
Sep 16 12:28:09.088784 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.088745    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdb1eb7e-f914-405d-beae-04702f157f5f" containerName="revoke-keys"
Sep 16 12:28:09.088784 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.088751    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fecc32cb-dd2d-4125-9411-d4dff27e602c" containerName="payload-pre-processing"
Sep 16 12:28:09.088784 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.088757    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5957aadf-0d0e-4877-a886-9be00ff13a82" containerName="payload-pre-processing"
Sep 16 12:28:09.088784 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.088762    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a26b4581-3386-42e8-8abc-896d8106cc97" containerName="main"
Sep 16 12:28:09.093809 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.093788    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-867202-4vz8r"
Sep 16 12:28:09.098947 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.098918    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9lc86\""
Sep 16 12:28:09.101269 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.101245    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-867202-4vz8r"]
Sep 16 12:28:09.192365 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.192301    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fcb67f5-aa13-45bf-9d03-8e1592bd0653-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-867202-4vz8r\" (UID: \"9fcb67f5-aa13-45bf-9d03-8e1592bd0653\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-867202-4vz8r"
Sep 16 12:28:09.294031 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.293990    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fcb67f5-aa13-45bf-9d03-8e1592bd0653-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-867202-4vz8r\" (UID: \"9fcb67f5-aa13-45bf-9d03-8e1592bd0653\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-867202-4vz8r"
Sep 16 12:28:09.294839 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.294814    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fcb67f5-aa13-45bf-9d03-8e1592bd0653-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-867202-4vz8r\" (UID: \"9fcb67f5-aa13-45bf-9d03-8e1592bd0653\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-867202-4vz8r"
Sep 16 12:28:09.411720 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.411693    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-867202-4vz8r"
Sep 16 12:28:09.683644 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:09.683617    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-867202-4vz8r"]
Sep 16 12:28:09.685436 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:28:09.685408    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fcb67f5_aa13_45bf_9d03_8e1592bd0653.slice/crio-21f3e98c5dad9f94df4dfa7326642e986fd1a613149fa1e24b471d5acb0d26b5 WatchSource:0}: Error finding container 21f3e98c5dad9f94df4dfa7326642e986fd1a613149fa1e24b471d5acb0d26b5: Status 404 returned error can't find the container with id 21f3e98c5dad9f94df4dfa7326642e986fd1a613149fa1e24b471d5acb0d26b5
Sep 16 12:28:10.653300 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:10.653261    2576 generic.go:356] "Generic (PLEG): container finished" podID="9fcb67f5-aa13-45bf-9d03-8e1592bd0653" containerID="4d5885fcc2c6cd714c68f977096504b90364646d9dbef622d58afa544c62f998" exitCode=0
Sep 16 12:28:10.653928 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:10.653350    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-867202-4vz8r" event={"ID":"9fcb67f5-aa13-45bf-9d03-8e1592bd0653","Type":"ContainerDied","Data":"4d5885fcc2c6cd714c68f977096504b90364646d9dbef622d58afa544c62f998"}
Sep 16 12:28:10.653928 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:10.653411    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-867202-4vz8r" event={"ID":"9fcb67f5-aa13-45bf-9d03-8e1592bd0653","Type":"ContainerStarted","Data":"21f3e98c5dad9f94df4dfa7326642e986fd1a613149fa1e24b471d5acb0d26b5"}
Sep 16 12:28:11.801817 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:11.801795    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-867202-4vz8r"
Sep 16 12:28:11.923918 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:11.923838    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fcb67f5-aa13-45bf-9d03-8e1592bd0653-maas-api-service-ca\") pod \"9fcb67f5-aa13-45bf-9d03-8e1592bd0653\" (UID: \"9fcb67f5-aa13-45bf-9d03-8e1592bd0653\") "
Sep 16 12:28:11.924183 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:11.924158    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fcb67f5-aa13-45bf-9d03-8e1592bd0653-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9fcb67f5-aa13-45bf-9d03-8e1592bd0653" (UID: "9fcb67f5-aa13-45bf-9d03-8e1592bd0653"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:28:11.924355 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:11.924306    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fcb67f5-aa13-45bf-9d03-8e1592bd0653-maas-api-service-ca\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:28:12.668090 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:12.667993    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-867202-4vz8r"
Sep 16 12:28:12.668090 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:12.668026    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-867202-4vz8r" event={"ID":"9fcb67f5-aa13-45bf-9d03-8e1592bd0653","Type":"ContainerDied","Data":"21f3e98c5dad9f94df4dfa7326642e986fd1a613149fa1e24b471d5acb0d26b5"}
Sep 16 12:28:12.668336 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:12.668097    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21f3e98c5dad9f94df4dfa7326642e986fd1a613149fa1e24b471d5acb0d26b5"
Sep 16 12:28:14.646569 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:14.646537    2576 scope.go:117] "RemoveContainer" containerID="4dc0d328122cc96084dda6bd1984e18129f710d444d2aea3780c80f264ecad44"
Sep 16 12:28:19.532651 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:19.532619    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv"]
Sep 16 12:28:19.533129 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:19.532894    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv" podUID="36ac8185-4fbd-4d0d-a883-a539e6425d12" containerName="payload-processing" containerID="cri-o://4473600adb8f6c1bb6f5e82650e7ece764d95688aedab1ec0835415f7e68b3bc" gracePeriod=30
Sep 16 12:28:19.540205 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:19.540175    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24"]
Sep 16 12:28:19.540477 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:19.540427    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24" podUID="41edceca-35d9-4a38-81b9-d460ed9d7b85" containerName="payload-pre-processing" containerID="cri-o://b8946d699385adf5f350b32ccee7f86ee11217180c7fcf71ccac53ae99ccca40" gracePeriod=30
Sep 16 12:28:19.543835 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:19.540634    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv" podUID="36ac8185-4fbd-4d0d-a883-a539e6425d12" containerName="payload-processing" probeResult="failure" output="dial tcp 10.134.0.64:9004: connect: connection refused"
Sep 16 12:28:19.680834 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:19.680605    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-867202-4vz8r"]
Sep 16 12:28:19.684269 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:19.684241    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-867202-4vz8r"]
Sep 16 12:28:19.716718 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:19.716682    2576 generic.go:356] "Generic (PLEG): container finished" podID="41edceca-35d9-4a38-81b9-d460ed9d7b85" containerID="b8946d699385adf5f350b32ccee7f86ee11217180c7fcf71ccac53ae99ccca40" exitCode=0
Sep 16 12:28:19.716872 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:19.716841    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24" event={"ID":"41edceca-35d9-4a38-81b9-d460ed9d7b85","Type":"ContainerDied","Data":"b8946d699385adf5f350b32ccee7f86ee11217180c7fcf71ccac53ae99ccca40"}
Sep 16 12:28:19.718765 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:19.718739    2576 generic.go:356] "Generic (PLEG): container finished" podID="36ac8185-4fbd-4d0d-a883-a539e6425d12" containerID="4473600adb8f6c1bb6f5e82650e7ece764d95688aedab1ec0835415f7e68b3bc" exitCode=0
Sep 16 12:28:19.718893 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:19.718816    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv" event={"ID":"36ac8185-4fbd-4d0d-a883-a539e6425d12","Type":"ContainerDied","Data":"4473600adb8f6c1bb6f5e82650e7ece764d95688aedab1ec0835415f7e68b3bc"}
Sep 16 12:28:19.845377 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:19.845354    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv"
Sep 16 12:28:19.848438 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:19.848418    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24"
Sep 16 12:28:20.003826 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:20.003801    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36ac8185-4fbd-4d0d-a883-a539e6425d12-plugins-config-volume\") pod \"36ac8185-4fbd-4d0d-a883-a539e6425d12\" (UID: \"36ac8185-4fbd-4d0d-a883-a539e6425d12\") "
Sep 16 12:28:20.004010 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:20.003896    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqrzx\" (UniqueName: \"kubernetes.io/projected/41edceca-35d9-4a38-81b9-d460ed9d7b85-kube-api-access-hqrzx\") pod \"41edceca-35d9-4a38-81b9-d460ed9d7b85\" (UID: \"41edceca-35d9-4a38-81b9-d460ed9d7b85\") "
Sep 16 12:28:20.004010 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:20.003977    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41edceca-35d9-4a38-81b9-d460ed9d7b85-plugins-config-volume\") pod \"41edceca-35d9-4a38-81b9-d460ed9d7b85\" (UID: \"41edceca-35d9-4a38-81b9-d460ed9d7b85\") "
Sep 16 12:28:20.004099 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:20.004034    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2fxg\" (UniqueName: \"kubernetes.io/projected/36ac8185-4fbd-4d0d-a883-a539e6425d12-kube-api-access-l2fxg\") pod \"36ac8185-4fbd-4d0d-a883-a539e6425d12\" (UID: \"36ac8185-4fbd-4d0d-a883-a539e6425d12\") "
Sep 16 12:28:20.004377 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:20.004309    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36ac8185-4fbd-4d0d-a883-a539e6425d12-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "36ac8185-4fbd-4d0d-a883-a539e6425d12" (UID: "36ac8185-4fbd-4d0d-a883-a539e6425d12"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:28:20.004377 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:20.004352    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41edceca-35d9-4a38-81b9-d460ed9d7b85-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "41edceca-35d9-4a38-81b9-d460ed9d7b85" (UID: "41edceca-35d9-4a38-81b9-d460ed9d7b85"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:28:20.004546 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:20.004452    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41edceca-35d9-4a38-81b9-d460ed9d7b85-plugins-config-volume\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:28:20.004546 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:20.004465    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36ac8185-4fbd-4d0d-a883-a539e6425d12-plugins-config-volume\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:28:20.006232 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:20.006208    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36ac8185-4fbd-4d0d-a883-a539e6425d12-kube-api-access-l2fxg" (OuterVolumeSpecName: "kube-api-access-l2fxg") pod "36ac8185-4fbd-4d0d-a883-a539e6425d12" (UID: "36ac8185-4fbd-4d0d-a883-a539e6425d12"). InnerVolumeSpecName "kube-api-access-l2fxg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:28:20.006338 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:20.006308    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41edceca-35d9-4a38-81b9-d460ed9d7b85-kube-api-access-hqrzx" (OuterVolumeSpecName: "kube-api-access-hqrzx") pod "41edceca-35d9-4a38-81b9-d460ed9d7b85" (UID: "41edceca-35d9-4a38-81b9-d460ed9d7b85"). InnerVolumeSpecName "kube-api-access-hqrzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:28:20.106072 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:20.106049    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2fxg\" (UniqueName: \"kubernetes.io/projected/36ac8185-4fbd-4d0d-a883-a539e6425d12-kube-api-access-l2fxg\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:28:20.106238 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:20.106076    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqrzx\" (UniqueName: \"kubernetes.io/projected/41edceca-35d9-4a38-81b9-d460ed9d7b85-kube-api-access-hqrzx\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:28:20.395300 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:20.395214    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fcb67f5-aa13-45bf-9d03-8e1592bd0653" path="/var/lib/kubelet/pods/9fcb67f5-aa13-45bf-9d03-8e1592bd0653/volumes"
Sep 16 12:28:20.726794 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:20.726704    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24" event={"ID":"41edceca-35d9-4a38-81b9-d460ed9d7b85","Type":"ContainerDied","Data":"30107a0e7dae15493ee193004aff2baa9d37a58a6bb150b6913b818868e0a89b"}
Sep 16 12:28:20.726794 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:20.726714    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24"
Sep 16 12:28:20.727296 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:20.726777    2576 scope.go:117] "RemoveContainer" containerID="b8946d699385adf5f350b32ccee7f86ee11217180c7fcf71ccac53ae99ccca40"
Sep 16 12:28:20.728359 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:20.728289    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv" event={"ID":"36ac8185-4fbd-4d0d-a883-a539e6425d12","Type":"ContainerDied","Data":"f369fcbdd8f35670d1ca030ed34fec05805c78c73410767728b387ce314a5150"}
Sep 16 12:28:20.728359 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:20.728302    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv"
Sep 16 12:28:20.736526 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:20.736508    2576 scope.go:117] "RemoveContainer" containerID="4473600adb8f6c1bb6f5e82650e7ece764d95688aedab1ec0835415f7e68b3bc"
Sep 16 12:28:20.746652 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:20.746633    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv"]
Sep 16 12:28:20.750127 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:20.750106    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-867202-546f59fdd9-t8spv"]
Sep 16 12:28:20.765454 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:20.765432    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24"]
Sep 16 12:28:20.779467 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:20.779446    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-867202-d4d69bb5d-9dh24"]
Sep 16 12:28:22.394044 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:22.394012    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36ac8185-4fbd-4d0d-a883-a539e6425d12" path="/var/lib/kubelet/pods/36ac8185-4fbd-4d0d-a883-a539e6425d12/volumes"
Sep 16 12:28:22.394431 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:22.394400    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41edceca-35d9-4a38-81b9-d460ed9d7b85" path="/var/lib/kubelet/pods/41edceca-35d9-4a38-81b9-d460ed9d7b85/volumes"
Sep 16 12:28:26.686135 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:26.686100    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-6f8610-pjjlg"]
Sep 16 12:28:26.686637 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:26.686620    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36ac8185-4fbd-4d0d-a883-a539e6425d12" containerName="payload-processing"
Sep 16 12:28:26.686689 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:26.686641    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="36ac8185-4fbd-4d0d-a883-a539e6425d12" containerName="payload-processing"
Sep 16 12:28:26.686689 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:26.686660    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41edceca-35d9-4a38-81b9-d460ed9d7b85" containerName="payload-pre-processing"
Sep 16 12:28:26.686689 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:26.686668    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="41edceca-35d9-4a38-81b9-d460ed9d7b85" containerName="payload-pre-processing"
Sep 16 12:28:26.686689 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:26.686682    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35be3a8f-570c-4921-a90c-3195445dff07" containerName="istio-proxy"
Sep 16 12:28:26.686815 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:26.686690    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="35be3a8f-570c-4921-a90c-3195445dff07" containerName="istio-proxy"
Sep 16 12:28:26.686815 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:26.686711    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fcb67f5-aa13-45bf-9d03-8e1592bd0653" containerName="revoke-keys"
Sep 16 12:28:26.686815 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:26.686718    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fcb67f5-aa13-45bf-9d03-8e1592bd0653" containerName="revoke-keys"
Sep 16 12:28:26.686908 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:26.686867    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="35be3a8f-570c-4921-a90c-3195445dff07" containerName="istio-proxy"
Sep 16 12:28:26.686908 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:26.686885    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="41edceca-35d9-4a38-81b9-d460ed9d7b85" containerName="payload-pre-processing"
Sep 16 12:28:26.686908 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:26.686896    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="36ac8185-4fbd-4d0d-a883-a539e6425d12" containerName="payload-processing"
Sep 16 12:28:26.686908 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:26.686906    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fcb67f5-aa13-45bf-9d03-8e1592bd0653" containerName="revoke-keys"
Sep 16 12:28:26.691794 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:26.691776    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-6f8610-pjjlg"
Sep 16 12:28:26.694347 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:26.694297    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9lc86\""
Sep 16 12:28:26.699446 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:26.699423    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-6f8610-pjjlg"]
Sep 16 12:28:26.772170 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:26.772140    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21897c0c-dd8b-4b96-a7e4-e532b66a1909-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-6f8610-pjjlg\" (UID: \"21897c0c-dd8b-4b96-a7e4-e532b66a1909\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-6f8610-pjjlg"
Sep 16 12:28:26.873037 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:26.873006    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21897c0c-dd8b-4b96-a7e4-e532b66a1909-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-6f8610-pjjlg\" (UID: \"21897c0c-dd8b-4b96-a7e4-e532b66a1909\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-6f8610-pjjlg"
Sep 16 12:28:26.873673 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:26.873652    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21897c0c-dd8b-4b96-a7e4-e532b66a1909-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-6f8610-pjjlg\" (UID: \"21897c0c-dd8b-4b96-a7e4-e532b66a1909\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-6f8610-pjjlg"
Sep 16 12:28:27.006014 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:27.005940    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-6f8610-pjjlg"
Sep 16 12:28:27.283749 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:27.283725    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-6f8610-pjjlg"]
Sep 16 12:28:27.286487 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:28:27.286456    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21897c0c_dd8b_4b96_a7e4_e532b66a1909.slice/crio-2b148b7879e92bd39870956000d184db8627a844ebcfdb669ec13e1dd56e4a97 WatchSource:0}: Error finding container 2b148b7879e92bd39870956000d184db8627a844ebcfdb669ec13e1dd56e4a97: Status 404 returned error can't find the container with id 2b148b7879e92bd39870956000d184db8627a844ebcfdb669ec13e1dd56e4a97
Sep 16 12:28:27.776933 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:27.776890    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-6f8610-pjjlg" event={"ID":"21897c0c-dd8b-4b96-a7e4-e532b66a1909","Type":"ContainerStarted","Data":"c8406b0e0da46fcca850a9e1e78af695203d9da962b01a1e0fef3e783726ebe4"}
Sep 16 12:28:27.777420 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:27.776946    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-6f8610-pjjlg" event={"ID":"21897c0c-dd8b-4b96-a7e4-e532b66a1909","Type":"ContainerStarted","Data":"2b148b7879e92bd39870956000d184db8627a844ebcfdb669ec13e1dd56e4a97"}
Sep 16 12:28:27.799416 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:27.799354    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-6f8610-pjjlg" podStartSLOduration=1.7993006839999999 podStartE2EDuration="1.799300684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:28:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:28:27.79811551 +0000 UTC m=+1573.967080211" watchObservedRunningTime="2026-09-16 12:28:27.799300684 +0000 UTC m=+1573.968265394"
Sep 16 12:28:28.785358 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:28.785296    2576 generic.go:356] "Generic (PLEG): container finished" podID="21897c0c-dd8b-4b96-a7e4-e532b66a1909" containerID="c8406b0e0da46fcca850a9e1e78af695203d9da962b01a1e0fef3e783726ebe4" exitCode=0
Sep 16 12:28:28.785758 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:28.785384    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-6f8610-pjjlg" event={"ID":"21897c0c-dd8b-4b96-a7e4-e532b66a1909","Type":"ContainerDied","Data":"c8406b0e0da46fcca850a9e1e78af695203d9da962b01a1e0fef3e783726ebe4"}
Sep 16 12:28:29.937304 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:29.937281    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-6f8610-pjjlg"
Sep 16 12:28:30.007508 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:30.007478    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21897c0c-dd8b-4b96-a7e4-e532b66a1909-maas-api-service-ca\") pod \"21897c0c-dd8b-4b96-a7e4-e532b66a1909\" (UID: \"21897c0c-dd8b-4b96-a7e4-e532b66a1909\") "
Sep 16 12:28:30.007881 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:30.007854    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21897c0c-dd8b-4b96-a7e4-e532b66a1909-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "21897c0c-dd8b-4b96-a7e4-e532b66a1909" (UID: "21897c0c-dd8b-4b96-a7e4-e532b66a1909"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:28:30.109041 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:30.109014    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21897c0c-dd8b-4b96-a7e4-e532b66a1909-maas-api-service-ca\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:28:30.799136 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:30.799061    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-6f8610-pjjlg"
Sep 16 12:28:30.799136 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:30.799088    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-6f8610-pjjlg" event={"ID":"21897c0c-dd8b-4b96-a7e4-e532b66a1909","Type":"ContainerDied","Data":"2b148b7879e92bd39870956000d184db8627a844ebcfdb669ec13e1dd56e4a97"}
Sep 16 12:28:30.799136 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:30.799130    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b148b7879e92bd39870956000d184db8627a844ebcfdb669ec13e1dd56e4a97"
Sep 16 12:28:37.363536 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:37.363492    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-6f8610-pjjlg"]
Sep 16 12:28:37.365486 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:37.365463    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-6f8610-pjjlg"]
Sep 16 12:28:38.394171 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:38.394134    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21897c0c-dd8b-4b96-a7e4-e532b66a1909" path="/var/lib/kubelet/pods/21897c0c-dd8b-4b96-a7e4-e532b66a1909/volumes"
Sep 16 12:28:38.747045 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:38.746963    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"]
Sep 16 12:28:53.767102 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:53.767059    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph" podUID="449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56" containerName="main" containerID="cri-o://1f6165d9cba788375e2888254ede63a580eb3497acb6d3208560bf60fe797b42" gracePeriod=45
Sep 16 12:28:53.935343 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:53.935292    2576 generic.go:356] "Generic (PLEG): container finished" podID="449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56" containerID="1f6165d9cba788375e2888254ede63a580eb3497acb6d3208560bf60fe797b42" exitCode=0
Sep 16 12:28:53.935480 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:53.935356    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph" event={"ID":"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56","Type":"ContainerDied","Data":"1f6165d9cba788375e2888254ede63a580eb3497acb6d3208560bf60fe797b42"}
Sep 16 12:28:54.016783 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:54.016756    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"
Sep 16 12:28:54.148057 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:54.148028    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-model-cache\") pod \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\" (UID: \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\") "
Sep 16 12:28:54.148242 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:54.148117    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-tmp-dir\") pod \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\" (UID: \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\") "
Sep 16 12:28:54.148242 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:54.148169    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x87rv\" (UniqueName: \"kubernetes.io/projected/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-kube-api-access-x87rv\") pod \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\" (UID: \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\") "
Sep 16 12:28:54.148242 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:54.148213    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-home\") pod \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\" (UID: \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\") "
Sep 16 12:28:54.148460 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:54.148277    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-tls-certs\") pod \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\" (UID: \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\") "
Sep 16 12:28:54.148460 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:54.148294    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-model-cache" (OuterVolumeSpecName: "model-cache") pod "449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56" (UID: "449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:28:54.148460 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:54.148370    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-dshm\") pod \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\" (UID: \"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56\") "
Sep 16 12:28:54.148460 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:54.148424    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56" (UID: "449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:28:54.148662 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:54.148560    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-home" (OuterVolumeSpecName: "home") pod "449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56" (UID: "449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:28:54.148709 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:54.148697    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-tmp-dir\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:28:54.148745 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:54.148711    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-home\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:28:54.148745 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:54.148719    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-model-cache\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:28:54.150773 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:54.150748    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-dshm" (OuterVolumeSpecName: "dshm") pod "449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56" (UID: "449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:28:54.150773 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:54.150754    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56" (UID: "449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:28:54.150773 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:54.150767    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-kube-api-access-x87rv" (OuterVolumeSpecName: "kube-api-access-x87rv") pod "449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56" (UID: "449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56"). InnerVolumeSpecName "kube-api-access-x87rv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:28:54.249809 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:54.249765    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-tls-certs\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:28:54.249809 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:54.249801    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-dshm\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:28:54.249809 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:54.249814    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x87rv\" (UniqueName: \"kubernetes.io/projected/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56-kube-api-access-x87rv\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:28:54.942866 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:54.942833    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"
Sep 16 12:28:54.942866 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:54.942845    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph" event={"ID":"449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56","Type":"ContainerDied","Data":"f5442328b09f647f738bd17f6a8941290c8ecca2f12453721959ad331c8408e5"}
Sep 16 12:28:54.943415 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:54.942895    2576 scope.go:117] "RemoveContainer" containerID="1f6165d9cba788375e2888254ede63a580eb3497acb6d3208560bf60fe797b42"
Sep 16 12:28:54.960201 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:54.960169    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"]
Sep 16 12:28:54.964271 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:54.964249    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w2-db42a6/auth-test-model-db42a6-kserve-54b87d7d67-4qxph"]
Sep 16 12:28:56.394755 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:28:56.394725    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56" path="/var/lib/kubelet/pods/449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56/volumes"
Sep 16 12:30:00.134741 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:00.134697    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826030-4rx9l"]
Sep 16 12:30:00.135501 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:00.135482    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56" containerName="main"
Sep 16 12:30:00.135573 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:00.135505    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56" containerName="main"
Sep 16 12:30:00.135573 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:00.135547    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21897c0c-dd8b-4b96-a7e4-e532b66a1909" containerName="revoke-keys"
Sep 16 12:30:00.135573 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:00.135555    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="21897c0c-dd8b-4b96-a7e4-e532b66a1909" containerName="revoke-keys"
Sep 16 12:30:00.135692 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:00.135679    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="449ac1c1-1ffd-46ec-aeac-5bb0eb4e1a56" containerName="main"
Sep 16 12:30:00.135737 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:00.135702    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="21897c0c-dd8b-4b96-a7e4-e532b66a1909" containerName="revoke-keys"
Sep 16 12:30:00.139366 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:00.139350    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-db42a6-29826030-5v2j9"]
Sep 16 12:30:00.139431 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:00.139413    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826030-4rx9l"
Sep 16 12:30:00.142051 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:00.142029    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9lc86\""
Sep 16 12:30:00.143032 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:00.143018    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-db42a6-29826030-5v2j9"
Sep 16 12:30:00.150604 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:00.149231    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826030-4rx9l"]
Sep 16 12:30:00.152236 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:00.152212    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-db42a6-29826030-5v2j9"]
Sep 16 12:30:00.154582 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:00.154563    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826030-4rx9l"
Sep 16 12:30:00.163046 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:00.163026    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-db42a6-29826030-5v2j9"
Sep 16 12:30:00.436897 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:00.436876    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826030-4rx9l"]
Sep 16 12:30:00.439202 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:30:00.439167    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod967110bc_c9ad_45ef_9be0_ebd61e14adc9.slice/crio-6c80128ddad32e06a92c27fdf2a14d30e768c8f0163d2c7dc456791944cd592e WatchSource:0}: Error finding container 6c80128ddad32e06a92c27fdf2a14d30e768c8f0163d2c7dc456791944cd592e: Status 404 returned error can't find the container with id 6c80128ddad32e06a92c27fdf2a14d30e768c8f0163d2c7dc456791944cd592e
Sep 16 12:30:00.450583 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:00.450557    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-db42a6-29826030-5v2j9"]
Sep 16 12:30:00.457114 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:30:00.457084    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d2b64bf_2a2f_476b_a154_591d71d909e9.slice/crio-1881eda27c2fdc796c2f19f4c6b8aabeb3e8ccf10f4ea76211c4df91f91f962d WatchSource:0}: Error finding container 1881eda27c2fdc796c2f19f4c6b8aabeb3e8ccf10f4ea76211c4df91f91f962d: Status 404 returned error can't find the container with id 1881eda27c2fdc796c2f19f4c6b8aabeb3e8ccf10f4ea76211c4df91f91f962d
Sep 16 12:30:01.314220 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:01.314186    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-db42a6-29826030-5v2j9" event={"ID":"2d2b64bf-2a2f-476b-a154-591d71d909e9","Type":"ContainerStarted","Data":"02588fd317ec5d4d1933f52b84dac3551d1330b2d57c45165098f325139f6929"}
Sep 16 12:30:01.314656 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:01.314247    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-db42a6-29826030-5v2j9" event={"ID":"2d2b64bf-2a2f-476b-a154-591d71d909e9","Type":"ContainerStarted","Data":"1881eda27c2fdc796c2f19f4c6b8aabeb3e8ccf10f4ea76211c4df91f91f962d"}
Sep 16 12:30:01.316135 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:01.316103    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826030-4rx9l" event={"ID":"967110bc-c9ad-45ef-9be0-ebd61e14adc9","Type":"ContainerStarted","Data":"a5eeeeeba19806dfd42ed4b609b19216b29d5c39384ea0e43e5b893428b1bd9a"}
Sep 16 12:30:01.316255 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:01.316162    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826030-4rx9l" event={"ID":"967110bc-c9ad-45ef-9be0-ebd61e14adc9","Type":"ContainerStarted","Data":"6c80128ddad32e06a92c27fdf2a14d30e768c8f0163d2c7dc456791944cd592e"}
Sep 16 12:30:01.328992 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:01.328950    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-db42a6-29826030-5v2j9" podStartSLOduration=1.328933291 podStartE2EDuration="1.328933291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:30:01.327943827 +0000 UTC m=+1667.496908534" watchObservedRunningTime="2026-09-16 12:30:01.328933291 +0000 UTC m=+1667.497897997"
Sep 16 12:30:01.341716 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:01.341668    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826030-4rx9l" podStartSLOduration=1.341652568 podStartE2EDuration="1.341652568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:30:01.340725455 +0000 UTC m=+1667.509690162" watchObservedRunningTime="2026-09-16 12:30:01.341652568 +0000 UTC m=+1667.510617305"
Sep 16 12:30:02.322712 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:02.322676    2576 generic.go:356] "Generic (PLEG): container finished" podID="2d2b64bf-2a2f-476b-a154-591d71d909e9" containerID="02588fd317ec5d4d1933f52b84dac3551d1330b2d57c45165098f325139f6929" exitCode=0
Sep 16 12:30:02.323138 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:02.322769    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-db42a6-29826030-5v2j9" event={"ID":"2d2b64bf-2a2f-476b-a154-591d71d909e9","Type":"ContainerDied","Data":"02588fd317ec5d4d1933f52b84dac3551d1330b2d57c45165098f325139f6929"}
Sep 16 12:30:02.324349 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:02.324310    2576 generic.go:356] "Generic (PLEG): container finished" podID="967110bc-c9ad-45ef-9be0-ebd61e14adc9" containerID="a5eeeeeba19806dfd42ed4b609b19216b29d5c39384ea0e43e5b893428b1bd9a" exitCode=0
Sep 16 12:30:02.324469 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:02.324402    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826030-4rx9l" event={"ID":"967110bc-c9ad-45ef-9be0-ebd61e14adc9","Type":"ContainerDied","Data":"a5eeeeeba19806dfd42ed4b609b19216b29d5c39384ea0e43e5b893428b1bd9a"}
Sep 16 12:30:03.464094 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:03.464068    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-db42a6-29826030-5v2j9"
Sep 16 12:30:03.509747 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:03.509720    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826030-4rx9l"
Sep 16 12:30:04.336996 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:04.336966    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-db42a6-29826030-5v2j9"
Sep 16 12:30:04.336996 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:04.336975    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-db42a6-29826030-5v2j9" event={"ID":"2d2b64bf-2a2f-476b-a154-591d71d909e9","Type":"ContainerDied","Data":"1881eda27c2fdc796c2f19f4c6b8aabeb3e8ccf10f4ea76211c4df91f91f962d"}
Sep 16 12:30:04.337216 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:04.337014    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1881eda27c2fdc796c2f19f4c6b8aabeb3e8ccf10f4ea76211c4df91f91f962d"
Sep 16 12:30:04.338502 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:04.338480    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826030-4rx9l" event={"ID":"967110bc-c9ad-45ef-9be0-ebd61e14adc9","Type":"ContainerDied","Data":"6c80128ddad32e06a92c27fdf2a14d30e768c8f0163d2c7dc456791944cd592e"}
Sep 16 12:30:04.338502 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:04.338492    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826030-4rx9l"
Sep 16 12:30:04.338688 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:30:04.338513    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c80128ddad32e06a92c27fdf2a14d30e768c8f0163d2c7dc456791944cd592e"
Sep 16 12:31:14.743696 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:31:14.743660    2576 scope.go:117] "RemoveContainer" containerID="d9b873a94cc162fe829b18f67255e6cb7a2949fe14b4590289d1620bfd067263"
Sep 16 12:32:14.503487 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:14.503462    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tb7dg_fb6b35a8-78d4-40b2-a087-7b45e92b2234/ovn-acl-logging/0.log"
Sep 16 12:32:14.505594 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:14.505565    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tb7dg_fb6b35a8-78d4-40b2-a087-7b45e92b2234/ovn-acl-logging/0.log"
Sep 16 12:32:22.887339 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:22.887277    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"]
Sep 16 12:32:22.887869 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:22.887851    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="967110bc-c9ad-45ef-9be0-ebd61e14adc9" containerName="cleanup"
Sep 16 12:32:22.887922 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:22.887871    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="967110bc-c9ad-45ef-9be0-ebd61e14adc9" containerName="cleanup"
Sep 16 12:32:22.887922 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:22.887886    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d2b64bf-2a2f-476b-a154-591d71d909e9" containerName="cleanup"
Sep 16 12:32:22.887922 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:22.887893    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d2b64bf-2a2f-476b-a154-591d71d909e9" containerName="cleanup"
Sep 16 12:32:22.888026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:22.887966    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="967110bc-c9ad-45ef-9be0-ebd61e14adc9" containerName="cleanup"
Sep 16 12:32:22.888026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:22.887980    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d2b64bf-2a2f-476b-a154-591d71d909e9" containerName="cleanup"
Sep 16 12:32:22.891216 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:22.891200    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:22.894211 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:22.894191    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-a4f954-openshift-default-dockercfg-nhgrr\""
Sep 16 12:32:22.902954 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:22.902930    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"]
Sep 16 12:32:22.984015 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:22.983971    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-istio-envoy\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:22.984367 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:22.984344    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-workload-socket\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:22.984571 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:22.984542    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15711897-0941-4e50-b5ec-8cf72c65d30b-istiod-ca-cert\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:22.984772 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:22.984708    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-credential-socket\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:22.984772 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:22.984750    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15711897-0941-4e50-b5ec-8cf72c65d30b-istio-token\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:22.984957 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:22.984789    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-istio-data\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:22.984957 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:22.984832    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15711897-0941-4e50-b5ec-8cf72c65d30b-istio-podinfo\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:22.984957 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:22.984864    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-workload-certs\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:22.984957 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:22.984891    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vttzs\" (UniqueName: \"kubernetes.io/projected/15711897-0941-4e50-b5ec-8cf72c65d30b-kube-api-access-vttzs\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:23.085518 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:23.085475    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15711897-0941-4e50-b5ec-8cf72c65d30b-istiod-ca-cert\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:23.085717 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:23.085561    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-credential-socket\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:23.085717 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:23.085583    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15711897-0941-4e50-b5ec-8cf72c65d30b-istio-token\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:23.085717 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:23.085603    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-istio-data\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:23.085717 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:23.085628    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15711897-0941-4e50-b5ec-8cf72c65d30b-istio-podinfo\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:23.085717 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:23.085648    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-workload-certs\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:23.085717 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:23.085664    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vttzs\" (UniqueName: \"kubernetes.io/projected/15711897-0941-4e50-b5ec-8cf72c65d30b-kube-api-access-vttzs\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:23.086047 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:23.085834    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-istio-envoy\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:23.086047 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:23.085892    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-workload-socket\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:23.086047 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:23.086013    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-credential-socket\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:23.086168 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:23.086058    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-workload-certs\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:23.086267 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:23.086250    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-istio-data\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:23.086374 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:23.086277    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-workload-socket\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:23.086374 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:23.086303    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15711897-0941-4e50-b5ec-8cf72c65d30b-istiod-ca-cert\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:23.088194 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:23.088174    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-istio-envoy\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:23.088425 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:23.088408    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15711897-0941-4e50-b5ec-8cf72c65d30b-istio-podinfo\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:23.100921 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:23.100895    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15711897-0941-4e50-b5ec-8cf72c65d30b-istio-token\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:23.101409 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:23.101387    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vttzs\" (UniqueName: \"kubernetes.io/projected/15711897-0941-4e50-b5ec-8cf72c65d30b-kube-api-access-vttzs\") pod \"e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") " pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:23.202924 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:23.202845    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:23.485471 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:23.485441    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"]
Sep 16 12:32:23.488510 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:32:23.488483    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15711897_0941_4e50_b5ec_8cf72c65d30b.slice/crio-aa12b18c73b30a2f6a8e8017c6cf21232e15efaa42acc43d6f1bac5a26379e7a WatchSource:0}: Error finding container aa12b18c73b30a2f6a8e8017c6cf21232e15efaa42acc43d6f1bac5a26379e7a: Status 404 returned error can't find the container with id aa12b18c73b30a2f6a8e8017c6cf21232e15efaa42acc43d6f1bac5a26379e7a
Sep 16 12:32:23.490734 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:23.490696    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:32:23.490820 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:23.490759    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:32:23.490820 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:23.490786    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:32:24.135707 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:24.135673    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9" event={"ID":"15711897-0941-4e50-b5ec-8cf72c65d30b","Type":"ContainerStarted","Data":"b671540c67175af6d6fe62a3b8c74c5652a7abb2687f44e34ad1d0b4f279be40"}
Sep 16 12:32:24.136227 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:24.135728    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9" event={"ID":"15711897-0941-4e50-b5ec-8cf72c65d30b","Type":"ContainerStarted","Data":"aa12b18c73b30a2f6a8e8017c6cf21232e15efaa42acc43d6f1bac5a26379e7a"}
Sep 16 12:32:24.158118 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:24.158065    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9" podStartSLOduration=2.158051126 podStartE2EDuration="2.158051126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:32:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:32:24.155656039 +0000 UTC m=+1810.324620758" watchObservedRunningTime="2026-09-16 12:32:24.158051126 +0000 UTC m=+1810.327015832"
Sep 16 12:32:24.203381 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:24.203354    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:24.208581 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:24.208556    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:25.141384 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:25.141353    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:25.142309 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:25.142288    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:28.879858 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:28.879825    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897"]
Sep 16 12:32:28.883985 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:28.883964    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897"
Sep 16 12:32:28.887264 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:28.887247    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-a4f954\""
Sep 16 12:32:28.887383 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:28.887271    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-a4f954-dockercfg-kkbxk\""
Sep 16 12:32:28.898172 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:28.898146    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897"]
Sep 16 12:32:28.945820 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:28.945786    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897\" (UID: \"75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897"
Sep 16 12:32:28.946012 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:28.945974    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mkxk\" (UniqueName: \"kubernetes.io/projected/75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe-kube-api-access-8mkxk\") pod \"payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897\" (UID: \"75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897"
Sep 16 12:32:29.047372 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:29.047333    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mkxk\" (UniqueName: \"kubernetes.io/projected/75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe-kube-api-access-8mkxk\") pod \"payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897\" (UID: \"75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897"
Sep 16 12:32:29.047616 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:29.047420    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897\" (UID: \"75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897"
Sep 16 12:32:29.048381 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:29.048359    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897\" (UID: \"75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897"
Sep 16 12:32:29.059555 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:29.059526    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mkxk\" (UniqueName: \"kubernetes.io/projected/75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe-kube-api-access-8mkxk\") pod \"payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897\" (UID: \"75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897"
Sep 16 12:32:29.195952 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:29.195868    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897"
Sep 16 12:32:29.475000 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:29.474905    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897"]
Sep 16 12:32:29.477536 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:32:29.477510    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75ed2a08_7c7d_48f3_8ce7_cead5a7fd1fe.slice/crio-1316b0bf955672a9668f78ce7eaf8a177b9a9a8ffe1264c8d6994c56217da6f4 WatchSource:0}: Error finding container 1316b0bf955672a9668f78ce7eaf8a177b9a9a8ffe1264c8d6994c56217da6f4: Status 404 returned error can't find the container with id 1316b0bf955672a9668f78ce7eaf8a177b9a9a8ffe1264c8d6994c56217da6f4
Sep 16 12:32:30.173253 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:30.173215    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897" event={"ID":"75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe","Type":"ContainerStarted","Data":"ef5b958ff5bb823221ef730abdd5561ee9d499d36aaf197d7274e09bbb3b82f9"}
Sep 16 12:32:30.173697 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:30.173275    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897" event={"ID":"75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe","Type":"ContainerStarted","Data":"1316b0bf955672a9668f78ce7eaf8a177b9a9a8ffe1264c8d6994c56217da6f4"}
Sep 16 12:32:30.173697 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:30.173329    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897"
Sep 16 12:32:30.190205 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:30.190159    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897" podStartSLOduration=2.190145387 podStartE2EDuration="2.190145387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:32:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:32:30.189164389 +0000 UTC m=+1816.358129096" watchObservedRunningTime="2026-09-16 12:32:30.190145387 +0000 UTC m=+1816.359110122"
Sep 16 12:32:41.183465 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:41.183424    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 12:32:41.183899 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:41.183487    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9" podUID="15711897-0941-4e50-b5ec-8cf72c65d30b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 12:32:41.188208 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:41.188185    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897"
Sep 16 12:32:42.260117 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:42.260087    2576 generic.go:356] "Generic (PLEG): container finished" podID="15711897-0941-4e50-b5ec-8cf72c65d30b" containerID="b671540c67175af6d6fe62a3b8c74c5652a7abb2687f44e34ad1d0b4f279be40" exitCode=0
Sep 16 12:32:42.260557 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:42.260128    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9" event={"ID":"15711897-0941-4e50-b5ec-8cf72c65d30b","Type":"ContainerDied","Data":"b671540c67175af6d6fe62a3b8c74c5652a7abb2687f44e34ad1d0b4f279be40"}
Sep 16 12:32:42.260613 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:42.260574    2576 scope.go:117] "RemoveContainer" containerID="b671540c67175af6d6fe62a3b8c74c5652a7abb2687f44e34ad1d0b4f279be40"
Sep 16 12:32:42.261795 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:42.261767    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:32:42.261855 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:42.261839    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:32:42.261900 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:42.261872    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:32:43.268067 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:43.268033    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9" event={"ID":"15711897-0941-4e50-b5ec-8cf72c65d30b","Type":"ContainerStarted","Data":"8bf8064efb5238ac5bddedfbfcd28e1c83b20fd0129afe6b7d052c52124a805f"}
Sep 16 12:32:44.203584 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:44.203537    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:44.204029 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:44.203995    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Sep 16 12:32:44.204155 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:44.204064    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9" podUID="15711897-0941-4e50-b5ec-8cf72c65d30b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Sep 16 12:32:45.204037 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:45.203542    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Sep 16 12:32:45.204037 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:45.203608    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9" podUID="15711897-0941-4e50-b5ec-8cf72c65d30b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Sep 16 12:32:46.203519 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:46.203474    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Sep 16 12:32:46.203746 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:46.203546    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9" podUID="15711897-0941-4e50-b5ec-8cf72c65d30b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Sep 16 12:32:47.203934 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:47.203898    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Sep 16 12:32:47.204537 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:47.204506    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9" podUID="15711897-0941-4e50-b5ec-8cf72c65d30b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Sep 16 12:32:48.204294 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:48.204246    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Sep 16 12:32:48.204822 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:48.204342    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9" podUID="15711897-0941-4e50-b5ec-8cf72c65d30b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Sep 16 12:32:49.206649 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:49.206619    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:49.207122 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:49.207000    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:49.207632 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:49.207617    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:32:58.117426 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:58.117375    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk"]
Sep 16 12:32:58.123360 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:58.123305    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk"
Sep 16 12:32:58.126242 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:58.126216    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-3863e0\""
Sep 16 12:32:58.126404 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:58.126296    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-3863e0-dockercfg-fqtj5\""
Sep 16 12:32:58.132219 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:58.132199    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk"]
Sep 16 12:32:58.164557 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:58.164528    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjl6h\" (UniqueName: \"kubernetes.io/projected/b7a5bb9d-d218-4c4b-b914-ee401a0e1e52-kube-api-access-cjl6h\") pod \"payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk\" (UID: \"b7a5bb9d-d218-4c4b-b914-ee401a0e1e52\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk"
Sep 16 12:32:58.164711 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:58.164575    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7a5bb9d-d218-4c4b-b914-ee401a0e1e52-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk\" (UID: \"b7a5bb9d-d218-4c4b-b914-ee401a0e1e52\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk"
Sep 16 12:32:58.265838 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:58.265804    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjl6h\" (UniqueName: \"kubernetes.io/projected/b7a5bb9d-d218-4c4b-b914-ee401a0e1e52-kube-api-access-cjl6h\") pod \"payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk\" (UID: \"b7a5bb9d-d218-4c4b-b914-ee401a0e1e52\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk"
Sep 16 12:32:58.266012 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:58.265853    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7a5bb9d-d218-4c4b-b914-ee401a0e1e52-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk\" (UID: \"b7a5bb9d-d218-4c4b-b914-ee401a0e1e52\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk"
Sep 16 12:32:58.266686 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:58.266664    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7a5bb9d-d218-4c4b-b914-ee401a0e1e52-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk\" (UID: \"b7a5bb9d-d218-4c4b-b914-ee401a0e1e52\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk"
Sep 16 12:32:58.274220 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:58.274198    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjl6h\" (UniqueName: \"kubernetes.io/projected/b7a5bb9d-d218-4c4b-b914-ee401a0e1e52-kube-api-access-cjl6h\") pod \"payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk\" (UID: \"b7a5bb9d-d218-4c4b-b914-ee401a0e1e52\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk"
Sep 16 12:32:58.434955 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:58.434872    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk"
Sep 16 12:32:58.714778 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:58.714751    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk"]
Sep 16 12:32:58.716737 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:32:58.716697    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7a5bb9d_d218_4c4b_b914_ee401a0e1e52.slice/crio-f9cf985d254858f7dfce313525d3296228566803245d1b94c0401a5bc9f6a4f6 WatchSource:0}: Error finding container f9cf985d254858f7dfce313525d3296228566803245d1b94c0401a5bc9f6a4f6: Status 404 returned error can't find the container with id f9cf985d254858f7dfce313525d3296228566803245d1b94c0401a5bc9f6a4f6
Sep 16 12:32:59.365573 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:59.365538    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk" event={"ID":"b7a5bb9d-d218-4c4b-b914-ee401a0e1e52","Type":"ContainerStarted","Data":"48353b4c3c01e6d853c893a41d4d17a29f20e0c094c8059045e6169973536ae1"}
Sep 16 12:32:59.365970 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:59.365593    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk" event={"ID":"b7a5bb9d-d218-4c4b-b914-ee401a0e1e52","Type":"ContainerStarted","Data":"f9cf985d254858f7dfce313525d3296228566803245d1b94c0401a5bc9f6a4f6"}
Sep 16 12:32:59.365970 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:59.365622    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk"
Sep 16 12:32:59.381626 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:32:59.381560    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk" podStartSLOduration=1.381546194 podStartE2EDuration="1.381546194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:32:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:32:59.380173885 +0000 UTC m=+1845.549138591" watchObservedRunningTime="2026-09-16 12:32:59.381546194 +0000 UTC m=+1845.550510901"
Sep 16 12:33:10.374307 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:33:10.374278    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk"
Sep 16 12:33:14.778934 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:33:14.778905    2576 scope.go:117] "RemoveContainer" containerID="014fae944f54693bb96999b257437caa3b5dbc3acdbfb81b8971d905b7cc73c1"
Sep 16 12:33:25.226763 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:33:25.226731    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pgdkq_b34262c2-533f-4c3b-b82f-f52f256fbaec/payload-processing/0.log"
Sep 16 12:34:11.642010 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:11.641979    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pgdkq_b34262c2-533f-4c3b-b82f-f52f256fbaec/payload-processing/0.log"
Sep 16 12:34:12.397729 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.397701    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"]
Sep 16 12:34:12.401666 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.401642    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.406655 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.406624    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-555bf4-openshift-default-dockercfg-sg8dm\""
Sep 16 12:34:12.428188 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.428158    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"]
Sep 16 12:34:12.501176 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.501121    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istio-token\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.501413 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.501247    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-workload-certs\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.501413 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.501289    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-workload-socket\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.501413 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.501376    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-credential-socket\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.501413 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.501406    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istiod-ca-cert\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.501848 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.501547    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqq2s\" (UniqueName: \"kubernetes.io/projected/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-kube-api-access-sqq2s\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.501848 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.501581    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istio-envoy\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.501848 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.501630    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istio-data\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.501848 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.501712    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istio-podinfo\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.602554 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.602515    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istio-podinfo\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.602728 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.602572    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istio-token\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.602728 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.602627    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-workload-certs\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.602728 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.602670    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-workload-socket\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.602728 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.602713    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-credential-socket\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.602970 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.602735    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istiod-ca-cert\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.602970 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.602763    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqq2s\" (UniqueName: \"kubernetes.io/projected/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-kube-api-access-sqq2s\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.602970 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.602796    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istio-envoy\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.602970 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.602845    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istio-data\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.603256 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.603082    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-workload-certs\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.603256 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.603134    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-credential-socket\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.603256 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.603177    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-workload-socket\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.603256 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.603204    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istio-data\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.603552 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.603535    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istiod-ca-cert\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.605140 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.605118    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istio-envoy\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.605250 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.605234    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istio-podinfo\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.612464 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.612440    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqq2s\" (UniqueName: \"kubernetes.io/projected/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-kube-api-access-sqq2s\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.612570 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.612543    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istio-token\") pod \"e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") " pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:12.713155 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:12.713073    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:13.005606 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:13.005571    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"]
Sep 16 12:34:13.006785 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:34:13.006759    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f4fa7cb_baa7_4729_9f6e_1c377d136eb9.slice/crio-3c0267809c43aca0531e7617a7cae39a165c04a2781751d40e7b03723de75706 WatchSource:0}: Error finding container 3c0267809c43aca0531e7617a7cae39a165c04a2781751d40e7b03723de75706: Status 404 returned error can't find the container with id 3c0267809c43aca0531e7617a7cae39a165c04a2781751d40e7b03723de75706
Sep 16 12:34:13.009006 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:13.008977    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:34:13.009073 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:13.009052    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:34:13.009111 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:13.009083    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:34:13.805756 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:13.805718    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4" event={"ID":"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9","Type":"ContainerStarted","Data":"bab55ddaaceb69b2d68bfc43aa6f13b866a889cf288be8f6b8d1fdb0215f9d9f"}
Sep 16 12:34:13.806165 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:13.805802    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4" event={"ID":"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9","Type":"ContainerStarted","Data":"3c0267809c43aca0531e7617a7cae39a165c04a2781751d40e7b03723de75706"}
Sep 16 12:34:13.833584 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:13.833530    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4" podStartSLOduration=1.8335154710000001 podStartE2EDuration="1.833515471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:34:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:34:13.831300367 +0000 UTC m=+1920.000265073" watchObservedRunningTime="2026-09-16 12:34:13.833515471 +0000 UTC m=+1920.002480178"
Sep 16 12:34:14.713947 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:14.713912    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:14.719777 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:14.719751    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:14.801911 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:14.801877    2576 scope.go:117] "RemoveContainer" containerID="9e7a0c7d40f12f01e76adb9994035ce0655631c4d640beb2a9b7a22e50dccfb6"
Sep 16 12:34:14.812935 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:14.812912    2576 scope.go:117] "RemoveContainer" containerID="4afe15ecbcfff25a56a7f27e813a7d90c2ba3c6da3c535a9f7426c491dcc7496"
Sep 16 12:34:14.813238 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:14.813220    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:14.814397 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:14.814376    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:14.821664 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:14.821643    2576 scope.go:117] "RemoveContainer" containerID="4d5885fcc2c6cd714c68f977096504b90364646d9dbef622d58afa544c62f998"
Sep 16 12:34:14.829812 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:14.829795    2576 scope.go:117] "RemoveContainer" containerID="4b999d366e8e14ca14ad5b139aaf706c2d4cdf4f7952bbd5651db26810a75427"
Sep 16 12:34:35.950026 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:35.949941    2576 generic.go:356] "Generic (PLEG): container finished" podID="5f4fa7cb-baa7-4729-9f6e-1c377d136eb9" containerID="bab55ddaaceb69b2d68bfc43aa6f13b866a889cf288be8f6b8d1fdb0215f9d9f" exitCode=0
Sep 16 12:34:35.950561 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:35.950023    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4" event={"ID":"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9","Type":"ContainerDied","Data":"bab55ddaaceb69b2d68bfc43aa6f13b866a889cf288be8f6b8d1fdb0215f9d9f"}
Sep 16 12:34:35.950631 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:35.950576    2576 scope.go:117] "RemoveContainer" containerID="bab55ddaaceb69b2d68bfc43aa6f13b866a889cf288be8f6b8d1fdb0215f9d9f"
Sep 16 12:34:35.951759 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:35.951735    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:34:35.951829 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:35.951801    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:34:35.951869 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:35.951833    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 16 12:34:36.958343 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:36.958291    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4" event={"ID":"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9","Type":"ContainerStarted","Data":"5986d0f1fa08cf71c170adaef5c45bd764057621ad57d2aed9d64a13067854c0"}
Sep 16 12:34:37.714205 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:37.714161    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:37.714462 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:37.714301    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Sep 16 12:34:37.714462 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:37.714376    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4" podUID="5f4fa7cb-baa7-4729-9f6e-1c377d136eb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Sep 16 12:34:38.714748 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:38.714702    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Sep 16 12:34:38.715258 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:38.714775    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4" podUID="5f4fa7cb-baa7-4729-9f6e-1c377d136eb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Sep 16 12:34:39.713767 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:39.713723    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Sep 16 12:34:39.713992 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:39.713789    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4" podUID="5f4fa7cb-baa7-4729-9f6e-1c377d136eb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Sep 16 12:34:40.714394 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:40.714352    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Sep 16 12:34:40.714901 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:40.714419    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4" podUID="5f4fa7cb-baa7-4729-9f6e-1c377d136eb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Sep 16 12:34:41.714476 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:41.714439    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Sep 16 12:34:41.715556 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:41.715103    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4" podUID="5f4fa7cb-baa7-4729-9f6e-1c377d136eb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Sep 16 12:34:42.717712 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:42.717679    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:42.718208 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:42.717954    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:42.718674 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:42.718653    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:34:46.702465 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:46.702427    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-555bf4-5fklw"]
Sep 16 12:34:46.706960 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:46.706940    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-555bf4-5fklw"
Sep 16 12:34:46.709893 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:46.709871    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9lc86\""
Sep 16 12:34:46.715207 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:46.715184    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-555bf4-5fklw"]
Sep 16 12:34:46.777140 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:46.777111    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14588993-146e-4512-a688-5ad0bc5958ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-555bf4-5fklw\" (UID: \"14588993-146e-4512-a688-5ad0bc5958ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-555bf4-5fklw"
Sep 16 12:34:46.878600 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:46.878568    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14588993-146e-4512-a688-5ad0bc5958ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-555bf4-5fklw\" (UID: \"14588993-146e-4512-a688-5ad0bc5958ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-555bf4-5fklw"
Sep 16 12:34:46.879171 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:46.879150    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14588993-146e-4512-a688-5ad0bc5958ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-555bf4-5fklw\" (UID: \"14588993-146e-4512-a688-5ad0bc5958ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-555bf4-5fklw"
Sep 16 12:34:47.020028 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:47.019951    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-555bf4-5fklw"
Sep 16 12:34:47.295158 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:47.295127    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-555bf4-5fklw"]
Sep 16 12:34:47.296497 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:34:47.296468    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14588993_146e_4512_a688_5ad0bc5958ec.slice/crio-27e8ee59b9b7722d91784f6df681d8370ae0c4a34b79871b23e3080fa1c76541 WatchSource:0}: Error finding container 27e8ee59b9b7722d91784f6df681d8370ae0c4a34b79871b23e3080fa1c76541: Status 404 returned error can't find the container with id 27e8ee59b9b7722d91784f6df681d8370ae0c4a34b79871b23e3080fa1c76541
Sep 16 12:34:48.021433 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:48.021404    2576 generic.go:356] "Generic (PLEG): container finished" podID="14588993-146e-4512-a688-5ad0bc5958ec" containerID="c0dad94406612037f2ecea6101a66a46fe7e661f7ad1ec7f0426401aee7163b3" exitCode=0
Sep 16 12:34:48.021797 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:48.021498    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-555bf4-5fklw" event={"ID":"14588993-146e-4512-a688-5ad0bc5958ec","Type":"ContainerDied","Data":"c0dad94406612037f2ecea6101a66a46fe7e661f7ad1ec7f0426401aee7163b3"}
Sep 16 12:34:48.021797 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:48.021560    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-555bf4-5fklw" event={"ID":"14588993-146e-4512-a688-5ad0bc5958ec","Type":"ContainerStarted","Data":"27e8ee59b9b7722d91784f6df681d8370ae0c4a34b79871b23e3080fa1c76541"}
Sep 16 12:34:49.175125 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:49.175064    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-555bf4-5fklw"
Sep 16 12:34:49.306596 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:49.306516    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14588993-146e-4512-a688-5ad0bc5958ec-maas-api-service-ca\") pod \"14588993-146e-4512-a688-5ad0bc5958ec\" (UID: \"14588993-146e-4512-a688-5ad0bc5958ec\") "
Sep 16 12:34:49.306848 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:49.306827    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14588993-146e-4512-a688-5ad0bc5958ec-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "14588993-146e-4512-a688-5ad0bc5958ec" (UID: "14588993-146e-4512-a688-5ad0bc5958ec"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:34:49.407191 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:49.407159    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14588993-146e-4512-a688-5ad0bc5958ec-maas-api-service-ca\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:34:50.035970 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:50.035937    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-555bf4-5fklw" event={"ID":"14588993-146e-4512-a688-5ad0bc5958ec","Type":"ContainerDied","Data":"27e8ee59b9b7722d91784f6df681d8370ae0c4a34b79871b23e3080fa1c76541"}
Sep 16 12:34:50.035970 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:50.035965    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-555bf4-5fklw"
Sep 16 12:34:50.036195 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:50.035987    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27e8ee59b9b7722d91784f6df681d8370ae0c4a34b79871b23e3080fa1c76541"
Sep 16 12:34:57.820187 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:57.820148    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-555bf4-5fklw"]
Sep 16 12:34:57.822640 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:57.822612    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-555bf4-5fklw"]
Sep 16 12:34:58.393935 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:34:58.393892    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14588993-146e-4512-a688-5ad0bc5958ec" path="/var/lib/kubelet/pods/14588993-146e-4512-a688-5ad0bc5958ec/volumes"
Sep 16 12:35:04.521897 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:04.521862    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"]
Sep 16 12:35:04.522386 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:04.522139    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4" podUID="5f4fa7cb-baa7-4729-9f6e-1c377d136eb9" containerName="istio-proxy" containerID="cri-o://5986d0f1fa08cf71c170adaef5c45bd764057621ad57d2aed9d64a13067854c0" gracePeriod=30
Sep 16 12:35:08.619817 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:08.619736    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a4f954-6m6tw"]
Sep 16 12:35:08.620243 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:08.620229    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14588993-146e-4512-a688-5ad0bc5958ec" containerName="revoke-keys"
Sep 16 12:35:08.620288 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:08.620244    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="14588993-146e-4512-a688-5ad0bc5958ec" containerName="revoke-keys"
Sep 16 12:35:08.620367 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:08.620356    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="14588993-146e-4512-a688-5ad0bc5958ec" containerName="revoke-keys"
Sep 16 12:35:08.623788 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:08.623772    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a4f954-6m6tw"
Sep 16 12:35:08.626129 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:08.626108    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9lc86\""
Sep 16 12:35:08.630562 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:08.630538    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a4f954-6m6tw"]
Sep 16 12:35:08.716290 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:08.716259    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10d75719-d4bd-40ad-80e8-9067adb65ad7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-a4f954-6m6tw\" (UID: \"10d75719-d4bd-40ad-80e8-9067adb65ad7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a4f954-6m6tw"
Sep 16 12:35:08.817716 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:08.817685    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10d75719-d4bd-40ad-80e8-9067adb65ad7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-a4f954-6m6tw\" (UID: \"10d75719-d4bd-40ad-80e8-9067adb65ad7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a4f954-6m6tw"
Sep 16 12:35:08.818381 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:08.818356    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10d75719-d4bd-40ad-80e8-9067adb65ad7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-a4f954-6m6tw\" (UID: \"10d75719-d4bd-40ad-80e8-9067adb65ad7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a4f954-6m6tw"
Sep 16 12:35:08.937078 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:08.936988    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a4f954-6m6tw"
Sep 16 12:35:09.226891 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.226868    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a4f954-6m6tw"]
Sep 16 12:35:09.228645 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:35:09.228609    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10d75719_d4bd_40ad_80e8_9067adb65ad7.slice/crio-40092fdf4e5d26a083c8c1924f756db2b82a38b26ebdce891cb1101647276642 WatchSource:0}: Error finding container 40092fdf4e5d26a083c8c1924f756db2b82a38b26ebdce891cb1101647276642: Status 404 returned error can't find the container with id 40092fdf4e5d26a083c8c1924f756db2b82a38b26ebdce891cb1101647276642
Sep 16 12:35:09.763332 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.763296    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:35:09.827016 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.826990    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istio-token\") pod \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") "
Sep 16 12:35:09.827188 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.827029    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-credential-socket\") pod \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") "
Sep 16 12:35:09.827259 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.827201    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istio-data\") pod \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") "
Sep 16 12:35:09.827259 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.827239    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5f4fa7cb-baa7-4729-9f6e-1c377d136eb9" (UID: "5f4fa7cb-baa7-4729-9f6e-1c377d136eb9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:35:09.827400 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.827275    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-workload-socket\") pod \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") "
Sep 16 12:35:09.827400 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.827308    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istio-envoy\") pod \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") "
Sep 16 12:35:09.827501 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.827419    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istio-podinfo\") pod \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") "
Sep 16 12:35:09.827501 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.827451    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-workload-certs\") pod \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") "
Sep 16 12:35:09.827501 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.827455    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istio-data" (OuterVolumeSpecName: "istio-data") pod "5f4fa7cb-baa7-4729-9f6e-1c377d136eb9" (UID: "5f4fa7cb-baa7-4729-9f6e-1c377d136eb9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:35:09.827667 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.827522    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5f4fa7cb-baa7-4729-9f6e-1c377d136eb9" (UID: "5f4fa7cb-baa7-4729-9f6e-1c377d136eb9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:35:09.827667 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.827527    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istiod-ca-cert\") pod \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") "
Sep 16 12:35:09.827667 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.827569    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqq2s\" (UniqueName: \"kubernetes.io/projected/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-kube-api-access-sqq2s\") pod \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\" (UID: \"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9\") "
Sep 16 12:35:09.827826 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.827803    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5f4fa7cb-baa7-4729-9f6e-1c377d136eb9" (UID: "5f4fa7cb-baa7-4729-9f6e-1c377d136eb9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:35:09.827887 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.827842    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5f4fa7cb-baa7-4729-9f6e-1c377d136eb9" (UID: "5f4fa7cb-baa7-4729-9f6e-1c377d136eb9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:35:09.828108 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.828076    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istiod-ca-cert\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:35:09.828430 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.828108    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-credential-socket\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:35:09.828430 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.828165    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istio-data\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:35:09.828430 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.828178    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-workload-socket\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:35:09.828430 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.828190    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-workload-certs\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:35:09.829528 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.829495    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istio-token" (OuterVolumeSpecName: "istio-token") pod "5f4fa7cb-baa7-4729-9f6e-1c377d136eb9" (UID: "5f4fa7cb-baa7-4729-9f6e-1c377d136eb9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:35:09.829674 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.829655    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5f4fa7cb-baa7-4729-9f6e-1c377d136eb9" (UID: "5f4fa7cb-baa7-4729-9f6e-1c377d136eb9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:35:09.829781 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.829761    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5f4fa7cb-baa7-4729-9f6e-1c377d136eb9" (UID: "5f4fa7cb-baa7-4729-9f6e-1c377d136eb9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:35:09.829878 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.829857    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-kube-api-access-sqq2s" (OuterVolumeSpecName: "kube-api-access-sqq2s") pod "5f4fa7cb-baa7-4729-9f6e-1c377d136eb9" (UID: "5f4fa7cb-baa7-4729-9f6e-1c377d136eb9"). InnerVolumeSpecName "kube-api-access-sqq2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:35:09.928738 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.928703    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istio-token\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:35:09.928738 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.928731    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istio-envoy\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:35:09.928738 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.928743    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-istio-podinfo\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:35:09.928956 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:09.928755    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqq2s\" (UniqueName: \"kubernetes.io/projected/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9-kube-api-access-sqq2s\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:35:10.162433 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:10.162401    2576 generic.go:356] "Generic (PLEG): container finished" podID="10d75719-d4bd-40ad-80e8-9067adb65ad7" containerID="13ab8af8498808b6933ef22093f530eabcd36d7b2d9373e91941ab99a9311367" exitCode=0
Sep 16 12:35:10.162631 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:10.162482    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a4f954-6m6tw" event={"ID":"10d75719-d4bd-40ad-80e8-9067adb65ad7","Type":"ContainerDied","Data":"13ab8af8498808b6933ef22093f530eabcd36d7b2d9373e91941ab99a9311367"}
Sep 16 12:35:10.162631 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:10.162547    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a4f954-6m6tw" event={"ID":"10d75719-d4bd-40ad-80e8-9067adb65ad7","Type":"ContainerStarted","Data":"40092fdf4e5d26a083c8c1924f756db2b82a38b26ebdce891cb1101647276642"}
Sep 16 12:35:10.164400 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:10.164375    2576 generic.go:356] "Generic (PLEG): container finished" podID="5f4fa7cb-baa7-4729-9f6e-1c377d136eb9" containerID="5986d0f1fa08cf71c170adaef5c45bd764057621ad57d2aed9d64a13067854c0" exitCode=0
Sep 16 12:35:10.164522 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:10.164420    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"
Sep 16 12:35:10.164522 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:10.164468    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4" event={"ID":"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9","Type":"ContainerDied","Data":"5986d0f1fa08cf71c170adaef5c45bd764057621ad57d2aed9d64a13067854c0"}
Sep 16 12:35:10.164629 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:10.164528    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4" event={"ID":"5f4fa7cb-baa7-4729-9f6e-1c377d136eb9","Type":"ContainerDied","Data":"3c0267809c43aca0531e7617a7cae39a165c04a2781751d40e7b03723de75706"}
Sep 16 12:35:10.164629 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:10.164560    2576 scope.go:117] "RemoveContainer" containerID="5986d0f1fa08cf71c170adaef5c45bd764057621ad57d2aed9d64a13067854c0"
Sep 16 12:35:10.174719 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:10.174691    2576 scope.go:117] "RemoveContainer" containerID="bab55ddaaceb69b2d68bfc43aa6f13b866a889cf288be8f6b8d1fdb0215f9d9f"
Sep 16 12:35:10.184141 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:10.184124    2576 scope.go:117] "RemoveContainer" containerID="5986d0f1fa08cf71c170adaef5c45bd764057621ad57d2aed9d64a13067854c0"
Sep 16 12:35:10.184442 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:35:10.184423    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5986d0f1fa08cf71c170adaef5c45bd764057621ad57d2aed9d64a13067854c0\": container with ID starting with 5986d0f1fa08cf71c170adaef5c45bd764057621ad57d2aed9d64a13067854c0 not found: ID does not exist" containerID="5986d0f1fa08cf71c170adaef5c45bd764057621ad57d2aed9d64a13067854c0"
Sep 16 12:35:10.184509 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:10.184449    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5986d0f1fa08cf71c170adaef5c45bd764057621ad57d2aed9d64a13067854c0"} err="failed to get container status \"5986d0f1fa08cf71c170adaef5c45bd764057621ad57d2aed9d64a13067854c0\": rpc error: code = NotFound desc = could not find container \"5986d0f1fa08cf71c170adaef5c45bd764057621ad57d2aed9d64a13067854c0\": container with ID starting with 5986d0f1fa08cf71c170adaef5c45bd764057621ad57d2aed9d64a13067854c0 not found: ID does not exist"
Sep 16 12:35:10.184509 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:10.184466    2576 scope.go:117] "RemoveContainer" containerID="bab55ddaaceb69b2d68bfc43aa6f13b866a889cf288be8f6b8d1fdb0215f9d9f"
Sep 16 12:35:10.184721 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:35:10.184701    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bab55ddaaceb69b2d68bfc43aa6f13b866a889cf288be8f6b8d1fdb0215f9d9f\": container with ID starting with bab55ddaaceb69b2d68bfc43aa6f13b866a889cf288be8f6b8d1fdb0215f9d9f not found: ID does not exist" containerID="bab55ddaaceb69b2d68bfc43aa6f13b866a889cf288be8f6b8d1fdb0215f9d9f"
Sep 16 12:35:10.184767 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:10.184728    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bab55ddaaceb69b2d68bfc43aa6f13b866a889cf288be8f6b8d1fdb0215f9d9f"} err="failed to get container status \"bab55ddaaceb69b2d68bfc43aa6f13b866a889cf288be8f6b8d1fdb0215f9d9f\": rpc error: code = NotFound desc = could not find container \"bab55ddaaceb69b2d68bfc43aa6f13b866a889cf288be8f6b8d1fdb0215f9d9f\": container with ID starting with bab55ddaaceb69b2d68bfc43aa6f13b866a889cf288be8f6b8d1fdb0215f9d9f not found: ID does not exist"
Sep 16 12:35:10.193074 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:10.193055    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"]
Sep 16 12:35:10.199649 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:10.199628    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-555bf4-openshift-default-787d86fbc8-dclr4"]
Sep 16 12:35:10.394452 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:10.394419    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f4fa7cb-baa7-4729-9f6e-1c377d136eb9" path="/var/lib/kubelet/pods/5f4fa7cb-baa7-4729-9f6e-1c377d136eb9/volumes"
Sep 16 12:35:11.307905 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:11.307878    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a4f954-6m6tw"
Sep 16 12:35:11.341841 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:11.341813    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10d75719-d4bd-40ad-80e8-9067adb65ad7-maas-api-service-ca\") pod \"10d75719-d4bd-40ad-80e8-9067adb65ad7\" (UID: \"10d75719-d4bd-40ad-80e8-9067adb65ad7\") "
Sep 16 12:35:11.342154 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:11.342131    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10d75719-d4bd-40ad-80e8-9067adb65ad7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "10d75719-d4bd-40ad-80e8-9067adb65ad7" (UID: "10d75719-d4bd-40ad-80e8-9067adb65ad7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:35:11.443483 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:11.443402    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10d75719-d4bd-40ad-80e8-9067adb65ad7-maas-api-service-ca\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:35:12.178560 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:12.178507    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a4f954-6m6tw"
Sep 16 12:35:12.178560 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:12.178545    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a4f954-6m6tw" event={"ID":"10d75719-d4bd-40ad-80e8-9067adb65ad7","Type":"ContainerDied","Data":"40092fdf4e5d26a083c8c1924f756db2b82a38b26ebdce891cb1101647276642"}
Sep 16 12:35:12.178794 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:12.178624    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40092fdf4e5d26a083c8c1924f756db2b82a38b26ebdce891cb1101647276642"
Sep 16 12:35:14.866272 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:14.866225    2576 scope.go:117] "RemoveContainer" containerID="c8406b0e0da46fcca850a9e1e78af695203d9da962b01a1e0fef3e783726ebe4"
Sep 16 12:35:24.330477 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:24.330443    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897"]
Sep 16 12:35:24.331087 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:24.330653    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897" podUID="75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe" containerName="payload-pre-processing" containerID="cri-o://ef5b958ff5bb823221ef730abdd5561ee9d499d36aaf197d7274e09bbb3b82f9" gracePeriod=30
Sep 16 12:35:24.469699 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:24.469663    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a4f954-6m6tw"]
Sep 16 12:35:24.473231 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:24.473193    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-a4f954-6m6tw"]
Sep 16 12:35:24.613294 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:24.613265    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897"
Sep 16 12:35:24.779921 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:24.779896    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe-plugins-config-volume\") pod \"75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe\" (UID: \"75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe\") "
Sep 16 12:35:24.780091 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:24.779975    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mkxk\" (UniqueName: \"kubernetes.io/projected/75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe-kube-api-access-8mkxk\") pod \"75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe\" (UID: \"75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe\") "
Sep 16 12:35:24.780283 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:24.780259    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe" (UID: "75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:35:24.782228 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:24.782206    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe-kube-api-access-8mkxk" (OuterVolumeSpecName: "kube-api-access-8mkxk") pod "75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe" (UID: "75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe"). InnerVolumeSpecName "kube-api-access-8mkxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:35:24.881648 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:24.881617    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mkxk\" (UniqueName: \"kubernetes.io/projected/75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe-kube-api-access-8mkxk\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:35:24.881648 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:24.881642    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe-plugins-config-volume\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:35:25.254607 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:25.254518    2576 generic.go:356] "Generic (PLEG): container finished" podID="75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe" containerID="ef5b958ff5bb823221ef730abdd5561ee9d499d36aaf197d7274e09bbb3b82f9" exitCode=0
Sep 16 12:35:25.254607 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:25.254567    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897"
Sep 16 12:35:25.254789 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:25.254611    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897" event={"ID":"75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe","Type":"ContainerDied","Data":"ef5b958ff5bb823221ef730abdd5561ee9d499d36aaf197d7274e09bbb3b82f9"}
Sep 16 12:35:25.254789 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:25.254666    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897" event={"ID":"75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe","Type":"ContainerDied","Data":"1316b0bf955672a9668f78ce7eaf8a177b9a9a8ffe1264c8d6994c56217da6f4"}
Sep 16 12:35:25.254789 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:25.254688    2576 scope.go:117] "RemoveContainer" containerID="ef5b958ff5bb823221ef730abdd5561ee9d499d36aaf197d7274e09bbb3b82f9"
Sep 16 12:35:25.264142 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:25.264124    2576 scope.go:117] "RemoveContainer" containerID="ef5b958ff5bb823221ef730abdd5561ee9d499d36aaf197d7274e09bbb3b82f9"
Sep 16 12:35:25.264444 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:35:25.264423    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef5b958ff5bb823221ef730abdd5561ee9d499d36aaf197d7274e09bbb3b82f9\": container with ID starting with ef5b958ff5bb823221ef730abdd5561ee9d499d36aaf197d7274e09bbb3b82f9 not found: ID does not exist" containerID="ef5b958ff5bb823221ef730abdd5561ee9d499d36aaf197d7274e09bbb3b82f9"
Sep 16 12:35:25.264511 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:25.264454    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef5b958ff5bb823221ef730abdd5561ee9d499d36aaf197d7274e09bbb3b82f9"} err="failed to get container status \"ef5b958ff5bb823221ef730abdd5561ee9d499d36aaf197d7274e09bbb3b82f9\": rpc error: code = NotFound desc = could not find container \"ef5b958ff5bb823221ef730abdd5561ee9d499d36aaf197d7274e09bbb3b82f9\": container with ID starting with ef5b958ff5bb823221ef730abdd5561ee9d499d36aaf197d7274e09bbb3b82f9 not found: ID does not exist"
Sep 16 12:35:25.280386 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:25.280364    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897"]
Sep 16 12:35:25.285483 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:25.285459    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a4f954-7df9f8c998-w9897"]
Sep 16 12:35:26.394133 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:26.394099    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10d75719-d4bd-40ad-80e8-9067adb65ad7" path="/var/lib/kubelet/pods/10d75719-d4bd-40ad-80e8-9067adb65ad7/volumes"
Sep 16 12:35:26.394541 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:35:26.394518    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe" path="/var/lib/kubelet/pods/75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe/volumes"
Sep 16 12:36:12.648342 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:12.648286    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"]
Sep 16 12:36:12.648841 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:12.648529    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9" podUID="15711897-0941-4e50-b5ec-8cf72c65d30b" containerName="istio-proxy" containerID="cri-o://8bf8064efb5238ac5bddedfbfcd28e1c83b20fd0129afe6b7d052c52124a805f" gracePeriod=30
Sep 16 12:36:13.105763 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:13.105720    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3863e0-c29f2"]
Sep 16 12:36:13.106506 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:13.106484    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f4fa7cb-baa7-4729-9f6e-1c377d136eb9" containerName="istio-proxy"
Sep 16 12:36:13.106640 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:13.106510    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f4fa7cb-baa7-4729-9f6e-1c377d136eb9" containerName="istio-proxy"
Sep 16 12:36:13.106640 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:13.106525    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d75719-d4bd-40ad-80e8-9067adb65ad7" containerName="revoke-keys"
Sep 16 12:36:13.106640 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:13.106533    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d75719-d4bd-40ad-80e8-9067adb65ad7" containerName="revoke-keys"
Sep 16 12:36:13.106640 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:13.106568    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe" containerName="payload-pre-processing"
Sep 16 12:36:13.106640 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:13.106576    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe" containerName="payload-pre-processing"
Sep 16 12:36:13.106640 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:13.106607    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f4fa7cb-baa7-4729-9f6e-1c377d136eb9" containerName="istio-proxy"
Sep 16 12:36:13.106640 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:13.106615    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f4fa7cb-baa7-4729-9f6e-1c377d136eb9" containerName="istio-proxy"
Sep 16 12:36:13.106866 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:13.106723    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="10d75719-d4bd-40ad-80e8-9067adb65ad7" containerName="revoke-keys"
Sep 16 12:36:13.106866 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:13.106734    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="75ed2a08-7c7d-48f3-8ce7-cead5a7fd1fe" containerName="payload-pre-processing"
Sep 16 12:36:13.106866 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:13.106745    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f4fa7cb-baa7-4729-9f6e-1c377d136eb9" containerName="istio-proxy"
Sep 16 12:36:13.106866 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:13.106757    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f4fa7cb-baa7-4729-9f6e-1c377d136eb9" containerName="istio-proxy"
Sep 16 12:36:13.110673 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:13.110650    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3863e0-c29f2"
Sep 16 12:36:13.113334 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:13.113291    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9lc86\""
Sep 16 12:36:13.115284 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:13.115264    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3863e0-c29f2"]
Sep 16 12:36:13.258038 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:13.258003    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db481032-d752-4ad0-a7b2-a5246490d262-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-3863e0-c29f2\" (UID: \"db481032-d752-4ad0-a7b2-a5246490d262\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3863e0-c29f2"
Sep 16 12:36:13.359163 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:13.359073    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db481032-d752-4ad0-a7b2-a5246490d262-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-3863e0-c29f2\" (UID: \"db481032-d752-4ad0-a7b2-a5246490d262\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3863e0-c29f2"
Sep 16 12:36:13.359943 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:13.359917    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db481032-d752-4ad0-a7b2-a5246490d262-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-3863e0-c29f2\" (UID: \"db481032-d752-4ad0-a7b2-a5246490d262\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3863e0-c29f2"
Sep 16 12:36:13.425152 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:13.425116    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3863e0-c29f2"
Sep 16 12:36:13.702068 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:13.701991    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3863e0-c29f2"]
Sep 16 12:36:13.705987 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:36:13.705957    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb481032_d752_4ad0_a7b2_a5246490d262.slice/crio-af6591e7934d2c9bb1991cbdcfe4e40b51a4263415e1285fcf424b9a9c433947 WatchSource:0}: Error finding container af6591e7934d2c9bb1991cbdcfe4e40b51a4263415e1285fcf424b9a9c433947: Status 404 returned error can't find the container with id af6591e7934d2c9bb1991cbdcfe4e40b51a4263415e1285fcf424b9a9c433947
Sep 16 12:36:14.537337 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:14.537287    2576 generic.go:356] "Generic (PLEG): container finished" podID="db481032-d752-4ad0-a7b2-a5246490d262" containerID="918e58ef25c295b2a533d02f8836d86798e2a4979e47f82264d40461fc567d61" exitCode=0
Sep 16 12:36:14.537499 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:14.537356    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3863e0-c29f2" event={"ID":"db481032-d752-4ad0-a7b2-a5246490d262","Type":"ContainerDied","Data":"918e58ef25c295b2a533d02f8836d86798e2a4979e47f82264d40461fc567d61"}
Sep 16 12:36:14.537499 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:14.537417    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3863e0-c29f2" event={"ID":"db481032-d752-4ad0-a7b2-a5246490d262","Type":"ContainerStarted","Data":"af6591e7934d2c9bb1991cbdcfe4e40b51a4263415e1285fcf424b9a9c433947"}
Sep 16 12:36:15.688236 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:15.688212    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3863e0-c29f2"
Sep 16 12:36:15.881918 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:15.881894    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db481032-d752-4ad0-a7b2-a5246490d262-maas-api-service-ca\") pod \"db481032-d752-4ad0-a7b2-a5246490d262\" (UID: \"db481032-d752-4ad0-a7b2-a5246490d262\") "
Sep 16 12:36:15.882262 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:15.882237    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db481032-d752-4ad0-a7b2-a5246490d262-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "db481032-d752-4ad0-a7b2-a5246490d262" (UID: "db481032-d752-4ad0-a7b2-a5246490d262"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:36:15.983186 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:15.983153    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db481032-d752-4ad0-a7b2-a5246490d262-maas-api-service-ca\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:36:16.550101 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:16.550070    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3863e0-c29f2" event={"ID":"db481032-d752-4ad0-a7b2-a5246490d262","Type":"ContainerDied","Data":"af6591e7934d2c9bb1991cbdcfe4e40b51a4263415e1285fcf424b9a9c433947"}
Sep 16 12:36:16.550101 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:16.550097    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3863e0-c29f2"
Sep 16 12:36:16.550347 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:16.550123    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af6591e7934d2c9bb1991cbdcfe4e40b51a4263415e1285fcf424b9a9c433947"
Sep 16 12:36:17.903621 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:17.903596    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:36:17.998458 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:17.998369    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-credential-socket\") pod \"15711897-0941-4e50-b5ec-8cf72c65d30b\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") "
Sep 16 12:36:17.998458 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:17.998406    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15711897-0941-4e50-b5ec-8cf72c65d30b-istio-podinfo\") pod \"15711897-0941-4e50-b5ec-8cf72c65d30b\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") "
Sep 16 12:36:17.998458 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:17.998435    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15711897-0941-4e50-b5ec-8cf72c65d30b-istio-token\") pod \"15711897-0941-4e50-b5ec-8cf72c65d30b\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") "
Sep 16 12:36:17.998745 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:17.998560    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-workload-socket\") pod \"15711897-0941-4e50-b5ec-8cf72c65d30b\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") "
Sep 16 12:36:17.998745 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:17.998623    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-istio-envoy\") pod \"15711897-0941-4e50-b5ec-8cf72c65d30b\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") "
Sep 16 12:36:17.998745 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:17.998650    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vttzs\" (UniqueName: \"kubernetes.io/projected/15711897-0941-4e50-b5ec-8cf72c65d30b-kube-api-access-vttzs\") pod \"15711897-0941-4e50-b5ec-8cf72c65d30b\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") "
Sep 16 12:36:17.998745 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:17.998678    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15711897-0941-4e50-b5ec-8cf72c65d30b-istiod-ca-cert\") pod \"15711897-0941-4e50-b5ec-8cf72c65d30b\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") "
Sep 16 12:36:17.998745 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:17.998680    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "15711897-0941-4e50-b5ec-8cf72c65d30b" (UID: "15711897-0941-4e50-b5ec-8cf72c65d30b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:36:17.998745 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:17.998713    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-workload-certs\") pod \"15711897-0941-4e50-b5ec-8cf72c65d30b\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") "
Sep 16 12:36:17.998745 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:17.998740    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-istio-data\") pod \"15711897-0941-4e50-b5ec-8cf72c65d30b\" (UID: \"15711897-0941-4e50-b5ec-8cf72c65d30b\") "
Sep 16 12:36:17.999286 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:17.998820    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "15711897-0941-4e50-b5ec-8cf72c65d30b" (UID: "15711897-0941-4e50-b5ec-8cf72c65d30b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:36:17.999286 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:17.999036    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "15711897-0941-4e50-b5ec-8cf72c65d30b" (UID: "15711897-0941-4e50-b5ec-8cf72c65d30b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:36:17.999286 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:17.999068    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15711897-0941-4e50-b5ec-8cf72c65d30b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "15711897-0941-4e50-b5ec-8cf72c65d30b" (UID: "15711897-0941-4e50-b5ec-8cf72c65d30b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:36:17.999286 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:17.999194    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-istio-data" (OuterVolumeSpecName: "istio-data") pod "15711897-0941-4e50-b5ec-8cf72c65d30b" (UID: "15711897-0941-4e50-b5ec-8cf72c65d30b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:36:17.999564 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:17.999502    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-workload-socket\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:36:17.999564 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:17.999527    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15711897-0941-4e50-b5ec-8cf72c65d30b-istiod-ca-cert\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:36:17.999564 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:17.999542    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-workload-certs\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:36:17.999564 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:17.999555    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-istio-data\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:36:18.000053 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:17.999568    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-credential-socket\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:36:18.000887 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:18.000863    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15711897-0941-4e50-b5ec-8cf72c65d30b-istio-token" (OuterVolumeSpecName: "istio-token") pod "15711897-0941-4e50-b5ec-8cf72c65d30b" (UID: "15711897-0941-4e50-b5ec-8cf72c65d30b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:36:18.001008 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:18.000883    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15711897-0941-4e50-b5ec-8cf72c65d30b-kube-api-access-vttzs" (OuterVolumeSpecName: "kube-api-access-vttzs") pod "15711897-0941-4e50-b5ec-8cf72c65d30b" (UID: "15711897-0941-4e50-b5ec-8cf72c65d30b"). InnerVolumeSpecName "kube-api-access-vttzs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:36:18.001008 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:18.000941    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "15711897-0941-4e50-b5ec-8cf72c65d30b" (UID: "15711897-0941-4e50-b5ec-8cf72c65d30b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:36:18.001008 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:18.000966    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/15711897-0941-4e50-b5ec-8cf72c65d30b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "15711897-0941-4e50-b5ec-8cf72c65d30b" (UID: "15711897-0941-4e50-b5ec-8cf72c65d30b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 12:36:18.100812 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:18.100775    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15711897-0941-4e50-b5ec-8cf72c65d30b-istio-podinfo\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:36:18.100812 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:18.100804    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15711897-0941-4e50-b5ec-8cf72c65d30b-istio-token\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:36:18.100812 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:18.100813    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15711897-0941-4e50-b5ec-8cf72c65d30b-istio-envoy\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:36:18.101034 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:18.100822    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vttzs\" (UniqueName: \"kubernetes.io/projected/15711897-0941-4e50-b5ec-8cf72c65d30b-kube-api-access-vttzs\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:36:18.563211 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:18.563175    2576 generic.go:356] "Generic (PLEG): container finished" podID="15711897-0941-4e50-b5ec-8cf72c65d30b" containerID="8bf8064efb5238ac5bddedfbfcd28e1c83b20fd0129afe6b7d052c52124a805f" exitCode=0
Sep 16 12:36:18.563429 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:18.563218    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9" event={"ID":"15711897-0941-4e50-b5ec-8cf72c65d30b","Type":"ContainerDied","Data":"8bf8064efb5238ac5bddedfbfcd28e1c83b20fd0129afe6b7d052c52124a805f"}
Sep 16 12:36:18.563429 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:18.563233    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"
Sep 16 12:36:18.563429 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:18.563257    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9" event={"ID":"15711897-0941-4e50-b5ec-8cf72c65d30b","Type":"ContainerDied","Data":"aa12b18c73b30a2f6a8e8017c6cf21232e15efaa42acc43d6f1bac5a26379e7a"}
Sep 16 12:36:18.563429 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:18.563278    2576 scope.go:117] "RemoveContainer" containerID="8bf8064efb5238ac5bddedfbfcd28e1c83b20fd0129afe6b7d052c52124a805f"
Sep 16 12:36:18.575293 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:18.575266    2576 scope.go:117] "RemoveContainer" containerID="b671540c67175af6d6fe62a3b8c74c5652a7abb2687f44e34ad1d0b4f279be40"
Sep 16 12:36:18.581702 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:18.581653    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"]
Sep 16 12:36:18.586267 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:18.586184    2576 scope.go:117] "RemoveContainer" containerID="8bf8064efb5238ac5bddedfbfcd28e1c83b20fd0129afe6b7d052c52124a805f"
Sep 16 12:36:18.586267 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:18.586203    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-a4f954-openshift-default-67c7b557c6-pnhf9"]
Sep 16 12:36:18.594223 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:36:18.588694    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bf8064efb5238ac5bddedfbfcd28e1c83b20fd0129afe6b7d052c52124a805f\": container with ID starting with 8bf8064efb5238ac5bddedfbfcd28e1c83b20fd0129afe6b7d052c52124a805f not found: ID does not exist" containerID="8bf8064efb5238ac5bddedfbfcd28e1c83b20fd0129afe6b7d052c52124a805f"
Sep 16 12:36:18.594223 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:18.588731    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bf8064efb5238ac5bddedfbfcd28e1c83b20fd0129afe6b7d052c52124a805f"} err="failed to get container status \"8bf8064efb5238ac5bddedfbfcd28e1c83b20fd0129afe6b7d052c52124a805f\": rpc error: code = NotFound desc = could not find container \"8bf8064efb5238ac5bddedfbfcd28e1c83b20fd0129afe6b7d052c52124a805f\": container with ID starting with 8bf8064efb5238ac5bddedfbfcd28e1c83b20fd0129afe6b7d052c52124a805f not found: ID does not exist"
Sep 16 12:36:18.594223 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:18.588758    2576 scope.go:117] "RemoveContainer" containerID="b671540c67175af6d6fe62a3b8c74c5652a7abb2687f44e34ad1d0b4f279be40"
Sep 16 12:36:18.594223 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:36:18.589034    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b671540c67175af6d6fe62a3b8c74c5652a7abb2687f44e34ad1d0b4f279be40\": container with ID starting with b671540c67175af6d6fe62a3b8c74c5652a7abb2687f44e34ad1d0b4f279be40 not found: ID does not exist" containerID="b671540c67175af6d6fe62a3b8c74c5652a7abb2687f44e34ad1d0b4f279be40"
Sep 16 12:36:18.594223 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:18.589058    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b671540c67175af6d6fe62a3b8c74c5652a7abb2687f44e34ad1d0b4f279be40"} err="failed to get container status \"b671540c67175af6d6fe62a3b8c74c5652a7abb2687f44e34ad1d0b4f279be40\": rpc error: code = NotFound desc = could not find container \"b671540c67175af6d6fe62a3b8c74c5652a7abb2687f44e34ad1d0b4f279be40\": container with ID starting with b671540c67175af6d6fe62a3b8c74c5652a7abb2687f44e34ad1d0b4f279be40 not found: ID does not exist"
Sep 16 12:36:20.394550 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:20.394515    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15711897-0941-4e50-b5ec-8cf72c65d30b" path="/var/lib/kubelet/pods/15711897-0941-4e50-b5ec-8cf72c65d30b/volumes"
Sep 16 12:36:23.793673 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:23.793641    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk"]
Sep 16 12:36:23.794160 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:23.793998    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk" podUID="b7a5bb9d-d218-4c4b-b914-ee401a0e1e52" containerName="payload-pre-processing" containerID="cri-o://48353b4c3c01e6d853c893a41d4d17a29f20e0c094c8059045e6169973536ae1" gracePeriod=30
Sep 16 12:36:23.945215 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:23.945175    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3863e0-c29f2"]
Sep 16 12:36:23.948807 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:23.948784    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3863e0-c29f2"]
Sep 16 12:36:24.063604 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:24.063580    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk"
Sep 16 12:36:24.159025 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:24.158986    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7a5bb9d-d218-4c4b-b914-ee401a0e1e52-plugins-config-volume\") pod \"b7a5bb9d-d218-4c4b-b914-ee401a0e1e52\" (UID: \"b7a5bb9d-d218-4c4b-b914-ee401a0e1e52\") "
Sep 16 12:36:24.159209 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:24.159111    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjl6h\" (UniqueName: \"kubernetes.io/projected/b7a5bb9d-d218-4c4b-b914-ee401a0e1e52-kube-api-access-cjl6h\") pod \"b7a5bb9d-d218-4c4b-b914-ee401a0e1e52\" (UID: \"b7a5bb9d-d218-4c4b-b914-ee401a0e1e52\") "
Sep 16 12:36:24.159401 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:24.159379    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7a5bb9d-d218-4c4b-b914-ee401a0e1e52-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b7a5bb9d-d218-4c4b-b914-ee401a0e1e52" (UID: "b7a5bb9d-d218-4c4b-b914-ee401a0e1e52"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:36:24.161288 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:24.161263    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7a5bb9d-d218-4c4b-b914-ee401a0e1e52-kube-api-access-cjl6h" (OuterVolumeSpecName: "kube-api-access-cjl6h") pod "b7a5bb9d-d218-4c4b-b914-ee401a0e1e52" (UID: "b7a5bb9d-d218-4c4b-b914-ee401a0e1e52"). InnerVolumeSpecName "kube-api-access-cjl6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:36:24.260465 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:24.260424    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7a5bb9d-d218-4c4b-b914-ee401a0e1e52-plugins-config-volume\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:36:24.260465 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:24.260461    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjl6h\" (UniqueName: \"kubernetes.io/projected/b7a5bb9d-d218-4c4b-b914-ee401a0e1e52-kube-api-access-cjl6h\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:36:24.395264 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:24.395223    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db481032-d752-4ad0-a7b2-a5246490d262" path="/var/lib/kubelet/pods/db481032-d752-4ad0-a7b2-a5246490d262/volumes"
Sep 16 12:36:24.603355 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:24.603292    2576 generic.go:356] "Generic (PLEG): container finished" podID="b7a5bb9d-d218-4c4b-b914-ee401a0e1e52" containerID="48353b4c3c01e6d853c893a41d4d17a29f20e0c094c8059045e6169973536ae1" exitCode=0
Sep 16 12:36:24.603507 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:24.603357    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk" event={"ID":"b7a5bb9d-d218-4c4b-b914-ee401a0e1e52","Type":"ContainerDied","Data":"48353b4c3c01e6d853c893a41d4d17a29f20e0c094c8059045e6169973536ae1"}
Sep 16 12:36:24.603507 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:24.603376    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk"
Sep 16 12:36:24.603507 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:24.603447    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk" event={"ID":"b7a5bb9d-d218-4c4b-b914-ee401a0e1e52","Type":"ContainerDied","Data":"f9cf985d254858f7dfce313525d3296228566803245d1b94c0401a5bc9f6a4f6"}
Sep 16 12:36:24.603507 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:24.603471    2576 scope.go:117] "RemoveContainer" containerID="48353b4c3c01e6d853c893a41d4d17a29f20e0c094c8059045e6169973536ae1"
Sep 16 12:36:24.612480 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:24.612457    2576 scope.go:117] "RemoveContainer" containerID="48353b4c3c01e6d853c893a41d4d17a29f20e0c094c8059045e6169973536ae1"
Sep 16 12:36:24.612751 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:36:24.612732    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48353b4c3c01e6d853c893a41d4d17a29f20e0c094c8059045e6169973536ae1\": container with ID starting with 48353b4c3c01e6d853c893a41d4d17a29f20e0c094c8059045e6169973536ae1 not found: ID does not exist" containerID="48353b4c3c01e6d853c893a41d4d17a29f20e0c094c8059045e6169973536ae1"
Sep 16 12:36:24.612829 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:24.612760    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48353b4c3c01e6d853c893a41d4d17a29f20e0c094c8059045e6169973536ae1"} err="failed to get container status \"48353b4c3c01e6d853c893a41d4d17a29f20e0c094c8059045e6169973536ae1\": rpc error: code = NotFound desc = could not find container \"48353b4c3c01e6d853c893a41d4d17a29f20e0c094c8059045e6169973536ae1\": container with ID starting with 48353b4c3c01e6d853c893a41d4d17a29f20e0c094c8059045e6169973536ae1 not found: ID does not exist"
Sep 16 12:36:24.635766 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:24.635742    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk"]
Sep 16 12:36:24.641073 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:24.641052    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-3863e0-67967b75f8-8cbhk"]
Sep 16 12:36:26.394376 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:26.394337    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7a5bb9d-d218-4c4b-b914-ee401a0e1e52" path="/var/lib/kubelet/pods/b7a5bb9d-d218-4c4b-b914-ee401a0e1e52/volumes"
Sep 16 12:36:31.067007 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:31.066965    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db42a6-c5pkj"]
Sep 16 12:36:31.067649 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:31.067627    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7a5bb9d-d218-4c4b-b914-ee401a0e1e52" containerName="payload-pre-processing"
Sep 16 12:36:31.067739 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:31.067651    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7a5bb9d-d218-4c4b-b914-ee401a0e1e52" containerName="payload-pre-processing"
Sep 16 12:36:31.067739 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:31.067677    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15711897-0941-4e50-b5ec-8cf72c65d30b" containerName="istio-proxy"
Sep 16 12:36:31.067739 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:31.067686    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="15711897-0941-4e50-b5ec-8cf72c65d30b" containerName="istio-proxy"
Sep 16 12:36:31.067739 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:31.067708    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15711897-0941-4e50-b5ec-8cf72c65d30b" containerName="istio-proxy"
Sep 16 12:36:31.067739 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:31.067716    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="15711897-0941-4e50-b5ec-8cf72c65d30b" containerName="istio-proxy"
Sep 16 12:36:31.067739 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:31.067738    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db481032-d752-4ad0-a7b2-a5246490d262" containerName="revoke-keys"
Sep 16 12:36:31.068037 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:31.067747    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="db481032-d752-4ad0-a7b2-a5246490d262" containerName="revoke-keys"
Sep 16 12:36:31.068037 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:31.067850    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="15711897-0941-4e50-b5ec-8cf72c65d30b" containerName="istio-proxy"
Sep 16 12:36:31.068037 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:31.067860    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7a5bb9d-d218-4c4b-b914-ee401a0e1e52" containerName="payload-pre-processing"
Sep 16 12:36:31.068037 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:31.067872    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="15711897-0941-4e50-b5ec-8cf72c65d30b" containerName="istio-proxy"
Sep 16 12:36:31.068037 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:31.067883    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="db481032-d752-4ad0-a7b2-a5246490d262" containerName="revoke-keys"
Sep 16 12:36:31.073677 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:31.073648    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db42a6-c5pkj"
Sep 16 12:36:31.076275 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:31.076249    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9lc86\""
Sep 16 12:36:31.077775 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:31.077757    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db42a6-c5pkj"]
Sep 16 12:36:31.131827 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:31.131794    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/09ddd6d4-ecfc-4130-8ba9-c22b58b6e695-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-db42a6-c5pkj\" (UID: \"09ddd6d4-ecfc-4130-8ba9-c22b58b6e695\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db42a6-c5pkj"
Sep 16 12:36:31.232996 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:31.232960    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/09ddd6d4-ecfc-4130-8ba9-c22b58b6e695-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-db42a6-c5pkj\" (UID: \"09ddd6d4-ecfc-4130-8ba9-c22b58b6e695\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db42a6-c5pkj"
Sep 16 12:36:31.233665 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:31.233642    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/09ddd6d4-ecfc-4130-8ba9-c22b58b6e695-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-db42a6-c5pkj\" (UID: \"09ddd6d4-ecfc-4130-8ba9-c22b58b6e695\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db42a6-c5pkj"
Sep 16 12:36:31.385687 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:31.385656    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db42a6-c5pkj"
Sep 16 12:36:31.659953 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:31.659932    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db42a6-c5pkj"]
Sep 16 12:36:31.662038 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:36:31.662011    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09ddd6d4_ecfc_4130_8ba9_c22b58b6e695.slice/crio-d774c46a4a319145c9a2ef6dfff91810874c0dfaa86addee25615dd2c8ec85a7 WatchSource:0}: Error finding container d774c46a4a319145c9a2ef6dfff91810874c0dfaa86addee25615dd2c8ec85a7: Status 404 returned error can't find the container with id d774c46a4a319145c9a2ef6dfff91810874c0dfaa86addee25615dd2c8ec85a7
Sep 16 12:36:32.657499 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:32.657402    2576 generic.go:356] "Generic (PLEG): container finished" podID="09ddd6d4-ecfc-4130-8ba9-c22b58b6e695" containerID="2502e44dceb3931aeabf880a10bea178478b0daf7d5fcc4e0c269ae21bd9c32e" exitCode=0
Sep 16 12:36:32.657499 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:32.657475    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db42a6-c5pkj" event={"ID":"09ddd6d4-ecfc-4130-8ba9-c22b58b6e695","Type":"ContainerDied","Data":"2502e44dceb3931aeabf880a10bea178478b0daf7d5fcc4e0c269ae21bd9c32e"}
Sep 16 12:36:32.657900 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:32.657528    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db42a6-c5pkj" event={"ID":"09ddd6d4-ecfc-4130-8ba9-c22b58b6e695","Type":"ContainerStarted","Data":"d774c46a4a319145c9a2ef6dfff91810874c0dfaa86addee25615dd2c8ec85a7"}
Sep 16 12:36:33.809952 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:33.809928    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db42a6-c5pkj"
Sep 16 12:36:33.962066 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:33.961987    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/09ddd6d4-ecfc-4130-8ba9-c22b58b6e695-maas-api-service-ca\") pod \"09ddd6d4-ecfc-4130-8ba9-c22b58b6e695\" (UID: \"09ddd6d4-ecfc-4130-8ba9-c22b58b6e695\") "
Sep 16 12:36:33.962366 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:33.962343    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09ddd6d4-ecfc-4130-8ba9-c22b58b6e695-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "09ddd6d4-ecfc-4130-8ba9-c22b58b6e695" (UID: "09ddd6d4-ecfc-4130-8ba9-c22b58b6e695"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:36:34.063082 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:34.063049    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/09ddd6d4-ecfc-4130-8ba9-c22b58b6e695-maas-api-service-ca\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:36:34.671285 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:34.671204    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db42a6-c5pkj"
Sep 16 12:36:34.671285 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:34.671255    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db42a6-c5pkj" event={"ID":"09ddd6d4-ecfc-4130-8ba9-c22b58b6e695","Type":"ContainerDied","Data":"d774c46a4a319145c9a2ef6dfff91810874c0dfaa86addee25615dd2c8ec85a7"}
Sep 16 12:36:34.671495 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:34.671298    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d774c46a4a319145c9a2ef6dfff91810874c0dfaa86addee25615dd2c8ec85a7"
Sep 16 12:36:41.588088 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:41.588007    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-db42a6-29826030-5v2j9"]
Sep 16 12:36:41.590185 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:41.590162    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-db42a6-29826030-5v2j9"]
Sep 16 12:36:41.613396 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:41.613367    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6"]
Sep 16 12:36:41.613650 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:41.613622    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6" podUID="4cef6f9b-52a2-43be-88e4-662ed9a3b45c" containerName="payload-processing" containerID="cri-o://e0229b75f3f752ec0cd94616d6d63681f5729c7b3c6d371fff07fd4b84548c50" gracePeriod=30
Sep 16 12:36:41.622195 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:41.621652    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd"]
Sep 16 12:36:41.622195 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:41.621859    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd" podUID="c1bd305e-6644-49a7-b5c5-f020d2f9495f" containerName="payload-pre-processing" containerID="cri-o://f888d0d520db9da8007e9414c592aebbb9144d381b0cd0222a03d63e4038d837" gracePeriod=30
Sep 16 12:36:41.751376 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:41.751303    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db42a6-c5pkj"]
Sep 16 12:36:41.754767 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:41.754736    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-db42a6-c5pkj"]
Sep 16 12:36:41.910247 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:41.910220    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6"
Sep 16 12:36:41.913109 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:41.913091    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd"
Sep 16 12:36:42.038660 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.038628    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4p6gn\" (UniqueName: \"kubernetes.io/projected/4cef6f9b-52a2-43be-88e4-662ed9a3b45c-kube-api-access-4p6gn\") pod \"4cef6f9b-52a2-43be-88e4-662ed9a3b45c\" (UID: \"4cef6f9b-52a2-43be-88e4-662ed9a3b45c\") "
Sep 16 12:36:42.038858 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.038694    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bkhb\" (UniqueName: \"kubernetes.io/projected/c1bd305e-6644-49a7-b5c5-f020d2f9495f-kube-api-access-4bkhb\") pod \"c1bd305e-6644-49a7-b5c5-f020d2f9495f\" (UID: \"c1bd305e-6644-49a7-b5c5-f020d2f9495f\") "
Sep 16 12:36:42.038858 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.038747    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cef6f9b-52a2-43be-88e4-662ed9a3b45c-plugins-config-volume\") pod \"4cef6f9b-52a2-43be-88e4-662ed9a3b45c\" (UID: \"4cef6f9b-52a2-43be-88e4-662ed9a3b45c\") "
Sep 16 12:36:42.038858 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.038769    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1bd305e-6644-49a7-b5c5-f020d2f9495f-plugins-config-volume\") pod \"c1bd305e-6644-49a7-b5c5-f020d2f9495f\" (UID: \"c1bd305e-6644-49a7-b5c5-f020d2f9495f\") "
Sep 16 12:36:42.039131 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.039103    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cef6f9b-52a2-43be-88e4-662ed9a3b45c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4cef6f9b-52a2-43be-88e4-662ed9a3b45c" (UID: "4cef6f9b-52a2-43be-88e4-662ed9a3b45c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:36:42.039269 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.039196    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1bd305e-6644-49a7-b5c5-f020d2f9495f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c1bd305e-6644-49a7-b5c5-f020d2f9495f" (UID: "c1bd305e-6644-49a7-b5c5-f020d2f9495f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:36:42.040917 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.040895    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1bd305e-6644-49a7-b5c5-f020d2f9495f-kube-api-access-4bkhb" (OuterVolumeSpecName: "kube-api-access-4bkhb") pod "c1bd305e-6644-49a7-b5c5-f020d2f9495f" (UID: "c1bd305e-6644-49a7-b5c5-f020d2f9495f"). InnerVolumeSpecName "kube-api-access-4bkhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:36:42.040984 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.040956    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cef6f9b-52a2-43be-88e4-662ed9a3b45c-kube-api-access-4p6gn" (OuterVolumeSpecName: "kube-api-access-4p6gn") pod "4cef6f9b-52a2-43be-88e4-662ed9a3b45c" (UID: "4cef6f9b-52a2-43be-88e4-662ed9a3b45c"). InnerVolumeSpecName "kube-api-access-4p6gn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:36:42.144396 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.140131    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4p6gn\" (UniqueName: \"kubernetes.io/projected/4cef6f9b-52a2-43be-88e4-662ed9a3b45c-kube-api-access-4p6gn\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:36:42.144396 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.140165    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bkhb\" (UniqueName: \"kubernetes.io/projected/c1bd305e-6644-49a7-b5c5-f020d2f9495f-kube-api-access-4bkhb\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:36:42.144396 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.140188    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4cef6f9b-52a2-43be-88e4-662ed9a3b45c-plugins-config-volume\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:36:42.144396 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.140203    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1bd305e-6644-49a7-b5c5-f020d2f9495f-plugins-config-volume\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:36:42.394304 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.394265    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09ddd6d4-ecfc-4130-8ba9-c22b58b6e695" path="/var/lib/kubelet/pods/09ddd6d4-ecfc-4130-8ba9-c22b58b6e695/volumes"
Sep 16 12:36:42.394778 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.394729    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d2b64bf-2a2f-476b-a154-591d71d909e9" path="/var/lib/kubelet/pods/2d2b64bf-2a2f-476b-a154-591d71d909e9/volumes"
Sep 16 12:36:42.717900 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.717812    2576 generic.go:356] "Generic (PLEG): container finished" podID="4cef6f9b-52a2-43be-88e4-662ed9a3b45c" containerID="e0229b75f3f752ec0cd94616d6d63681f5729c7b3c6d371fff07fd4b84548c50" exitCode=0
Sep 16 12:36:42.717900 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.717886    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6"
Sep 16 12:36:42.718413 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.717900    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6" event={"ID":"4cef6f9b-52a2-43be-88e4-662ed9a3b45c","Type":"ContainerDied","Data":"e0229b75f3f752ec0cd94616d6d63681f5729c7b3c6d371fff07fd4b84548c50"}
Sep 16 12:36:42.718413 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.717959    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6" event={"ID":"4cef6f9b-52a2-43be-88e4-662ed9a3b45c","Type":"ContainerDied","Data":"6f7d24cf24738c021d40216a10150e7edd6df9458a3bd8778ee2c6bbb53d5079"}
Sep 16 12:36:42.718413 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.717976    2576 scope.go:117] "RemoveContainer" containerID="e0229b75f3f752ec0cd94616d6d63681f5729c7b3c6d371fff07fd4b84548c50"
Sep 16 12:36:42.719770 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.719742    2576 generic.go:356] "Generic (PLEG): container finished" podID="c1bd305e-6644-49a7-b5c5-f020d2f9495f" containerID="f888d0d520db9da8007e9414c592aebbb9144d381b0cd0222a03d63e4038d837" exitCode=0
Sep 16 12:36:42.719886 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.719820    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd" event={"ID":"c1bd305e-6644-49a7-b5c5-f020d2f9495f","Type":"ContainerDied","Data":"f888d0d520db9da8007e9414c592aebbb9144d381b0cd0222a03d63e4038d837"}
Sep 16 12:36:42.719886 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.719847    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd"
Sep 16 12:36:42.719886 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.719859    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd" event={"ID":"c1bd305e-6644-49a7-b5c5-f020d2f9495f","Type":"ContainerDied","Data":"2a7dd43507f06312a8e53cea0a11bb180d2ce03550eef839ec97cdb1db54fb5a"}
Sep 16 12:36:42.731447 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.731417    2576 scope.go:117] "RemoveContainer" containerID="e0229b75f3f752ec0cd94616d6d63681f5729c7b3c6d371fff07fd4b84548c50"
Sep 16 12:36:42.731895 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:36:42.731871    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0229b75f3f752ec0cd94616d6d63681f5729c7b3c6d371fff07fd4b84548c50\": container with ID starting with e0229b75f3f752ec0cd94616d6d63681f5729c7b3c6d371fff07fd4b84548c50 not found: ID does not exist" containerID="e0229b75f3f752ec0cd94616d6d63681f5729c7b3c6d371fff07fd4b84548c50"
Sep 16 12:36:42.731966 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.731905    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0229b75f3f752ec0cd94616d6d63681f5729c7b3c6d371fff07fd4b84548c50"} err="failed to get container status \"e0229b75f3f752ec0cd94616d6d63681f5729c7b3c6d371fff07fd4b84548c50\": rpc error: code = NotFound desc = could not find container \"e0229b75f3f752ec0cd94616d6d63681f5729c7b3c6d371fff07fd4b84548c50\": container with ID starting with e0229b75f3f752ec0cd94616d6d63681f5729c7b3c6d371fff07fd4b84548c50 not found: ID does not exist"
Sep 16 12:36:42.731966 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.731921    2576 scope.go:117] "RemoveContainer" containerID="f888d0d520db9da8007e9414c592aebbb9144d381b0cd0222a03d63e4038d837"
Sep 16 12:36:42.737955 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.737935    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6"]
Sep 16 12:36:42.740629 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.740611    2576 scope.go:117] "RemoveContainer" containerID="f888d0d520db9da8007e9414c592aebbb9144d381b0cd0222a03d63e4038d837"
Sep 16 12:36:42.740979 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:36:42.740934    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f888d0d520db9da8007e9414c592aebbb9144d381b0cd0222a03d63e4038d837\": container with ID starting with f888d0d520db9da8007e9414c592aebbb9144d381b0cd0222a03d63e4038d837 not found: ID does not exist" containerID="f888d0d520db9da8007e9414c592aebbb9144d381b0cd0222a03d63e4038d837"
Sep 16 12:36:42.740979 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.740962    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f888d0d520db9da8007e9414c592aebbb9144d381b0cd0222a03d63e4038d837"} err="failed to get container status \"f888d0d520db9da8007e9414c592aebbb9144d381b0cd0222a03d63e4038d837\": rpc error: code = NotFound desc = could not find container \"f888d0d520db9da8007e9414c592aebbb9144d381b0cd0222a03d63e4038d837\": container with ID starting with f888d0d520db9da8007e9414c592aebbb9144d381b0cd0222a03d63e4038d837 not found: ID does not exist"
Sep 16 12:36:42.744181 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.744156    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-db42a6-647c85fbbc-6d5m6"]
Sep 16 12:36:42.756551 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.756529    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd"]
Sep 16 12:36:42.760268 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:42.760249    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-db42a6-7d9c6bc7c4-qhbvd"]
Sep 16 12:36:44.395034 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:44.394999    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cef6f9b-52a2-43be-88e4-662ed9a3b45c" path="/var/lib/kubelet/pods/4cef6f9b-52a2-43be-88e4-662ed9a3b45c/volumes"
Sep 16 12:36:44.395445 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:44.395393    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1bd305e-6644-49a7-b5c5-f020d2f9495f" path="/var/lib/kubelet/pods/c1bd305e-6644-49a7-b5c5-f020d2f9495f/volumes"
Sep 16 12:36:49.111032 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:49.110995    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c03953-pp6w2"]
Sep 16 12:36:49.111539 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:49.111457    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09ddd6d4-ecfc-4130-8ba9-c22b58b6e695" containerName="revoke-keys"
Sep 16 12:36:49.111539 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:49.111468    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="09ddd6d4-ecfc-4130-8ba9-c22b58b6e695" containerName="revoke-keys"
Sep 16 12:36:49.111539 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:49.111482    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cef6f9b-52a2-43be-88e4-662ed9a3b45c" containerName="payload-processing"
Sep 16 12:36:49.111539 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:49.111489    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cef6f9b-52a2-43be-88e4-662ed9a3b45c" containerName="payload-processing"
Sep 16 12:36:49.111539 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:49.111510    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1bd305e-6644-49a7-b5c5-f020d2f9495f" containerName="payload-pre-processing"
Sep 16 12:36:49.111539 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:49.111515    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1bd305e-6644-49a7-b5c5-f020d2f9495f" containerName="payload-pre-processing"
Sep 16 12:36:49.111777 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:49.111581    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cef6f9b-52a2-43be-88e4-662ed9a3b45c" containerName="payload-processing"
Sep 16 12:36:49.111777 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:49.111593    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="09ddd6d4-ecfc-4130-8ba9-c22b58b6e695" containerName="revoke-keys"
Sep 16 12:36:49.111777 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:49.111612    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1bd305e-6644-49a7-b5c5-f020d2f9495f" containerName="payload-pre-processing"
Sep 16 12:36:49.115023 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:49.114999    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c03953-pp6w2"
Sep 16 12:36:49.118143 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:49.118116    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9lc86\""
Sep 16 12:36:49.122068 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:49.122043    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c03953-pp6w2"]
Sep 16 12:36:49.213179 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:49.213136    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/957aa640-7cbd-4236-a717-179761c4e7a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-c03953-pp6w2\" (UID: \"957aa640-7cbd-4236-a717-179761c4e7a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c03953-pp6w2"
Sep 16 12:36:49.314248 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:49.314209    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/957aa640-7cbd-4236-a717-179761c4e7a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-c03953-pp6w2\" (UID: \"957aa640-7cbd-4236-a717-179761c4e7a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c03953-pp6w2"
Sep 16 12:36:49.314854 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:49.314833    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/957aa640-7cbd-4236-a717-179761c4e7a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-c03953-pp6w2\" (UID: \"957aa640-7cbd-4236-a717-179761c4e7a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c03953-pp6w2"
Sep 16 12:36:49.427952 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:49.427873    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c03953-pp6w2"
Sep 16 12:36:49.700878 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:49.700793    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c03953-pp6w2"]
Sep 16 12:36:49.705153 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:36:49.705123    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod957aa640_7cbd_4236_a717_179761c4e7a1.slice/crio-c15f95eefe43a6f6690da63502029f0665a953f6429e26aeef81080252aa1fe4 WatchSource:0}: Error finding container c15f95eefe43a6f6690da63502029f0665a953f6429e26aeef81080252aa1fe4: Status 404 returned error can't find the container with id c15f95eefe43a6f6690da63502029f0665a953f6429e26aeef81080252aa1fe4
Sep 16 12:36:49.763775 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:49.763749    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c03953-pp6w2" event={"ID":"957aa640-7cbd-4236-a717-179761c4e7a1","Type":"ContainerStarted","Data":"c15f95eefe43a6f6690da63502029f0665a953f6429e26aeef81080252aa1fe4"}
Sep 16 12:36:50.771131 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:50.771047    2576 generic.go:356] "Generic (PLEG): container finished" podID="957aa640-7cbd-4236-a717-179761c4e7a1" containerID="33742d9941ff170caa9a1856ea5e4f920b6329196a275da30e2459b398077ff2" exitCode=0
Sep 16 12:36:50.771537 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:50.771141    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c03953-pp6w2" event={"ID":"957aa640-7cbd-4236-a717-179761c4e7a1","Type":"ContainerDied","Data":"33742d9941ff170caa9a1856ea5e4f920b6329196a275da30e2459b398077ff2"}
Sep 16 12:36:51.922995 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:51.922967    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c03953-pp6w2"
Sep 16 12:36:51.937971 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:51.937645    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/957aa640-7cbd-4236-a717-179761c4e7a1-maas-api-service-ca\") pod \"957aa640-7cbd-4236-a717-179761c4e7a1\" (UID: \"957aa640-7cbd-4236-a717-179761c4e7a1\") "
Sep 16 12:36:51.938219 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:51.938192    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/957aa640-7cbd-4236-a717-179761c4e7a1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "957aa640-7cbd-4236-a717-179761c4e7a1" (UID: "957aa640-7cbd-4236-a717-179761c4e7a1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:36:51.938466 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:51.938446    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/957aa640-7cbd-4236-a717-179761c4e7a1-maas-api-service-ca\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:36:52.784448 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:52.784361    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c03953-pp6w2" event={"ID":"957aa640-7cbd-4236-a717-179761c4e7a1","Type":"ContainerDied","Data":"c15f95eefe43a6f6690da63502029f0665a953f6429e26aeef81080252aa1fe4"}
Sep 16 12:36:52.784448 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:52.784415    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c15f95eefe43a6f6690da63502029f0665a953f6429e26aeef81080252aa1fe4"
Sep 16 12:36:52.784448 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:52.784369    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c03953-pp6w2"
Sep 16 12:36:59.707437 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:59.707400    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5"]
Sep 16 12:36:59.707964 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:59.707660    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5" podUID="86046ef4-6a68-4453-843d-cf7fd1dd0d71" containerName="payload-processing" containerID="cri-o://819c31bb0da0304c3e591f59a7b492e3bc14f5b6ff5ac67c470e6f296a9d1cae" gracePeriod=30
Sep 16 12:36:59.719275 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:59.719247    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv"]
Sep 16 12:36:59.719542 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:59.719518    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv" podUID="e10bb12b-7fda-49ff-9a7d-7f64a9b83732" containerName="payload-pre-processing" containerID="cri-o://575ba8c7c43c88a083722f6af28edae52e16372a341d1aa936a457370230047d" gracePeriod=30
Sep 16 12:36:59.824675 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:59.824644    2576 generic.go:356] "Generic (PLEG): container finished" podID="86046ef4-6a68-4453-843d-cf7fd1dd0d71" containerID="819c31bb0da0304c3e591f59a7b492e3bc14f5b6ff5ac67c470e6f296a9d1cae" exitCode=0
Sep 16 12:36:59.824845 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:59.824727    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5" event={"ID":"86046ef4-6a68-4453-843d-cf7fd1dd0d71","Type":"ContainerDied","Data":"819c31bb0da0304c3e591f59a7b492e3bc14f5b6ff5ac67c470e6f296a9d1cae"}
Sep 16 12:36:59.874222 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:59.874188    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c03953-pp6w2"]
Sep 16 12:36:59.876579 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:36:59.876547    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-c03953-pp6w2"]
Sep 16 12:37:00.015931 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.015902    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5"
Sep 16 12:37:00.018937 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.018910    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv"
Sep 16 12:37:00.133692 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.133657    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e10bb12b-7fda-49ff-9a7d-7f64a9b83732-plugins-config-volume\") pod \"e10bb12b-7fda-49ff-9a7d-7f64a9b83732\" (UID: \"e10bb12b-7fda-49ff-9a7d-7f64a9b83732\") "
Sep 16 12:37:00.133878 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.133751    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86046ef4-6a68-4453-843d-cf7fd1dd0d71-plugins-config-volume\") pod \"86046ef4-6a68-4453-843d-cf7fd1dd0d71\" (UID: \"86046ef4-6a68-4453-843d-cf7fd1dd0d71\") "
Sep 16 12:37:00.133878 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.133787    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5p4dr\" (UniqueName: \"kubernetes.io/projected/e10bb12b-7fda-49ff-9a7d-7f64a9b83732-kube-api-access-5p4dr\") pod \"e10bb12b-7fda-49ff-9a7d-7f64a9b83732\" (UID: \"e10bb12b-7fda-49ff-9a7d-7f64a9b83732\") "
Sep 16 12:37:00.133878 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.133814    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svx2c\" (UniqueName: \"kubernetes.io/projected/86046ef4-6a68-4453-843d-cf7fd1dd0d71-kube-api-access-svx2c\") pod \"86046ef4-6a68-4453-843d-cf7fd1dd0d71\" (UID: \"86046ef4-6a68-4453-843d-cf7fd1dd0d71\") "
Sep 16 12:37:00.134081 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.134055    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e10bb12b-7fda-49ff-9a7d-7f64a9b83732-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e10bb12b-7fda-49ff-9a7d-7f64a9b83732" (UID: "e10bb12b-7fda-49ff-9a7d-7f64a9b83732"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:37:00.134195 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.134171    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86046ef4-6a68-4453-843d-cf7fd1dd0d71-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "86046ef4-6a68-4453-843d-cf7fd1dd0d71" (UID: "86046ef4-6a68-4453-843d-cf7fd1dd0d71"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:37:00.134245 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.134200    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e10bb12b-7fda-49ff-9a7d-7f64a9b83732-plugins-config-volume\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:37:00.136012 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.135992    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e10bb12b-7fda-49ff-9a7d-7f64a9b83732-kube-api-access-5p4dr" (OuterVolumeSpecName: "kube-api-access-5p4dr") pod "e10bb12b-7fda-49ff-9a7d-7f64a9b83732" (UID: "e10bb12b-7fda-49ff-9a7d-7f64a9b83732"). InnerVolumeSpecName "kube-api-access-5p4dr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:37:00.136065 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.136012    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86046ef4-6a68-4453-843d-cf7fd1dd0d71-kube-api-access-svx2c" (OuterVolumeSpecName: "kube-api-access-svx2c") pod "86046ef4-6a68-4453-843d-cf7fd1dd0d71" (UID: "86046ef4-6a68-4453-843d-cf7fd1dd0d71"). InnerVolumeSpecName "kube-api-access-svx2c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:37:00.235465 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.235391    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5p4dr\" (UniqueName: \"kubernetes.io/projected/e10bb12b-7fda-49ff-9a7d-7f64a9b83732-kube-api-access-5p4dr\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:37:00.235465 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.235419    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svx2c\" (UniqueName: \"kubernetes.io/projected/86046ef4-6a68-4453-843d-cf7fd1dd0d71-kube-api-access-svx2c\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:37:00.235465 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.235428    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86046ef4-6a68-4453-843d-cf7fd1dd0d71-plugins-config-volume\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:37:00.400622 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.400569    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="957aa640-7cbd-4236-a717-179761c4e7a1" path="/var/lib/kubelet/pods/957aa640-7cbd-4236-a717-179761c4e7a1/volumes"
Sep 16 12:37:00.832249 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.832220    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5"
Sep 16 12:37:00.832679 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.832217    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5" event={"ID":"86046ef4-6a68-4453-843d-cf7fd1dd0d71","Type":"ContainerDied","Data":"1ae8ecda6b62b75f553da787ec25f8e93ec83c222a8a706b17eb409adba07f04"}
Sep 16 12:37:00.832679 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.832381    2576 scope.go:117] "RemoveContainer" containerID="819c31bb0da0304c3e591f59a7b492e3bc14f5b6ff5ac67c470e6f296a9d1cae"
Sep 16 12:37:00.833838 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.833681    2576 generic.go:356] "Generic (PLEG): container finished" podID="e10bb12b-7fda-49ff-9a7d-7f64a9b83732" containerID="575ba8c7c43c88a083722f6af28edae52e16372a341d1aa936a457370230047d" exitCode=0
Sep 16 12:37:00.833838 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.833717    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv" event={"ID":"e10bb12b-7fda-49ff-9a7d-7f64a9b83732","Type":"ContainerDied","Data":"575ba8c7c43c88a083722f6af28edae52e16372a341d1aa936a457370230047d"}
Sep 16 12:37:00.833838 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.833776    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv" event={"ID":"e10bb12b-7fda-49ff-9a7d-7f64a9b83732","Type":"ContainerDied","Data":"caf320f00975f35b4058bf85d615866d57c8c56c4864e61b7bb12ce90c1151b5"}
Sep 16 12:37:00.833838 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.833793    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv"
Sep 16 12:37:00.844716 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.844644    2576 scope.go:117] "RemoveContainer" containerID="575ba8c7c43c88a083722f6af28edae52e16372a341d1aa936a457370230047d"
Sep 16 12:37:00.853965 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.853947    2576 scope.go:117] "RemoveContainer" containerID="575ba8c7c43c88a083722f6af28edae52e16372a341d1aa936a457370230047d"
Sep 16 12:37:00.854262 ip-10-0-137-240 kubenswrapper[2576]: E0916 12:37:00.854242    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"575ba8c7c43c88a083722f6af28edae52e16372a341d1aa936a457370230047d\": container with ID starting with 575ba8c7c43c88a083722f6af28edae52e16372a341d1aa936a457370230047d not found: ID does not exist" containerID="575ba8c7c43c88a083722f6af28edae52e16372a341d1aa936a457370230047d"
Sep 16 12:37:00.854401 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.854270    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"575ba8c7c43c88a083722f6af28edae52e16372a341d1aa936a457370230047d"} err="failed to get container status \"575ba8c7c43c88a083722f6af28edae52e16372a341d1aa936a457370230047d\": rpc error: code = NotFound desc = could not find container \"575ba8c7c43c88a083722f6af28edae52e16372a341d1aa936a457370230047d\": container with ID starting with 575ba8c7c43c88a083722f6af28edae52e16372a341d1aa936a457370230047d not found: ID does not exist"
Sep 16 12:37:00.855503 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.855484    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv"]
Sep 16 12:37:00.858894 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.858875    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c03953-6c457b8674-8rmnv"]
Sep 16 12:37:00.869601 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.869578    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5"]
Sep 16 12:37:00.872365 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:00.872344    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-c03953-bc84c55bf-rjzf5"]
Sep 16 12:37:02.395536 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:02.395496    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86046ef4-6a68-4453-843d-cf7fd1dd0d71" path="/var/lib/kubelet/pods/86046ef4-6a68-4453-843d-cf7fd1dd0d71/volumes"
Sep 16 12:37:02.396031 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:02.396014    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e10bb12b-7fda-49ff-9a7d-7f64a9b83732" path="/var/lib/kubelet/pods/e10bb12b-7fda-49ff-9a7d-7f64a9b83732/volumes"
Sep 16 12:37:11.749721 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:11.749683    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d8575c494-2t7ph"]
Sep 16 12:37:11.750260 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:11.750144    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-d8575c494-2t7ph" podUID="8553286a-bc85-4353-8ee9-fcda8c49dad4" containerName="manager" containerID="cri-o://7ed2d362f4477ce5511e0581790dff54ae9e7a39978fc2ff696cdec8ebbdf3e0" gracePeriod=30
Sep 16 12:37:11.901939 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:11.901906    2576 generic.go:356] "Generic (PLEG): container finished" podID="8553286a-bc85-4353-8ee9-fcda8c49dad4" containerID="7ed2d362f4477ce5511e0581790dff54ae9e7a39978fc2ff696cdec8ebbdf3e0" exitCode=0
Sep 16 12:37:11.902109 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:11.901976    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d8575c494-2t7ph" event={"ID":"8553286a-bc85-4353-8ee9-fcda8c49dad4","Type":"ContainerDied","Data":"7ed2d362f4477ce5511e0581790dff54ae9e7a39978fc2ff696cdec8ebbdf3e0"}
Sep 16 12:37:12.004349 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:12.004268    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d8575c494-2t7ph"
Sep 16 12:37:12.150379 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:12.150343    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4pnb\" (UniqueName: \"kubernetes.io/projected/8553286a-bc85-4353-8ee9-fcda8c49dad4-kube-api-access-h4pnb\") pod \"8553286a-bc85-4353-8ee9-fcda8c49dad4\" (UID: \"8553286a-bc85-4353-8ee9-fcda8c49dad4\") "
Sep 16 12:37:12.150529 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:12.150419    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8553286a-bc85-4353-8ee9-fcda8c49dad4-webhook-cert\") pod \"8553286a-bc85-4353-8ee9-fcda8c49dad4\" (UID: \"8553286a-bc85-4353-8ee9-fcda8c49dad4\") "
Sep 16 12:37:12.150529 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:12.150509    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8553286a-bc85-4353-8ee9-fcda8c49dad4-metrics-certs\") pod \"8553286a-bc85-4353-8ee9-fcda8c49dad4\" (UID: \"8553286a-bc85-4353-8ee9-fcda8c49dad4\") "
Sep 16 12:37:12.152637 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:12.152606    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8553286a-bc85-4353-8ee9-fcda8c49dad4-kube-api-access-h4pnb" (OuterVolumeSpecName: "kube-api-access-h4pnb") pod "8553286a-bc85-4353-8ee9-fcda8c49dad4" (UID: "8553286a-bc85-4353-8ee9-fcda8c49dad4"). InnerVolumeSpecName "kube-api-access-h4pnb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:37:12.152637 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:12.152631    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8553286a-bc85-4353-8ee9-fcda8c49dad4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8553286a-bc85-4353-8ee9-fcda8c49dad4" (UID: "8553286a-bc85-4353-8ee9-fcda8c49dad4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:37:12.152793 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:12.152675    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8553286a-bc85-4353-8ee9-fcda8c49dad4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8553286a-bc85-4353-8ee9-fcda8c49dad4" (UID: "8553286a-bc85-4353-8ee9-fcda8c49dad4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:37:12.251908 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:12.251876    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4pnb\" (UniqueName: \"kubernetes.io/projected/8553286a-bc85-4353-8ee9-fcda8c49dad4-kube-api-access-h4pnb\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:37:12.251908 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:12.251902    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8553286a-bc85-4353-8ee9-fcda8c49dad4-webhook-cert\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:37:12.251908 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:12.251912    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8553286a-bc85-4353-8ee9-fcda8c49dad4-metrics-certs\") on node \"ip-10-0-137-240.ec2.internal\" DevicePath \"\""
Sep 16 12:37:12.909878 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:12.909850    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d8575c494-2t7ph"
Sep 16 12:37:12.910336 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:12.909884    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d8575c494-2t7ph" event={"ID":"8553286a-bc85-4353-8ee9-fcda8c49dad4","Type":"ContainerDied","Data":"aebce5057931d3575ec7697dea8461af0c6522318323c61e74e443e5f27f6df1"}
Sep 16 12:37:12.910336 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:12.909932    2576 scope.go:117] "RemoveContainer" containerID="7ed2d362f4477ce5511e0581790dff54ae9e7a39978fc2ff696cdec8ebbdf3e0"
Sep 16 12:37:12.927204 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:12.927180    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d8575c494-2t7ph"]
Sep 16 12:37:12.930252 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:12.930230    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-d8575c494-2t7ph"]
Sep 16 12:37:14.396538 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:14.396499    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8553286a-bc85-4353-8ee9-fcda8c49dad4" path="/var/lib/kubelet/pods/8553286a-bc85-4353-8ee9-fcda8c49dad4/volumes"
Sep 16 12:37:14.554697 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:14.554661    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tb7dg_fb6b35a8-78d4-40b2-a087-7b45e92b2234/ovn-acl-logging/0.log"
Sep 16 12:37:14.555419 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:14.555393    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tb7dg_fb6b35a8-78d4-40b2-a087-7b45e92b2234/ovn-acl-logging/0.log"
Sep 16 12:37:14.908454 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:37:14.908406    2576 scope.go:117] "RemoveContainer" containerID="02588fd317ec5d4d1933f52b84dac3551d1330b2d57c45165098f325139f6929"
Sep 16 12:38:37.724617 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.724582    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d8575c494-dcgp5"]
Sep 16 12:38:37.725129 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.725117    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="957aa640-7cbd-4236-a717-179761c4e7a1" containerName="revoke-keys"
Sep 16 12:38:37.725188 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.725135    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="957aa640-7cbd-4236-a717-179761c4e7a1" containerName="revoke-keys"
Sep 16 12:38:37.725188 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.725147    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8553286a-bc85-4353-8ee9-fcda8c49dad4" containerName="manager"
Sep 16 12:38:37.725188 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.725152    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8553286a-bc85-4353-8ee9-fcda8c49dad4" containerName="manager"
Sep 16 12:38:37.725188 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.725161    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e10bb12b-7fda-49ff-9a7d-7f64a9b83732" containerName="payload-pre-processing"
Sep 16 12:38:37.725188 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.725168    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e10bb12b-7fda-49ff-9a7d-7f64a9b83732" containerName="payload-pre-processing"
Sep 16 12:38:37.725188 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.725176    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86046ef4-6a68-4453-843d-cf7fd1dd0d71" containerName="payload-processing"
Sep 16 12:38:37.725188 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.725181    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="86046ef4-6a68-4453-843d-cf7fd1dd0d71" containerName="payload-processing"
Sep 16 12:38:37.725432 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.725242    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e10bb12b-7fda-49ff-9a7d-7f64a9b83732" containerName="payload-pre-processing"
Sep 16 12:38:37.725432 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.725250    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="957aa640-7cbd-4236-a717-179761c4e7a1" containerName="revoke-keys"
Sep 16 12:38:37.725432 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.725260    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8553286a-bc85-4353-8ee9-fcda8c49dad4" containerName="manager"
Sep 16 12:38:37.725432 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.725265    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="86046ef4-6a68-4453-843d-cf7fd1dd0d71" containerName="payload-processing"
Sep 16 12:38:37.728493 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.728477    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d8575c494-dcgp5"
Sep 16 12:38:37.731027 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.730998    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ddsz6\""
Sep 16 12:38:37.731159 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.731116    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 16 12:38:37.732088 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.732068    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 16 12:38:37.732193 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.732101    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 16 12:38:37.736619 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.736598    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d8575c494-dcgp5"]
Sep 16 12:38:37.869657 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.869625    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/296605a1-3d20-49f8-af97-a7449c7a4eb8-webhook-cert\") pod \"maas-controller-d8575c494-dcgp5\" (UID: \"296605a1-3d20-49f8-af97-a7449c7a4eb8\") " pod="opendatahub/maas-controller-d8575c494-dcgp5"
Sep 16 12:38:37.869832 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.869663    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk68h\" (UniqueName: \"kubernetes.io/projected/296605a1-3d20-49f8-af97-a7449c7a4eb8-kube-api-access-wk68h\") pod \"maas-controller-d8575c494-dcgp5\" (UID: \"296605a1-3d20-49f8-af97-a7449c7a4eb8\") " pod="opendatahub/maas-controller-d8575c494-dcgp5"
Sep 16 12:38:37.869882 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.869846    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/296605a1-3d20-49f8-af97-a7449c7a4eb8-metrics-certs\") pod \"maas-controller-d8575c494-dcgp5\" (UID: \"296605a1-3d20-49f8-af97-a7449c7a4eb8\") " pod="opendatahub/maas-controller-d8575c494-dcgp5"
Sep 16 12:38:37.970780 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.970743    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/296605a1-3d20-49f8-af97-a7449c7a4eb8-webhook-cert\") pod \"maas-controller-d8575c494-dcgp5\" (UID: \"296605a1-3d20-49f8-af97-a7449c7a4eb8\") " pod="opendatahub/maas-controller-d8575c494-dcgp5"
Sep 16 12:38:37.970780 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.970780    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk68h\" (UniqueName: \"kubernetes.io/projected/296605a1-3d20-49f8-af97-a7449c7a4eb8-kube-api-access-wk68h\") pod \"maas-controller-d8575c494-dcgp5\" (UID: \"296605a1-3d20-49f8-af97-a7449c7a4eb8\") " pod="opendatahub/maas-controller-d8575c494-dcgp5"
Sep 16 12:38:37.970979 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.970884    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/296605a1-3d20-49f8-af97-a7449c7a4eb8-metrics-certs\") pod \"maas-controller-d8575c494-dcgp5\" (UID: \"296605a1-3d20-49f8-af97-a7449c7a4eb8\") " pod="opendatahub/maas-controller-d8575c494-dcgp5"
Sep 16 12:38:37.973641 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.973612    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/296605a1-3d20-49f8-af97-a7449c7a4eb8-metrics-certs\") pod \"maas-controller-d8575c494-dcgp5\" (UID: \"296605a1-3d20-49f8-af97-a7449c7a4eb8\") " pod="opendatahub/maas-controller-d8575c494-dcgp5"
Sep 16 12:38:37.973791 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.973612    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/296605a1-3d20-49f8-af97-a7449c7a4eb8-webhook-cert\") pod \"maas-controller-d8575c494-dcgp5\" (UID: \"296605a1-3d20-49f8-af97-a7449c7a4eb8\") " pod="opendatahub/maas-controller-d8575c494-dcgp5"
Sep 16 12:38:37.979284 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:37.979216    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk68h\" (UniqueName: \"kubernetes.io/projected/296605a1-3d20-49f8-af97-a7449c7a4eb8-kube-api-access-wk68h\") pod \"maas-controller-d8575c494-dcgp5\" (UID: \"296605a1-3d20-49f8-af97-a7449c7a4eb8\") " pod="opendatahub/maas-controller-d8575c494-dcgp5"
Sep 16 12:38:38.040965 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:38.040932    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d8575c494-dcgp5"
Sep 16 12:38:38.314111 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:38.314086    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d8575c494-dcgp5"]
Sep 16 12:38:38.315881 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:38:38.315852    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod296605a1_3d20_49f8_af97_a7449c7a4eb8.slice/crio-868139ca9243eebff10ef5396e5e4e8675c8026fb9b32f3401482bb19a895b10 WatchSource:0}: Error finding container 868139ca9243eebff10ef5396e5e4e8675c8026fb9b32f3401482bb19a895b10: Status 404 returned error can't find the container with id 868139ca9243eebff10ef5396e5e4e8675c8026fb9b32f3401482bb19a895b10
Sep 16 12:38:38.317266 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:38.317248    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 12:38:38.371166 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:38.371131    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d8575c494-dcgp5" event={"ID":"296605a1-3d20-49f8-af97-a7449c7a4eb8","Type":"ContainerStarted","Data":"868139ca9243eebff10ef5396e5e4e8675c8026fb9b32f3401482bb19a895b10"}
Sep 16 12:38:39.377570 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:39.377526    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d8575c494-dcgp5" event={"ID":"296605a1-3d20-49f8-af97-a7449c7a4eb8","Type":"ContainerStarted","Data":"cc263864dac4a154eec84df5231bb17db24f2acb5feb52deb3a108e46349efa3"}
Sep 16 12:38:39.377961 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:39.377625    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d8575c494-dcgp5"
Sep 16 12:38:39.396052 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:39.396007    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d8575c494-dcgp5" podStartSLOduration=2.076472797 podStartE2EDuration="2.395992481s" totalImagesPullingTime="319.519684ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:38:39.394865909 +0000 UTC m=+2185.563830616" watchObservedRunningTime="2026-09-16 12:38:39.395992481 +0000 UTC m=+2185.564957188"
Sep 16 12:38:50.386046 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:38:50.386018    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d8575c494-dcgp5"
Sep 16 12:41:14.982289 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:41:14.982257    2576 scope.go:117] "RemoveContainer" containerID="13ab8af8498808b6933ef22093f530eabcd36d7b2d9373e91941ab99a9311367"
Sep 16 12:41:14.991230 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:41:14.991206    2576 scope.go:117] "RemoveContainer" containerID="c0dad94406612037f2ecea6101a66a46fe7e661f7ad1ec7f0426401aee7163b3"
Sep 16 12:42:14.593301 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:42:14.593262    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tb7dg_fb6b35a8-78d4-40b2-a087-7b45e92b2234/ovn-acl-logging/0.log"
Sep 16 12:42:14.595377 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:42:14.595357    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tb7dg_fb6b35a8-78d4-40b2-a087-7b45e92b2234/ovn-acl-logging/0.log"
Sep 16 12:42:15.015844 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:42:15.015811    2576 scope.go:117] "RemoveContainer" containerID="918e58ef25c295b2a533d02f8836d86798e2a4979e47f82264d40461fc567d61"
Sep 16 12:42:53.307552 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:42:53.307474    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-tjjlr_f9760368-a10d-4cbe-91f6-da746a43f44a/manager/0.log"
Sep 16 12:42:53.452230 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:42:53.452202    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-dcg42_9e8d62ea-b469-4d45-9113-3480c4a5868a/manager/0.log"
Sep 16 12:42:53.621848 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:42:53.621822    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-d8575c494-dcgp5_296605a1-3d20-49f8-af97-a7449c7a4eb8/manager/0.log"
Sep 16 12:42:54.370795 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:42:54.370766    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b54c497cf-rmdvf_9e61c677-df57-4b0b-b863-60a5ae670cb5/copy-manifests/0.log"
Sep 16 12:42:54.382387 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:42:54.382361    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b54c497cf-rmdvf_9e61c677-df57-4b0b-b863-60a5ae670cb5/manager/0.log"
Sep 16 12:42:55.141179 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:42:55.141150    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29826030-4rx9l_967110bc-c9ad-45ef-9be0-ebd61e14adc9/cleanup/0.log"
Sep 16 12:42:55.288558 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:42:55.288530    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-rs4mt_5e3af338-dccc-40fc-abcb-b0ccd1be4e19/postgres/0.log"
Sep 16 12:42:56.427223 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:42:56.427196    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-x69w7_3856504b-72e4-4c0e-b205-48f4c65483c3/manager/0.log"
Sep 16 12:42:56.549070 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:42:56.549042    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-bwjw9_a785d79d-e71e-44ac-8887-91a5f0178c95/manager/0.log"
Sep 16 12:42:57.628224 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:42:57.628193    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb_11b1a66a-a978-4dfa-9485-a56d0a3b6b2d/istio-proxy/0.log"
Sep 16 12:42:58.168926 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:42:58.168897    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-xtdcn_f8ca5c0e-e21e-432c-8e61-d18e876bb904/istio-proxy/1.log"
Sep 16 12:42:58.315184 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:42:58.315152    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-4hfft_40cd11db-3c75-4f28-aba7-caee4cd3d952/payload-pre-processing/0.log"
Sep 16 12:42:58.455701 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:42:58.455627    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pgdkq_b34262c2-533f-4c3b-b82f-f52f256fbaec/payload-processing/0.log"
Sep 16 12:42:59.118429 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:42:59.118400    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-v6s7k_ae7bc84e-8a7b-4ab7-8b41-3847ef8d0ae0/main/0.log"
Sep 16 12:42:59.503694 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:42:59.503613    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fl7f5l_faf4e17d-bf60-4677-bf01-baae88d52dff/main/0.log"
Sep 16 12:43:09.872348 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:09.872304    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-f2cw4_adc5bf4e-bcb9-4c7f-be43-8d36a70a55aa/global-pull-secret-syncer/0.log"
Sep 16 12:43:10.094913 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:10.094884    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zjz4j_43306d34-2366-4ca1-b63b-1362b9495ee9/konnectivity-agent/0.log"
Sep 16 12:43:10.182786 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:10.182715    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-240.ec2.internal_a9435f0d3784aef4bb9e6f27c49dafc3/haproxy/0.log"
Sep 16 12:43:15.036925 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:15.036891    2576 scope.go:117] "RemoveContainer" containerID="33742d9941ff170caa9a1856ea5e4f920b6329196a275da30e2459b398077ff2"
Sep 16 12:43:15.045680 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:15.045659    2576 scope.go:117] "RemoveContainer" containerID="2502e44dceb3931aeabf880a10bea178478b0daf7d5fcc4e0c269ae21bd9c32e"
Sep 16 12:43:15.368010 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:15.367979    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-x69w7_3856504b-72e4-4c0e-b205-48f4c65483c3/manager/0.log"
Sep 16 12:43:15.411277 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:15.411248    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-bwjw9_a785d79d-e71e-44ac-8887-91a5f0178c95/manager/0.log"
Sep 16 12:43:17.547461 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:17.547429    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f0f07c08-edbf-4a82-8d71-ac25d24866ea/alertmanager/0.log"
Sep 16 12:43:17.668159 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:17.668068    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f0f07c08-edbf-4a82-8d71-ac25d24866ea/config-reloader/0.log"
Sep 16 12:43:17.746836 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:17.746806    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f0f07c08-edbf-4a82-8d71-ac25d24866ea/kube-rbac-proxy-web/0.log"
Sep 16 12:43:17.802450 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:17.802424    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f0f07c08-edbf-4a82-8d71-ac25d24866ea/kube-rbac-proxy/0.log"
Sep 16 12:43:17.880258 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:17.880232    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f0f07c08-edbf-4a82-8d71-ac25d24866ea/kube-rbac-proxy-metric/0.log"
Sep 16 12:43:17.947897 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:17.947827    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f0f07c08-edbf-4a82-8d71-ac25d24866ea/prom-label-proxy/0.log"
Sep 16 12:43:18.000689 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:18.000661    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f0f07c08-edbf-4a82-8d71-ac25d24866ea/init-config-reloader/0.log"
Sep 16 12:43:18.167307 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:18.167252    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-4mc9f_37f094a7-073d-4e13-a44e-725b73012a35/kube-state-metrics/0.log"
Sep 16 12:43:18.193291 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:18.193263    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-4mc9f_37f094a7-073d-4e13-a44e-725b73012a35/kube-rbac-proxy-main/0.log"
Sep 16 12:43:18.238596 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:18.238520    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-4mc9f_37f094a7-073d-4e13-a44e-725b73012a35/kube-rbac-proxy-self/0.log"
Sep 16 12:43:18.285777 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:18.285750    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7848cb88fc-dtdcm_00d111ef-b475-4d41-8f2a-48bd14eab7ec/metrics-server/0.log"
Sep 16 12:43:18.320923 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:18.320891    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-llsqs_7005fad8-295b-4177-99ac-d1184abe0892/monitoring-plugin/0.log"
Sep 16 12:43:18.586133 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:18.586012    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z87bt_c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564/node-exporter/0.log"
Sep 16 12:43:18.612295 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:18.612249    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z87bt_c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564/kube-rbac-proxy/0.log"
Sep 16 12:43:18.639779 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:18.639758    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z87bt_c32bbaf2-8460-4cfe-9dd5-7dd7c56d1564/init-textfile/0.log"
Sep 16 12:43:18.681969 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:18.681949    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-gb9t4_aa578d5c-1d4a-465a-8f1d-00e7be81a208/kube-rbac-proxy-main/0.log"
Sep 16 12:43:18.713798 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:18.713764    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-gb9t4_aa578d5c-1d4a-465a-8f1d-00e7be81a208/kube-rbac-proxy-self/0.log"
Sep 16 12:43:18.761942 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:18.761902    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-gb9t4_aa578d5c-1d4a-465a-8f1d-00e7be81a208/openshift-state-metrics/0.log"
Sep 16 12:43:18.822406 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:18.822385    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f03e463e-5f57-4c6c-a864-e30965cac514/prometheus/0.log"
Sep 16 12:43:18.866147 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:18.866125    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f03e463e-5f57-4c6c-a864-e30965cac514/config-reloader/0.log"
Sep 16 12:43:18.892351 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:18.892326    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8nlh7/perf-node-gather-daemonset-48k2m"]
Sep 16 12:43:18.898043 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:18.898021    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8nlh7/perf-node-gather-daemonset-48k2m"
Sep 16 12:43:18.901862 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:18.901821    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8nlh7\"/\"kube-root-ca.crt\""
Sep 16 12:43:18.901967 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:18.901933    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8nlh7\"/\"default-dockercfg-x94cz\""
Sep 16 12:43:18.906359 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:18.906341    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8nlh7\"/\"openshift-service-ca.crt\""
Sep 16 12:43:18.931178 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:18.931154    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8nlh7/perf-node-gather-daemonset-48k2m"]
Sep 16 12:43:18.937160 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:18.937143    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f03e463e-5f57-4c6c-a864-e30965cac514/thanos-sidecar/0.log"
Sep 16 12:43:18.970999 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:18.970972    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7dafb8b-023b-4880-8a8c-2f417e9c7716-sys\") pod \"perf-node-gather-daemonset-48k2m\" (UID: \"d7dafb8b-023b-4880-8a8c-2f417e9c7716\") " pod="openshift-must-gather-8nlh7/perf-node-gather-daemonset-48k2m"
Sep 16 12:43:18.971140 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:18.971118    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d7dafb8b-023b-4880-8a8c-2f417e9c7716-podres\") pod \"perf-node-gather-daemonset-48k2m\" (UID: \"d7dafb8b-023b-4880-8a8c-2f417e9c7716\") " pod="openshift-must-gather-8nlh7/perf-node-gather-daemonset-48k2m"
Sep 16 12:43:18.971256 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:18.971239    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j58w6\" (UniqueName: \"kubernetes.io/projected/d7dafb8b-023b-4880-8a8c-2f417e9c7716-kube-api-access-j58w6\") pod \"perf-node-gather-daemonset-48k2m\" (UID: \"d7dafb8b-023b-4880-8a8c-2f417e9c7716\") " pod="openshift-must-gather-8nlh7/perf-node-gather-daemonset-48k2m"
Sep 16 12:43:18.971299 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:18.971282    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d7dafb8b-023b-4880-8a8c-2f417e9c7716-proc\") pod \"perf-node-gather-daemonset-48k2m\" (UID: \"d7dafb8b-023b-4880-8a8c-2f417e9c7716\") " pod="openshift-must-gather-8nlh7/perf-node-gather-daemonset-48k2m"
Sep 16 12:43:18.971380 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:18.971305    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7dafb8b-023b-4880-8a8c-2f417e9c7716-lib-modules\") pod \"perf-node-gather-daemonset-48k2m\" (UID: \"d7dafb8b-023b-4880-8a8c-2f417e9c7716\") " pod="openshift-must-gather-8nlh7/perf-node-gather-daemonset-48k2m"
Sep 16 12:43:19.000541 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.000519    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f03e463e-5f57-4c6c-a864-e30965cac514/kube-rbac-proxy-web/0.log"
Sep 16 12:43:19.056933 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.056914    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f03e463e-5f57-4c6c-a864-e30965cac514/kube-rbac-proxy/0.log"
Sep 16 12:43:19.072794 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.072768    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d7dafb8b-023b-4880-8a8c-2f417e9c7716-proc\") pod \"perf-node-gather-daemonset-48k2m\" (UID: \"d7dafb8b-023b-4880-8a8c-2f417e9c7716\") " pod="openshift-must-gather-8nlh7/perf-node-gather-daemonset-48k2m"
Sep 16 12:43:19.072891 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.072800    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7dafb8b-023b-4880-8a8c-2f417e9c7716-lib-modules\") pod \"perf-node-gather-daemonset-48k2m\" (UID: \"d7dafb8b-023b-4880-8a8c-2f417e9c7716\") " pod="openshift-must-gather-8nlh7/perf-node-gather-daemonset-48k2m"
Sep 16 12:43:19.072891 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.072845    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7dafb8b-023b-4880-8a8c-2f417e9c7716-sys\") pod \"perf-node-gather-daemonset-48k2m\" (UID: \"d7dafb8b-023b-4880-8a8c-2f417e9c7716\") " pod="openshift-must-gather-8nlh7/perf-node-gather-daemonset-48k2m"
Sep 16 12:43:19.072891 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.072875    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d7dafb8b-023b-4880-8a8c-2f417e9c7716-podres\") pod \"perf-node-gather-daemonset-48k2m\" (UID: \"d7dafb8b-023b-4880-8a8c-2f417e9c7716\") " pod="openshift-must-gather-8nlh7/perf-node-gather-daemonset-48k2m"
Sep 16 12:43:19.073007 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.072896    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d7dafb8b-023b-4880-8a8c-2f417e9c7716-proc\") pod \"perf-node-gather-daemonset-48k2m\" (UID: \"d7dafb8b-023b-4880-8a8c-2f417e9c7716\") " pod="openshift-must-gather-8nlh7/perf-node-gather-daemonset-48k2m"
Sep 16 12:43:19.073007 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.072955    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d7dafb8b-023b-4880-8a8c-2f417e9c7716-lib-modules\") pod \"perf-node-gather-daemonset-48k2m\" (UID: \"d7dafb8b-023b-4880-8a8c-2f417e9c7716\") " pod="openshift-must-gather-8nlh7/perf-node-gather-daemonset-48k2m"
Sep 16 12:43:19.073007 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.072964    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j58w6\" (UniqueName: \"kubernetes.io/projected/d7dafb8b-023b-4880-8a8c-2f417e9c7716-kube-api-access-j58w6\") pod \"perf-node-gather-daemonset-48k2m\" (UID: \"d7dafb8b-023b-4880-8a8c-2f417e9c7716\") " pod="openshift-must-gather-8nlh7/perf-node-gather-daemonset-48k2m"
Sep 16 12:43:19.073007 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.072963    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7dafb8b-023b-4880-8a8c-2f417e9c7716-sys\") pod \"perf-node-gather-daemonset-48k2m\" (UID: \"d7dafb8b-023b-4880-8a8c-2f417e9c7716\") " pod="openshift-must-gather-8nlh7/perf-node-gather-daemonset-48k2m"
Sep 16 12:43:19.073007 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.072985    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d7dafb8b-023b-4880-8a8c-2f417e9c7716-podres\") pod \"perf-node-gather-daemonset-48k2m\" (UID: \"d7dafb8b-023b-4880-8a8c-2f417e9c7716\") " pod="openshift-must-gather-8nlh7/perf-node-gather-daemonset-48k2m"
Sep 16 12:43:19.082464 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.082441    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j58w6\" (UniqueName: \"kubernetes.io/projected/d7dafb8b-023b-4880-8a8c-2f417e9c7716-kube-api-access-j58w6\") pod \"perf-node-gather-daemonset-48k2m\" (UID: \"d7dafb8b-023b-4880-8a8c-2f417e9c7716\") " pod="openshift-must-gather-8nlh7/perf-node-gather-daemonset-48k2m"
Sep 16 12:43:19.108287 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.108265    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f03e463e-5f57-4c6c-a864-e30965cac514/kube-rbac-proxy-thanos/0.log"
Sep 16 12:43:19.144192 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.144139    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f03e463e-5f57-4c6c-a864-e30965cac514/init-config-reloader/0.log"
Sep 16 12:43:19.196220 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.196203    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-qbvnt_deb90443-89e0-492f-a22d-4f01c5c042ac/prometheus-operator/0.log"
Sep 16 12:43:19.208044 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.208022    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8nlh7/perf-node-gather-daemonset-48k2m"
Sep 16 12:43:19.250845 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.250821    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-qbvnt_deb90443-89e0-492f-a22d-4f01c5c042ac/kube-rbac-proxy/0.log"
Sep 16 12:43:19.351018 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.350993    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6895c9dbf5-klvmc_3c90b7bf-5842-4749-813c-98d02a3c8edf/telemeter-client/0.log"
Sep 16 12:43:19.391652 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.391629    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6895c9dbf5-klvmc_3c90b7bf-5842-4749-813c-98d02a3c8edf/reload/0.log"
Sep 16 12:43:19.434933 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.434872    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6895c9dbf5-klvmc_3c90b7bf-5842-4749-813c-98d02a3c8edf/kube-rbac-proxy/0.log"
Sep 16 12:43:19.495951 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.495931    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8nlh7/perf-node-gather-daemonset-48k2m"]
Sep 16 12:43:19.497307 ip-10-0-137-240 kubenswrapper[2576]: W0916 12:43:19.497282    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd7dafb8b_023b_4880_8a8c_2f417e9c7716.slice/crio-4ab63d190818cf32d38c024762671acc225e4d96c87226a8d92cd3317a111165 WatchSource:0}: Error finding container 4ab63d190818cf32d38c024762671acc225e4d96c87226a8d92cd3317a111165: Status 404 returned error can't find the container with id 4ab63d190818cf32d38c024762671acc225e4d96c87226a8d92cd3317a111165
Sep 16 12:43:19.505556 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.505538    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d4679ccc4-7l8jv_3d558b8f-26c9-4f80-9697-60b5e5291a50/thanos-query/0.log"
Sep 16 12:43:19.564529 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.564506    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d4679ccc4-7l8jv_3d558b8f-26c9-4f80-9697-60b5e5291a50/kube-rbac-proxy-web/0.log"
Sep 16 12:43:19.601911 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.601891    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d4679ccc4-7l8jv_3d558b8f-26c9-4f80-9697-60b5e5291a50/kube-rbac-proxy/0.log"
Sep 16 12:43:19.636710 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.636683    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d4679ccc4-7l8jv_3d558b8f-26c9-4f80-9697-60b5e5291a50/prom-label-proxy/0.log"
Sep 16 12:43:19.673567 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.673550    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d4679ccc4-7l8jv_3d558b8f-26c9-4f80-9697-60b5e5291a50/kube-rbac-proxy-rules/0.log"
Sep 16 12:43:19.703185 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.703127    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d4679ccc4-7l8jv_3d558b8f-26c9-4f80-9697-60b5e5291a50/kube-rbac-proxy-metrics/0.log"
Sep 16 12:43:19.879851 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.879815    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8nlh7/perf-node-gather-daemonset-48k2m" event={"ID":"d7dafb8b-023b-4880-8a8c-2f417e9c7716","Type":"ContainerStarted","Data":"6f10ebb319a55dc4495dd78b6dad7470164b1665f73264f838cea51ddf17981e"}
Sep 16 12:43:19.880024 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.879866    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8nlh7/perf-node-gather-daemonset-48k2m" event={"ID":"d7dafb8b-023b-4880-8a8c-2f417e9c7716","Type":"ContainerStarted","Data":"4ab63d190818cf32d38c024762671acc225e4d96c87226a8d92cd3317a111165"}
Sep 16 12:43:19.880024 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.879916    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8nlh7/perf-node-gather-daemonset-48k2m"
Sep 16 12:43:19.898237 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:19.898188    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8nlh7/perf-node-gather-daemonset-48k2m" podStartSLOduration=1.8981725919999999 podStartE2EDuration="1.898172592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:43:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:43:19.896871066 +0000 UTC m=+2466.065835786" watchObservedRunningTime="2026-09-16 12:43:19.898172592 +0000 UTC m=+2466.067137298"
Sep 16 12:43:21.946990 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:21.946961    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f6777d646-v9f7d_40286131-6f5e-4814-a64c-8ecfa9c9755c/console/0.log"
Sep 16 12:43:23.726360 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:23.726333    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t4gsd_338da2cf-d706-4e26-a554-cdf094cfab4a/dns/0.log"
Sep 16 12:43:23.754671 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:23.754632    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t4gsd_338da2cf-d706-4e26-a554-cdf094cfab4a/kube-rbac-proxy/0.log"
Sep 16 12:43:23.911213 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:23.911190    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-njgng_5db11b86-96e5-48c8-84cc-174c9d8f5afe/dns-node-resolver/0.log"
Sep 16 12:43:24.568147 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:24.568118    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5kmrr_4445dc63-354e-46f6-8c05-70215ea9909e/node-ca/0.log"
Sep 16 12:43:25.641742 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:25.641706    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb_11b1a66a-a978-4dfa-9485-a56d0a3b6b2d/istio-proxy/0.log"
Sep 16 12:43:25.894609 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:25.894537    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8nlh7/perf-node-gather-daemonset-48k2m"
Sep 16 12:43:26.125385 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:26.125336    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-xtdcn_f8ca5c0e-e21e-432c-8e61-d18e876bb904/istio-proxy/0.log"
Sep 16 12:43:26.128261 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:26.128240    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-xtdcn_f8ca5c0e-e21e-432c-8e61-d18e876bb904/istio-proxy/1.log"
Sep 16 12:43:26.157418 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:26.157345    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-4hfft_40cd11db-3c75-4f28-aba7-caee4cd3d952/payload-pre-processing/0.log"
Sep 16 12:43:26.187968 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:26.187946    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pgdkq_b34262c2-533f-4c3b-b82f-f52f256fbaec/payload-processing/0.log"
Sep 16 12:43:27.162249 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:27.162217    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kt228_244e73f8-246b-4a53-baa6-551d6e490867/serve-healthcheck-canary/0.log"
Sep 16 12:43:27.988278 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:27.988250    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n46zh_6d3631ca-3bfd-4470-a406-13156c76abda/kube-rbac-proxy/0.log"
Sep 16 12:43:28.019102 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:28.019067    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n46zh_6d3631ca-3bfd-4470-a406-13156c76abda/exporter/0.log"
Sep 16 12:43:28.060169 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:28.060148    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n46zh_6d3631ca-3bfd-4470-a406-13156c76abda/extractor/0.log"
Sep 16 12:43:30.562994 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:30.562972    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-tjjlr_f9760368-a10d-4cbe-91f6-da746a43f44a/manager/0.log"
Sep 16 12:43:30.863469 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:30.863444    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-dcg42_9e8d62ea-b469-4d45-9113-3480c4a5868a/manager/0.log"
Sep 16 12:43:30.889111 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:30.889065    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb_11b1a66a-a978-4dfa-9485-a56d0a3b6b2d/istio-proxy/0.log"
Sep 16 12:43:30.927121 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:30.927093    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-d8575c494-dcgp5_296605a1-3d20-49f8-af97-a7449c7a4eb8/manager/0.log"
Sep 16 12:43:31.387808 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:31.387784    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b54c497cf-rmdvf_9e61c677-df57-4b0b-b863-60a5ae670cb5/manager/0.log"
Sep 16 12:43:31.404693 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:31.404667    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-xtdcn_f8ca5c0e-e21e-432c-8e61-d18e876bb904/istio-proxy/0.log"
Sep 16 12:43:31.407006 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:31.406987    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-xtdcn_f8ca5c0e-e21e-432c-8e61-d18e876bb904/istio-proxy/1.log"
Sep 16 12:43:31.425125 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:31.425102    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b54c497cf-rmdvf_9e61c677-df57-4b0b-b863-60a5ae670cb5/copy-manifests/0.log"
Sep 16 12:43:31.428862 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:31.428840    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-4hfft_40cd11db-3c75-4f28-aba7-caee4cd3d952/payload-pre-processing/0.log"
Sep 16 12:43:31.453195 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:31.453174    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pgdkq_b34262c2-533f-4c3b-b82f-f52f256fbaec/payload-processing/0.log"
Sep 16 12:43:32.765032 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:32.765003    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-596fbdbcd6-q5fbg_97ec7311-fe23-4ae4-b24b-07f9b3d62f85/manager/0.log"
Sep 16 12:43:33.092715 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:33.092618    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-wkfrb_11b1a66a-a978-4dfa-9485-a56d0a3b6b2d/istio-proxy/0.log"
Sep 16 12:43:33.598622 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:33.598565    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-xtdcn_f8ca5c0e-e21e-432c-8e61-d18e876bb904/istio-proxy/0.log"
Sep 16 12:43:33.599076 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:33.599057    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-xtdcn_f8ca5c0e-e21e-432c-8e61-d18e876bb904/istio-proxy/1.log"
Sep 16 12:43:33.622999 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:33.622973    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-4hfft_40cd11db-3c75-4f28-aba7-caee4cd3d952/payload-pre-processing/0.log"
Sep 16 12:43:33.647368 ip-10-0-137-240 kubenswrapper[2576]: I0916 12:43:33.647343    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pgdkq_b34262c2-533f-4c3b-b82f-f52f256fbaec/payload-processing/0.log"