Sep 18 22:00:23.541999 ip-10-0-141-255 systemd[1]: Starting Kubernetes Kubelet...
Sep 18 22:00:23.892193 ip-10-0-141-255 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 22:00:23.892193 ip-10-0-141-255 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 18 22:00:23.892193 ip-10-0-141-255 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 22:00:23.892193 ip-10-0-141-255 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 18 22:00:23.892193 ip-10-0-141-255 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 22:00:23.892988 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.892903    2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 18 22:00:23.900365 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900347    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 22:00:23.900365 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900363    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 22:00:23.900365 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900366    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 22:00:23.900365 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900369    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 22:00:23.900365 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900372    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 22:00:23.900537 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900375    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 22:00:23.900537 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900378    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 22:00:23.900537 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900381    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 22:00:23.900537 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900384    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 22:00:23.900537 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900387    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 22:00:23.900537 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900389    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 22:00:23.900537 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900398    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 22:00:23.900537 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900400    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 22:00:23.900537 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900404    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 22:00:23.900537 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900406    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 22:00:23.900537 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900409    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 22:00:23.900537 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900411    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 22:00:23.900537 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900414    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 22:00:23.900537 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900416    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 22:00:23.900537 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900421    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 22:00:23.900537 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900425    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 22:00:23.900537 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900428    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 22:00:23.900537 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900430    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 22:00:23.900537 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900433    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 22:00:23.900537 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900436    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 22:00:23.901030 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900438    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 22:00:23.901030 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900441    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 22:00:23.901030 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900443    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 22:00:23.901030 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900446    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 22:00:23.901030 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900448    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 22:00:23.901030 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900451    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 22:00:23.901030 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900454    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 22:00:23.901030 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900456    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 22:00:23.901030 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900459    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 22:00:23.901030 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900461    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 22:00:23.901030 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900464    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 22:00:23.901030 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900468    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 22:00:23.901030 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900471    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 22:00:23.901030 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900474    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 22:00:23.901030 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900476    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 22:00:23.901030 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900478    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 22:00:23.901030 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900481    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 22:00:23.901030 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900484    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 22:00:23.901030 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900486    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 22:00:23.901030 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900489    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 22:00:23.901503 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900491    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 22:00:23.901503 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900494    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 22:00:23.901503 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900497    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 22:00:23.901503 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900499    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 22:00:23.901503 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900501    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 22:00:23.901503 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900504    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 22:00:23.901503 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900506    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 22:00:23.901503 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900509    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 22:00:23.901503 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900512    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 22:00:23.901503 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900514    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 22:00:23.901503 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900516    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 22:00:23.901503 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900518    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 22:00:23.901503 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900521    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 22:00:23.901503 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900523    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 22:00:23.901503 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900526    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 22:00:23.901503 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900528    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 22:00:23.901503 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900531    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 22:00:23.901503 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900533    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 22:00:23.901503 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900536    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 22:00:23.902015 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900539    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 22:00:23.902015 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900541    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 22:00:23.902015 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900544    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 22:00:23.902015 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900546    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 22:00:23.902015 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900550    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 22:00:23.902015 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900552    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 22:00:23.902015 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900555    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 22:00:23.902015 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900557    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 22:00:23.902015 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900560    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 22:00:23.902015 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900562    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 22:00:23.902015 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900566    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 22:00:23.902015 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900569    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 22:00:23.902015 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900574    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 22:00:23.902015 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900578    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 22:00:23.902015 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900581    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 22:00:23.902015 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900583    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 22:00:23.902015 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900586    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 22:00:23.902015 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900589    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 22:00:23.902015 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900591    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 22:00:23.902511 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900594    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 22:00:23.902511 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900597    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 22:00:23.902511 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900599    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 22:00:23.902511 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900601    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 22:00:23.902511 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900604    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 22:00:23.902511 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900606    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 22:00:23.902511 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900608    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 22:00:23.902511 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900611    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 22:00:23.902511 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900613    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 22:00:23.902511 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900616    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 22:00:23.902511 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900618    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 22:00:23.902511 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900622    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 22:00:23.902511 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900624    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 22:00:23.902511 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900627    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 22:00:23.902511 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900629    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 22:00:23.902511 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.900632    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 22:00:23.902511 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901357    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 22:00:23.902511 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901365    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 22:00:23.902511 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901368    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 22:00:23.903028 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901371    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 22:00:23.903028 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901374    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 22:00:23.903028 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901377    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 22:00:23.903028 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901379    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 22:00:23.903028 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901382    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 22:00:23.903028 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901384    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 22:00:23.903028 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901391    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 22:00:23.903028 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901394    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 22:00:23.903028 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901398    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 22:00:23.903028 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901402    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 22:00:23.903028 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901405    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 22:00:23.903028 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901407    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 22:00:23.903028 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901410    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 22:00:23.903028 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901412    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 22:00:23.903028 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901415    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 22:00:23.903028 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901417    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 22:00:23.903028 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901420    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 22:00:23.903028 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901422    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 22:00:23.903028 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901425    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 22:00:23.903491 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901427    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 22:00:23.903491 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901430    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 22:00:23.903491 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901433    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 22:00:23.903491 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901435    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 22:00:23.903491 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901437    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 22:00:23.903491 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901442    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 22:00:23.903491 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901447    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 22:00:23.903491 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901450    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 22:00:23.903491 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901452    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 22:00:23.903491 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901455    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 22:00:23.903491 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901457    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 22:00:23.903491 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901460    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 22:00:23.903491 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901463    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 22:00:23.903491 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901466    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 22:00:23.903491 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901470    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 22:00:23.903491 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901473    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 22:00:23.903491 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901476    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 22:00:23.903491 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901478    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 22:00:23.903491 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901481    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 22:00:23.904000 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901483    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 22:00:23.904000 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901487    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 22:00:23.904000 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901490    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 22:00:23.904000 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901492    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 22:00:23.904000 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901495    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 22:00:23.904000 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901498    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 22:00:23.904000 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901500    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 22:00:23.904000 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901504    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 22:00:23.904000 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901506    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 22:00:23.904000 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901509    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 22:00:23.904000 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901512    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 22:00:23.904000 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901514    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 22:00:23.904000 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901517    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 22:00:23.904000 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901519    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 22:00:23.904000 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901522    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 22:00:23.904000 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901524    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 22:00:23.904000 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901527    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 22:00:23.904000 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901529    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 22:00:23.904000 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901532    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 22:00:23.904461 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901535    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 22:00:23.904461 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901537    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 22:00:23.904461 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901540    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 22:00:23.904461 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901542    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 22:00:23.904461 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901545    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 22:00:23.904461 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901548    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 22:00:23.904461 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901550    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 22:00:23.904461 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901553    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 22:00:23.904461 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901555    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 22:00:23.904461 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901558    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 22:00:23.904461 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901560    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 22:00:23.904461 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901562    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 22:00:23.904461 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901565    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 22:00:23.904461 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901567    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 22:00:23.904461 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901570    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 22:00:23.904461 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901573    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 22:00:23.904461 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901575    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 22:00:23.904461 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901578    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 22:00:23.904461 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901580    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 22:00:23.904461 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901583    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 22:00:23.905018 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901585    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 22:00:23.905018 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901588    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 22:00:23.905018 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901590    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 22:00:23.905018 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901593    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 22:00:23.905018 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901595    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 22:00:23.905018 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901598    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 22:00:23.905018 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901600    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 22:00:23.905018 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901602    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 22:00:23.905018 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901605    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 22:00:23.905018 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901607    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 22:00:23.905018 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901610    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 22:00:23.905018 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901612    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 22:00:23.905018 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901614    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 22:00:23.905018 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901617    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 22:00:23.905018 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901619    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 22:00:23.905018 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901621    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 22:00:23.905018 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901624    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 22:00:23.905018 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901627    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 22:00:23.905018 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.901629    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 22:00:23.905018 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902025    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 22:00:23.905506 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902031    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 22:00:23.905506 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902034    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 22:00:23.905506 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902037    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 22:00:23.905506 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902040    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 22:00:23.905506 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902042    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 22:00:23.905506 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902046    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 22:00:23.905506 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902048    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 22:00:23.905506 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902051    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 22:00:23.905506 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902054    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 22:00:23.905506 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902057    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 22:00:23.905506 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902059    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 22:00:23.905506 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902062    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 22:00:23.905506 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902064    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 22:00:23.905506 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902067    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 22:00:23.905506 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902069    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 22:00:23.905506 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902072    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 22:00:23.905506 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902074    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 22:00:23.905506 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902077    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 22:00:23.905506 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902079    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 22:00:23.905506 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902081    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 22:00:23.906005 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902084    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 22:00:23.906005 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902086    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 22:00:23.906005 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902089    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 22:00:23.906005 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902091    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 22:00:23.906005 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902094    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 22:00:23.906005 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902096    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 22:00:23.906005 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902099    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 22:00:23.906005 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902101    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 22:00:23.906005 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902104    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 22:00:23.906005 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902106    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 22:00:23.906005 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902109    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 22:00:23.906005 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902112    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 22:00:23.906005 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902114    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 22:00:23.906005 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902117    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 22:00:23.906005 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902119    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 22:00:23.906005 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902123    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 22:00:23.906005 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902126    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 22:00:23.906005 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902129    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 22:00:23.906005 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902133    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 22:00:23.906475 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902136    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 22:00:23.906475 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902139    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 22:00:23.906475 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902142    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 22:00:23.906475 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902144    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 22:00:23.906475 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902147    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 22:00:23.906475 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902149    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 22:00:23.906475 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902151    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 22:00:23.906475 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902154    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 22:00:23.906475 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902156    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 22:00:23.906475 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902159    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 22:00:23.906475 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902161    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 22:00:23.906475 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902163    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 22:00:23.906475 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902166    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 22:00:23.906475 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902168    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 22:00:23.906475 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902170    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 22:00:23.906475 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902173    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 22:00:23.906475 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902176    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 22:00:23.906475 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902178    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 22:00:23.906475 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902180    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 22:00:23.906475 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902183    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 22:00:23.906975 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902185    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 22:00:23.906975 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902188    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 22:00:23.906975 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902191    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 22:00:23.906975 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902193    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 22:00:23.906975 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902196    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 22:00:23.906975 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902198    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 22:00:23.906975 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902201    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 22:00:23.906975 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902204    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 22:00:23.906975 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902208    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 22:00:23.906975 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902211    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 22:00:23.906975 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902213    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 22:00:23.906975 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902216    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 22:00:23.906975 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902218    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 22:00:23.906975 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902221    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 22:00:23.906975 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902224    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 22:00:23.906975 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902226    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 22:00:23.906975 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902228    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 22:00:23.906975 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902231    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 22:00:23.906975 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902233    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 22:00:23.907468 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902236    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 22:00:23.907468 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902238    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 22:00:23.907468 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902240    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 22:00:23.907468 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902242    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 22:00:23.907468 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902245    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 22:00:23.907468 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902248    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 22:00:23.907468 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902251    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 22:00:23.907468 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902253    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 22:00:23.907468 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902256    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 22:00:23.907468 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902258    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 22:00:23.907468 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902261    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 22:00:23.907468 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902263    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 22:00:23.907468 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902266    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 22:00:23.907468 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902268    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 22:00:23.907468 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902271    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 22:00:23.907468 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902273    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 22:00:23.907468 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902276    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 22:00:23.907468 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902278    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 22:00:23.907468 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902281    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 22:00:23.907468 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.902283    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 22:00:23.907468 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902387    2574 flags.go:64] FLAG: --address="0.0.0.0"
Sep 18 22:00:23.908011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902422    2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 18 22:00:23.908011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902429    2574 flags.go:64] FLAG: --anonymous-auth="true"
Sep 18 22:00:23.908011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902433    2574 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 18 22:00:23.908011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902437    2574 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 18 22:00:23.908011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902440    2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 18 22:00:23.908011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902444    2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 18 22:00:23.908011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902448    2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 18 22:00:23.908011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902451    2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 18 22:00:23.908011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902455    2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 18 22:00:23.908011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902458    2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 18 22:00:23.908011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902463    2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 18 22:00:23.908011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902466    2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 18 22:00:23.908011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902469    2574 flags.go:64] FLAG: --cgroup-root=""
Sep 18 22:00:23.908011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902472    2574 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 18 22:00:23.908011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902475    2574 flags.go:64] FLAG: --client-ca-file=""
Sep 18 22:00:23.908011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902477    2574 flags.go:64] FLAG: --cloud-provider="external"
Sep 18 22:00:23.908011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902480    2574 flags.go:64] FLAG: --cluster-dns="[]"
Sep 18 22:00:23.908011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902484    2574 flags.go:64] FLAG: --cluster-domain=""
Sep 18 22:00:23.908011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902487    2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 18 22:00:23.908011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902490    2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 18 22:00:23.908011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902492    2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 18 22:00:23.908011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902495    2574 flags.go:64] FLAG: --container-log-max-files="5"
Sep 18 22:00:23.908011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902499    2574 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 18 22:00:23.908011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902502    2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 18 22:00:23.908623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902505    2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 18 22:00:23.908623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902509    2574 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 18 22:00:23.908623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902512    2574 flags.go:64] FLAG: --contention-profiling="false"
Sep 18 22:00:23.908623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902515    2574 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 18 22:00:23.908623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902518    2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 18 22:00:23.908623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902521    2574 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 18 22:00:23.908623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902524    2574 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 18 22:00:23.908623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902528    2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 18 22:00:23.908623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902531    2574 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 18 22:00:23.908623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902534    2574 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 18 22:00:23.908623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902537    2574 flags.go:64] FLAG: --enable-load-reader="false"
Sep 18 22:00:23.908623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902540    2574 flags.go:64] FLAG: --enable-server="true"
Sep 18 22:00:23.908623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902542    2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 18 22:00:23.908623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902547    2574 flags.go:64] FLAG: --event-burst="100"
Sep 18 22:00:23.908623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902550    2574 flags.go:64] FLAG: --event-qps="50"
Sep 18 22:00:23.908623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902553    2574 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 18 22:00:23.908623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902556    2574 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 18 22:00:23.908623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902559    2574 flags.go:64] FLAG: --eviction-hard=""
Sep 18 22:00:23.908623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902564    2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 18 22:00:23.908623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902567    2574 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 18 22:00:23.908623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902570    2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 18 22:00:23.908623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902573    2574 flags.go:64] FLAG: --eviction-soft=""
Sep 18 22:00:23.908623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902576    2574 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 18 22:00:23.908623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902578    2574 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 18 22:00:23.908623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902581    2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 18 22:00:23.909279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902583    2574 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 18 22:00:23.909279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902586    2574 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 18 22:00:23.909279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902589    2574 flags.go:64] FLAG: --fail-swap-on="true"
Sep 18 22:00:23.909279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902592    2574 flags.go:64] FLAG: --feature-gates=""
Sep 18 22:00:23.909279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902595    2574 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 18 22:00:23.909279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902598    2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 18 22:00:23.909279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902601    2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 18 22:00:23.909279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902604    2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 18 22:00:23.909279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902607    2574 flags.go:64] FLAG: --healthz-port="10248"
Sep 18 22:00:23.909279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902611    2574 flags.go:64] FLAG: --help="false"
Sep 18 22:00:23.909279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902614    2574 flags.go:64] FLAG: --hostname-override="ip-10-0-141-255.ec2.internal"
Sep 18 22:00:23.909279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902617    2574 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 18 22:00:23.909279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902620    2574 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 18 22:00:23.909279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902622    2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 18 22:00:23.909279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902626    2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 18 22:00:23.909279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902629    2574 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 18 22:00:23.909279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902631    2574 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 18 22:00:23.909279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902634    2574 flags.go:64] FLAG: --image-service-endpoint=""
Sep 18 22:00:23.909279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902637    2574 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 18 22:00:23.909279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902640    2574 flags.go:64] FLAG: --kube-api-burst="100"
Sep 18 22:00:23.909279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902642    2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 18 22:00:23.909279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902645    2574 flags.go:64] FLAG: --kube-api-qps="50"
Sep 18 22:00:23.909279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902660    2574 flags.go:64] FLAG: --kube-reserved=""
Sep 18 22:00:23.909279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902663    2574 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 18 22:00:23.909946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902667    2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 18 22:00:23.909946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902671    2574 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 18 22:00:23.909946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902674    2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 18 22:00:23.909946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902676    2574 flags.go:64] FLAG: --lock-file=""
Sep 18 22:00:23.909946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902679    2574 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 18 22:00:23.909946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902682    2574 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 18 22:00:23.909946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902685    2574 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 18 22:00:23.909946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902690    2574 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 18 22:00:23.909946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902693    2574 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 18 22:00:23.909946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902696    2574 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 18 22:00:23.909946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902698    2574 flags.go:64] FLAG: --logging-format="text"
Sep 18 22:00:23.909946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902701    2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 18 22:00:23.909946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902704    2574 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 18 22:00:23.909946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902707    2574 flags.go:64] FLAG: --manifest-url=""
Sep 18 22:00:23.909946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902711    2574 flags.go:64] FLAG: --manifest-url-header=""
Sep 18 22:00:23.909946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902715    2574 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 18 22:00:23.909946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902718    2574 flags.go:64] FLAG: --max-open-files="1000000"
Sep 18 22:00:23.909946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902722    2574 flags.go:64] FLAG: --max-pods="110"
Sep 18 22:00:23.909946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902725    2574 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 18 22:00:23.909946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902744    2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 18 22:00:23.909946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902747    2574 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 18 22:00:23.909946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902750    2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 18 22:00:23.909946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902753    2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 18 22:00:23.909946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902756    2574 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 18 22:00:23.909946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902758    2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 18 22:00:23.910559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902766    2574 flags.go:64] FLAG: --node-status-max-images="50"
Sep 18 22:00:23.910559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902769    2574 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 18 22:00:23.910559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902772    2574 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 18 22:00:23.910559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902774    2574 flags.go:64] FLAG: --pod-cidr=""
Sep 18 22:00:23.910559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902777    2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 18 22:00:23.910559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902782    2574 flags.go:64] FLAG: --pod-manifest-path=""
Sep 18 22:00:23.910559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902785    2574 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 18 22:00:23.910559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902788    2574 flags.go:64] FLAG: --pods-per-core="0"
Sep 18 22:00:23.910559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902793    2574 flags.go:64] FLAG: --port="10250"
Sep 18 22:00:23.910559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902796    2574 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 18 22:00:23.910559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902799    2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0867db937f2ade9e7"
Sep 18 22:00:23.910559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902802    2574 flags.go:64] FLAG: --qos-reserved=""
Sep 18 22:00:23.910559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902805    2574 flags.go:64] FLAG: --read-only-port="10255"
Sep 18 22:00:23.910559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902808    2574 flags.go:64] FLAG: --register-node="true"
Sep 18 22:00:23.910559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902811    2574 flags.go:64] FLAG: --register-with-taints=""
Sep 18 22:00:23.910559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902814    2574 flags.go:64] FLAG: --registry-burst="10"
Sep 18 22:00:23.910559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902817    2574 flags.go:64] FLAG: --registry-qps="5"
Sep 18 22:00:23.910559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902819    2574 flags.go:64] FLAG: --reserved-cpus=""
Sep 18 22:00:23.910559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902822    2574 flags.go:64] FLAG: --reserved-memory=""
Sep 18 22:00:23.910559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902826    2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 18 22:00:23.910559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902829    2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 18 22:00:23.910559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902831    2574 flags.go:64] FLAG: --rotate-certificates="false"
Sep 18 22:00:23.910559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902836    2574 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 18 22:00:23.910559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902839    2574 flags.go:64] FLAG: --runonce="false"
Sep 18 22:00:23.910559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902842    2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 18 22:00:23.911199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902845    2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 18 22:00:23.911199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902848    2574 flags.go:64] FLAG: --seccomp-default="false"
Sep 18 22:00:23.911199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902851    2574 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 18 22:00:23.911199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902854    2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 18 22:00:23.911199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902857    2574 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 18 22:00:23.911199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902860    2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 18 22:00:23.911199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902863    2574 flags.go:64] FLAG: --storage-driver-password="root"
Sep 18 22:00:23.911199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902866    2574 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 18 22:00:23.911199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902868    2574 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 18 22:00:23.911199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902871    2574 flags.go:64] FLAG: --storage-driver-user="root"
Sep 18 22:00:23.911199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902873    2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 18 22:00:23.911199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902876    2574 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 18 22:00:23.911199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902879    2574 flags.go:64] FLAG: --system-cgroups=""
Sep 18 22:00:23.911199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902882    2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 18 22:00:23.911199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902886    2574 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 18 22:00:23.911199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902891    2574 flags.go:64] FLAG: --tls-cert-file=""
Sep 18 22:00:23.911199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902898    2574 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 18 22:00:23.911199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902908    2574 flags.go:64] FLAG: --tls-min-version=""
Sep 18 22:00:23.911199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902912    2574 flags.go:64] FLAG: --tls-private-key-file=""
Sep 18 22:00:23.911199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902915    2574 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 18 22:00:23.911199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902918    2574 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 18 22:00:23.911199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902920    2574 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 18 22:00:23.911199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902923    2574 flags.go:64] FLAG: --v="2"
Sep 18 22:00:23.911199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902927    2574 flags.go:64] FLAG: --version="false"
Sep 18 22:00:23.911199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902931    2574 flags.go:64] FLAG: --vmodule=""
Sep 18 22:00:23.911825 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902934    2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 18 22:00:23.911825 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.902937    2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 18 22:00:23.911825 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903050    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 22:00:23.911825 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903054    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 22:00:23.911825 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903058    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 22:00:23.911825 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903061    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 22:00:23.911825 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903065    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 22:00:23.911825 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903068    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 22:00:23.911825 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903072    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 22:00:23.911825 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903076    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 22:00:23.911825 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903078    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 22:00:23.911825 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903081    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 22:00:23.911825 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903083    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 22:00:23.911825 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903086    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 22:00:23.911825 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903089    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 22:00:23.911825 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903091    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 22:00:23.911825 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903093    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 22:00:23.911825 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903096    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 22:00:23.911825 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903098    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 22:00:23.912295 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903101    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 22:00:23.912295 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903104    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 22:00:23.912295 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903106    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 22:00:23.912295 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903110    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 22:00:23.912295 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903112    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 22:00:23.912295 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903116    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 22:00:23.912295 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903118    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 22:00:23.912295 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903121    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 22:00:23.912295 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903123    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 22:00:23.912295 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903126    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 22:00:23.912295 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903128    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 22:00:23.912295 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903131    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 22:00:23.912295 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903133    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 22:00:23.912295 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903136    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 22:00:23.912295 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903138    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 22:00:23.912295 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903140    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 22:00:23.912295 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903143    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 22:00:23.912295 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903146    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 22:00:23.912295 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903149    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 22:00:23.912295 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903151    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 22:00:23.912803 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903154    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 22:00:23.912803 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903156    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 22:00:23.912803 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903159    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 22:00:23.912803 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903161    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 22:00:23.912803 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903164    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 22:00:23.912803 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903166    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 22:00:23.912803 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903169    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 22:00:23.912803 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903171    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 22:00:23.912803 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903174    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 22:00:23.912803 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903176    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 22:00:23.912803 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903179    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 22:00:23.912803 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903181    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 22:00:23.912803 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903184    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 22:00:23.912803 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903186    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 22:00:23.912803 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903189    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 22:00:23.912803 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903194    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 22:00:23.912803 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903197    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 22:00:23.912803 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903200    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 22:00:23.912803 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903203    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 22:00:23.913270 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903206    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 22:00:23.913270 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903208    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 22:00:23.913270 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903211    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 22:00:23.913270 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903213    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 22:00:23.913270 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903216    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 22:00:23.913270 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903218    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 22:00:23.913270 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903221    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 22:00:23.913270 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903223    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 22:00:23.913270 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903226    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 22:00:23.913270 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903228    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 22:00:23.913270 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903232    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 22:00:23.913270 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903234    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 22:00:23.913270 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903237    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 22:00:23.913270 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903239    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 22:00:23.913270 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903241    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 22:00:23.913270 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903244    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 22:00:23.913270 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903247    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 22:00:23.913270 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903249    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 22:00:23.913270 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903251    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 22:00:23.913270 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903254    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 22:00:23.913835 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903256    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 22:00:23.913835 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903259    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 22:00:23.913835 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903261    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 22:00:23.913835 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903264    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 22:00:23.913835 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903266    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 22:00:23.913835 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903269    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 22:00:23.913835 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903271    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 22:00:23.913835 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903274    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 22:00:23.913835 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903277    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 22:00:23.913835 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903280    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 22:00:23.913835 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903282    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 22:00:23.913835 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903285    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 22:00:23.913835 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903287    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 22:00:23.913835 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903290    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 22:00:23.913835 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903292    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 22:00:23.913835 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903295    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 22:00:23.913835 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903297    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 22:00:23.913835 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903299    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 22:00:23.913835 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903302    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 22:00:23.913835 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903304    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 22:00:23.914330 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903307    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 22:00:23.914330 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903311    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 22:00:23.914330 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.903315    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 22:00:23.914330 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.903839    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 22:00:23.914330 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.911173    2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 18 22:00:23.914330 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.911187    2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 18 22:00:23.914330 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.911206    2574 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 18 22:00:23.914330 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.911213    2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 18 22:00:23.914330 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911266    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 22:00:23.914330 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911271    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 22:00:23.914330 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911274    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 22:00:23.914330 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911277    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 22:00:23.914330 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911280    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 22:00:23.914330 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911283    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 22:00:23.914678 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911286    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 22:00:23.914678 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911289    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 22:00:23.914678 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911291    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 22:00:23.914678 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911294    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 22:00:23.914678 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911296    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 22:00:23.914678 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911299    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 22:00:23.914678 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911303    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 22:00:23.914678 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911307    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 22:00:23.914678 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911311    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 22:00:23.914678 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911314    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 22:00:23.914678 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911317    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 22:00:23.914678 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911320    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 22:00:23.914678 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911323    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 22:00:23.914678 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911325    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 22:00:23.914678 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911328    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 22:00:23.914678 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911331    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 22:00:23.914678 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911333    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 22:00:23.914678 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911336    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 22:00:23.914678 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911339    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 22:00:23.915162 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911342    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 22:00:23.915162 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911344    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 22:00:23.915162 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911347    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 22:00:23.915162 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911349    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 22:00:23.915162 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911353    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 22:00:23.915162 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911356    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 22:00:23.915162 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911358    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 22:00:23.915162 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911361    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 22:00:23.915162 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911363    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 22:00:23.915162 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911366    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 22:00:23.915162 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911383    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 22:00:23.915162 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911386    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 22:00:23.915162 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911389    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 22:00:23.915162 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911393    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 22:00:23.915162 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911395    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 22:00:23.915162 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911398    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 22:00:23.915162 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911401    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 22:00:23.915162 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911404    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 22:00:23.915162 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911406    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 22:00:23.915162 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911409    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 22:00:23.915642 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911413    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 22:00:23.915642 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911416    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 22:00:23.915642 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911419    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 22:00:23.915642 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911422    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 22:00:23.915642 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911425    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 22:00:23.915642 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911428    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 22:00:23.915642 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911430    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 22:00:23.915642 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911433    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 22:00:23.915642 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911436    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 22:00:23.915642 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911438    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 22:00:23.915642 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911441    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 22:00:23.915642 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911444    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 22:00:23.915642 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911446    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 22:00:23.915642 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911449    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 22:00:23.915642 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911452    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 22:00:23.915642 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911454    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 22:00:23.915642 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911457    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 22:00:23.915642 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911461    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 22:00:23.915642 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911464    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 22:00:23.916364 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911467    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 22:00:23.916364 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911469    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 22:00:23.916364 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911472    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 22:00:23.916364 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911474    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 22:00:23.916364 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911477    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 22:00:23.916364 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911479    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 22:00:23.916364 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911482    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 22:00:23.916364 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911484    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 22:00:23.916364 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911487    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 22:00:23.916364 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911490    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 22:00:23.916364 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911492    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 22:00:23.916364 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911495    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 22:00:23.916364 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911497    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 22:00:23.916364 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911500    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 22:00:23.916364 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911502    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 22:00:23.916364 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911504    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 22:00:23.916364 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911507    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 22:00:23.916364 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911509    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 22:00:23.916364 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911511    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 22:00:23.917141 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911514    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 22:00:23.917141 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911516    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 22:00:23.917141 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911518    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 22:00:23.917141 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911521    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 22:00:23.917141 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911523    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 22:00:23.917141 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911526    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 22:00:23.917141 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911528    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 22:00:23.917141 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911531    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 22:00:23.917141 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911533    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 22:00:23.917141 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911535    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 22:00:23.917141 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911539    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 22:00:23.917141 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911541    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 22:00:23.917141 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911545    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 22:00:23.917141 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911547    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 22:00:23.917141 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911550    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 22:00:23.917141 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911552    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 22:00:23.917612 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.911558    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 22:00:23.917612 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911692    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 22:00:23.917612 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911698    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 22:00:23.917612 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911701    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 22:00:23.917612 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911705    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 22:00:23.917612 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911709    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 22:00:23.917612 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911713    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 22:00:23.917612 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911716    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 22:00:23.917612 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911719    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 22:00:23.917612 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911721    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 22:00:23.917612 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911724    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 22:00:23.917612 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911727    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 22:00:23.917612 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911746    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 22:00:23.917612 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911750    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 22:00:23.918004 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911752    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 22:00:23.918004 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911755    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 22:00:23.918004 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911758    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 22:00:23.918004 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911761    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 22:00:23.918004 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911763    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 22:00:23.918004 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911766    2574 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 22:00:23.918004 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911768    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 22:00:23.918004 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911771    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 22:00:23.918004 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911773    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 22:00:23.918004 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911776    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 22:00:23.918004 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911779    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 22:00:23.918004 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911781    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 22:00:23.918004 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911784    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 22:00:23.918004 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911787    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 22:00:23.918004 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911790    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 22:00:23.918004 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911793    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 22:00:23.918004 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911796    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 22:00:23.918004 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911800    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 22:00:23.918004 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911803    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 22:00:23.918004 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911806    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 22:00:23.918532 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911808    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 22:00:23.918532 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911811    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 22:00:23.918532 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911813    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 22:00:23.918532 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911816    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 22:00:23.918532 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911818    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 22:00:23.918532 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911821    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 22:00:23.918532 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911824    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 22:00:23.918532 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911827    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 22:00:23.918532 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911829    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 22:00:23.918532 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911832    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 22:00:23.918532 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911835    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 22:00:23.918532 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911837    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 22:00:23.918532 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911840    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 22:00:23.918532 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911843    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 22:00:23.918532 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911845    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 22:00:23.918532 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911847    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 22:00:23.918532 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911850    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 22:00:23.918532 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911852    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 22:00:23.918532 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911855    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 22:00:23.919059 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911857    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 22:00:23.919059 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911860    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 22:00:23.919059 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911862    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 22:00:23.919059 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911865    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 22:00:23.919059 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911867    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 22:00:23.919059 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911869    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 22:00:23.919059 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911872    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 22:00:23.919059 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911874    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 22:00:23.919059 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911877    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 22:00:23.919059 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911880    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 22:00:23.919059 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911882    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 22:00:23.919059 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911885    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 22:00:23.919059 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911887    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 22:00:23.919059 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911890    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 22:00:23.919059 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911892    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 22:00:23.919059 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911894    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 22:00:23.919059 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911897    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 22:00:23.919059 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911899    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 22:00:23.919059 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911902    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 22:00:23.919059 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911904    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 22:00:23.919596 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911907    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 22:00:23.919596 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911909    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 22:00:23.919596 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911911    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 22:00:23.919596 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911914    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 22:00:23.919596 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911916    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 22:00:23.919596 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911918    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 22:00:23.919596 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911921    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 22:00:23.919596 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911923    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 22:00:23.919596 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911926    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 22:00:23.919596 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911928    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 22:00:23.919596 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911931    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 22:00:23.919596 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911933    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 22:00:23.919596 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911936    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 22:00:23.919596 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911938    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 22:00:23.919596 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911940    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 22:00:23.919596 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911943    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 22:00:23.919596 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911945    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 22:00:23.919596 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911947    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 22:00:23.919596 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911950    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 22:00:23.919596 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911953    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 22:00:23.920152 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911956    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 22:00:23.920152 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911958    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 22:00:23.920152 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911961    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 22:00:23.920152 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911963    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 22:00:23.920152 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911966    2574 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 22:00:23.920152 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911968    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 22:00:23.920152 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:23.911971    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 22:00:23.920152 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.911975    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 22:00:23.920152 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.912088    2574 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 18 22:00:23.920152 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.914078    2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 18 22:00:23.920152 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.914955    2574 server.go:1019] "Starting client certificate rotation"
Sep 18 22:00:23.920152 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.915056    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 22:00:23.920152 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.915091    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 22:00:23.920152 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.917963    2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 22:00:23.920519 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.919041    2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 22:00:23.929764 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.929746    2574 log.go:25] "Validated CRI v1 runtime API"
Sep 18 22:00:23.932443 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.932429    2574 log.go:25] "Validated CRI v1 image API"
Sep 18 22:00:23.934529 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.934516    2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 18 22:00:23.937400 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.937382    2574 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7c44dbf5-3b85-4e59-8ee2-f802073a5968:/dev/nvme0n1p4 c17cbc11-139a-44ea-a9de-3828ba02388e:/dev/nvme0n1p3]
Sep 18 22:00:23.937459 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.937400    2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 18 22:00:23.942192 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.942078    2574 manager.go:216] Machine: {Timestamp:2026-09-18 22:00:23.940927886 +0000 UTC m=+0.297482186 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097540 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28997c39331f1caf45a2724c92503c SystemUUID:ec28997c-3933-1f1c-af45-a2724c92503c BootID:63982563-236e-4d03-8900-f4668e4be6f1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:eb:b6:cb:ff Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:eb:b6:cb:ff Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:bb:a9:2c:6b:4a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 18 22:00:23.942192 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.942180    2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 18 22:00:23.942348 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.942257    2574 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 18 22:00:23.944940 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.944899    2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 18 22:00:23.945100 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.944945    2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-255.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 18 22:00:23.946134 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.946122    2574 topology_manager.go:138] "Creating topology manager with none policy"
Sep 18 22:00:23.946199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.946141    2574 container_manager_linux.go:309] "Creating device plugin manager"
Sep 18 22:00:23.946199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.946152    2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 22:00:23.946795 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.946783    2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 22:00:23.947398 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.947384    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 22:00:23.947938 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.947926    2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 18 22:00:23.952200 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.952185    2574 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 22:00:23.952334 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.952323    2574 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 18 22:00:23.952390 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.952366    2574 kubelet.go:486] "Attempting to sync node with API server"
Sep 18 22:00:23.952390 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.952381    2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 18 22:00:23.952479 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.952401    2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 18 22:00:23.952479 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.952415    2574 kubelet.go:398] "Adding apiserver pod source"
Sep 18 22:00:23.952479 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.952442    2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 18 22:00:23.952814 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.952800    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 22:00:23.952905 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.952823    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 22:00:23.954943 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.954927    2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 18 22:00:23.957474 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.957460    2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 18 22:00:23.957526 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.957490    2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 18 22:00:23.957650 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.957641    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 18 22:00:23.957682 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.957655    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 18 22:00:23.957682 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.957661    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 18 22:00:23.957682 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.957666    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 18 22:00:23.957682 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.957675    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 18 22:00:23.957682 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.957680    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 18 22:00:23.958074 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.958066    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 18 22:00:23.958108 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.958075    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 18 22:00:23.958108 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.958081    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 18 22:00:23.958108 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.958087    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 18 22:00:23.958108 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.958095    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 18 22:00:23.958108 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.958102    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 18 22:00:23.958753 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.958743    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 18 22:00:23.958785 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.958756    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 18 22:00:23.962808 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.962788    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-255.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 18 22:00:23.962921 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:23.962893    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 18 22:00:23.962985 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:23.962970    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-255.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 18 22:00:23.963781 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.963763    2574 server.go:1268] "Started kubelet"
Sep 18 22:00:23.963928 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.963837    2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 18 22:00:23.963981 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.963912    2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 18 22:00:23.963981 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.963975    2574 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 18 22:00:23.964256 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.964231    2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 18 22:00:23.964896 ip-10-0-141-255 systemd[1]: Started Kubernetes Kubelet.
Sep 18 22:00:23.965508 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.965493    2574 server.go:310] "Adding debug handlers to kubelet server"
Sep 18 22:00:23.969486 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:23.969363    2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 18 22:00:23.969835 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:23.969011    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-255.ec2.internal.18d68943466cf83f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-255.ec2.internal,UID:ip-10-0-141-255.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-255.ec2.internal,},FirstTimestamp:2026-09-18 22:00:23.963711551 +0000 UTC m=+0.320265854,LastTimestamp:2026-09-18 22:00:23.963711551 +0000 UTC m=+0.320265854,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-255.ec2.internal,}"
Sep 18 22:00:23.971047 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.971033    2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 18 22:00:23.971047 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.971046    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 18 22:00:23.971165 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:23.971100    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-255.ec2.internal\" not found"
Sep 18 22:00:23.971677 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.971653    2574 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 18 22:00:23.971776 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.971696    2574 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 18 22:00:23.971776 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.971721    2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 18 22:00:23.972096 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.972082    2574 reconstruct.go:97] "Volume reconstruction finished"
Sep 18 22:00:23.972189 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.972172    2574 reconciler.go:29] "Reconciler: start to sync state"
Sep 18 22:00:23.972189 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.972095    2574 factory.go:55] Registering systemd factory
Sep 18 22:00:23.972307 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.972203    2574 factory.go:223] Registration of the systemd container factory successfully
Sep 18 22:00:23.972632 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.972614    2574 factory.go:153] Registering CRI-O factory
Sep 18 22:00:23.972632 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.972633    2574 factory.go:223] Registration of the crio container factory successfully
Sep 18 22:00:23.972783 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.972700    2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 18 22:00:23.972783 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.972717    2574 factory.go:103] Registering Raw factory
Sep 18 22:00:23.972783 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.972747    2574 manager.go:1196] Started watching for new ooms in manager
Sep 18 22:00:23.973068 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.973056    2574 manager.go:349] Starting recovery of all containers
Sep 18 22:00:23.979905 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:23.979876    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 18 22:00:23.980401 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:23.980374    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-255.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 18 22:00:23.983382 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.983360    2574 manager.go:354] Recovery completed
Sep 18 22:00:23.983897 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.983877    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mtgws"
Sep 18 22:00:23.985409 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:23.985385    2574 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 18 22:00:23.989130 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.989119    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 22:00:23.991621 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.991606    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mtgws"
Sep 18 22:00:23.997046 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.997031    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-255.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 22:00:23.997111 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.997059    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-255.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 22:00:23.997111 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.997073    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-255.ec2.internal" event="NodeHasSufficientPID"
Sep 18 22:00:23.997605 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.997587    2574 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 18 22:00:23.997605 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.997604    2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 18 22:00:23.997780 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.997615    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 22:00:23.997780 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.997623    2574 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 22:00:23.998332 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.998318    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-255.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 22:00:23.998434 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.998341    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-255.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 22:00:23.998434 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.998351    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-255.ec2.internal" event="NodeHasSufficientPID"
Sep 18 22:00:23.999683 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.999671    2574 policy_none.go:49] "None policy: Start"
Sep 18 22:00:23.999717 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.999687    2574 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 18 22:00:23.999717 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:23.999696    2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 18 22:00:24.001667 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.001656    2574 policy_none.go:47] "Start"
Sep 18 22:00:24.057541 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.045351    2574 manager.go:337] "Starting Device Plugin manager"
Sep 18 22:00:24.057541 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:24.045391    2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 18 22:00:24.057541 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.045402    2574 server.go:87] "Starting device plugin registration server"
Sep 18 22:00:24.057541 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.045700    2574 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 18 22:00:24.057541 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.045713    2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 18 22:00:24.057541 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.045828    2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 18 22:00:24.057541 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.045901    2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 18 22:00:24.057541 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.045910    2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 18 22:00:24.057541 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:24.047400    2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 18 22:00:24.057541 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:24.047451    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-255.ec2.internal\" not found"
Sep 18 22:00:24.112843 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.112804    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 18 22:00:24.114285 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.114263    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 18 22:00:24.114383 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.114311    2574 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 18 22:00:24.114383 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.114333    2574 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 18 22:00:24.114383 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:24.114372    2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 18 22:00:24.117131 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.117113    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 22:00:24.146172 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.146102    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 22:00:24.146955 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.146939    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-255.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 22:00:24.147028 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.146967    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-255.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 22:00:24.147028 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.146977    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-255.ec2.internal" event="NodeHasSufficientPID"
Sep 18 22:00:24.147028 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.146997    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-255.ec2.internal"
Sep 18 22:00:24.152765 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.152753    2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-255.ec2.internal"
Sep 18 22:00:24.152819 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:24.152771    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-255.ec2.internal\": node \"ip-10-0-141-255.ec2.internal\" not found"
Sep 18 22:00:24.214679 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.214643    2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-255.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-255.ec2.internal"]
Sep 18 22:00:24.214820 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.214751    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 22:00:24.215598 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.215582    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-255.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 22:00:24.215673 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.215609    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-255.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 22:00:24.215673 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.215619    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-255.ec2.internal" event="NodeHasSufficientPID"
Sep 18 22:00:24.217825 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.217812    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 22:00:24.217934 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.217920    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-255.ec2.internal"
Sep 18 22:00:24.218005 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.217946    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 22:00:24.218538 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.218524    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-255.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 22:00:24.218538 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.218535    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-255.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 22:00:24.218642 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.218552    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-255.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 22:00:24.218642 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.218553    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-255.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 22:00:24.218642 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.218565    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-255.ec2.internal" event="NodeHasSufficientPID"
Sep 18 22:00:24.218642 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.218572    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-255.ec2.internal" event="NodeHasSufficientPID"
Sep 18 22:00:24.220808 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.220795    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-255.ec2.internal"
Sep 18 22:00:24.220881 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.220815    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 22:00:24.221403 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.221385    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-255.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 22:00:24.221485 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.221414    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-255.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 22:00:24.221485 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.221425    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-255.ec2.internal" event="NodeHasSufficientPID"
Sep 18 22:00:24.224294 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:24.224273    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-255.ec2.internal\" not found"
Sep 18 22:00:24.243246 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:24.243229    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-255.ec2.internal\" not found" node="ip-10-0-141-255.ec2.internal"
Sep 18 22:00:24.247678 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:24.247664    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-255.ec2.internal\" not found" node="ip-10-0-141-255.ec2.internal"
Sep 18 22:00:24.274755 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.274724    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a37eccb74ba3d314843a55dca527e48a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-255.ec2.internal\" (UID: \"a37eccb74ba3d314843a55dca527e48a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-255.ec2.internal"
Sep 18 22:00:24.274824 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.274759    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a37eccb74ba3d314843a55dca527e48a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-255.ec2.internal\" (UID: \"a37eccb74ba3d314843a55dca527e48a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-255.ec2.internal"
Sep 18 22:00:24.274824 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.274775    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/79f70c2b414f57ea7072d15b46bebdf1-config\") pod \"kube-apiserver-proxy-ip-10-0-141-255.ec2.internal\" (UID: \"79f70c2b414f57ea7072d15b46bebdf1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-255.ec2.internal"
Sep 18 22:00:24.324470 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:24.324437    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-255.ec2.internal\" not found"
Sep 18 22:00:24.375133 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.375113    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a37eccb74ba3d314843a55dca527e48a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-255.ec2.internal\" (UID: \"a37eccb74ba3d314843a55dca527e48a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-255.ec2.internal"
Sep 18 22:00:24.375209 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.375135    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/79f70c2b414f57ea7072d15b46bebdf1-config\") pod \"kube-apiserver-proxy-ip-10-0-141-255.ec2.internal\" (UID: \"79f70c2b414f57ea7072d15b46bebdf1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-255.ec2.internal"
Sep 18 22:00:24.375209 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.375151    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a37eccb74ba3d314843a55dca527e48a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-255.ec2.internal\" (UID: \"a37eccb74ba3d314843a55dca527e48a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-255.ec2.internal"
Sep 18 22:00:24.375209 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.375188    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a37eccb74ba3d314843a55dca527e48a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-255.ec2.internal\" (UID: \"a37eccb74ba3d314843a55dca527e48a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-255.ec2.internal"
Sep 18 22:00:24.375308 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.375220    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/79f70c2b414f57ea7072d15b46bebdf1-config\") pod \"kube-apiserver-proxy-ip-10-0-141-255.ec2.internal\" (UID: \"79f70c2b414f57ea7072d15b46bebdf1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-255.ec2.internal"
Sep 18 22:00:24.375308 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.375220    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a37eccb74ba3d314843a55dca527e48a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-255.ec2.internal\" (UID: \"a37eccb74ba3d314843a55dca527e48a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-255.ec2.internal"
Sep 18 22:00:24.425366 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:24.425310    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-255.ec2.internal\" not found"
Sep 18 22:00:24.525402 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:24.525368    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-255.ec2.internal\" not found"
Sep 18 22:00:24.546540 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.546516    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-255.ec2.internal"
Sep 18 22:00:24.550694 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.550678    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-255.ec2.internal"
Sep 18 22:00:24.626028 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:24.625985    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-255.ec2.internal\" not found"
Sep 18 22:00:24.726463 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:24.726424    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-255.ec2.internal\" not found"
Sep 18 22:00:24.827003 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:24.826974    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-255.ec2.internal\" not found"
Sep 18 22:00:24.869509 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.869486    2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 22:00:24.871985 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.871969    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-255.ec2.internal"
Sep 18 22:00:24.886805 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.886785    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 22:00:24.888275 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.888261    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-255.ec2.internal"
Sep 18 22:00:24.904121 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.904100    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 22:00:24.915262 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.915246    2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 18 22:00:24.915366 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.915352    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 22:00:24.915412 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.915396    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 22:00:24.953529 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.953513    2574 apiserver.go:52] "Watching apiserver"
Sep 18 22:00:24.971509 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.971485    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 18 22:00:24.971711 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.971696    2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 18 22:00:24.972615 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.972593    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-wqhkx","openshift-network-diagnostics/network-check-target-wj4fb","openshift-ovn-kubernetes/ovnkube-node-zzwf2","kube-system/global-pull-secret-syncer-t7m2k","kube-system/kube-apiserver-proxy-ip-10-0-141-255.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c","openshift-cluster-node-tuning-operator/tuned-hgx8j","openshift-dns/node-resolver-tb58x","openshift-multus/multus-4s62x","openshift-multus/network-metrics-daemon-td6sj","openshift-network-operator/iptables-alerter-hr5db","kube-system/konnectivity-agent-p5qkr","openshift-image-registry/node-ca-rtsx9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-255.ec2.internal"]
Sep 18 22:00:24.974988 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.974975    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:24.977091 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.977047    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hr5db"
Sep 18 22:00:24.977685 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.977668    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 18 22:00:24.977809 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.977670    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 18 22:00:24.977945 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.977933    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rmz6t\""
Sep 18 22:00:24.978657 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.978637    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 18 22:00:24.979725 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.979700    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:24.980699 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.980672    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 18 22:00:24.981387 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.981364    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 18 22:00:24.981387 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.981380    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-x5rmr\""
Sep 18 22:00:24.982256 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.982234    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:24.982361 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:24.982342    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t7m2k" podUID="0fa9a758-4e4b-477c-b6de-b36dc677e1cd"
Sep 18 22:00:24.983695 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.983673    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 18 22:00:24.983695 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.983691    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 18 22:00:24.983906 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.983676    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 18 22:00:24.983906 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.983791    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 18 22:00:24.984029 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.984014    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 18 22:00:24.984124 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.984108    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 18 22:00:24.984321 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.984306    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cq8fn\""
Sep 18 22:00:24.984507 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.984495    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tb58x"
Sep 18 22:00:24.986670 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.986655    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c"
Sep 18 22:00:24.987141 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.987124    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 18 22:00:24.987610 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.987596    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 18 22:00:24.987651 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.987638    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4f49d\""
Sep 18 22:00:24.988964 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.988945    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4s62x"
Sep 18 22:00:24.989084 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.989066    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 18 22:00:24.989245 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.989230    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 18 22:00:24.990779 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.990764    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 18 22:00:24.990867 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.990770    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vks6z\""
Sep 18 22:00:24.991255 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.991235    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rtsx9"
Sep 18 22:00:24.991344 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.991307    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 18 22:00:24.991768 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.991754    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 18 22:00:24.992002 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.991988    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 18 22:00:24.992086 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.991996    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 18 22:00:24.992403 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.992387    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4tr6w\""
Sep 18 22:00:24.993381 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.993284    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 18 22:00:24.993568 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.993553    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:00:24.993636 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.993578    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 18 22:00:24.993636 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:24.993598    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj4fb" podUID="8e3f6f16-2634-4b45-ac6c-5470f9cfef13"
Sep 18 22:00:24.994055 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.994038    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 18 22:00:24.994136 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.994063    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m8tkh\""
Sep 18 22:00:24.995877 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.995853    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 21:55:25 +0000 UTC" deadline="2028-05-15 18:29:57.871012241 +0000 UTC"
Sep 18 22:00:24.995939 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.995876    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:24.995939 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:24.995916    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td6sj" podUID="8a7392bf-ea47-4efe-b58a-fc15baaa7461"
Sep 18 22:00:24.995939 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.995878    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14516h29m32.875137416s"
Sep 18 22:00:24.997668 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.997654    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 22:00:24.998055 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:24.998042    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wqhkx"
Sep 18 22:00:25.000195 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.000181    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p5qkr"
Sep 18 22:00:25.002485 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.002462    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 18 22:00:25.002553 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.002533    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 18 22:00:25.002596 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.002579    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qrgll\""
Sep 18 22:00:25.005950 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.005934    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 18 22:00:25.006031 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.005953    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 18 22:00:25.006211 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.006198    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-t2j2c\""
Sep 18 22:00:25.022959 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.022941    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-grhzz"
Sep 18 22:00:25.034966 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.034949    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-grhzz"
Sep 18 22:00:25.072487 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.072461    2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 18 22:00:25.077359 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.077339    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a15b3603-f8d9-4ef9-af80-718d1870bfca-iptables-alerter-script\") pod \"iptables-alerter-hr5db\" (UID: \"a15b3603-f8d9-4ef9-af80-718d1870bfca\") " pod="openshift-network-operator/iptables-alerter-hr5db"
Sep 18 22:00:25.077461 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.077370    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-system-cni-dir\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.077461 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.077395    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqj6c\" (UniqueName: \"kubernetes.io/projected/cdf3488e-8f04-4dfe-b930-3a01d87da247-kube-api-access-xqj6c\") pod \"node-ca-rtsx9\" (UID: \"cdf3488e-8f04-4dfe-b930-3a01d87da247\") " pod="openshift-image-registry/node-ca-rtsx9"
Sep 18 22:00:25.077461 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.077417    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-host-slash\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.077461 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.077441    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/81a07ab6-391c-45d4-a4ac-23caeb039ddd-ovnkube-config\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.077618 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.077463    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmv59\" (UniqueName: \"kubernetes.io/projected/8e3f6f16-2634-4b45-ac6c-5470f9cfef13-kube-api-access-cmv59\") pod \"network-check-target-wj4fb\" (UID: \"8e3f6f16-2634-4b45-ac6c-5470f9cfef13\") " pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:00:25.077618 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.077499    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/94be214b-068b-40be-8bbe-f02f700392f2-sys-fs\") pod \"aws-ebs-csi-driver-node-dzv6c\" (UID: \"94be214b-068b-40be-8bbe-f02f700392f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c"
Sep 18 22:00:25.077618 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.077529    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-hostroot\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.077618 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.077547    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-etc-kubernetes\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.077618 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.077562    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cdf3488e-8f04-4dfe-b930-3a01d87da247-serviceca\") pod \"node-ca-rtsx9\" (UID: \"cdf3488e-8f04-4dfe-b930-3a01d87da247\") " pod="openshift-image-registry/node-ca-rtsx9"
Sep 18 22:00:25.077618 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.077594    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-host-kubelet\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.077852 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.077634    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-host-cni-netd\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.077852 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.077661    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8435563a-0f46-48fb-b9c7-acce85b59376-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wqhkx\" (UID: \"8435563a-0f46-48fb-b9c7-acce85b59376\") " pod="openshift-multus/multus-additional-cni-plugins-wqhkx"
Sep 18 22:00:25.077852 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.077687    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-etc-sysctl-d\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.077852 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.077720    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-kubelet-config\") pod \"global-pull-secret-syncer-t7m2k\" (UID: \"0fa9a758-4e4b-477c-b6de-b36dc677e1cd\") " pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:25.077852 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.077770    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-cnibin\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.077852 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.077796    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-multus-socket-dir-parent\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.077852 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.077819    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-host-run-netns\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.078186 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.077854    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-host-run-multus-certs\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.078186 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.077879    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-run-ovn\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.078186 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.077905    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/81a07ab6-391c-45d4-a4ac-23caeb039ddd-ovn-node-metrics-cert\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.078186 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.077961    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mtnf\" (UniqueName: \"kubernetes.io/projected/8435563a-0f46-48fb-b9c7-acce85b59376-kube-api-access-9mtnf\") pod \"multus-additional-cni-plugins-wqhkx\" (UID: \"8435563a-0f46-48fb-b9c7-acce85b59376\") " pod="openshift-multus/multus-additional-cni-plugins-wqhkx"
Sep 18 22:00:25.078186 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.077997    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-var-lib-kubelet\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.078186 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078021    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/94be214b-068b-40be-8bbe-f02f700392f2-etc-selinux\") pod \"aws-ebs-csi-driver-node-dzv6c\" (UID: \"94be214b-068b-40be-8bbe-f02f700392f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c"
Sep 18 22:00:25.078186 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078042    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-host-var-lib-cni-bin\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.078186 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078063    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-etc-tuned\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.078186 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078084    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-dbus\") pod \"global-pull-secret-syncer-t7m2k\" (UID: \"0fa9a758-4e4b-477c-b6de-b36dc677e1cd\") " pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:25.078186 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078109    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-var-lib-openvswitch\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.078186 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078135    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e92e768d-c8b5-4b47-a146-ca7ebecb1bab-agent-certs\") pod \"konnectivity-agent-p5qkr\" (UID: \"e92e768d-c8b5-4b47-a146-ca7ebecb1bab\") " pod="kube-system/konnectivity-agent-p5qkr"
Sep 18 22:00:25.078186 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078180    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-host\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.078639 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078219    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5f2w\" (UniqueName: \"kubernetes.io/projected/a15b3603-f8d9-4ef9-af80-718d1870bfca-kube-api-access-s5f2w\") pod \"iptables-alerter-hr5db\" (UID: \"a15b3603-f8d9-4ef9-af80-718d1870bfca\") " pod="openshift-network-operator/iptables-alerter-hr5db"
Sep 18 22:00:25.078639 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078254    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-multus-conf-dir\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.078639 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078276    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-systemd-units\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.078639 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078311    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-run-systemd\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.078639 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078330    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-run-openvswitch\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.078639 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078364    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-etc-sysconfig\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.078639 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078402    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-etc-modprobe-d\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.078639 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078428    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-log-socket\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.078639 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078449    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-sys\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.078639 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078473    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-lib-modules\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.078639 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078493    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-tmp\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.078639 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078515    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tjn6\" (UniqueName: \"kubernetes.io/projected/3935be4c-a503-4315-8667-dba4a76ab439-kube-api-access-6tjn6\") pod \"node-resolver-tb58x\" (UID: \"3935be4c-a503-4315-8667-dba4a76ab439\") " pod="openshift-dns/node-resolver-tb58x"
Sep 18 22:00:25.078639 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078540    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-host-var-lib-kubelet\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.078639 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078562    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csbd2\" (UniqueName: \"kubernetes.io/projected/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-kube-api-access-csbd2\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.078639 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078580    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-host-run-netns\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.078639 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078598    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.079284 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078617    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-etc-systemd\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.079284 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078639    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnspx\" (UniqueName: \"kubernetes.io/projected/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-kube-api-access-qnspx\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.079284 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078656    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a15b3603-f8d9-4ef9-af80-718d1870bfca-host-slash\") pod \"iptables-alerter-hr5db\" (UID: \"a15b3603-f8d9-4ef9-af80-718d1870bfca\") " pod="openshift-network-operator/iptables-alerter-hr5db"
Sep 18 22:00:25.079284 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078671    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-host-var-lib-cni-multus\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.079284 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078685    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gzdw\" (UniqueName: \"kubernetes.io/projected/81a07ab6-391c-45d4-a4ac-23caeb039ddd-kube-api-access-9gzdw\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.079284 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078701    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-etc-kubernetes\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.079284 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078748    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-original-pull-secret\") pod \"global-pull-secret-syncer-t7m2k\" (UID: \"0fa9a758-4e4b-477c-b6de-b36dc677e1cd\") " pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:25.079284 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078772    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3935be4c-a503-4315-8667-dba4a76ab439-hosts-file\") pod \"node-resolver-tb58x\" (UID: \"3935be4c-a503-4315-8667-dba4a76ab439\") " pod="openshift-dns/node-resolver-tb58x"
Sep 18 22:00:25.079284 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078786    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j9wd\" (UniqueName: \"kubernetes.io/projected/94be214b-068b-40be-8bbe-f02f700392f2-kube-api-access-9j9wd\") pod \"aws-ebs-csi-driver-node-dzv6c\" (UID: \"94be214b-068b-40be-8bbe-f02f700392f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c"
Sep 18 22:00:25.079284 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078805    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-etc-openvswitch\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.079284 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078831    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-node-log\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.079284 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078847    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-host-cni-bin\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.079284 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078860    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/81a07ab6-391c-45d4-a4ac-23caeb039ddd-ovnkube-script-lib\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.079284 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078873    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs\") pod \"network-metrics-daemon-td6sj\" (UID: \"8a7392bf-ea47-4efe-b58a-fc15baaa7461\") " pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:25.079284 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078894    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/94be214b-068b-40be-8bbe-f02f700392f2-registration-dir\") pod \"aws-ebs-csi-driver-node-dzv6c\" (UID: \"94be214b-068b-40be-8bbe-f02f700392f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c"
Sep 18 22:00:25.079284 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078923    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-host-run-k8s-cni-cncf-io\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.079788 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078958    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cdf3488e-8f04-4dfe-b930-3a01d87da247-host\") pod \"node-ca-rtsx9\" (UID: \"cdf3488e-8f04-4dfe-b930-3a01d87da247\") " pod="openshift-image-registry/node-ca-rtsx9"
Sep 18 22:00:25.079788 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.078992    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-host-run-ovn-kubernetes\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.079788 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.079019    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8435563a-0f46-48fb-b9c7-acce85b59376-system-cni-dir\") pod \"multus-additional-cni-plugins-wqhkx\" (UID: \"8435563a-0f46-48fb-b9c7-acce85b59376\") " pod="openshift-multus/multus-additional-cni-plugins-wqhkx"
Sep 18 22:00:25.079788 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.079043    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8435563a-0f46-48fb-b9c7-acce85b59376-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wqhkx\" (UID: \"8435563a-0f46-48fb-b9c7-acce85b59376\") " pod="openshift-multus/multus-additional-cni-plugins-wqhkx"
Sep 18 22:00:25.079788 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.079066    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/94be214b-068b-40be-8bbe-f02f700392f2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dzv6c\" (UID: \"94be214b-068b-40be-8bbe-f02f700392f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c"
Sep 18 22:00:25.079788 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.079088    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/94be214b-068b-40be-8bbe-f02f700392f2-device-dir\") pod \"aws-ebs-csi-driver-node-dzv6c\" (UID: \"94be214b-068b-40be-8bbe-f02f700392f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c"
Sep 18 22:00:25.079788 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.079111    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8435563a-0f46-48fb-b9c7-acce85b59376-cni-binary-copy\") pod \"multus-additional-cni-plugins-wqhkx\" (UID: \"8435563a-0f46-48fb-b9c7-acce85b59376\") " pod="openshift-multus/multus-additional-cni-plugins-wqhkx"
Sep 18 22:00:25.079788 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.079153    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e92e768d-c8b5-4b47-a146-ca7ebecb1bab-konnectivity-ca\") pod \"konnectivity-agent-p5qkr\" (UID: \"e92e768d-c8b5-4b47-a146-ca7ebecb1bab\") " pod="kube-system/konnectivity-agent-p5qkr"
Sep 18 22:00:25.079788 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.079175    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-multus-cni-dir\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.079788 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.079225    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/81a07ab6-391c-45d4-a4ac-23caeb039ddd-env-overrides\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.079788 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.079250    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtt76\" (UniqueName: \"kubernetes.io/projected/8a7392bf-ea47-4efe-b58a-fc15baaa7461-kube-api-access-wtt76\") pod \"network-metrics-daemon-td6sj\" (UID: \"8a7392bf-ea47-4efe-b58a-fc15baaa7461\") " pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:25.079788 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.079267    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8435563a-0f46-48fb-b9c7-acce85b59376-cnibin\") pod \"multus-additional-cni-plugins-wqhkx\" (UID: \"8435563a-0f46-48fb-b9c7-acce85b59376\") " pod="openshift-multus/multus-additional-cni-plugins-wqhkx"
Sep 18 22:00:25.079788 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.079285    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8435563a-0f46-48fb-b9c7-acce85b59376-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wqhkx\" (UID: \"8435563a-0f46-48fb-b9c7-acce85b59376\") " pod="openshift-multus/multus-additional-cni-plugins-wqhkx"
Sep 18 22:00:25.079788 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.079301    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-run\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.079788 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.079313    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3935be4c-a503-4315-8667-dba4a76ab439-tmp-dir\") pod \"node-resolver-tb58x\" (UID: \"3935be4c-a503-4315-8667-dba4a76ab439\") " pod="openshift-dns/node-resolver-tb58x"
Sep 18 22:00:25.079788 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.079327    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/94be214b-068b-40be-8bbe-f02f700392f2-socket-dir\") pod \"aws-ebs-csi-driver-node-dzv6c\" (UID: \"94be214b-068b-40be-8bbe-f02f700392f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c"
Sep 18 22:00:25.080245 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.079343    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-cni-binary-copy\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.080245 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.079365    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-multus-daemon-config\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.080245 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.079392    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-etc-sysctl-conf\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.179669 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.179628    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a15b3603-f8d9-4ef9-af80-718d1870bfca-iptables-alerter-script\") pod \"iptables-alerter-hr5db\" (UID: \"a15b3603-f8d9-4ef9-af80-718d1870bfca\") " pod="openshift-network-operator/iptables-alerter-hr5db"
Sep 18 22:00:25.179669 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.179671    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-system-cni-dir\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.179947 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.179695    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqj6c\" (UniqueName: \"kubernetes.io/projected/cdf3488e-8f04-4dfe-b930-3a01d87da247-kube-api-access-xqj6c\") pod \"node-ca-rtsx9\" (UID: \"cdf3488e-8f04-4dfe-b930-3a01d87da247\") " pod="openshift-image-registry/node-ca-rtsx9"
Sep 18 22:00:25.179947 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.179871    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-host-slash\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.179947 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.179891    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-system-cni-dir\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.179947 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.179914    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/81a07ab6-391c-45d4-a4ac-23caeb039ddd-ovnkube-config\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.179947 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.179942    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmv59\" (UniqueName: \"kubernetes.io/projected/8e3f6f16-2634-4b45-ac6c-5470f9cfef13-kube-api-access-cmv59\") pod \"network-check-target-wj4fb\" (UID: \"8e3f6f16-2634-4b45-ac6c-5470f9cfef13\") " pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:00:25.180160 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.179961    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-host-slash\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.180160 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.179964    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/94be214b-068b-40be-8bbe-f02f700392f2-sys-fs\") pod \"aws-ebs-csi-driver-node-dzv6c\" (UID: \"94be214b-068b-40be-8bbe-f02f700392f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c"
Sep 18 22:00:25.180160 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180031    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-hostroot\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.180160 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180056    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-etc-kubernetes\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.180160 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180079    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/94be214b-068b-40be-8bbe-f02f700392f2-sys-fs\") pod \"aws-ebs-csi-driver-node-dzv6c\" (UID: \"94be214b-068b-40be-8bbe-f02f700392f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c"
Sep 18 22:00:25.180160 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180098    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-hostroot\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.180160 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180116    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cdf3488e-8f04-4dfe-b930-3a01d87da247-serviceca\") pod \"node-ca-rtsx9\" (UID: \"cdf3488e-8f04-4dfe-b930-3a01d87da247\") " pod="openshift-image-registry/node-ca-rtsx9"
Sep 18 22:00:25.180160 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180145    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-host-kubelet\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.180160 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180161    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-host-cni-netd\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.180556 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180176    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8435563a-0f46-48fb-b9c7-acce85b59376-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wqhkx\" (UID: \"8435563a-0f46-48fb-b9c7-acce85b59376\") " pod="openshift-multus/multus-additional-cni-plugins-wqhkx"
Sep 18 22:00:25.180556 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180199    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-etc-kubernetes\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.180556 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180230    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-host-kubelet\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.180556 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180231    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-host-cni-netd\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.180556 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180260    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-etc-sysctl-d\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.180556 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180267    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a15b3603-f8d9-4ef9-af80-718d1870bfca-iptables-alerter-script\") pod \"iptables-alerter-hr5db\" (UID: \"a15b3603-f8d9-4ef9-af80-718d1870bfca\") " pod="openshift-network-operator/iptables-alerter-hr5db"
Sep 18 22:00:25.180556 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180290    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-kubelet-config\") pod \"global-pull-secret-syncer-t7m2k\" (UID: \"0fa9a758-4e4b-477c-b6de-b36dc677e1cd\") " pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:25.180556 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180316    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-cnibin\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.180556 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180340    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-multus-socket-dir-parent\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.180556 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180370    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-host-run-netns\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.180556 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180396    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-host-run-multus-certs\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.180556 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180397    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-cnibin\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.180556 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180418    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-multus-socket-dir-parent\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.180556 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180424    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/81a07ab6-391c-45d4-a4ac-23caeb039ddd-ovnkube-config\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.180556 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180367    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-kubelet-config\") pod \"global-pull-secret-syncer-t7m2k\" (UID: \"0fa9a758-4e4b-477c-b6de-b36dc677e1cd\") " pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:25.180556 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180419    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-etc-sysctl-d\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.180556 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180436    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-host-run-multus-certs\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.180556 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180431    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-run-ovn\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.181352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180464    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-run-ovn\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.181352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180480    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/81a07ab6-391c-45d4-a4ac-23caeb039ddd-ovn-node-metrics-cert\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.181352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180508    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mtnf\" (UniqueName: \"kubernetes.io/projected/8435563a-0f46-48fb-b9c7-acce85b59376-kube-api-access-9mtnf\") pod \"multus-additional-cni-plugins-wqhkx\" (UID: \"8435563a-0f46-48fb-b9c7-acce85b59376\") " pod="openshift-multus/multus-additional-cni-plugins-wqhkx"
Sep 18 22:00:25.181352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180511    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-host-run-netns\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.181352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180534    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-var-lib-kubelet\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.181352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180557    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/94be214b-068b-40be-8bbe-f02f700392f2-etc-selinux\") pod \"aws-ebs-csi-driver-node-dzv6c\" (UID: \"94be214b-068b-40be-8bbe-f02f700392f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c"
Sep 18 22:00:25.181352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180578    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-host-var-lib-cni-bin\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.181352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180600    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-etc-tuned\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.181352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180611    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-var-lib-kubelet\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.181352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180625    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-dbus\") pod \"global-pull-secret-syncer-t7m2k\" (UID: \"0fa9a758-4e4b-477c-b6de-b36dc677e1cd\") " pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:25.181352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180648    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-var-lib-openvswitch\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.181352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180657    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-host-var-lib-cni-bin\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.181352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180657    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/94be214b-068b-40be-8bbe-f02f700392f2-etc-selinux\") pod \"aws-ebs-csi-driver-node-dzv6c\" (UID: \"94be214b-068b-40be-8bbe-f02f700392f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c"
Sep 18 22:00:25.181352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180671    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e92e768d-c8b5-4b47-a146-ca7ebecb1bab-agent-certs\") pod \"konnectivity-agent-p5qkr\" (UID: \"e92e768d-c8b5-4b47-a146-ca7ebecb1bab\") " pod="kube-system/konnectivity-agent-p5qkr"
Sep 18 22:00:25.181352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180694    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cdf3488e-8f04-4dfe-b930-3a01d87da247-serviceca\") pod \"node-ca-rtsx9\" (UID: \"cdf3488e-8f04-4dfe-b930-3a01d87da247\") " pod="openshift-image-registry/node-ca-rtsx9"
Sep 18 22:00:25.181352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180700    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-host\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.181352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180724    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-dbus\") pod \"global-pull-secret-syncer-t7m2k\" (UID: \"0fa9a758-4e4b-477c-b6de-b36dc677e1cd\") " pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:25.182177 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180745    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5f2w\" (UniqueName: \"kubernetes.io/projected/a15b3603-f8d9-4ef9-af80-718d1870bfca-kube-api-access-s5f2w\") pod \"iptables-alerter-hr5db\" (UID: \"a15b3603-f8d9-4ef9-af80-718d1870bfca\") " pod="openshift-network-operator/iptables-alerter-hr5db"
Sep 18 22:00:25.182177 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180771    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8435563a-0f46-48fb-b9c7-acce85b59376-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wqhkx\" (UID: \"8435563a-0f46-48fb-b9c7-acce85b59376\") " pod="openshift-multus/multus-additional-cni-plugins-wqhkx"
Sep 18 22:00:25.182177 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180775    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-multus-conf-dir\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.182177 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180802    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-multus-conf-dir\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.182177 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180830    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-systemd-units\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.182177 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180845    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-host\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.182177 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180849    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-var-lib-openvswitch\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.182177 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180855    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-run-systemd\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.182177 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180889    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-systemd-units\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.182177 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180895    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-run-systemd\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.182177 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180899    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-run-openvswitch\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.182177 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180923    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-etc-sysconfig\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.182177 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180945    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-etc-modprobe-d\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.182177 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180947    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-run-openvswitch\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.182177 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180967    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-log-socket\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.182177 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180989    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-sys\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.182177 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.180996    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-log-socket\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.182177 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181002    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-lib-modules\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.183118 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181004    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-etc-sysconfig\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.183118 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181016    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-tmp\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.183118 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181040    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-etc-modprobe-d\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.183118 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181046    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tjn6\" (UniqueName: \"kubernetes.io/projected/3935be4c-a503-4315-8667-dba4a76ab439-kube-api-access-6tjn6\") pod \"node-resolver-tb58x\" (UID: \"3935be4c-a503-4315-8667-dba4a76ab439\") " pod="openshift-dns/node-resolver-tb58x"
Sep 18 22:00:25.183118 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181043    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-sys\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.183118 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181071    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-host-var-lib-kubelet\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.183118 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181093    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csbd2\" (UniqueName: \"kubernetes.io/projected/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-kube-api-access-csbd2\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.183118 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181113    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-host-run-netns\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.183118 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181127    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-host-var-lib-kubelet\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.183118 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181153    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-host-run-netns\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.183118 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181160    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-lib-modules\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.183118 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181193    2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 18 22:00:25.183118 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181207    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.183118 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181247    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-etc-systemd\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.183118 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181269    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnspx\" (UniqueName: \"kubernetes.io/projected/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-kube-api-access-qnspx\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.183118 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181288    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a15b3603-f8d9-4ef9-af80-718d1870bfca-host-slash\") pod \"iptables-alerter-hr5db\" (UID: \"a15b3603-f8d9-4ef9-af80-718d1870bfca\") " pod="openshift-network-operator/iptables-alerter-hr5db"
Sep 18 22:00:25.183118 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181309    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-host-var-lib-cni-multus\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.183118 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181283    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.183681 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181328    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-etc-systemd\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.183681 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181357    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a15b3603-f8d9-4ef9-af80-718d1870bfca-host-slash\") pod \"iptables-alerter-hr5db\" (UID: \"a15b3603-f8d9-4ef9-af80-718d1870bfca\") " pod="openshift-network-operator/iptables-alerter-hr5db"
Sep 18 22:00:25.183681 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181359    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gzdw\" (UniqueName: \"kubernetes.io/projected/81a07ab6-391c-45d4-a4ac-23caeb039ddd-kube-api-access-9gzdw\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.183681 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181403    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-etc-kubernetes\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.183681 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181428    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-original-pull-secret\") pod \"global-pull-secret-syncer-t7m2k\" (UID: \"0fa9a758-4e4b-477c-b6de-b36dc677e1cd\") " pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:25.183681 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181454    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3935be4c-a503-4315-8667-dba4a76ab439-hosts-file\") pod \"node-resolver-tb58x\" (UID: \"3935be4c-a503-4315-8667-dba4a76ab439\") " pod="openshift-dns/node-resolver-tb58x"
Sep 18 22:00:25.183681 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181457    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-host-var-lib-cni-multus\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.183681 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181478    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j9wd\" (UniqueName: \"kubernetes.io/projected/94be214b-068b-40be-8bbe-f02f700392f2-kube-api-access-9j9wd\") pod \"aws-ebs-csi-driver-node-dzv6c\" (UID: \"94be214b-068b-40be-8bbe-f02f700392f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c"
Sep 18 22:00:25.183681 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181491    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-etc-kubernetes\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.183681 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181502    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-etc-openvswitch\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.183681 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181530    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-node-log\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.183681 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181543    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-etc-openvswitch\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.183681 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:25.181549    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:25.183681 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181553    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-host-cni-bin\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.183681 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181575    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/81a07ab6-391c-45d4-a4ac-23caeb039ddd-ovnkube-script-lib\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.183681 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181594    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs\") pod \"network-metrics-daemon-td6sj\" (UID: \"8a7392bf-ea47-4efe-b58a-fc15baaa7461\") " pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:25.183681 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:25.181628    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-original-pull-secret podName:0fa9a758-4e4b-477c-b6de-b36dc677e1cd nodeName:}" failed. No retries permitted until 2026-09-18 22:00:25.681609974 +0000 UTC m=+2.038164261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-original-pull-secret") pod "global-pull-secret-syncer-t7m2k" (UID: "0fa9a758-4e4b-477c-b6de-b36dc677e1cd") : object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:25.184192 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181629    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3935be4c-a503-4315-8667-dba4a76ab439-hosts-file\") pod \"node-resolver-tb58x\" (UID: \"3935be4c-a503-4315-8667-dba4a76ab439\") " pod="openshift-dns/node-resolver-tb58x"
Sep 18 22:00:25.184192 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181642    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/94be214b-068b-40be-8bbe-f02f700392f2-registration-dir\") pod \"aws-ebs-csi-driver-node-dzv6c\" (UID: \"94be214b-068b-40be-8bbe-f02f700392f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c"
Sep 18 22:00:25.184192 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181664    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-host-run-k8s-cni-cncf-io\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.184192 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181681    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-node-log\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.184192 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181687    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cdf3488e-8f04-4dfe-b930-3a01d87da247-host\") pod \"node-ca-rtsx9\" (UID: \"cdf3488e-8f04-4dfe-b930-3a01d87da247\") " pod="openshift-image-registry/node-ca-rtsx9"
Sep 18 22:00:25.184192 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181706    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-host-run-ovn-kubernetes\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.184192 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181716    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-host-cni-bin\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.184192 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:25.181771    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:25.184192 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:25.181809    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs podName:8a7392bf-ea47-4efe-b58a-fc15baaa7461 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:25.681795226 +0000 UTC m=+2.038349532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs") pod "network-metrics-daemon-td6sj" (UID: "8a7392bf-ea47-4efe-b58a-fc15baaa7461") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:25.184192 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181812    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8435563a-0f46-48fb-b9c7-acce85b59376-system-cni-dir\") pod \"multus-additional-cni-plugins-wqhkx\" (UID: \"8435563a-0f46-48fb-b9c7-acce85b59376\") " pod="openshift-multus/multus-additional-cni-plugins-wqhkx"
Sep 18 22:00:25.184192 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181819    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/94be214b-068b-40be-8bbe-f02f700392f2-registration-dir\") pod \"aws-ebs-csi-driver-node-dzv6c\" (UID: \"94be214b-068b-40be-8bbe-f02f700392f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c"
Sep 18 22:00:25.184192 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181743    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8435563a-0f46-48fb-b9c7-acce85b59376-system-cni-dir\") pod \"multus-additional-cni-plugins-wqhkx\" (UID: \"8435563a-0f46-48fb-b9c7-acce85b59376\") " pod="openshift-multus/multus-additional-cni-plugins-wqhkx"
Sep 18 22:00:25.184192 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181849    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cdf3488e-8f04-4dfe-b930-3a01d87da247-host\") pod \"node-ca-rtsx9\" (UID: \"cdf3488e-8f04-4dfe-b930-3a01d87da247\") " pod="openshift-image-registry/node-ca-rtsx9"
Sep 18 22:00:25.184192 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181857    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8435563a-0f46-48fb-b9c7-acce85b59376-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wqhkx\" (UID: \"8435563a-0f46-48fb-b9c7-acce85b59376\") " pod="openshift-multus/multus-additional-cni-plugins-wqhkx"
Sep 18 22:00:25.184192 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181884    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/94be214b-068b-40be-8bbe-f02f700392f2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dzv6c\" (UID: \"94be214b-068b-40be-8bbe-f02f700392f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c"
Sep 18 22:00:25.184192 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181860    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81a07ab6-391c-45d4-a4ac-23caeb039ddd-host-run-ovn-kubernetes\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.184192 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181908    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/94be214b-068b-40be-8bbe-f02f700392f2-device-dir\") pod \"aws-ebs-csi-driver-node-dzv6c\" (UID: \"94be214b-068b-40be-8bbe-f02f700392f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c"
Sep 18 22:00:25.184754 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181933    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/94be214b-068b-40be-8bbe-f02f700392f2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dzv6c\" (UID: \"94be214b-068b-40be-8bbe-f02f700392f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c"
Sep 18 22:00:25.184754 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181934    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8435563a-0f46-48fb-b9c7-acce85b59376-cni-binary-copy\") pod \"multus-additional-cni-plugins-wqhkx\" (UID: \"8435563a-0f46-48fb-b9c7-acce85b59376\") " pod="openshift-multus/multus-additional-cni-plugins-wqhkx"
Sep 18 22:00:25.184754 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181966    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e92e768d-c8b5-4b47-a146-ca7ebecb1bab-konnectivity-ca\") pod \"konnectivity-agent-p5qkr\" (UID: \"e92e768d-c8b5-4b47-a146-ca7ebecb1bab\") " pod="kube-system/konnectivity-agent-p5qkr"
Sep 18 22:00:25.184754 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181986    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-multus-cni-dir\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.184754 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181885    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-host-run-k8s-cni-cncf-io\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.184754 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.182005    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/81a07ab6-391c-45d4-a4ac-23caeb039ddd-env-overrides\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.184754 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.182026    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtt76\" (UniqueName: \"kubernetes.io/projected/8a7392bf-ea47-4efe-b58a-fc15baaa7461-kube-api-access-wtt76\") pod \"network-metrics-daemon-td6sj\" (UID: \"8a7392bf-ea47-4efe-b58a-fc15baaa7461\") " pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:25.184754 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.182033    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/94be214b-068b-40be-8bbe-f02f700392f2-device-dir\") pod \"aws-ebs-csi-driver-node-dzv6c\" (UID: \"94be214b-068b-40be-8bbe-f02f700392f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c"
Sep 18 22:00:25.184754 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.181986    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8435563a-0f46-48fb-b9c7-acce85b59376-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wqhkx\" (UID: \"8435563a-0f46-48fb-b9c7-acce85b59376\") " pod="openshift-multus/multus-additional-cni-plugins-wqhkx"
Sep 18 22:00:25.184754 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.182048    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8435563a-0f46-48fb-b9c7-acce85b59376-cnibin\") pod \"multus-additional-cni-plugins-wqhkx\" (UID: \"8435563a-0f46-48fb-b9c7-acce85b59376\") " pod="openshift-multus/multus-additional-cni-plugins-wqhkx"
Sep 18 22:00:25.184754 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.182070    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8435563a-0f46-48fb-b9c7-acce85b59376-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wqhkx\" (UID: \"8435563a-0f46-48fb-b9c7-acce85b59376\") " pod="openshift-multus/multus-additional-cni-plugins-wqhkx"
Sep 18 22:00:25.184754 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.182088    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-run\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.184754 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.182106    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3935be4c-a503-4315-8667-dba4a76ab439-tmp-dir\") pod \"node-resolver-tb58x\" (UID: \"3935be4c-a503-4315-8667-dba4a76ab439\") " pod="openshift-dns/node-resolver-tb58x"
Sep 18 22:00:25.184754 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.182125    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/94be214b-068b-40be-8bbe-f02f700392f2-socket-dir\") pod \"aws-ebs-csi-driver-node-dzv6c\" (UID: \"94be214b-068b-40be-8bbe-f02f700392f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c"
Sep 18 22:00:25.184754 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.182144    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-cni-binary-copy\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.184754 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.182166    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-multus-daemon-config\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.184754 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.182185    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-etc-sysctl-conf\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.185444 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.182234    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/81a07ab6-391c-45d4-a4ac-23caeb039ddd-ovnkube-script-lib\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.185444 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.182286    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-etc-sysctl-conf\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.185444 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.182298    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-multus-cni-dir\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.185444 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.182333    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8435563a-0f46-48fb-b9c7-acce85b59376-cnibin\") pod \"multus-additional-cni-plugins-wqhkx\" (UID: \"8435563a-0f46-48fb-b9c7-acce85b59376\") " pod="openshift-multus/multus-additional-cni-plugins-wqhkx"
Sep 18 22:00:25.185444 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.182385    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8435563a-0f46-48fb-b9c7-acce85b59376-cni-binary-copy\") pod \"multus-additional-cni-plugins-wqhkx\" (UID: \"8435563a-0f46-48fb-b9c7-acce85b59376\") " pod="openshift-multus/multus-additional-cni-plugins-wqhkx"
Sep 18 22:00:25.185444 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.182502    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e92e768d-c8b5-4b47-a146-ca7ebecb1bab-konnectivity-ca\") pod \"konnectivity-agent-p5qkr\" (UID: \"e92e768d-c8b5-4b47-a146-ca7ebecb1bab\") " pod="kube-system/konnectivity-agent-p5qkr"
Sep 18 22:00:25.185444 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.182840    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/81a07ab6-391c-45d4-a4ac-23caeb039ddd-env-overrides\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.185444 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.182935    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-cni-binary-copy\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.185444 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.182989    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8435563a-0f46-48fb-b9c7-acce85b59376-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wqhkx\" (UID: \"8435563a-0f46-48fb-b9c7-acce85b59376\") " pod="openshift-multus/multus-additional-cni-plugins-wqhkx"
Sep 18 22:00:25.185444 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.183049    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/94be214b-068b-40be-8bbe-f02f700392f2-socket-dir\") pod \"aws-ebs-csi-driver-node-dzv6c\" (UID: \"94be214b-068b-40be-8bbe-f02f700392f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c"
Sep 18 22:00:25.185444 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.183080    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-run\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.185444 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.183334    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3935be4c-a503-4315-8667-dba4a76ab439-tmp-dir\") pod \"node-resolver-tb58x\" (UID: \"3935be4c-a503-4315-8667-dba4a76ab439\") " pod="openshift-dns/node-resolver-tb58x"
Sep 18 22:00:25.185444 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.183416    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-multus-daemon-config\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.185444 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.184875    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-etc-tuned\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.185444 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.185103    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-tmp\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.185444 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.185214    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/81a07ab6-391c-45d4-a4ac-23caeb039ddd-ovn-node-metrics-cert\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.185444 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.185328    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e92e768d-c8b5-4b47-a146-ca7ebecb1bab-agent-certs\") pod \"konnectivity-agent-p5qkr\" (UID: \"e92e768d-c8b5-4b47-a146-ca7ebecb1bab\") " pod="kube-system/konnectivity-agent-p5qkr"
Sep 18 22:00:25.200397 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:25.200372    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 22:00:25.200397 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:25.200400    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 22:00:25.200591 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:25.200415    2574 projected.go:196] Error preparing data for projected volume kube-api-access-cmv59 for pod openshift-network-diagnostics/network-check-target-wj4fb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:25.200591 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:25.200483    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e3f6f16-2634-4b45-ac6c-5470f9cfef13-kube-api-access-cmv59 podName:8e3f6f16-2634-4b45-ac6c-5470f9cfef13 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:25.700464825 +0000 UTC m=+2.057019115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cmv59" (UniqueName: "kubernetes.io/projected/8e3f6f16-2634-4b45-ac6c-5470f9cfef13-kube-api-access-cmv59") pod "network-check-target-wj4fb" (UID: "8e3f6f16-2634-4b45-ac6c-5470f9cfef13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:25.201394 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.201370    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csbd2\" (UniqueName: \"kubernetes.io/projected/09e0c1dc-cf28-4957-9607-f530d6f0e1e1-kube-api-access-csbd2\") pod \"multus-4s62x\" (UID: \"09e0c1dc-cf28-4957-9607-f530d6f0e1e1\") " pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.201546 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.201400    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqj6c\" (UniqueName: \"kubernetes.io/projected/cdf3488e-8f04-4dfe-b930-3a01d87da247-kube-api-access-xqj6c\") pod \"node-ca-rtsx9\" (UID: \"cdf3488e-8f04-4dfe-b930-3a01d87da247\") " pod="openshift-image-registry/node-ca-rtsx9"
Sep 18 22:00:25.201949 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.201929    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mtnf\" (UniqueName: \"kubernetes.io/projected/8435563a-0f46-48fb-b9c7-acce85b59376-kube-api-access-9mtnf\") pod \"multus-additional-cni-plugins-wqhkx\" (UID: \"8435563a-0f46-48fb-b9c7-acce85b59376\") " pod="openshift-multus/multus-additional-cni-plugins-wqhkx"
Sep 18 22:00:25.202671 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.202622    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtt76\" (UniqueName: \"kubernetes.io/projected/8a7392bf-ea47-4efe-b58a-fc15baaa7461-kube-api-access-wtt76\") pod \"network-metrics-daemon-td6sj\" (UID: \"8a7392bf-ea47-4efe-b58a-fc15baaa7461\") " pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:25.203197 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.203150    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tjn6\" (UniqueName: \"kubernetes.io/projected/3935be4c-a503-4315-8667-dba4a76ab439-kube-api-access-6tjn6\") pod \"node-resolver-tb58x\" (UID: \"3935be4c-a503-4315-8667-dba4a76ab439\") " pod="openshift-dns/node-resolver-tb58x"
Sep 18 22:00:25.203511 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.203486    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5f2w\" (UniqueName: \"kubernetes.io/projected/a15b3603-f8d9-4ef9-af80-718d1870bfca-kube-api-access-s5f2w\") pod \"iptables-alerter-hr5db\" (UID: \"a15b3603-f8d9-4ef9-af80-718d1870bfca\") " pod="openshift-network-operator/iptables-alerter-hr5db"
Sep 18 22:00:25.203787 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.203772    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j9wd\" (UniqueName: \"kubernetes.io/projected/94be214b-068b-40be-8bbe-f02f700392f2-kube-api-access-9j9wd\") pod \"aws-ebs-csi-driver-node-dzv6c\" (UID: \"94be214b-068b-40be-8bbe-f02f700392f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c"
Sep 18 22:00:25.205167 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.205146    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnspx\" (UniqueName: \"kubernetes.io/projected/ef6a0b72-7951-4302-a30a-f867f5c2dc0c-kube-api-access-qnspx\") pod \"tuned-hgx8j\" (UID: \"ef6a0b72-7951-4302-a30a-f867f5c2dc0c\") " pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.205260 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.205171    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gzdw\" (UniqueName: \"kubernetes.io/projected/81a07ab6-391c-45d4-a4ac-23caeb039ddd-kube-api-access-9gzdw\") pod \"ovnkube-node-zzwf2\" (UID: \"81a07ab6-391c-45d4-a4ac-23caeb039ddd\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.260447 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:25.260278    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda37eccb74ba3d314843a55dca527e48a.slice/crio-a1a6e56ca6fd0c18169d5fecc871a373bdcc249b1fac49f584d6603f8afc9883 WatchSource:0}: Error finding container a1a6e56ca6fd0c18169d5fecc871a373bdcc249b1fac49f584d6603f8afc9883: Status 404 returned error can't find the container with id a1a6e56ca6fd0c18169d5fecc871a373bdcc249b1fac49f584d6603f8afc9883
Sep 18 22:00:25.260723 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:25.260705    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79f70c2b414f57ea7072d15b46bebdf1.slice/crio-d9114903cdd032a9348d84b20b82e55243ea6f0bd858c549ccef024b84852230 WatchSource:0}: Error finding container d9114903cdd032a9348d84b20b82e55243ea6f0bd858c549ccef024b84852230: Status 404 returned error can't find the container with id d9114903cdd032a9348d84b20b82e55243ea6f0bd858c549ccef024b84852230
Sep 18 22:00:25.264928 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.264899    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 22:00:25.307136 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.307109    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hgx8j"
Sep 18 22:00:25.316172 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:25.316149    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef6a0b72_7951_4302_a30a_f867f5c2dc0c.slice/crio-1556531599ab0f803ef48602ce8c04705c6379cf1f3ac9d49b2508683e7013da WatchSource:0}: Error finding container 1556531599ab0f803ef48602ce8c04705c6379cf1f3ac9d49b2508683e7013da: Status 404 returned error can't find the container with id 1556531599ab0f803ef48602ce8c04705c6379cf1f3ac9d49b2508683e7013da
Sep 18 22:00:25.324008 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.323994    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hr5db"
Sep 18 22:00:25.331243 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:25.331223    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda15b3603_f8d9_4ef9_af80_718d1870bfca.slice/crio-cd41134d17f9438b89dcd4a153d5ca04434ed1cc172080e044fa47c9a44e4f5b WatchSource:0}: Error finding container cd41134d17f9438b89dcd4a153d5ca04434ed1cc172080e044fa47c9a44e4f5b: Status 404 returned error can't find the container with id cd41134d17f9438b89dcd4a153d5ca04434ed1cc172080e044fa47c9a44e4f5b
Sep 18 22:00:25.344246 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.344229    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:25.351618 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:25.351598    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81a07ab6_391c_45d4_a4ac_23caeb039ddd.slice/crio-cbbc1159b0e0f3ba3f88be0a34c833363c5e071f768f066e2e04d8f0948b7857 WatchSource:0}: Error finding container cbbc1159b0e0f3ba3f88be0a34c833363c5e071f768f066e2e04d8f0948b7857: Status 404 returned error can't find the container with id cbbc1159b0e0f3ba3f88be0a34c833363c5e071f768f066e2e04d8f0948b7857
Sep 18 22:00:25.355515 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.355500    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tb58x"
Sep 18 22:00:25.359325 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.359039    2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 22:00:25.361400 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.361364    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c"
Sep 18 22:00:25.365967 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:25.365948    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3935be4c_a503_4315_8667_dba4a76ab439.slice/crio-fec26d6b0580a14a80aab6a977d42f782d5505694c9b2dbc2aa6087c4e41bc7e WatchSource:0}: Error finding container fec26d6b0580a14a80aab6a977d42f782d5505694c9b2dbc2aa6087c4e41bc7e: Status 404 returned error can't find the container with id fec26d6b0580a14a80aab6a977d42f782d5505694c9b2dbc2aa6087c4e41bc7e
Sep 18 22:00:25.370691 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:25.370661    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94be214b_068b_40be_8bbe_f02f700392f2.slice/crio-f3dc61116774ad342dcb27f2405b3649f822fb9b304d92d1689657660a30d5a5 WatchSource:0}: Error finding container f3dc61116774ad342dcb27f2405b3649f822fb9b304d92d1689657660a30d5a5: Status 404 returned error can't find the container with id f3dc61116774ad342dcb27f2405b3649f822fb9b304d92d1689657660a30d5a5
Sep 18 22:00:25.380799 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.380772    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4s62x"
Sep 18 22:00:25.389396 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:25.389379    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09e0c1dc_cf28_4957_9607_f530d6f0e1e1.slice/crio-da01d773151ad6e54d70631800c8356079c0e07e7139e33fd0e67515dfa13288 WatchSource:0}: Error finding container da01d773151ad6e54d70631800c8356079c0e07e7139e33fd0e67515dfa13288: Status 404 returned error can't find the container with id da01d773151ad6e54d70631800c8356079c0e07e7139e33fd0e67515dfa13288
Sep 18 22:00:25.393980 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.393963    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rtsx9"
Sep 18 22:00:25.401496 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:25.401475    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdf3488e_8f04_4dfe_b930_3a01d87da247.slice/crio-5ee0742c607cdb96826418545a1b0ab7f8688804261776389d7030c8ca673539 WatchSource:0}: Error finding container 5ee0742c607cdb96826418545a1b0ab7f8688804261776389d7030c8ca673539: Status 404 returned error can't find the container with id 5ee0742c607cdb96826418545a1b0ab7f8688804261776389d7030c8ca673539
Sep 18 22:00:25.403250 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.403238    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 22:00:25.413623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.413600    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wqhkx"
Sep 18 22:00:25.418108 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:25.418092    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p5qkr"
Sep 18 22:00:25.422325 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:25.422308    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8435563a_0f46_48fb_b9c7_acce85b59376.slice/crio-b9724f66c5f704a287366799de66f9ef2c2924e4bb367b6f49ac7e47734fb784 WatchSource:0}: Error finding container b9724f66c5f704a287366799de66f9ef2c2924e4bb367b6f49ac7e47734fb784: Status 404 returned error can't find the container with id b9724f66c5f704a287366799de66f9ef2c2924e4bb367b6f49ac7e47734fb784
Sep 18 22:00:25.426796 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:25.426779    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode92e768d_c8b5_4b47_a146_ca7ebecb1bab.slice/crio-aa9416be06ecbf86f008ac3751ca377f57dcc5d065907898fd416f336e657d05 WatchSource:0}: Error finding container aa9416be06ecbf86f008ac3751ca377f57dcc5d065907898fd416f336e657d05: Status 404 returned error can't find the container with id aa9416be06ecbf86f008ac3751ca377f57dcc5d065907898fd416f336e657d05
Sep 18 22:00:25.428212 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:25.428193    2574 kuberuntime_manager.go:1459] "Unhandled Error" err="container konnectivity-agent start failed in pod konnectivity-agent-p5qkr_kube-system(e92e768d-c8b5-4b47-a146-ca7ebecb1bab): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Sep 18 22:00:25.428283 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:25.428225    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"konnectivity-agent\" with ErrImagePull: \"pull QPS exceeded\"" pod="kube-system/konnectivity-agent-p5qkr" podUID="e92e768d-c8b5-4b47-a146-ca7ebecb1bab"
Sep 18 22:00:26.909726 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:26.909693    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-original-pull-secret\") pod \"global-pull-secret-syncer-t7m2k\" (UID: \"0fa9a758-4e4b-477c-b6de-b36dc677e1cd\") " pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:26.909726 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:26.909733    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs\") pod \"network-metrics-daemon-td6sj\" (UID: \"8a7392bf-ea47-4efe-b58a-fc15baaa7461\") " pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:26.909925 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:26.909845    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:26.909925 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:26.909856    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:26.909925 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:26.909899    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs podName:8a7392bf-ea47-4efe-b58a-fc15baaa7461 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:27.909882308 +0000 UTC m=+3.041663368 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs") pod "network-metrics-daemon-td6sj" (UID: "8a7392bf-ea47-4efe-b58a-fc15baaa7461") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:26.909925 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:26.909916    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-original-pull-secret podName:0fa9a758-4e4b-477c-b6de-b36dc677e1cd nodeName:}" failed. No retries permitted until 2026-09-18 22:00:27.909908419 +0000 UTC m=+3.041689482 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-original-pull-secret") pod "global-pull-secret-syncer-t7m2k" (UID: "0fa9a758-4e4b-477c-b6de-b36dc677e1cd") : object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:27.010948 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:27.010236    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmv59\" (UniqueName: \"kubernetes.io/projected/8e3f6f16-2634-4b45-ac6c-5470f9cfef13-kube-api-access-cmv59\") pod \"network-check-target-wj4fb\" (UID: \"8e3f6f16-2634-4b45-ac6c-5470f9cfef13\") " pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:00:27.010948 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:27.010436    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 22:00:27.010948 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:27.010455    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 22:00:27.010948 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:27.010483    2574 projected.go:196] Error preparing data for projected volume kube-api-access-cmv59 for pod openshift-network-diagnostics/network-check-target-wj4fb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:27.010948 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:27.010555    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e3f6f16-2634-4b45-ac6c-5470f9cfef13-kube-api-access-cmv59 podName:8e3f6f16-2634-4b45-ac6c-5470f9cfef13 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:28.010537356 +0000 UTC m=+3.142318420 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cmv59" (UniqueName: "kubernetes.io/projected/8e3f6f16-2634-4b45-ac6c-5470f9cfef13-kube-api-access-cmv59") pod "network-check-target-wj4fb" (UID: "8e3f6f16-2634-4b45-ac6c-5470f9cfef13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:27.263045 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:27.262930    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 21:55:26 +0000 UTC" deadline="2028-04-01 15:02:48.906675151 +0000 UTC"
Sep 18 22:00:27.263045 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:27.262988    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13457h2m21.643690925s"
Sep 18 22:00:27.343537 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:27.342643    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:00:27.343537 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:27.342770    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj4fb" podUID="8e3f6f16-2634-4b45-ac6c-5470f9cfef13"
Sep 18 22:00:27.343537 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:27.342858    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:27.343537 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:27.342945    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td6sj" podUID="8a7392bf-ea47-4efe-b58a-fc15baaa7461"
Sep 18 22:00:27.343537 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:27.343001    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:27.343537 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:27.343149    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t7m2k" podUID="0fa9a758-4e4b-477c-b6de-b36dc677e1cd"
Sep 18 22:00:27.356100 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:27.355977    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2" event={"ID":"81a07ab6-391c-45d4-a4ac-23caeb039ddd","Type":"ContainerStarted","Data":"cbbc1159b0e0f3ba3f88be0a34c833363c5e071f768f066e2e04d8f0948b7857"}
Sep 18 22:00:27.367965 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:27.367933    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hr5db" event={"ID":"a15b3603-f8d9-4ef9-af80-718d1870bfca","Type":"ContainerStarted","Data":"cd41134d17f9438b89dcd4a153d5ca04434ed1cc172080e044fa47c9a44e4f5b"}
Sep 18 22:00:27.371061 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:27.371033    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rtsx9" event={"ID":"cdf3488e-8f04-4dfe-b930-3a01d87da247","Type":"ContainerStarted","Data":"5ee0742c607cdb96826418545a1b0ab7f8688804261776389d7030c8ca673539"}
Sep 18 22:00:27.373071 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:27.373049    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c" event={"ID":"94be214b-068b-40be-8bbe-f02f700392f2","Type":"ContainerStarted","Data":"f3dc61116774ad342dcb27f2405b3649f822fb9b304d92d1689657660a30d5a5"}
Sep 18 22:00:27.376477 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:27.376452    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tb58x" event={"ID":"3935be4c-a503-4315-8667-dba4a76ab439","Type":"ContainerStarted","Data":"fec26d6b0580a14a80aab6a977d42f782d5505694c9b2dbc2aa6087c4e41bc7e"}
Sep 18 22:00:27.381383 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:27.381357    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hgx8j" event={"ID":"ef6a0b72-7951-4302-a30a-f867f5c2dc0c","Type":"ContainerStarted","Data":"1556531599ab0f803ef48602ce8c04705c6379cf1f3ac9d49b2508683e7013da"}
Sep 18 22:00:27.387992 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:27.387966    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-255.ec2.internal" event={"ID":"79f70c2b414f57ea7072d15b46bebdf1","Type":"ContainerStarted","Data":"d9114903cdd032a9348d84b20b82e55243ea6f0bd858c549ccef024b84852230"}
Sep 18 22:00:27.403891 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:27.403863    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-255.ec2.internal" event={"ID":"a37eccb74ba3d314843a55dca527e48a","Type":"ContainerStarted","Data":"a1a6e56ca6fd0c18169d5fecc871a373bdcc249b1fac49f584d6603f8afc9883"}
Sep 18 22:00:27.416272 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:27.416241    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p5qkr" event={"ID":"e92e768d-c8b5-4b47-a146-ca7ebecb1bab","Type":"ContainerStarted","Data":"aa9416be06ecbf86f008ac3751ca377f57dcc5d065907898fd416f336e657d05"}
Sep 18 22:00:27.418463 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:27.418394    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"konnectivity-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:804c33f4d2f186a4968326ed9d398c7bc4669539fb76023857e7b13efd6c8cb0\\\": ErrImagePull: pull QPS exceeded\"" pod="kube-system/konnectivity-agent-p5qkr" podUID="e92e768d-c8b5-4b47-a146-ca7ebecb1bab"
Sep 18 22:00:27.420656 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:27.420549    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqhkx" event={"ID":"8435563a-0f46-48fb-b9c7-acce85b59376","Type":"ContainerStarted","Data":"b9724f66c5f704a287366799de66f9ef2c2924e4bb367b6f49ac7e47734fb784"}
Sep 18 22:00:27.427863 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:27.427840    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4s62x" event={"ID":"09e0c1dc-cf28-4957-9607-f530d6f0e1e1","Type":"ContainerStarted","Data":"da01d773151ad6e54d70631800c8356079c0e07e7139e33fd0e67515dfa13288"}
Sep 18 22:00:27.487338 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:27.487291    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 22:00:27.918583 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:27.917811    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-original-pull-secret\") pod \"global-pull-secret-syncer-t7m2k\" (UID: \"0fa9a758-4e4b-477c-b6de-b36dc677e1cd\") " pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:27.918583 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:27.917868    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs\") pod \"network-metrics-daemon-td6sj\" (UID: \"8a7392bf-ea47-4efe-b58a-fc15baaa7461\") " pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:27.918583 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:27.918035    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:27.918583 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:27.918095    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs podName:8a7392bf-ea47-4efe-b58a-fc15baaa7461 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:29.918076843 +0000 UTC m=+5.049857905 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs") pod "network-metrics-daemon-td6sj" (UID: "8a7392bf-ea47-4efe-b58a-fc15baaa7461") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:27.918583 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:27.918467    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:27.918583 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:27.918532    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-original-pull-secret podName:0fa9a758-4e4b-477c-b6de-b36dc677e1cd nodeName:}" failed. No retries permitted until 2026-09-18 22:00:29.918517367 +0000 UTC m=+5.050298443 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-original-pull-secret") pod "global-pull-secret-syncer-t7m2k" (UID: "0fa9a758-4e4b-477c-b6de-b36dc677e1cd") : object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:28.019255 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:28.019216    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmv59\" (UniqueName: \"kubernetes.io/projected/8e3f6f16-2634-4b45-ac6c-5470f9cfef13-kube-api-access-cmv59\") pod \"network-check-target-wj4fb\" (UID: \"8e3f6f16-2634-4b45-ac6c-5470f9cfef13\") " pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:00:28.019468 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:28.019396    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 22:00:28.019468 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:28.019416    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 22:00:28.019468 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:28.019428    2574 projected.go:196] Error preparing data for projected volume kube-api-access-cmv59 for pod openshift-network-diagnostics/network-check-target-wj4fb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:28.019653 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:28.019488    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e3f6f16-2634-4b45-ac6c-5470f9cfef13-kube-api-access-cmv59 podName:8e3f6f16-2634-4b45-ac6c-5470f9cfef13 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:30.019468656 +0000 UTC m=+5.151249719 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cmv59" (UniqueName: "kubernetes.io/projected/8e3f6f16-2634-4b45-ac6c-5470f9cfef13-kube-api-access-cmv59") pod "network-check-target-wj4fb" (UID: "8e3f6f16-2634-4b45-ac6c-5470f9cfef13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:28.261481 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:28.261409    2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 22:00:28.263450 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:28.263410    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 21:55:26 +0000 UTC" deadline="2028-05-20 05:00:09.714774654 +0000 UTC"
Sep 18 22:00:28.263450 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:28.263441    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14622h59m41.451337903s"
Sep 18 22:00:29.340039 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:29.340012    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:00:29.340624 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:29.340096    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj4fb" podUID="8e3f6f16-2634-4b45-ac6c-5470f9cfef13"
Sep 18 22:00:29.340624 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:29.340354    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:29.340624 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:29.340420    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td6sj" podUID="8a7392bf-ea47-4efe-b58a-fc15baaa7461"
Sep 18 22:00:29.340624 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:29.340453    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:29.340624 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:29.340491    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t7m2k" podUID="0fa9a758-4e4b-477c-b6de-b36dc677e1cd"
Sep 18 22:00:29.934440 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:29.934400    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs\") pod \"network-metrics-daemon-td6sj\" (UID: \"8a7392bf-ea47-4efe-b58a-fc15baaa7461\") " pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:29.934660 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:29.934488    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-original-pull-secret\") pod \"global-pull-secret-syncer-t7m2k\" (UID: \"0fa9a758-4e4b-477c-b6de-b36dc677e1cd\") " pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:29.934660 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:29.934617    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:29.934775 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:29.934677    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-original-pull-secret podName:0fa9a758-4e4b-477c-b6de-b36dc677e1cd nodeName:}" failed. No retries permitted until 2026-09-18 22:00:33.934659905 +0000 UTC m=+9.066440971 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-original-pull-secret") pod "global-pull-secret-syncer-t7m2k" (UID: "0fa9a758-4e4b-477c-b6de-b36dc677e1cd") : object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:29.935060 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:29.935041    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:29.935159 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:29.935092    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs podName:8a7392bf-ea47-4efe-b58a-fc15baaa7461 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:33.935077795 +0000 UTC m=+9.066858860 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs") pod "network-metrics-daemon-td6sj" (UID: "8a7392bf-ea47-4efe-b58a-fc15baaa7461") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:30.035329 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:30.035282    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmv59\" (UniqueName: \"kubernetes.io/projected/8e3f6f16-2634-4b45-ac6c-5470f9cfef13-kube-api-access-cmv59\") pod \"network-check-target-wj4fb\" (UID: \"8e3f6f16-2634-4b45-ac6c-5470f9cfef13\") " pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:00:30.035493 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:30.035449    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 22:00:30.035493 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:30.035472    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 22:00:30.035493 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:30.035485    2574 projected.go:196] Error preparing data for projected volume kube-api-access-cmv59 for pod openshift-network-diagnostics/network-check-target-wj4fb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:30.035694 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:30.035559    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e3f6f16-2634-4b45-ac6c-5470f9cfef13-kube-api-access-cmv59 podName:8e3f6f16-2634-4b45-ac6c-5470f9cfef13 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:34.035541786 +0000 UTC m=+9.167322851 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cmv59" (UniqueName: "kubernetes.io/projected/8e3f6f16-2634-4b45-ac6c-5470f9cfef13-kube-api-access-cmv59") pod "network-check-target-wj4fb" (UID: "8e3f6f16-2634-4b45-ac6c-5470f9cfef13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:31.341454 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:31.341417    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:00:31.341934 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:31.341527    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj4fb" podUID="8e3f6f16-2634-4b45-ac6c-5470f9cfef13"
Sep 18 22:00:31.341934 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:31.341684    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:31.341934 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:31.341718    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:31.341934 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:31.341822    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td6sj" podUID="8a7392bf-ea47-4efe-b58a-fc15baaa7461"
Sep 18 22:00:31.341934 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:31.341906    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t7m2k" podUID="0fa9a758-4e4b-477c-b6de-b36dc677e1cd"
Sep 18 22:00:33.343767 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:33.343735    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:33.344189 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:33.343853    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t7m2k" podUID="0fa9a758-4e4b-477c-b6de-b36dc677e1cd"
Sep 18 22:00:33.344189 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:33.343925    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:00:33.344189 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:33.344000    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj4fb" podUID="8e3f6f16-2634-4b45-ac6c-5470f9cfef13"
Sep 18 22:00:33.344189 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:33.344038    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:33.344189 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:33.344107    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td6sj" podUID="8a7392bf-ea47-4efe-b58a-fc15baaa7461"
Sep 18 22:00:33.969810 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:33.969767    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-original-pull-secret\") pod \"global-pull-secret-syncer-t7m2k\" (UID: \"0fa9a758-4e4b-477c-b6de-b36dc677e1cd\") " pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:33.969810 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:33.969817    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs\") pod \"network-metrics-daemon-td6sj\" (UID: \"8a7392bf-ea47-4efe-b58a-fc15baaa7461\") " pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:33.970052 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:33.969944    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:33.970052 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:33.970016    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-original-pull-secret podName:0fa9a758-4e4b-477c-b6de-b36dc677e1cd nodeName:}" failed. No retries permitted until 2026-09-18 22:00:41.969996316 +0000 UTC m=+17.101777394 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-original-pull-secret") pod "global-pull-secret-syncer-t7m2k" (UID: "0fa9a758-4e4b-477c-b6de-b36dc677e1cd") : object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:33.970375 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:33.969949    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:33.970480 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:33.970414    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs podName:8a7392bf-ea47-4efe-b58a-fc15baaa7461 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:41.970398972 +0000 UTC m=+17.102180032 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs") pod "network-metrics-daemon-td6sj" (UID: "8a7392bf-ea47-4efe-b58a-fc15baaa7461") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:34.070586 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:34.070546    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmv59\" (UniqueName: \"kubernetes.io/projected/8e3f6f16-2634-4b45-ac6c-5470f9cfef13-kube-api-access-cmv59\") pod \"network-check-target-wj4fb\" (UID: \"8e3f6f16-2634-4b45-ac6c-5470f9cfef13\") " pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:00:34.070757 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:34.070740    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 22:00:34.070816 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:34.070766    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 22:00:34.070816 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:34.070780    2574 projected.go:196] Error preparing data for projected volume kube-api-access-cmv59 for pod openshift-network-diagnostics/network-check-target-wj4fb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:34.070915 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:34.070834    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e3f6f16-2634-4b45-ac6c-5470f9cfef13-kube-api-access-cmv59 podName:8e3f6f16-2634-4b45-ac6c-5470f9cfef13 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:42.070815858 +0000 UTC m=+17.202596933 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cmv59" (UniqueName: "kubernetes.io/projected/8e3f6f16-2634-4b45-ac6c-5470f9cfef13-kube-api-access-cmv59") pod "network-check-target-wj4fb" (UID: "8e3f6f16-2634-4b45-ac6c-5470f9cfef13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:35.340307 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:35.340271    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:35.340872 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:35.340385    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td6sj" podUID="8a7392bf-ea47-4efe-b58a-fc15baaa7461"
Sep 18 22:00:35.340872 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:35.340433    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:35.340872 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:35.340582    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t7m2k" podUID="0fa9a758-4e4b-477c-b6de-b36dc677e1cd"
Sep 18 22:00:35.340872 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:35.340630    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:00:35.340872 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:35.340725    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj4fb" podUID="8e3f6f16-2634-4b45-ac6c-5470f9cfef13"
Sep 18 22:00:37.339960 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:37.339925    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:00:37.339960 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:37.339946    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:37.340411 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:37.339925    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:37.340411 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:37.340049    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj4fb" podUID="8e3f6f16-2634-4b45-ac6c-5470f9cfef13"
Sep 18 22:00:37.340411 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:37.340143    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t7m2k" podUID="0fa9a758-4e4b-477c-b6de-b36dc677e1cd"
Sep 18 22:00:37.340411 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:37.340231    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td6sj" podUID="8a7392bf-ea47-4efe-b58a-fc15baaa7461"
Sep 18 22:00:39.340008 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:39.339934    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:00:39.340008 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:39.339953    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:39.340008 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:39.339935    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:39.340585 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:39.340209    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td6sj" podUID="8a7392bf-ea47-4efe-b58a-fc15baaa7461"
Sep 18 22:00:39.340585 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:39.340292    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj4fb" podUID="8e3f6f16-2634-4b45-ac6c-5470f9cfef13"
Sep 18 22:00:39.340585 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:39.340356    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t7m2k" podUID="0fa9a758-4e4b-477c-b6de-b36dc677e1cd"
Sep 18 22:00:41.339720 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:41.339694    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:41.340021 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:41.339735    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:00:41.340021 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:41.339831    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t7m2k" podUID="0fa9a758-4e4b-477c-b6de-b36dc677e1cd"
Sep 18 22:00:41.340021 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:41.339865    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj4fb" podUID="8e3f6f16-2634-4b45-ac6c-5470f9cfef13"
Sep 18 22:00:41.340021 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:41.339907    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:41.340371 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:41.340353    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td6sj" podUID="8a7392bf-ea47-4efe-b58a-fc15baaa7461"
Sep 18 22:00:42.026362 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:42.026322    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-original-pull-secret\") pod \"global-pull-secret-syncer-t7m2k\" (UID: \"0fa9a758-4e4b-477c-b6de-b36dc677e1cd\") " pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:42.026585 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:42.026379    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs\") pod \"network-metrics-daemon-td6sj\" (UID: \"8a7392bf-ea47-4efe-b58a-fc15baaa7461\") " pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:42.026585 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:42.026479    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:42.026585 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:42.026493    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:42.026585 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:42.026564    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs podName:8a7392bf-ea47-4efe-b58a-fc15baaa7461 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:58.026544962 +0000 UTC m=+33.158326022 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs") pod "network-metrics-daemon-td6sj" (UID: "8a7392bf-ea47-4efe-b58a-fc15baaa7461") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:42.026585 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:42.026577    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-original-pull-secret podName:0fa9a758-4e4b-477c-b6de-b36dc677e1cd nodeName:}" failed. No retries permitted until 2026-09-18 22:00:58.026571363 +0000 UTC m=+33.158352422 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-original-pull-secret") pod "global-pull-secret-syncer-t7m2k" (UID: "0fa9a758-4e4b-477c-b6de-b36dc677e1cd") : object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:42.127712 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:42.127657    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmv59\" (UniqueName: \"kubernetes.io/projected/8e3f6f16-2634-4b45-ac6c-5470f9cfef13-kube-api-access-cmv59\") pod \"network-check-target-wj4fb\" (UID: \"8e3f6f16-2634-4b45-ac6c-5470f9cfef13\") " pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:00:42.127904 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:42.127851    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 22:00:42.127904 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:42.127875    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 22:00:42.127904 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:42.127887    2574 projected.go:196] Error preparing data for projected volume kube-api-access-cmv59 for pod openshift-network-diagnostics/network-check-target-wj4fb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:42.128083 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:42.127954    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e3f6f16-2634-4b45-ac6c-5470f9cfef13-kube-api-access-cmv59 podName:8e3f6f16-2634-4b45-ac6c-5470f9cfef13 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:58.127933357 +0000 UTC m=+33.259714436 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cmv59" (UniqueName: "kubernetes.io/projected/8e3f6f16-2634-4b45-ac6c-5470f9cfef13-kube-api-access-cmv59") pod "network-check-target-wj4fb" (UID: "8e3f6f16-2634-4b45-ac6c-5470f9cfef13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:43.339363 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:43.339331    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:00:43.339945 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:43.339331    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:43.339945 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:43.339452    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj4fb" podUID="8e3f6f16-2634-4b45-ac6c-5470f9cfef13"
Sep 18 22:00:43.339945 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:43.339532    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t7m2k" podUID="0fa9a758-4e4b-477c-b6de-b36dc677e1cd"
Sep 18 22:00:43.339945 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:43.339335    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:43.339945 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:43.339625    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td6sj" podUID="8a7392bf-ea47-4efe-b58a-fc15baaa7461"
Sep 18 22:00:45.339936 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:45.339907    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:00:45.340296 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:45.339981    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:45.340296 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:45.340063    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t7m2k" podUID="0fa9a758-4e4b-477c-b6de-b36dc677e1cd"
Sep 18 22:00:45.340296 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:45.339977    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj4fb" podUID="8e3f6f16-2634-4b45-ac6c-5470f9cfef13"
Sep 18 22:00:45.340296 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:45.340111    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:45.340296 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:45.340179    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td6sj" podUID="8a7392bf-ea47-4efe-b58a-fc15baaa7461"
Sep 18 22:00:46.467717 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:46.467325    2574 generic.go:356] "Generic (PLEG): container finished" podID="a37eccb74ba3d314843a55dca527e48a" containerID="66e84fe05c70fddae3e3d36c02a8b0c4444237f07a7ef5eea122ceb4e5e4c8ab" exitCode=0
Sep 18 22:00:46.468358 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:46.467412    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-255.ec2.internal" event={"ID":"a37eccb74ba3d314843a55dca527e48a","Type":"ContainerDied","Data":"66e84fe05c70fddae3e3d36c02a8b0c4444237f07a7ef5eea122ceb4e5e4c8ab"}
Sep 18 22:00:46.470399 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:46.470372    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p5qkr" event={"ID":"e92e768d-c8b5-4b47-a146-ca7ebecb1bab","Type":"ContainerStarted","Data":"133dc45127eb883fa4a22c65401f502d3d210456325967a2e5b70628f2cf03e2"}
Sep 18 22:00:46.472312 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:46.472284    2574 generic.go:356] "Generic (PLEG): container finished" podID="8435563a-0f46-48fb-b9c7-acce85b59376" containerID="8904d4735263605cc4f7eea0290689b01dc7a79a757cf9b972eb07ce49751af3" exitCode=0
Sep 18 22:00:46.472393 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:46.472376    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqhkx" event={"ID":"8435563a-0f46-48fb-b9c7-acce85b59376","Type":"ContainerDied","Data":"8904d4735263605cc4f7eea0290689b01dc7a79a757cf9b972eb07ce49751af3"}
Sep 18 22:00:46.474429 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:46.474329    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4s62x" event={"ID":"09e0c1dc-cf28-4957-9607-f530d6f0e1e1","Type":"ContainerStarted","Data":"c8226b243d3f7665a1ab1138c2b596fb33d2b18843ac13e86b7e25263ef88889"}
Sep 18 22:00:46.477912 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:46.477893    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2" event={"ID":"81a07ab6-391c-45d4-a4ac-23caeb039ddd","Type":"ContainerStarted","Data":"4e124efe3b3c40e9c2d03e3fccccffcd862ce3b3e5330c9548455dd7422a2621"}
Sep 18 22:00:46.478009 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:46.477964    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2" event={"ID":"81a07ab6-391c-45d4-a4ac-23caeb039ddd","Type":"ContainerStarted","Data":"49cb5d0e637c6352c888afdfb7dc578f1173a945b0798dafcee9304dd2ef080a"}
Sep 18 22:00:46.478086 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:46.478014    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2" event={"ID":"81a07ab6-391c-45d4-a4ac-23caeb039ddd","Type":"ContainerStarted","Data":"1d8dd72c989c3594f01c4622c2ed9769576853160b6079f7b748497f55fd5266"}
Sep 18 22:00:46.478086 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:46.478062    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2" event={"ID":"81a07ab6-391c-45d4-a4ac-23caeb039ddd","Type":"ContainerStarted","Data":"73479eece130876b2a30b1396dda46fb86687236017b1064683338d166dd11b0"}
Sep 18 22:00:46.479602 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:46.479578    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rtsx9" event={"ID":"cdf3488e-8f04-4dfe-b930-3a01d87da247","Type":"ContainerStarted","Data":"e396e587f182e752129613945bef9d8e9f2527abe538b7192d6eea35657856cc"}
Sep 18 22:00:46.481180 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:46.481156    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c" event={"ID":"94be214b-068b-40be-8bbe-f02f700392f2","Type":"ContainerStarted","Data":"b6fa4102f562bcf65432bdf3114dec6b96568aef93d15516930997a833071923"}
Sep 18 22:00:46.482725 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:46.482698    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tb58x" event={"ID":"3935be4c-a503-4315-8667-dba4a76ab439","Type":"ContainerStarted","Data":"503c1c7c10fc0b94581a82f9f68ceb701ec189ec7541e8c246d3a5be010cf467"}
Sep 18 22:00:46.484265 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:46.484241    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hgx8j" event={"ID":"ef6a0b72-7951-4302-a30a-f867f5c2dc0c","Type":"ContainerStarted","Data":"7b242b60f1e2c75dc5682459c11c7f27dd765004ea3e6205f96ce8a549a35b99"}
Sep 18 22:00:46.485656 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:46.485628    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-255.ec2.internal" event={"ID":"79f70c2b414f57ea7072d15b46bebdf1","Type":"ContainerStarted","Data":"d527983ba4f8dcd5df0da9536b172148b1664dd27c3b67673e1ef8364aa6e69e"}
Sep 18 22:00:46.524053 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:46.524001    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p5qkr" podStartSLOduration=2.034313859 podStartE2EDuration="21.523982147s" totalImagesPullingTime="19.489668288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-09-18 22:00:46.523414282 +0000 UTC m=+21.655195364" watchObservedRunningTime="2026-09-18 22:00:46.523982147 +0000 UTC m=+21.655763230"
Sep 18 22:00:46.541475 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:46.541441    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4s62x" podStartSLOduration=1.997010468 podStartE2EDuration="21.541427223s" totalImagesPullingTime="19.544416755s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:00:46.541297499 +0000 UTC m=+21.673078605" watchObservedRunningTime="2026-09-18 22:00:46.541427223 +0000 UTC m=+21.673208315"
Sep 18 22:00:46.575878 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:46.575841    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rtsx9" podStartSLOduration=6.643260097 podStartE2EDuration="21.575826284s" totalImagesPullingTime="14.932566187s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:00:46.561904947 +0000 UTC m=+21.693686030" watchObservedRunningTime="2026-09-18 22:00:46.575826284 +0000 UTC m=+21.707607403"
Sep 18 22:00:46.576199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:46.576174    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-255.ec2.internal" podStartSLOduration=20.576168261 podStartE2EDuration="20.576168261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:00:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:00:46.575732631 +0000 UTC m=+21.707513723" watchObservedRunningTime="2026-09-18 22:00:46.576168261 +0000 UTC m=+21.707949344"
Sep 18 22:00:46.597848 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:46.597813    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hgx8j" podStartSLOduration=2.748140798 podStartE2EDuration="21.597798529s" totalImagesPullingTime="18.849657731s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:00:46.595801464 +0000 UTC m=+21.727582547" watchObservedRunningTime="2026-09-18 22:00:46.597798529 +0000 UTC m=+21.729579641"
Sep 18 22:00:46.628608 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:46.628569    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tb58x" podStartSLOduration=2.831405114 podStartE2EDuration="21.628554458s" totalImagesPullingTime="18.797149344s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:00:46.627843894 +0000 UTC m=+21.759624976" watchObservedRunningTime="2026-09-18 22:00:46.628554458 +0000 UTC m=+21.760335541"
Sep 18 22:00:47.166125 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:47.166081    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p5qkr"
Sep 18 22:00:47.167319 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:47.166860    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p5qkr"
Sep 18 22:00:47.339712 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:47.339681    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:00:47.339712 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:47.339710    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:47.339992 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:47.339692    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:47.339992 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:47.339796    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj4fb" podUID="8e3f6f16-2634-4b45-ac6c-5470f9cfef13"
Sep 18 22:00:47.339992 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:47.339853    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t7m2k" podUID="0fa9a758-4e4b-477c-b6de-b36dc677e1cd"
Sep 18 22:00:47.339992 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:47.339974    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td6sj" podUID="8a7392bf-ea47-4efe-b58a-fc15baaa7461"
Sep 18 22:00:47.490599 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:47.490540    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-255.ec2.internal" event={"ID":"a37eccb74ba3d314843a55dca527e48a","Type":"ContainerStarted","Data":"1618aef63f18cfa4a93322210191933355e6ac3701f34ba03cbcca80b5db4c0d"}
Sep 18 22:00:47.494163 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:47.494123    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2" event={"ID":"81a07ab6-391c-45d4-a4ac-23caeb039ddd","Type":"ContainerStarted","Data":"89fd5f812b132ef7c6c5202b59ea7d051ce8b5bf84bc28e6fcfea662f5017185"}
Sep 18 22:00:47.494902 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:47.494881    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p5qkr"
Sep 18 22:00:47.495020 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:47.494938    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p5qkr"
Sep 18 22:00:47.495020 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:47.494959    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2" event={"ID":"81a07ab6-391c-45d4-a4ac-23caeb039ddd","Type":"ContainerStarted","Data":"b047d88085390b23c14ba9681b58e83e7e9e8498495d6beb9fcd1f058d2ef7bb"}
Sep 18 22:00:47.526275 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:47.526225    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-255.ec2.internal" podStartSLOduration=21.526204905 podStartE2EDuration="21.526204905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:00:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:00:47.525914796 +0000 UTC m=+22.657695880" watchObservedRunningTime="2026-09-18 22:00:47.526204905 +0000 UTC m=+22.657985987"
Sep 18 22:00:47.689997 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:47.689968    2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 18 22:00:48.283400 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:48.283297    2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T22:00:47.689995901Z","UUID":"43c457ab-c328-446e-90c8-361ba71cb1b4","Handler":null,"Name":"","Endpoint":""}
Sep 18 22:00:48.284994 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:48.284975    2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 18 22:00:48.285137 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:48.285006    2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 18 22:00:48.498095 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:48.498064    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hr5db" event={"ID":"a15b3603-f8d9-4ef9-af80-718d1870bfca","Type":"ContainerStarted","Data":"8edb33300a47522567d4b1a8005074c4872884e2692954d969ee1b30b3af5f76"}
Sep 18 22:00:48.501101 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:48.501066    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c" event={"ID":"94be214b-068b-40be-8bbe-f02f700392f2","Type":"ContainerStarted","Data":"ab3782dd916129c767a75bcea682d5bf6667a08fa4659e5e8c8250eb64dc9ce8"}
Sep 18 22:00:49.339492 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:49.339294    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:49.339697 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:49.339337    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:00:49.339697 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:49.339614    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td6sj" podUID="8a7392bf-ea47-4efe-b58a-fc15baaa7461"
Sep 18 22:00:49.339697 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:49.339356    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:49.339697 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:49.339683    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj4fb" podUID="8e3f6f16-2634-4b45-ac6c-5470f9cfef13"
Sep 18 22:00:49.339860 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:49.339749    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t7m2k" podUID="0fa9a758-4e4b-477c-b6de-b36dc677e1cd"
Sep 18 22:00:49.507744 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:49.507704    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2" event={"ID":"81a07ab6-391c-45d4-a4ac-23caeb039ddd","Type":"ContainerStarted","Data":"9b9aa638a4dfefb80db199e9405a8c865f57ad41ba610ee31ba71a5d43c0bf5c"}
Sep 18 22:00:51.340243 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:51.340045    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:00:51.340641 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:51.340045    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:51.340641 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:51.340288    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj4fb" podUID="8e3f6f16-2634-4b45-ac6c-5470f9cfef13"
Sep 18 22:00:51.340641 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:51.340090    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:51.340641 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:51.340365    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t7m2k" podUID="0fa9a758-4e4b-477c-b6de-b36dc677e1cd"
Sep 18 22:00:51.340641 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:51.340483    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td6sj" podUID="8a7392bf-ea47-4efe-b58a-fc15baaa7461"
Sep 18 22:00:51.513951 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:51.513915    2574 generic.go:356] "Generic (PLEG): container finished" podID="8435563a-0f46-48fb-b9c7-acce85b59376" containerID="7016132fa34e97692267e1f703663868fc4b2a3b7d0776d2ae66929067fc01fa" exitCode=0
Sep 18 22:00:51.514130 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:51.513999    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqhkx" event={"ID":"8435563a-0f46-48fb-b9c7-acce85b59376","Type":"ContainerDied","Data":"7016132fa34e97692267e1f703663868fc4b2a3b7d0776d2ae66929067fc01fa"}
Sep 18 22:00:51.517783 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:51.517735    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2" event={"ID":"81a07ab6-391c-45d4-a4ac-23caeb039ddd","Type":"ContainerStarted","Data":"6f22f1a856a742aeb3c0b27cf1ba2d5e22ce120f001edf1f15cc943cd3b86784"}
Sep 18 22:00:51.518033 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:51.518012    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:51.518121 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:51.518078    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:51.518170 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:51.518131    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:51.520187 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:51.520167    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c" event={"ID":"94be214b-068b-40be-8bbe-f02f700392f2","Type":"ContainerStarted","Data":"4464c47f135ad995fdd5e435276b0194de15fb6ea2be690d9d35940d9cb31af3"}
Sep 18 22:00:51.535983 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:51.535958    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:51.536117 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:51.536077    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:00:51.543219 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:51.543175    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hr5db" podStartSLOduration=7.704005855 podStartE2EDuration="26.543162143s" totalImagesPullingTime="18.839156288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:00:48.516519146 +0000 UTC m=+23.648300219" watchObservedRunningTime="2026-09-18 22:00:51.543162143 +0000 UTC m=+26.674943225"
Sep 18 22:00:51.572360 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:51.572307    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2" podStartSLOduration=7.127682924 podStartE2EDuration="26.572292993s" totalImagesPullingTime="19.444610069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:00:51.572002092 +0000 UTC m=+26.703783173" watchObservedRunningTime="2026-09-18 22:00:51.572292993 +0000 UTC m=+26.704074075"
Sep 18 22:00:51.589722 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:51.589672    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dzv6c" podStartSLOduration=3.3698447639999998 podStartE2EDuration="26.589658409s" totalImagesPullingTime="23.219813645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:00:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:00:51.589225824 +0000 UTC m=+26.721006905" watchObservedRunningTime="2026-09-18 22:00:51.589658409 +0000 UTC m=+26.721439487"
Sep 18 22:00:53.206234 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:53.206163    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t7m2k"]
Sep 18 22:00:53.206858 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:53.206306    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:53.206858 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:53.206395    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t7m2k" podUID="0fa9a758-4e4b-477c-b6de-b36dc677e1cd"
Sep 18 22:00:53.211475 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:53.211450    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-td6sj"]
Sep 18 22:00:53.211623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:53.211583    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:53.211699 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:53.211685    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td6sj" podUID="8a7392bf-ea47-4efe-b58a-fc15baaa7461"
Sep 18 22:00:53.215756 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:53.215737    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wj4fb"]
Sep 18 22:00:53.215837 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:53.215818    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:00:53.215922 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:53.215902    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj4fb" podUID="8e3f6f16-2634-4b45-ac6c-5470f9cfef13"
Sep 18 22:00:53.526836 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:53.526755    2574 generic.go:356] "Generic (PLEG): container finished" podID="8435563a-0f46-48fb-b9c7-acce85b59376" containerID="8fc487b9bcbce7cf8fa1a7210defac9a10e043d72d891c382c22214fe5e6da99" exitCode=0
Sep 18 22:00:53.526979 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:53.526844    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqhkx" event={"ID":"8435563a-0f46-48fb-b9c7-acce85b59376","Type":"ContainerDied","Data":"8fc487b9bcbce7cf8fa1a7210defac9a10e043d72d891c382c22214fe5e6da99"}
Sep 18 22:00:54.340080 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:54.340007    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:00:54.340406 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:54.340109    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj4fb" podUID="8e3f6f16-2634-4b45-ac6c-5470f9cfef13"
Sep 18 22:00:55.341014 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:55.340767    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:55.341376 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:55.340817    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:55.341376 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:55.341107    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t7m2k" podUID="0fa9a758-4e4b-477c-b6de-b36dc677e1cd"
Sep 18 22:00:55.341376 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:55.341156    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td6sj" podUID="8a7392bf-ea47-4efe-b58a-fc15baaa7461"
Sep 18 22:00:55.534214 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:55.534184    2574 generic.go:356] "Generic (PLEG): container finished" podID="8435563a-0f46-48fb-b9c7-acce85b59376" containerID="d5d582c394f4ae389acede161077f5708c91df2ec6637b00a8ba25cd10ea1fa2" exitCode=0
Sep 18 22:00:55.534348 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:55.534239    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqhkx" event={"ID":"8435563a-0f46-48fb-b9c7-acce85b59376","Type":"ContainerDied","Data":"d5d582c394f4ae389acede161077f5708c91df2ec6637b00a8ba25cd10ea1fa2"}
Sep 18 22:00:56.339834 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:56.339803    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:00:56.340014 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:56.339915    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj4fb" podUID="8e3f6f16-2634-4b45-ac6c-5470f9cfef13"
Sep 18 22:00:57.339457 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:57.339424    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:57.339921 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:57.339565    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t7m2k" podUID="0fa9a758-4e4b-477c-b6de-b36dc677e1cd"
Sep 18 22:00:57.339921 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:57.339602    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:57.339921 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:57.339746    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-td6sj" podUID="8a7392bf-ea47-4efe-b58a-fc15baaa7461"
Sep 18 22:00:58.047632 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.047597    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-original-pull-secret\") pod \"global-pull-secret-syncer-t7m2k\" (UID: \"0fa9a758-4e4b-477c-b6de-b36dc677e1cd\") " pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:58.047632 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.047634    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs\") pod \"network-metrics-daemon-td6sj\" (UID: \"8a7392bf-ea47-4efe-b58a-fc15baaa7461\") " pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:58.048008 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:58.047727    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:58.048008 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:58.047739    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:58.048008 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:58.047777    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs podName:8a7392bf-ea47-4efe-b58a-fc15baaa7461 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:30.047762941 +0000 UTC m=+65.179544005 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs") pod "network-metrics-daemon-td6sj" (UID: "8a7392bf-ea47-4efe-b58a-fc15baaa7461") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 22:00:58.048008 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:58.047797    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-original-pull-secret podName:0fa9a758-4e4b-477c-b6de-b36dc677e1cd nodeName:}" failed. No retries permitted until 2026-09-18 22:01:30.047783327 +0000 UTC m=+65.179564401 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-original-pull-secret") pod "global-pull-secret-syncer-t7m2k" (UID: "0fa9a758-4e4b-477c-b6de-b36dc677e1cd") : object "kube-system"/"original-pull-secret" not registered
Sep 18 22:00:58.148312 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.148282    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmv59\" (UniqueName: \"kubernetes.io/projected/8e3f6f16-2634-4b45-ac6c-5470f9cfef13-kube-api-access-cmv59\") pod \"network-check-target-wj4fb\" (UID: \"8e3f6f16-2634-4b45-ac6c-5470f9cfef13\") " pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:00:58.148492 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:58.148414    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 22:00:58.148492 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:58.148434    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 22:00:58.148492 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:58.148446    2574 projected.go:196] Error preparing data for projected volume kube-api-access-cmv59 for pod openshift-network-diagnostics/network-check-target-wj4fb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:58.148658 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:58.148520    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e3f6f16-2634-4b45-ac6c-5470f9cfef13-kube-api-access-cmv59 podName:8e3f6f16-2634-4b45-ac6c-5470f9cfef13 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:30.148490114 +0000 UTC m=+65.280271178 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cmv59" (UniqueName: "kubernetes.io/projected/8e3f6f16-2634-4b45-ac6c-5470f9cfef13-kube-api-access-cmv59") pod "network-check-target-wj4fb" (UID: "8e3f6f16-2634-4b45-ac6c-5470f9cfef13") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 22:00:58.340231 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.340152    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:00:58.340651 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:58.340264    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wj4fb" podUID="8e3f6f16-2634-4b45-ac6c-5470f9cfef13"
Sep 18 22:00:58.655292 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.655267    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-255.ec2.internal" event="NodeReady"
Sep 18 22:00:58.655425 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.655381    2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 18 22:00:58.728870 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.728839    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bcxc9"]
Sep 18 22:00:58.731856 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.731837    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bcxc9"
Sep 18 22:00:58.734769 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.734744    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 18 22:00:58.735084 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.735062    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 18 22:00:58.735185 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.735092    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kdhvj\""
Sep 18 22:00:58.735634 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.735615    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hmx2x"]
Sep 18 22:00:58.737449 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.737430    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hmx2x"
Sep 18 22:00:58.740356 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.740117    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 18 22:00:58.740356 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.740252    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 18 22:00:58.740537 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.740522    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vdm9t\""
Sep 18 22:00:58.741949 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.741934    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 18 22:00:58.755601 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.755576    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hmx2x"]
Sep 18 22:00:58.760954 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.760935    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bcxc9"]
Sep 18 22:00:58.853329 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.853257    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4148d3f5-0a43-4d62-b1cc-6015b20f7228-config-volume\") pod \"dns-default-bcxc9\" (UID: \"4148d3f5-0a43-4d62-b1cc-6015b20f7228\") " pod="openshift-dns/dns-default-bcxc9"
Sep 18 22:00:58.853329 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.853292    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4148d3f5-0a43-4d62-b1cc-6015b20f7228-tmp-dir\") pod \"dns-default-bcxc9\" (UID: \"4148d3f5-0a43-4d62-b1cc-6015b20f7228\") " pod="openshift-dns/dns-default-bcxc9"
Sep 18 22:00:58.853567 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.853364    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75534380-ec8e-48f6-bf26-a57584c2e185-cert\") pod \"ingress-canary-hmx2x\" (UID: \"75534380-ec8e-48f6-bf26-a57584c2e185\") " pod="openshift-ingress-canary/ingress-canary-hmx2x"
Sep 18 22:00:58.853567 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.853388    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lgmb\" (UniqueName: \"kubernetes.io/projected/4148d3f5-0a43-4d62-b1cc-6015b20f7228-kube-api-access-9lgmb\") pod \"dns-default-bcxc9\" (UID: \"4148d3f5-0a43-4d62-b1cc-6015b20f7228\") " pod="openshift-dns/dns-default-bcxc9"
Sep 18 22:00:58.853567 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.853453    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4148d3f5-0a43-4d62-b1cc-6015b20f7228-metrics-tls\") pod \"dns-default-bcxc9\" (UID: \"4148d3f5-0a43-4d62-b1cc-6015b20f7228\") " pod="openshift-dns/dns-default-bcxc9"
Sep 18 22:00:58.853567 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.853548    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvc62\" (UniqueName: \"kubernetes.io/projected/75534380-ec8e-48f6-bf26-a57584c2e185-kube-api-access-dvc62\") pod \"ingress-canary-hmx2x\" (UID: \"75534380-ec8e-48f6-bf26-a57584c2e185\") " pod="openshift-ingress-canary/ingress-canary-hmx2x"
Sep 18 22:00:58.954621 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.954586    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvc62\" (UniqueName: \"kubernetes.io/projected/75534380-ec8e-48f6-bf26-a57584c2e185-kube-api-access-dvc62\") pod \"ingress-canary-hmx2x\" (UID: \"75534380-ec8e-48f6-bf26-a57584c2e185\") " pod="openshift-ingress-canary/ingress-canary-hmx2x"
Sep 18 22:00:58.954621 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.954625    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4148d3f5-0a43-4d62-b1cc-6015b20f7228-config-volume\") pod \"dns-default-bcxc9\" (UID: \"4148d3f5-0a43-4d62-b1cc-6015b20f7228\") " pod="openshift-dns/dns-default-bcxc9"
Sep 18 22:00:58.954845 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.954640    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4148d3f5-0a43-4d62-b1cc-6015b20f7228-tmp-dir\") pod \"dns-default-bcxc9\" (UID: \"4148d3f5-0a43-4d62-b1cc-6015b20f7228\") " pod="openshift-dns/dns-default-bcxc9"
Sep 18 22:00:58.954845 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.954691    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75534380-ec8e-48f6-bf26-a57584c2e185-cert\") pod \"ingress-canary-hmx2x\" (UID: \"75534380-ec8e-48f6-bf26-a57584c2e185\") " pod="openshift-ingress-canary/ingress-canary-hmx2x"
Sep 18 22:00:58.954845 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.954720    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lgmb\" (UniqueName: \"kubernetes.io/projected/4148d3f5-0a43-4d62-b1cc-6015b20f7228-kube-api-access-9lgmb\") pod \"dns-default-bcxc9\" (UID: \"4148d3f5-0a43-4d62-b1cc-6015b20f7228\") " pod="openshift-dns/dns-default-bcxc9"
Sep 18 22:00:58.954845 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.954749    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4148d3f5-0a43-4d62-b1cc-6015b20f7228-metrics-tls\") pod \"dns-default-bcxc9\" (UID: \"4148d3f5-0a43-4d62-b1cc-6015b20f7228\") " pod="openshift-dns/dns-default-bcxc9"
Sep 18 22:00:58.955009 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:58.954858    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 22:00:58.955009 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:58.954919    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4148d3f5-0a43-4d62-b1cc-6015b20f7228-metrics-tls podName:4148d3f5-0a43-4d62-b1cc-6015b20f7228 nodeName:}" failed. No retries permitted until 2026-09-18 22:00:59.454900318 +0000 UTC m=+34.586681392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4148d3f5-0a43-4d62-b1cc-6015b20f7228-metrics-tls") pod "dns-default-bcxc9" (UID: "4148d3f5-0a43-4d62-b1cc-6015b20f7228") : secret "dns-default-metrics-tls" not found
Sep 18 22:00:58.955240 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.955216    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4148d3f5-0a43-4d62-b1cc-6015b20f7228-tmp-dir\") pod \"dns-default-bcxc9\" (UID: \"4148d3f5-0a43-4d62-b1cc-6015b20f7228\") " pod="openshift-dns/dns-default-bcxc9"
Sep 18 22:00:58.955292 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.955266    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4148d3f5-0a43-4d62-b1cc-6015b20f7228-config-volume\") pod \"dns-default-bcxc9\" (UID: \"4148d3f5-0a43-4d62-b1cc-6015b20f7228\") " pod="openshift-dns/dns-default-bcxc9"
Sep 18 22:00:58.959637 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.959616    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75534380-ec8e-48f6-bf26-a57584c2e185-cert\") pod \"ingress-canary-hmx2x\" (UID: \"75534380-ec8e-48f6-bf26-a57584c2e185\") " pod="openshift-ingress-canary/ingress-canary-hmx2x"
Sep 18 22:00:58.963068 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.963044    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lgmb\" (UniqueName: \"kubernetes.io/projected/4148d3f5-0a43-4d62-b1cc-6015b20f7228-kube-api-access-9lgmb\") pod \"dns-default-bcxc9\" (UID: \"4148d3f5-0a43-4d62-b1cc-6015b20f7228\") " pod="openshift-dns/dns-default-bcxc9"
Sep 18 22:00:58.963748 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:58.963725    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvc62\" (UniqueName: \"kubernetes.io/projected/75534380-ec8e-48f6-bf26-a57584c2e185-kube-api-access-dvc62\") pod \"ingress-canary-hmx2x\" (UID: \"75534380-ec8e-48f6-bf26-a57584c2e185\") " pod="openshift-ingress-canary/ingress-canary-hmx2x"
Sep 18 22:00:59.049318 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:59.049288    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hmx2x"
Sep 18 22:00:59.340183 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:59.340143    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:00:59.340183 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:59.340186    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:00:59.343053 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:59.342808    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 22:00:59.343053 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:59.342825    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 22:00:59.343053 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:59.342825    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-27j86\""
Sep 18 22:00:59.459767 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:59.459733    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4148d3f5-0a43-4d62-b1cc-6015b20f7228-metrics-tls\") pod \"dns-default-bcxc9\" (UID: \"4148d3f5-0a43-4d62-b1cc-6015b20f7228\") " pod="openshift-dns/dns-default-bcxc9"
Sep 18 22:00:59.459937 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:59.459857    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 22:00:59.459937 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:00:59.459931    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4148d3f5-0a43-4d62-b1cc-6015b20f7228-metrics-tls podName:4148d3f5-0a43-4d62-b1cc-6015b20f7228 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:00.459910837 +0000 UTC m=+35.591691911 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4148d3f5-0a43-4d62-b1cc-6015b20f7228-metrics-tls") pod "dns-default-bcxc9" (UID: "4148d3f5-0a43-4d62-b1cc-6015b20f7228") : secret "dns-default-metrics-tls" not found
Sep 18 22:00:59.817365 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:00:59.817199    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hmx2x"]
Sep 18 22:00:59.821280 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:00:59.821255    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75534380_ec8e_48f6_bf26_a57584c2e185.slice/crio-ada31ef720c94272113b06682c3c0f6f66415c316150454a5a80da669b9abf05 WatchSource:0}: Error finding container ada31ef720c94272113b06682c3c0f6f66415c316150454a5a80da669b9abf05: Status 404 returned error can't find the container with id ada31ef720c94272113b06682c3c0f6f66415c316150454a5a80da669b9abf05
Sep 18 22:01:00.339340 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:00.339308    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:01:00.341847 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:00.341814    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8l8bl\""
Sep 18 22:01:00.341847 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:00.341814    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 22:01:00.342387 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:00.341854    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 22:01:00.467283 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:00.467251    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4148d3f5-0a43-4d62-b1cc-6015b20f7228-metrics-tls\") pod \"dns-default-bcxc9\" (UID: \"4148d3f5-0a43-4d62-b1cc-6015b20f7228\") " pod="openshift-dns/dns-default-bcxc9"
Sep 18 22:01:00.467445 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:00.467422    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 22:01:00.467529 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:00.467478    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4148d3f5-0a43-4d62-b1cc-6015b20f7228-metrics-tls podName:4148d3f5-0a43-4d62-b1cc-6015b20f7228 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:02.467463006 +0000 UTC m=+37.599244069 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4148d3f5-0a43-4d62-b1cc-6015b20f7228-metrics-tls") pod "dns-default-bcxc9" (UID: "4148d3f5-0a43-4d62-b1cc-6015b20f7228") : secret "dns-default-metrics-tls" not found
Sep 18 22:01:00.553095 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:00.553057    2574 generic.go:356] "Generic (PLEG): container finished" podID="8435563a-0f46-48fb-b9c7-acce85b59376" containerID="afb30218c5fcfe5493a12bbdfa7c32f0cf1f4b1c4a3b5b522a6c9195411da4d6" exitCode=0
Sep 18 22:01:00.553260 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:00.553181    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqhkx" event={"ID":"8435563a-0f46-48fb-b9c7-acce85b59376","Type":"ContainerDied","Data":"afb30218c5fcfe5493a12bbdfa7c32f0cf1f4b1c4a3b5b522a6c9195411da4d6"}
Sep 18 22:01:00.554657 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:00.554632    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hmx2x" event={"ID":"75534380-ec8e-48f6-bf26-a57584c2e185","Type":"ContainerStarted","Data":"ada31ef720c94272113b06682c3c0f6f66415c316150454a5a80da669b9abf05"}
Sep 18 22:01:01.561340 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:01.561303    2574 generic.go:356] "Generic (PLEG): container finished" podID="8435563a-0f46-48fb-b9c7-acce85b59376" containerID="945b9ef77b3c16da73c83238264da14f230e0c4b0e1d32fa11f964f140bba8b6" exitCode=0
Sep 18 22:01:01.561975 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:01.561366    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqhkx" event={"ID":"8435563a-0f46-48fb-b9c7-acce85b59376","Type":"ContainerDied","Data":"945b9ef77b3c16da73c83238264da14f230e0c4b0e1d32fa11f964f140bba8b6"}
Sep 18 22:01:02.484308 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:02.484279    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4148d3f5-0a43-4d62-b1cc-6015b20f7228-metrics-tls\") pod \"dns-default-bcxc9\" (UID: \"4148d3f5-0a43-4d62-b1cc-6015b20f7228\") " pod="openshift-dns/dns-default-bcxc9"
Sep 18 22:01:02.484437 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:02.484407    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 22:01:02.484528 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:02.484454    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4148d3f5-0a43-4d62-b1cc-6015b20f7228-metrics-tls podName:4148d3f5-0a43-4d62-b1cc-6015b20f7228 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:06.484442628 +0000 UTC m=+41.616223687 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4148d3f5-0a43-4d62-b1cc-6015b20f7228-metrics-tls") pod "dns-default-bcxc9" (UID: "4148d3f5-0a43-4d62-b1cc-6015b20f7228") : secret "dns-default-metrics-tls" not found
Sep 18 22:01:02.565482 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:02.565440    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hmx2x" event={"ID":"75534380-ec8e-48f6-bf26-a57584c2e185","Type":"ContainerStarted","Data":"aba87eb94d8dd5c51e49a7c920001ca10fd8dac965fb41ee1b021784b1b0e2bd"}
Sep 18 22:01:02.569090 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:02.569057    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqhkx" event={"ID":"8435563a-0f46-48fb-b9c7-acce85b59376","Type":"ContainerStarted","Data":"c43f3c659df2e2a790ecdaae9fdc9640e6d426a9568ef51f4a59c1512c6173a2"}
Sep 18 22:01:02.587372 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:02.587318    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hmx2x" podStartSLOduration=2.039948986 podStartE2EDuration="4.587297831s" totalImagesPullingTime="2.547348845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:01:02.586821082 +0000 UTC m=+37.718602163" watchObservedRunningTime="2026-09-18 22:01:02.587297831 +0000 UTC m=+37.719078915"
Sep 18 22:01:06.513539 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:06.513339    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4148d3f5-0a43-4d62-b1cc-6015b20f7228-metrics-tls\") pod \"dns-default-bcxc9\" (UID: \"4148d3f5-0a43-4d62-b1cc-6015b20f7228\") " pod="openshift-dns/dns-default-bcxc9"
Sep 18 22:01:06.513885 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:06.513484    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 22:01:06.513885 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:06.513652    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4148d3f5-0a43-4d62-b1cc-6015b20f7228-metrics-tls podName:4148d3f5-0a43-4d62-b1cc-6015b20f7228 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:14.513636249 +0000 UTC m=+49.645417308 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4148d3f5-0a43-4d62-b1cc-6015b20f7228-metrics-tls") pod "dns-default-bcxc9" (UID: "4148d3f5-0a43-4d62-b1cc-6015b20f7228") : secret "dns-default-metrics-tls" not found
Sep 18 22:01:13.057934 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.057882    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wqhkx" podStartSLOduration=18.645433086 podStartE2EDuration="48.057867112s" totalImagesPullingTime="29.412434026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:00:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:01:02.615243487 +0000 UTC m=+37.747024570" watchObservedRunningTime="2026-09-18 22:01:13.057867112 +0000 UTC m=+48.189648205"
Sep 18 22:01:13.058601 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.058584    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-lfdc6"]
Sep 18 22:01:13.120253 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.120222    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-lfdc6"]
Sep 18 22:01:13.120399 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.120318    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-lfdc6"
Sep 18 22:01:13.122847 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.122819    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 18 22:01:13.123649 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.123624    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 18 22:01:13.123793 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.123629    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-nq9db\""
Sep 18 22:01:13.172101 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.172073    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6454c8d7fd-6mjst"]
Sep 18 22:01:13.195268 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.195246    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-ggnkt"]
Sep 18 22:01:13.195387 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.195372    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:13.199403 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.199385    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 18 22:01:13.199666 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.199644    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 18 22:01:13.199771 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.199731    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 18 22:01:13.199984 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.199965    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 18 22:01:13.200195 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.200181    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zwkcf\""
Sep 18 22:01:13.203088 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.203067    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 18 22:01:13.204349 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.204333    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 18 22:01:13.215282 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.215265    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-ggnkt"]
Sep 18 22:01:13.215362 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.215292    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6454c8d7fd-6mjst"]
Sep 18 22:01:13.215362 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.215355    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ggnkt"
Sep 18 22:01:13.218775 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.218759    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 18 22:01:13.218892 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.218875    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 18 22:01:13.220158 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.220140    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 18 22:01:13.220234 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.220163    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-8nbqk\""
Sep 18 22:01:13.220234 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.220189    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 18 22:01:13.259580 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.259548    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfpsh\" (UniqueName: \"kubernetes.io/projected/84360888-bdae-4bde-b642-448c68479846-kube-api-access-rfpsh\") pod \"volume-data-source-validator-5c4db8bdf9-lfdc6\" (UID: \"84360888-bdae-4bde-b642-448c68479846\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-lfdc6"
Sep 18 22:01:13.360051 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.359979    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqz62\" (UniqueName: \"kubernetes.io/projected/77a9d433-df3d-4200-b498-83d36e01cf77-kube-api-access-wqz62\") pod \"router-default-6454c8d7fd-6mjst\" (UID: \"77a9d433-df3d-4200-b498-83d36e01cf77\") " pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:13.360051 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.360011    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/568547f4-50cc-41d7-a4a6-51ac3c1affb0-serving-cert\") pod \"service-ca-operator-57cdc4b768-ggnkt\" (UID: \"568547f4-50cc-41d7-a4a6-51ac3c1affb0\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ggnkt"
Sep 18 22:01:13.360051 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.360035    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77a9d433-df3d-4200-b498-83d36e01cf77-metrics-certs\") pod \"router-default-6454c8d7fd-6mjst\" (UID: \"77a9d433-df3d-4200-b498-83d36e01cf77\") " pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:13.360241 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.360114    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfpsh\" (UniqueName: \"kubernetes.io/projected/84360888-bdae-4bde-b642-448c68479846-kube-api-access-rfpsh\") pod \"volume-data-source-validator-5c4db8bdf9-lfdc6\" (UID: \"84360888-bdae-4bde-b642-448c68479846\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-lfdc6"
Sep 18 22:01:13.360241 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.360135    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/77a9d433-df3d-4200-b498-83d36e01cf77-stats-auth\") pod \"router-default-6454c8d7fd-6mjst\" (UID: \"77a9d433-df3d-4200-b498-83d36e01cf77\") " pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:13.360241 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.360153    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/568547f4-50cc-41d7-a4a6-51ac3c1affb0-config\") pod \"service-ca-operator-57cdc4b768-ggnkt\" (UID: \"568547f4-50cc-41d7-a4a6-51ac3c1affb0\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ggnkt"
Sep 18 22:01:13.360241 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.360174    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqt7q\" (UniqueName: \"kubernetes.io/projected/568547f4-50cc-41d7-a4a6-51ac3c1affb0-kube-api-access-nqt7q\") pod \"service-ca-operator-57cdc4b768-ggnkt\" (UID: \"568547f4-50cc-41d7-a4a6-51ac3c1affb0\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ggnkt"
Sep 18 22:01:13.360241 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.360202    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77a9d433-df3d-4200-b498-83d36e01cf77-service-ca-bundle\") pod \"router-default-6454c8d7fd-6mjst\" (UID: \"77a9d433-df3d-4200-b498-83d36e01cf77\") " pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:13.360386 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.360316    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/77a9d433-df3d-4200-b498-83d36e01cf77-default-certificate\") pod \"router-default-6454c8d7fd-6mjst\" (UID: \"77a9d433-df3d-4200-b498-83d36e01cf77\") " pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:13.369292 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.369270    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfpsh\" (UniqueName: \"kubernetes.io/projected/84360888-bdae-4bde-b642-448c68479846-kube-api-access-rfpsh\") pod \"volume-data-source-validator-5c4db8bdf9-lfdc6\" (UID: \"84360888-bdae-4bde-b642-448c68479846\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-lfdc6"
Sep 18 22:01:13.429201 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.429175    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-lfdc6"
Sep 18 22:01:13.461277 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.461252    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/77a9d433-df3d-4200-b498-83d36e01cf77-default-certificate\") pod \"router-default-6454c8d7fd-6mjst\" (UID: \"77a9d433-df3d-4200-b498-83d36e01cf77\") " pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:13.461377 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.461290    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqz62\" (UniqueName: \"kubernetes.io/projected/77a9d433-df3d-4200-b498-83d36e01cf77-kube-api-access-wqz62\") pod \"router-default-6454c8d7fd-6mjst\" (UID: \"77a9d433-df3d-4200-b498-83d36e01cf77\") " pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:13.461377 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.461317    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/568547f4-50cc-41d7-a4a6-51ac3c1affb0-serving-cert\") pod \"service-ca-operator-57cdc4b768-ggnkt\" (UID: \"568547f4-50cc-41d7-a4a6-51ac3c1affb0\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ggnkt"
Sep 18 22:01:13.461377 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.461363    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77a9d433-df3d-4200-b498-83d36e01cf77-metrics-certs\") pod \"router-default-6454c8d7fd-6mjst\" (UID: \"77a9d433-df3d-4200-b498-83d36e01cf77\") " pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:13.461547 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.461465    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/77a9d433-df3d-4200-b498-83d36e01cf77-stats-auth\") pod \"router-default-6454c8d7fd-6mjst\" (UID: \"77a9d433-df3d-4200-b498-83d36e01cf77\") " pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:13.461547 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.461494    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/568547f4-50cc-41d7-a4a6-51ac3c1affb0-config\") pod \"service-ca-operator-57cdc4b768-ggnkt\" (UID: \"568547f4-50cc-41d7-a4a6-51ac3c1affb0\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ggnkt"
Sep 18 22:01:13.461644 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:13.461559    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 22:01:13.461692 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:13.461646    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77a9d433-df3d-4200-b498-83d36e01cf77-metrics-certs podName:77a9d433-df3d-4200-b498-83d36e01cf77 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:13.96162484 +0000 UTC m=+49.093405921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77a9d433-df3d-4200-b498-83d36e01cf77-metrics-certs") pod "router-default-6454c8d7fd-6mjst" (UID: "77a9d433-df3d-4200-b498-83d36e01cf77") : secret "router-metrics-certs-default" not found
Sep 18 22:01:13.462026 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.461765    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqt7q\" (UniqueName: \"kubernetes.io/projected/568547f4-50cc-41d7-a4a6-51ac3c1affb0-kube-api-access-nqt7q\") pod \"service-ca-operator-57cdc4b768-ggnkt\" (UID: \"568547f4-50cc-41d7-a4a6-51ac3c1affb0\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ggnkt"
Sep 18 22:01:13.462026 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.461863    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77a9d433-df3d-4200-b498-83d36e01cf77-service-ca-bundle\") pod \"router-default-6454c8d7fd-6mjst\" (UID: \"77a9d433-df3d-4200-b498-83d36e01cf77\") " pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:13.462185 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:13.462077    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77a9d433-df3d-4200-b498-83d36e01cf77-service-ca-bundle podName:77a9d433-df3d-4200-b498-83d36e01cf77 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:13.96205892 +0000 UTC m=+49.093839989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/77a9d433-df3d-4200-b498-83d36e01cf77-service-ca-bundle") pod "router-default-6454c8d7fd-6mjst" (UID: "77a9d433-df3d-4200-b498-83d36e01cf77") : configmap references non-existent config key: service-ca.crt
Sep 18 22:01:13.462242 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.462216    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/568547f4-50cc-41d7-a4a6-51ac3c1affb0-config\") pod \"service-ca-operator-57cdc4b768-ggnkt\" (UID: \"568547f4-50cc-41d7-a4a6-51ac3c1affb0\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ggnkt"
Sep 18 22:01:13.463903 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.463878    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/568547f4-50cc-41d7-a4a6-51ac3c1affb0-serving-cert\") pod \"service-ca-operator-57cdc4b768-ggnkt\" (UID: \"568547f4-50cc-41d7-a4a6-51ac3c1affb0\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ggnkt"
Sep 18 22:01:13.464284 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.464260    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/77a9d433-df3d-4200-b498-83d36e01cf77-stats-auth\") pod \"router-default-6454c8d7fd-6mjst\" (UID: \"77a9d433-df3d-4200-b498-83d36e01cf77\") " pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:13.464345 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.464324    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/77a9d433-df3d-4200-b498-83d36e01cf77-default-certificate\") pod \"router-default-6454c8d7fd-6mjst\" (UID: \"77a9d433-df3d-4200-b498-83d36e01cf77\") " pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:13.472059 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.472040    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqt7q\" (UniqueName: \"kubernetes.io/projected/568547f4-50cc-41d7-a4a6-51ac3c1affb0-kube-api-access-nqt7q\") pod \"service-ca-operator-57cdc4b768-ggnkt\" (UID: \"568547f4-50cc-41d7-a4a6-51ac3c1affb0\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ggnkt"
Sep 18 22:01:13.485102 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.485082    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqz62\" (UniqueName: \"kubernetes.io/projected/77a9d433-df3d-4200-b498-83d36e01cf77-kube-api-access-wqz62\") pod \"router-default-6454c8d7fd-6mjst\" (UID: \"77a9d433-df3d-4200-b498-83d36e01cf77\") " pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:13.523841 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.523813    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ggnkt"
Sep 18 22:01:13.713086 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.713056    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-lfdc6"]
Sep 18 22:01:13.811389 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.811361    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-ggnkt"]
Sep 18 22:01:13.814278 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:01:13.814249    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod568547f4_50cc_41d7_a4a6_51ac3c1affb0.slice/crio-52e5ba0ddca705311ab97308721893fab117b1ac9bf813f94e8df9952a091dc9 WatchSource:0}: Error finding container 52e5ba0ddca705311ab97308721893fab117b1ac9bf813f94e8df9952a091dc9: Status 404 returned error can't find the container with id 52e5ba0ddca705311ab97308721893fab117b1ac9bf813f94e8df9952a091dc9
Sep 18 22:01:13.966971 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.966895    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77a9d433-df3d-4200-b498-83d36e01cf77-metrics-certs\") pod \"router-default-6454c8d7fd-6mjst\" (UID: \"77a9d433-df3d-4200-b498-83d36e01cf77\") " pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:13.967112 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:13.966977    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77a9d433-df3d-4200-b498-83d36e01cf77-service-ca-bundle\") pod \"router-default-6454c8d7fd-6mjst\" (UID: \"77a9d433-df3d-4200-b498-83d36e01cf77\") " pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:13.967112 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:13.967052    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 22:01:13.967112 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:13.967088    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77a9d433-df3d-4200-b498-83d36e01cf77-service-ca-bundle podName:77a9d433-df3d-4200-b498-83d36e01cf77 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:14.967075241 +0000 UTC m=+50.098856301 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/77a9d433-df3d-4200-b498-83d36e01cf77-service-ca-bundle") pod "router-default-6454c8d7fd-6mjst" (UID: "77a9d433-df3d-4200-b498-83d36e01cf77") : configmap references non-existent config key: service-ca.crt
Sep 18 22:01:13.967112 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:13.967111    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77a9d433-df3d-4200-b498-83d36e01cf77-metrics-certs podName:77a9d433-df3d-4200-b498-83d36e01cf77 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:14.967097281 +0000 UTC m=+50.098878344 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77a9d433-df3d-4200-b498-83d36e01cf77-metrics-certs") pod "router-default-6454c8d7fd-6mjst" (UID: "77a9d433-df3d-4200-b498-83d36e01cf77") : secret "router-metrics-certs-default" not found
Sep 18 22:01:14.572414 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:14.572373    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4148d3f5-0a43-4d62-b1cc-6015b20f7228-metrics-tls\") pod \"dns-default-bcxc9\" (UID: \"4148d3f5-0a43-4d62-b1cc-6015b20f7228\") " pod="openshift-dns/dns-default-bcxc9"
Sep 18 22:01:14.572970 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:14.572549    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 22:01:14.572970 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:14.572631    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4148d3f5-0a43-4d62-b1cc-6015b20f7228-metrics-tls podName:4148d3f5-0a43-4d62-b1cc-6015b20f7228 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:30.572609409 +0000 UTC m=+65.704390469 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4148d3f5-0a43-4d62-b1cc-6015b20f7228-metrics-tls") pod "dns-default-bcxc9" (UID: "4148d3f5-0a43-4d62-b1cc-6015b20f7228") : secret "dns-default-metrics-tls" not found
Sep 18 22:01:14.599340 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:14.599301    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ggnkt" event={"ID":"568547f4-50cc-41d7-a4a6-51ac3c1affb0","Type":"ContainerStarted","Data":"52e5ba0ddca705311ab97308721893fab117b1ac9bf813f94e8df9952a091dc9"}
Sep 18 22:01:14.600254 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:14.600234    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-lfdc6" event={"ID":"84360888-bdae-4bde-b642-448c68479846","Type":"ContainerStarted","Data":"ef6b711c34aa5acb19fb8b9113a218f266384a1886d8581356c5efaa12a454dd"}
Sep 18 22:01:14.975629 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:14.975589    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77a9d433-df3d-4200-b498-83d36e01cf77-metrics-certs\") pod \"router-default-6454c8d7fd-6mjst\" (UID: \"77a9d433-df3d-4200-b498-83d36e01cf77\") " pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:14.975813 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:14.975730    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77a9d433-df3d-4200-b498-83d36e01cf77-service-ca-bundle\") pod \"router-default-6454c8d7fd-6mjst\" (UID: \"77a9d433-df3d-4200-b498-83d36e01cf77\") " pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:14.975813 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:14.975770    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 22:01:14.975926 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:14.975850    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77a9d433-df3d-4200-b498-83d36e01cf77-metrics-certs podName:77a9d433-df3d-4200-b498-83d36e01cf77 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:16.975829635 +0000 UTC m=+52.107610706 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77a9d433-df3d-4200-b498-83d36e01cf77-metrics-certs") pod "router-default-6454c8d7fd-6mjst" (UID: "77a9d433-df3d-4200-b498-83d36e01cf77") : secret "router-metrics-certs-default" not found
Sep 18 22:01:14.975926 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:14.975872    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77a9d433-df3d-4200-b498-83d36e01cf77-service-ca-bundle podName:77a9d433-df3d-4200-b498-83d36e01cf77 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:16.975857468 +0000 UTC m=+52.107638549 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/77a9d433-df3d-4200-b498-83d36e01cf77-service-ca-bundle") pod "router-default-6454c8d7fd-6mjst" (UID: "77a9d433-df3d-4200-b498-83d36e01cf77") : configmap references non-existent config key: service-ca.crt
Sep 18 22:01:15.604347 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:15.604256    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-lfdc6" event={"ID":"84360888-bdae-4bde-b642-448c68479846","Type":"ContainerStarted","Data":"03b70231ea44e747bdecd425a5a36dd26a1907841d0eba499dfa9caee076fb18"}
Sep 18 22:01:15.619714 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:15.619649    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-lfdc6" podStartSLOduration=1.147894491 podStartE2EDuration="2.619630628s" totalImagesPullingTime="1.471736137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:01:15.618966733 +0000 UTC m=+50.750747815" watchObservedRunningTime="2026-09-18 22:01:15.619630628 +0000 UTC m=+50.751411761"
Sep 18 22:01:16.036087 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:16.036049    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-x45px"]
Sep 18 22:01:16.048938 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:16.048906    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-x45px"]
Sep 18 22:01:16.049069 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:16.049015    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-x45px"
Sep 18 22:01:16.051104 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:16.051080    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-94v55\""
Sep 18 22:01:16.187148 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:16.187113    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbf56\" (UniqueName: \"kubernetes.io/projected/9e632159-9a7e-4baa-bb9c-17da927353f0-kube-api-access-bbf56\") pod \"network-check-source-7cbc45fddc-x45px\" (UID: \"9e632159-9a7e-4baa-bb9c-17da927353f0\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-x45px"
Sep 18 22:01:16.287714 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:16.287618    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbf56\" (UniqueName: \"kubernetes.io/projected/9e632159-9a7e-4baa-bb9c-17da927353f0-kube-api-access-bbf56\") pod \"network-check-source-7cbc45fddc-x45px\" (UID: \"9e632159-9a7e-4baa-bb9c-17da927353f0\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-x45px"
Sep 18 22:01:16.296041 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:16.296018    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbf56\" (UniqueName: \"kubernetes.io/projected/9e632159-9a7e-4baa-bb9c-17da927353f0-kube-api-access-bbf56\") pod \"network-check-source-7cbc45fddc-x45px\" (UID: \"9e632159-9a7e-4baa-bb9c-17da927353f0\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-x45px"
Sep 18 22:01:16.360237 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:16.360203    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-x45px"
Sep 18 22:01:16.766437 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:16.766407    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-x45px"]
Sep 18 22:01:16.770002 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:01:16.769969    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e632159_9a7e_4baa_bb9c_17da927353f0.slice/crio-81845ef890db6cf336b0f0c3fb4b000c1586346cfec441f888bff9df4cddb998 WatchSource:0}: Error finding container 81845ef890db6cf336b0f0c3fb4b000c1586346cfec441f888bff9df4cddb998: Status 404 returned error can't find the container with id 81845ef890db6cf336b0f0c3fb4b000c1586346cfec441f888bff9df4cddb998
Sep 18 22:01:16.994277 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:16.994238    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77a9d433-df3d-4200-b498-83d36e01cf77-service-ca-bundle\") pod \"router-default-6454c8d7fd-6mjst\" (UID: \"77a9d433-df3d-4200-b498-83d36e01cf77\") " pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:16.994473 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:16.994312    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77a9d433-df3d-4200-b498-83d36e01cf77-metrics-certs\") pod \"router-default-6454c8d7fd-6mjst\" (UID: \"77a9d433-df3d-4200-b498-83d36e01cf77\") " pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:16.994473 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:16.994417    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77a9d433-df3d-4200-b498-83d36e01cf77-service-ca-bundle podName:77a9d433-df3d-4200-b498-83d36e01cf77 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:20.994399069 +0000 UTC m=+56.126180134 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/77a9d433-df3d-4200-b498-83d36e01cf77-service-ca-bundle") pod "router-default-6454c8d7fd-6mjst" (UID: "77a9d433-df3d-4200-b498-83d36e01cf77") : configmap references non-existent config key: service-ca.crt
Sep 18 22:01:16.994473 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:16.994462    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 22:01:16.994611 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:16.994536    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77a9d433-df3d-4200-b498-83d36e01cf77-metrics-certs podName:77a9d433-df3d-4200-b498-83d36e01cf77 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:20.994520435 +0000 UTC m=+56.126301511 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77a9d433-df3d-4200-b498-83d36e01cf77-metrics-certs") pod "router-default-6454c8d7fd-6mjst" (UID: "77a9d433-df3d-4200-b498-83d36e01cf77") : secret "router-metrics-certs-default" not found
Sep 18 22:01:17.612870 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:17.612449    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ggnkt" event={"ID":"568547f4-50cc-41d7-a4a6-51ac3c1affb0","Type":"ContainerStarted","Data":"bbe0b1ca82164d1a05953e52169570afa875d9cb7e1f3c9e1ed46684ca3ba080"}
Sep 18 22:01:17.613724 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:17.613677    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-x45px" event={"ID":"9e632159-9a7e-4baa-bb9c-17da927353f0","Type":"ContainerStarted","Data":"81845ef890db6cf336b0f0c3fb4b000c1586346cfec441f888bff9df4cddb998"}
Sep 18 22:01:17.629870 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:17.629826    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ggnkt" podStartSLOduration=1.940821674 podStartE2EDuration="4.62980992s" totalImagesPullingTime="2.688988246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:01:17.628929718 +0000 UTC m=+52.760710800" watchObservedRunningTime="2026-09-18 22:01:17.62980992 +0000 UTC m=+52.761591003"
Sep 18 22:01:19.391958 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.391923    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-kgk9h"]
Sep 18 22:01:19.395144 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.395123    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-kgk9h"
Sep 18 22:01:19.398180 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.398156    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 18 22:01:19.398496 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.398476    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-b77vt\""
Sep 18 22:01:19.398626 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.398492    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 18 22:01:19.412674 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.412645    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-kgk9h"]
Sep 18 22:01:19.500384 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.500340    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fvlvf"]
Sep 18 22:01:19.503132 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.503112    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:19.505575 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.505556    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 18 22:01:19.505690 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.505674    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wk4th\""
Sep 18 22:01:19.506095 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.506076    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 18 22:01:19.506173 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.506115    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 18 22:01:19.506405 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.506384    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 18 22:01:19.518117 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.518094    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqrxh\" (UniqueName: \"kubernetes.io/projected/b76a0482-5bca-4ad0-a5a2-3d133290eec7-kube-api-access-bqrxh\") pod \"migrator-76794cbd6c-kgk9h\" (UID: \"b76a0482-5bca-4ad0-a5a2-3d133290eec7\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-kgk9h"
Sep 18 22:01:19.519585 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.519563    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fvlvf"]
Sep 18 22:01:19.618606 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.618571    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e81147d8-4915-42ce-9328-e5b8db7cc44c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvlvf\" (UID: \"e81147d8-4915-42ce-9328-e5b8db7cc44c\") " pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:19.618797 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.618679    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqrxh\" (UniqueName: \"kubernetes.io/projected/b76a0482-5bca-4ad0-a5a2-3d133290eec7-kube-api-access-bqrxh\") pod \"migrator-76794cbd6c-kgk9h\" (UID: \"b76a0482-5bca-4ad0-a5a2-3d133290eec7\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-kgk9h"
Sep 18 22:01:19.618797 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.618720    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e81147d8-4915-42ce-9328-e5b8db7cc44c-data-volume\") pod \"insights-runtime-extractor-fvlvf\" (UID: \"e81147d8-4915-42ce-9328-e5b8db7cc44c\") " pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:19.618797 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.618769    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e81147d8-4915-42ce-9328-e5b8db7cc44c-crio-socket\") pod \"insights-runtime-extractor-fvlvf\" (UID: \"e81147d8-4915-42ce-9328-e5b8db7cc44c\") " pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:19.618797 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.618791    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lcqd\" (UniqueName: \"kubernetes.io/projected/e81147d8-4915-42ce-9328-e5b8db7cc44c-kube-api-access-8lcqd\") pod \"insights-runtime-extractor-fvlvf\" (UID: \"e81147d8-4915-42ce-9328-e5b8db7cc44c\") " pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:19.619018 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.618855    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e81147d8-4915-42ce-9328-e5b8db7cc44c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvlvf\" (UID: \"e81147d8-4915-42ce-9328-e5b8db7cc44c\") " pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:19.629973 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.629938    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqrxh\" (UniqueName: \"kubernetes.io/projected/b76a0482-5bca-4ad0-a5a2-3d133290eec7-kube-api-access-bqrxh\") pod \"migrator-76794cbd6c-kgk9h\" (UID: \"b76a0482-5bca-4ad0-a5a2-3d133290eec7\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-kgk9h"
Sep 18 22:01:19.706032 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.705995    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-kgk9h"
Sep 18 22:01:19.719242 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.719213    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lcqd\" (UniqueName: \"kubernetes.io/projected/e81147d8-4915-42ce-9328-e5b8db7cc44c-kube-api-access-8lcqd\") pod \"insights-runtime-extractor-fvlvf\" (UID: \"e81147d8-4915-42ce-9328-e5b8db7cc44c\") " pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:19.719370 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.719258    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e81147d8-4915-42ce-9328-e5b8db7cc44c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvlvf\" (UID: \"e81147d8-4915-42ce-9328-e5b8db7cc44c\") " pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:19.719370 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:19.719356    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 22:01:19.719482 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:19.719423    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e81147d8-4915-42ce-9328-e5b8db7cc44c-kube-rbac-proxy-cm podName:e81147d8-4915-42ce-9328-e5b8db7cc44c nodeName:}" failed. No retries permitted until 2026-09-18 22:01:20.219403372 +0000 UTC m=+55.351184435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e81147d8-4915-42ce-9328-e5b8db7cc44c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fvlvf" (UID: "e81147d8-4915-42ce-9328-e5b8db7cc44c") : configmap "kube-rbac-proxy" not found
Sep 18 22:01:19.719482 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.719448    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e81147d8-4915-42ce-9328-e5b8db7cc44c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvlvf\" (UID: \"e81147d8-4915-42ce-9328-e5b8db7cc44c\") " pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:19.719620 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.719500    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e81147d8-4915-42ce-9328-e5b8db7cc44c-data-volume\") pod \"insights-runtime-extractor-fvlvf\" (UID: \"e81147d8-4915-42ce-9328-e5b8db7cc44c\") " pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:19.719620 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.719583    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e81147d8-4915-42ce-9328-e5b8db7cc44c-crio-socket\") pod \"insights-runtime-extractor-fvlvf\" (UID: \"e81147d8-4915-42ce-9328-e5b8db7cc44c\") " pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:19.719732 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:19.719648    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 22:01:19.719732 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.719663    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e81147d8-4915-42ce-9328-e5b8db7cc44c-crio-socket\") pod \"insights-runtime-extractor-fvlvf\" (UID: \"e81147d8-4915-42ce-9328-e5b8db7cc44c\") " pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:19.719732 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:19.719714    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e81147d8-4915-42ce-9328-e5b8db7cc44c-insights-runtime-extractor-tls podName:e81147d8-4915-42ce-9328-e5b8db7cc44c nodeName:}" failed. No retries permitted until 2026-09-18 22:01:20.219698128 +0000 UTC m=+55.351479189 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e81147d8-4915-42ce-9328-e5b8db7cc44c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fvlvf" (UID: "e81147d8-4915-42ce-9328-e5b8db7cc44c") : secret "insights-runtime-extractor-tls" not found
Sep 18 22:01:19.719893 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.719855    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e81147d8-4915-42ce-9328-e5b8db7cc44c-data-volume\") pod \"insights-runtime-extractor-fvlvf\" (UID: \"e81147d8-4915-42ce-9328-e5b8db7cc44c\") " pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:19.731407 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:19.731383    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lcqd\" (UniqueName: \"kubernetes.io/projected/e81147d8-4915-42ce-9328-e5b8db7cc44c-kube-api-access-8lcqd\") pod \"insights-runtime-extractor-fvlvf\" (UID: \"e81147d8-4915-42ce-9328-e5b8db7cc44c\") " pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:20.223769 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:20.223735    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e81147d8-4915-42ce-9328-e5b8db7cc44c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvlvf\" (UID: \"e81147d8-4915-42ce-9328-e5b8db7cc44c\") " pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:20.223895 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:20.223820    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e81147d8-4915-42ce-9328-e5b8db7cc44c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvlvf\" (UID: \"e81147d8-4915-42ce-9328-e5b8db7cc44c\") " pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:20.223895 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:20.223869    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 22:01:20.224000 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:20.223950    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e81147d8-4915-42ce-9328-e5b8db7cc44c-kube-rbac-proxy-cm podName:e81147d8-4915-42ce-9328-e5b8db7cc44c nodeName:}" failed. No retries permitted until 2026-09-18 22:01:21.223933128 +0000 UTC m=+56.355714188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e81147d8-4915-42ce-9328-e5b8db7cc44c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fvlvf" (UID: "e81147d8-4915-42ce-9328-e5b8db7cc44c") : configmap "kube-rbac-proxy" not found
Sep 18 22:01:20.224000 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:20.223989    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 22:01:20.224101 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:20.224058    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e81147d8-4915-42ce-9328-e5b8db7cc44c-insights-runtime-extractor-tls podName:e81147d8-4915-42ce-9328-e5b8db7cc44c nodeName:}" failed. No retries permitted until 2026-09-18 22:01:21.224039119 +0000 UTC m=+56.355820195 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e81147d8-4915-42ce-9328-e5b8db7cc44c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fvlvf" (UID: "e81147d8-4915-42ce-9328-e5b8db7cc44c") : secret "insights-runtime-extractor-tls" not found
Sep 18 22:01:20.486146 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:20.486065    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-kgk9h"]
Sep 18 22:01:20.488573 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:01:20.488544    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb76a0482_5bca_4ad0_a5a2_3d133290eec7.slice/crio-fd796c757df7be92e4693a0241906ea109d95f47db52b82dddcda52a219633bf WatchSource:0}: Error finding container fd796c757df7be92e4693a0241906ea109d95f47db52b82dddcda52a219633bf: Status 404 returned error can't find the container with id fd796c757df7be92e4693a0241906ea109d95f47db52b82dddcda52a219633bf
Sep 18 22:01:20.622906 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:20.622870    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-kgk9h" event={"ID":"b76a0482-5bca-4ad0-a5a2-3d133290eec7","Type":"ContainerStarted","Data":"fd796c757df7be92e4693a0241906ea109d95f47db52b82dddcda52a219633bf"}
Sep 18 22:01:20.624424 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:20.624398    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-x45px" event={"ID":"9e632159-9a7e-4baa-bb9c-17da927353f0","Type":"ContainerStarted","Data":"07db117febc92cc98e144ed616b2c65d0a6a99c308ee62a0cb5424c21477d2a2"}
Sep 18 22:01:21.027858 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:21.027818    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77a9d433-df3d-4200-b498-83d36e01cf77-service-ca-bundle\") pod \"router-default-6454c8d7fd-6mjst\" (UID: \"77a9d433-df3d-4200-b498-83d36e01cf77\") " pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:21.028029 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:21.027877    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77a9d433-df3d-4200-b498-83d36e01cf77-metrics-certs\") pod \"router-default-6454c8d7fd-6mjst\" (UID: \"77a9d433-df3d-4200-b498-83d36e01cf77\") " pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:21.028029 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:21.027964    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 22:01:21.028029 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:21.027999    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77a9d433-df3d-4200-b498-83d36e01cf77-service-ca-bundle podName:77a9d433-df3d-4200-b498-83d36e01cf77 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:29.027975003 +0000 UTC m=+64.159756068 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/77a9d433-df3d-4200-b498-83d36e01cf77-service-ca-bundle") pod "router-default-6454c8d7fd-6mjst" (UID: "77a9d433-df3d-4200-b498-83d36e01cf77") : configmap references non-existent config key: service-ca.crt
Sep 18 22:01:21.028137 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:21.028063    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77a9d433-df3d-4200-b498-83d36e01cf77-metrics-certs podName:77a9d433-df3d-4200-b498-83d36e01cf77 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:29.028055821 +0000 UTC m=+64.159836881 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77a9d433-df3d-4200-b498-83d36e01cf77-metrics-certs") pod "router-default-6454c8d7fd-6mjst" (UID: "77a9d433-df3d-4200-b498-83d36e01cf77") : secret "router-metrics-certs-default" not found
Sep 18 22:01:21.230264 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:21.230227    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e81147d8-4915-42ce-9328-e5b8db7cc44c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvlvf\" (UID: \"e81147d8-4915-42ce-9328-e5b8db7cc44c\") " pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:21.230430 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:21.230286    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e81147d8-4915-42ce-9328-e5b8db7cc44c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvlvf\" (UID: \"e81147d8-4915-42ce-9328-e5b8db7cc44c\") " pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:21.230430 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:21.230359    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 22:01:21.230430 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:21.230416    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 22:01:21.230558 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:21.230431    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e81147d8-4915-42ce-9328-e5b8db7cc44c-kube-rbac-proxy-cm podName:e81147d8-4915-42ce-9328-e5b8db7cc44c nodeName:}" failed. No retries permitted until 2026-09-18 22:01:23.230410558 +0000 UTC m=+58.362191633 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e81147d8-4915-42ce-9328-e5b8db7cc44c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fvlvf" (UID: "e81147d8-4915-42ce-9328-e5b8db7cc44c") : configmap "kube-rbac-proxy" not found
Sep 18 22:01:21.230558 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:21.230447    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e81147d8-4915-42ce-9328-e5b8db7cc44c-insights-runtime-extractor-tls podName:e81147d8-4915-42ce-9328-e5b8db7cc44c nodeName:}" failed. No retries permitted until 2026-09-18 22:01:23.230438367 +0000 UTC m=+58.362219427 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e81147d8-4915-42ce-9328-e5b8db7cc44c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fvlvf" (UID: "e81147d8-4915-42ce-9328-e5b8db7cc44c") : secret "insights-runtime-extractor-tls" not found
Sep 18 22:01:22.450669 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:22.450640    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tb58x_3935be4c-a503-4315-8667-dba4a76ab439/dns-node-resolver/0.log"
Sep 18 22:01:22.631439 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:22.631407    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-kgk9h" event={"ID":"b76a0482-5bca-4ad0-a5a2-3d133290eec7","Type":"ContainerStarted","Data":"6b02294bce1917ba8ae0cab5fe89a4040b6369b0c9c96619fa20112f83f436c7"}
Sep 18 22:01:22.631597 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:22.631457    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-kgk9h" event={"ID":"b76a0482-5bca-4ad0-a5a2-3d133290eec7","Type":"ContainerStarted","Data":"e73c192d3bc2a4b5d52daae000574db2d7fbe0c9abf9beae09e1c13d4d860abb"}
Sep 18 22:01:22.650278 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:22.650231    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-x45px" podStartSLOduration=3.172514196 podStartE2EDuration="6.650215783s" totalImagesPullingTime="3.477701587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:01:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:01:20.654447116 +0000 UTC m=+55.786228197" watchObservedRunningTime="2026-09-18 22:01:22.650215783 +0000 UTC m=+57.781996898"
Sep 18 22:01:22.650734 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:22.650710    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-kgk9h" podStartSLOduration=2.113876053 podStartE2EDuration="3.650703015s" totalImagesPullingTime="1.536826962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:01:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:01:22.649092616 +0000 UTC m=+57.780873698" watchObservedRunningTime="2026-09-18 22:01:22.650703015 +0000 UTC m=+57.782484097"
Sep 18 22:01:23.246732 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:23.246705    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rtsx9_cdf3488e-8f04-4dfe-b930-3a01d87da247/node-ca/0.log"
Sep 18 22:01:23.247913 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:23.247894    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e81147d8-4915-42ce-9328-e5b8db7cc44c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvlvf\" (UID: \"e81147d8-4915-42ce-9328-e5b8db7cc44c\") " pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:23.247997 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:23.247941    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e81147d8-4915-42ce-9328-e5b8db7cc44c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvlvf\" (UID: \"e81147d8-4915-42ce-9328-e5b8db7cc44c\") " pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:23.248048 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:23.248004    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 22:01:23.248102 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:23.248058    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e81147d8-4915-42ce-9328-e5b8db7cc44c-kube-rbac-proxy-cm podName:e81147d8-4915-42ce-9328-e5b8db7cc44c nodeName:}" failed. No retries permitted until 2026-09-18 22:01:27.248042462 +0000 UTC m=+62.379823536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e81147d8-4915-42ce-9328-e5b8db7cc44c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fvlvf" (UID: "e81147d8-4915-42ce-9328-e5b8db7cc44c") : configmap "kube-rbac-proxy" not found
Sep 18 22:01:23.248168 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:23.248132    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 22:01:23.248219 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:23.248197    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e81147d8-4915-42ce-9328-e5b8db7cc44c-insights-runtime-extractor-tls podName:e81147d8-4915-42ce-9328-e5b8db7cc44c nodeName:}" failed. No retries permitted until 2026-09-18 22:01:27.248180116 +0000 UTC m=+62.379961182 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e81147d8-4915-42ce-9328-e5b8db7cc44c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fvlvf" (UID: "e81147d8-4915-42ce-9328-e5b8db7cc44c") : secret "insights-runtime-extractor-tls" not found
Sep 18 22:01:23.546075 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:23.545997    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zzwf2"
Sep 18 22:01:24.253004 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:24.252956    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hmx2x_75534380-ec8e-48f6-bf26-a57584c2e185/serve-healthcheck-canary/0.log"
Sep 18 22:01:24.447087 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:24.447054    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-kgk9h_b76a0482-5bca-4ad0-a5a2-3d133290eec7/migrator/0.log"
Sep 18 22:01:24.646935 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:24.646857    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-kgk9h_b76a0482-5bca-4ad0-a5a2-3d133290eec7/graceful-termination/0.log"
Sep 18 22:01:27.278314 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:27.278273    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e81147d8-4915-42ce-9328-e5b8db7cc44c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvlvf\" (UID: \"e81147d8-4915-42ce-9328-e5b8db7cc44c\") " pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:27.278736 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:27.278391    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e81147d8-4915-42ce-9328-e5b8db7cc44c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvlvf\" (UID: \"e81147d8-4915-42ce-9328-e5b8db7cc44c\") " pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:27.278736 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:27.278428    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 22:01:27.278736 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:27.278457    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 22:01:27.278736 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:27.278500    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e81147d8-4915-42ce-9328-e5b8db7cc44c-insights-runtime-extractor-tls podName:e81147d8-4915-42ce-9328-e5b8db7cc44c nodeName:}" failed. No retries permitted until 2026-09-18 22:01:35.278479714 +0000 UTC m=+70.410260827 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e81147d8-4915-42ce-9328-e5b8db7cc44c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fvlvf" (UID: "e81147d8-4915-42ce-9328-e5b8db7cc44c") : secret "insights-runtime-extractor-tls" not found
Sep 18 22:01:27.278736 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:27.278539    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e81147d8-4915-42ce-9328-e5b8db7cc44c-kube-rbac-proxy-cm podName:e81147d8-4915-42ce-9328-e5b8db7cc44c nodeName:}" failed. No retries permitted until 2026-09-18 22:01:35.278529559 +0000 UTC m=+70.410310622 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e81147d8-4915-42ce-9328-e5b8db7cc44c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fvlvf" (UID: "e81147d8-4915-42ce-9328-e5b8db7cc44c") : configmap "kube-rbac-proxy" not found
Sep 18 22:01:29.091006 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:29.090977    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77a9d433-df3d-4200-b498-83d36e01cf77-metrics-certs\") pod \"router-default-6454c8d7fd-6mjst\" (UID: \"77a9d433-df3d-4200-b498-83d36e01cf77\") " pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:29.091394 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:29.091071    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77a9d433-df3d-4200-b498-83d36e01cf77-service-ca-bundle\") pod \"router-default-6454c8d7fd-6mjst\" (UID: \"77a9d433-df3d-4200-b498-83d36e01cf77\") " pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:29.091394 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:29.091190    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/77a9d433-df3d-4200-b498-83d36e01cf77-service-ca-bundle podName:77a9d433-df3d-4200-b498-83d36e01cf77 nodeName:}" failed. No retries permitted until 2026-09-18 22:01:45.091174269 +0000 UTC m=+80.222955328 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/77a9d433-df3d-4200-b498-83d36e01cf77-service-ca-bundle") pod "router-default-6454c8d7fd-6mjst" (UID: "77a9d433-df3d-4200-b498-83d36e01cf77") : configmap references non-existent config key: service-ca.crt
Sep 18 22:01:29.093407 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:29.093384    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77a9d433-df3d-4200-b498-83d36e01cf77-metrics-certs\") pod \"router-default-6454c8d7fd-6mjst\" (UID: \"77a9d433-df3d-4200-b498-83d36e01cf77\") " pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:30.098827 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:30.098788    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-original-pull-secret\") pod \"global-pull-secret-syncer-t7m2k\" (UID: \"0fa9a758-4e4b-477c-b6de-b36dc677e1cd\") " pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:01:30.098827 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:30.098830    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs\") pod \"network-metrics-daemon-td6sj\" (UID: \"8a7392bf-ea47-4efe-b58a-fc15baaa7461\") " pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:01:30.100971 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:30.100944    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 22:01:30.101098 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:30.101081    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 22:01:30.109695 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:30.109676    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 18 22:01:30.109775 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:01:30.109761    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs podName:8a7392bf-ea47-4efe-b58a-fc15baaa7461 nodeName:}" failed. No retries permitted until 2026-09-18 22:02:34.10973937 +0000 UTC m=+129.241520441 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs") pod "network-metrics-daemon-td6sj" (UID: "8a7392bf-ea47-4efe-b58a-fc15baaa7461") : secret "metrics-daemon-secret" not found
Sep 18 22:01:30.112629 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:30.112610    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa9a758-4e4b-477c-b6de-b36dc677e1cd-original-pull-secret\") pod \"global-pull-secret-syncer-t7m2k\" (UID: \"0fa9a758-4e4b-477c-b6de-b36dc677e1cd\") " pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:01:30.199394 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:30.199353    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmv59\" (UniqueName: \"kubernetes.io/projected/8e3f6f16-2634-4b45-ac6c-5470f9cfef13-kube-api-access-cmv59\") pod \"network-check-target-wj4fb\" (UID: \"8e3f6f16-2634-4b45-ac6c-5470f9cfef13\") " pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:01:30.201921 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:30.201892    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmv59\" (UniqueName: \"kubernetes.io/projected/8e3f6f16-2634-4b45-ac6c-5470f9cfef13-kube-api-access-cmv59\") pod \"network-check-target-wj4fb\" (UID: \"8e3f6f16-2634-4b45-ac6c-5470f9cfef13\") " pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:01:30.251490 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:30.251458    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t7m2k"
Sep 18 22:01:30.349898 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:30.349837    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8l8bl\""
Sep 18 22:01:30.357729 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:30.357712    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:01:30.523804 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:30.523781    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t7m2k"]
Sep 18 22:01:30.525890 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:01:30.525862    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fa9a758_4e4b_477c_b6de_b36dc677e1cd.slice/crio-03a103e3067189d2c1adbdd7b7cb24ab7d4577c79176e714ab80a16ac642195c WatchSource:0}: Error finding container 03a103e3067189d2c1adbdd7b7cb24ab7d4577c79176e714ab80a16ac642195c: Status 404 returned error can't find the container with id 03a103e3067189d2c1adbdd7b7cb24ab7d4577c79176e714ab80a16ac642195c
Sep 18 22:01:30.603425 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:30.603364    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4148d3f5-0a43-4d62-b1cc-6015b20f7228-metrics-tls\") pod \"dns-default-bcxc9\" (UID: \"4148d3f5-0a43-4d62-b1cc-6015b20f7228\") " pod="openshift-dns/dns-default-bcxc9"
Sep 18 22:01:30.605664 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:30.605643    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4148d3f5-0a43-4d62-b1cc-6015b20f7228-metrics-tls\") pod \"dns-default-bcxc9\" (UID: \"4148d3f5-0a43-4d62-b1cc-6015b20f7228\") " pod="openshift-dns/dns-default-bcxc9"
Sep 18 22:01:30.625604 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:30.625583    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wj4fb"]
Sep 18 22:01:30.628862 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:01:30.628842    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e3f6f16_2634_4b45_ac6c_5470f9cfef13.slice/crio-9529e809e3fd22caaa7be6cb6a48de73f0f1974fef99bc0e2e3f5e7d769abacd WatchSource:0}: Error finding container 9529e809e3fd22caaa7be6cb6a48de73f0f1974fef99bc0e2e3f5e7d769abacd: Status 404 returned error can't find the container with id 9529e809e3fd22caaa7be6cb6a48de73f0f1974fef99bc0e2e3f5e7d769abacd
Sep 18 22:01:30.657954 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:30.657925    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wj4fb" event={"ID":"8e3f6f16-2634-4b45-ac6c-5470f9cfef13","Type":"ContainerStarted","Data":"9529e809e3fd22caaa7be6cb6a48de73f0f1974fef99bc0e2e3f5e7d769abacd"}
Sep 18 22:01:30.659009 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:30.658989    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t7m2k" event={"ID":"0fa9a758-4e4b-477c-b6de-b36dc677e1cd","Type":"ContainerStarted","Data":"03a103e3067189d2c1adbdd7b7cb24ab7d4577c79176e714ab80a16ac642195c"}
Sep 18 22:01:30.845647 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:30.845618    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kdhvj\""
Sep 18 22:01:30.853540 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:30.853476    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bcxc9"
Sep 18 22:01:31.144657 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:31.144585    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bcxc9"]
Sep 18 22:01:31.148407 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:01:31.148379    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4148d3f5_0a43_4d62_b1cc_6015b20f7228.slice/crio-f0d3bfbbad7a94088eba2ea88fd64f97a10bd313724937c5c75dc7c3f9987b66 WatchSource:0}: Error finding container f0d3bfbbad7a94088eba2ea88fd64f97a10bd313724937c5c75dc7c3f9987b66: Status 404 returned error can't find the container with id f0d3bfbbad7a94088eba2ea88fd64f97a10bd313724937c5c75dc7c3f9987b66
Sep 18 22:01:31.663472 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:31.663434    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bcxc9" event={"ID":"4148d3f5-0a43-4d62-b1cc-6015b20f7228","Type":"ContainerStarted","Data":"f0d3bfbbad7a94088eba2ea88fd64f97a10bd313724937c5c75dc7c3f9987b66"}
Sep 18 22:01:31.665199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:31.665177    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wj4fb" event={"ID":"8e3f6f16-2634-4b45-ac6c-5470f9cfef13","Type":"ContainerStarted","Data":"cf2c1c1ddba0e19e92d750088b708dd8e8dd26f9f97df0ec0397fbdf78940d64"}
Sep 18 22:01:31.665426 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:31.665401    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:01:31.684850 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:31.684809    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wj4fb" podStartSLOduration=66.684796207 podStartE2EDuration="1m6.684796207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:00:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:01:31.682785168 +0000 UTC m=+66.814566253" watchObservedRunningTime="2026-09-18 22:01:31.684796207 +0000 UTC m=+66.816577288"
Sep 18 22:01:34.677477 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:34.677442    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bcxc9" event={"ID":"4148d3f5-0a43-4d62-b1cc-6015b20f7228","Type":"ContainerStarted","Data":"d61c27791c86293cb206a85cd17eeaecbc8e7fde46a01c0f5387dbb9aff4aaba"}
Sep 18 22:01:34.678850 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:34.678821    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t7m2k" event={"ID":"0fa9a758-4e4b-477c-b6de-b36dc677e1cd","Type":"ContainerStarted","Data":"272521554ec336c6f69b4fc3a9cae7a0d724935846a380fc37e45ae0182a58cf"}
Sep 18 22:01:34.696773 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:34.696721    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-t7m2k" podStartSLOduration=65.701449145 podStartE2EDuration="1m9.696697537s" totalImagesPullingTime="3.995248392s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:01:34.695040072 +0000 UTC m=+69.826821157" watchObservedRunningTime="2026-09-18 22:01:34.696697537 +0000 UTC m=+69.828478619"
Sep 18 22:01:35.339957 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:35.339925    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e81147d8-4915-42ce-9328-e5b8db7cc44c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvlvf\" (UID: \"e81147d8-4915-42ce-9328-e5b8db7cc44c\") " pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:35.340125 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:35.339971    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e81147d8-4915-42ce-9328-e5b8db7cc44c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvlvf\" (UID: \"e81147d8-4915-42ce-9328-e5b8db7cc44c\") " pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:35.340561 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:35.340541    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e81147d8-4915-42ce-9328-e5b8db7cc44c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvlvf\" (UID: \"e81147d8-4915-42ce-9328-e5b8db7cc44c\") " pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:35.342648 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:35.342624    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e81147d8-4915-42ce-9328-e5b8db7cc44c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvlvf\" (UID: \"e81147d8-4915-42ce-9328-e5b8db7cc44c\") " pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:35.415517 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:35.415477    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wk4th\""
Sep 18 22:01:35.423210 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:35.423191    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fvlvf"
Sep 18 22:01:35.684407 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:35.684373    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bcxc9" event={"ID":"4148d3f5-0a43-4d62-b1cc-6015b20f7228","Type":"ContainerStarted","Data":"ce69c7a2078d72a647d128f15e7418368d47b453f8ab4f6c328bb9ae4736e990"}
Sep 18 22:01:35.701663 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:35.701641    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fvlvf"]
Sep 18 22:01:35.704448 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:35.704401    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bcxc9" podStartSLOduration=34.34112374 podStartE2EDuration="37.704386734s" totalImagesPullingTime="3.363262994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:01:35.703183549 +0000 UTC m=+70.834964630" watchObservedRunningTime="2026-09-18 22:01:35.704386734 +0000 UTC m=+70.836167840"
Sep 18 22:01:35.705138 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:01:35.705120    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode81147d8_4915_42ce_9328_e5b8db7cc44c.slice/crio-51d04d91a8b9d6eb351877bacadc62cb718c72dedf625335c100ee8ac6863ae3 WatchSource:0}: Error finding container 51d04d91a8b9d6eb351877bacadc62cb718c72dedf625335c100ee8ac6863ae3: Status 404 returned error can't find the container with id 51d04d91a8b9d6eb351877bacadc62cb718c72dedf625335c100ee8ac6863ae3
Sep 18 22:01:36.689177 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:36.689139    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fvlvf" event={"ID":"e81147d8-4915-42ce-9328-e5b8db7cc44c","Type":"ContainerStarted","Data":"ffdafea9caa228bc06604ad47c943a9b707b27cf54c68e550812432c5defdf9b"}
Sep 18 22:01:36.689574 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:36.689210    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fvlvf" event={"ID":"e81147d8-4915-42ce-9328-e5b8db7cc44c","Type":"ContainerStarted","Data":"76bcf05019bf080cec0b2531af4bbb9d1e07d226249594ce185ba8268a8535ca"}
Sep 18 22:01:36.689574 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:36.689240    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fvlvf" event={"ID":"e81147d8-4915-42ce-9328-e5b8db7cc44c","Type":"ContainerStarted","Data":"51d04d91a8b9d6eb351877bacadc62cb718c72dedf625335c100ee8ac6863ae3"}
Sep 18 22:01:36.689574 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:36.689349    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bcxc9"
Sep 18 22:01:38.698250 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:38.698213    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fvlvf" event={"ID":"e81147d8-4915-42ce-9328-e5b8db7cc44c","Type":"ContainerStarted","Data":"f6532052f0acb15bbba9da708c7e2bf11d3ea3aa537b2405826f106a22aad145"}
Sep 18 22:01:38.717485 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:38.717445    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fvlvf" podStartSLOduration=17.511351442 podStartE2EDuration="19.717432293s" totalImagesPullingTime="2.206080851s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:01:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:01:38.716291065 +0000 UTC m=+73.848072161" watchObservedRunningTime="2026-09-18 22:01:38.717432293 +0000 UTC m=+73.849213375"
Sep 18 22:01:44.143373 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.143336    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dc6476fb6-26x4n"]
Sep 18 22:01:44.145550 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.145533    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dc6476fb6-26x4n"
Sep 18 22:01:44.168861 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.168833    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 18 22:01:44.168966 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.168862    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 18 22:01:44.169863 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.169845    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-r6zpr\""
Sep 18 22:01:44.169967 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.169847    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 18 22:01:44.169967 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.169895    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 18 22:01:44.198410 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.198388    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zcjf\" (UniqueName: \"kubernetes.io/projected/ae77b449-9fb7-43ad-8380-d163100b2952-kube-api-access-4zcjf\") pod \"managed-serviceaccount-addon-agent-dc6476fb6-26x4n\" (UID: \"ae77b449-9fb7-43ad-8380-d163100b2952\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dc6476fb6-26x4n"
Sep 18 22:01:44.198521 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.198435    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae77b449-9fb7-43ad-8380-d163100b2952-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-dc6476fb6-26x4n\" (UID: \"ae77b449-9fb7-43ad-8380-d163100b2952\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dc6476fb6-26x4n"
Sep 18 22:01:44.200380 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.200360    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dc6476fb6-26x4n"]
Sep 18 22:01:44.299699 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.299671    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zcjf\" (UniqueName: \"kubernetes.io/projected/ae77b449-9fb7-43ad-8380-d163100b2952-kube-api-access-4zcjf\") pod \"managed-serviceaccount-addon-agent-dc6476fb6-26x4n\" (UID: \"ae77b449-9fb7-43ad-8380-d163100b2952\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dc6476fb6-26x4n"
Sep 18 22:01:44.299917 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.299725    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae77b449-9fb7-43ad-8380-d163100b2952-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-dc6476fb6-26x4n\" (UID: \"ae77b449-9fb7-43ad-8380-d163100b2952\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dc6476fb6-26x4n"
Sep 18 22:01:44.302233 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.302203    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae77b449-9fb7-43ad-8380-d163100b2952-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-dc6476fb6-26x4n\" (UID: \"ae77b449-9fb7-43ad-8380-d163100b2952\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dc6476fb6-26x4n"
Sep 18 22:01:44.332297 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.332277    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zcjf\" (UniqueName: \"kubernetes.io/projected/ae77b449-9fb7-43ad-8380-d163100b2952-kube-api-access-4zcjf\") pod \"managed-serviceaccount-addon-agent-dc6476fb6-26x4n\" (UID: \"ae77b449-9fb7-43ad-8380-d163100b2952\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dc6476fb6-26x4n"
Sep 18 22:01:44.429927 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.429901    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5868589844-72z5r"]
Sep 18 22:01:44.431910 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.431896    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:44.434586 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.434570    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 18 22:01:44.434810 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.434791    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 18 22:01:44.434856 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.434827    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 18 22:01:44.435150 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.435137    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m9bdj\""
Sep 18 22:01:44.441264 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.441246    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 18 22:01:44.461882 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.461860    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5868589844-72z5r"]
Sep 18 22:01:44.470018 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.470001    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dc6476fb6-26x4n"
Sep 18 22:01:44.501395 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.501369    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/89432bb2-0b3f-48e4-b1c3-f22bdc5e7399-image-registry-private-configuration\") pod \"image-registry-5868589844-72z5r\" (UID: \"89432bb2-0b3f-48e4-b1c3-f22bdc5e7399\") " pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:44.501544 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.501411    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/89432bb2-0b3f-48e4-b1c3-f22bdc5e7399-registry-tls\") pod \"image-registry-5868589844-72z5r\" (UID: \"89432bb2-0b3f-48e4-b1c3-f22bdc5e7399\") " pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:44.501544 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.501439    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/89432bb2-0b3f-48e4-b1c3-f22bdc5e7399-installation-pull-secrets\") pod \"image-registry-5868589844-72z5r\" (UID: \"89432bb2-0b3f-48e4-b1c3-f22bdc5e7399\") " pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:44.501544 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.501479    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/89432bb2-0b3f-48e4-b1c3-f22bdc5e7399-trusted-ca\") pod \"image-registry-5868589844-72z5r\" (UID: \"89432bb2-0b3f-48e4-b1c3-f22bdc5e7399\") " pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:44.501678 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.501575    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/89432bb2-0b3f-48e4-b1c3-f22bdc5e7399-ca-trust-extracted\") pod \"image-registry-5868589844-72z5r\" (UID: \"89432bb2-0b3f-48e4-b1c3-f22bdc5e7399\") " pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:44.501678 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.501638    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lfzw\" (UniqueName: \"kubernetes.io/projected/89432bb2-0b3f-48e4-b1c3-f22bdc5e7399-kube-api-access-4lfzw\") pod \"image-registry-5868589844-72z5r\" (UID: \"89432bb2-0b3f-48e4-b1c3-f22bdc5e7399\") " pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:44.501776 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.501710    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/89432bb2-0b3f-48e4-b1c3-f22bdc5e7399-registry-certificates\") pod \"image-registry-5868589844-72z5r\" (UID: \"89432bb2-0b3f-48e4-b1c3-f22bdc5e7399\") " pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:44.501776 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.501738    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89432bb2-0b3f-48e4-b1c3-f22bdc5e7399-bound-sa-token\") pod \"image-registry-5868589844-72z5r\" (UID: \"89432bb2-0b3f-48e4-b1c3-f22bdc5e7399\") " pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:44.602756 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.602714    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/89432bb2-0b3f-48e4-b1c3-f22bdc5e7399-image-registry-private-configuration\") pod \"image-registry-5868589844-72z5r\" (UID: \"89432bb2-0b3f-48e4-b1c3-f22bdc5e7399\") " pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:44.602756 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.602755    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/89432bb2-0b3f-48e4-b1c3-f22bdc5e7399-registry-tls\") pod \"image-registry-5868589844-72z5r\" (UID: \"89432bb2-0b3f-48e4-b1c3-f22bdc5e7399\") " pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:44.602938 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.602777    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/89432bb2-0b3f-48e4-b1c3-f22bdc5e7399-installation-pull-secrets\") pod \"image-registry-5868589844-72z5r\" (UID: \"89432bb2-0b3f-48e4-b1c3-f22bdc5e7399\") " pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:44.602938 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.602815    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/89432bb2-0b3f-48e4-b1c3-f22bdc5e7399-trusted-ca\") pod \"image-registry-5868589844-72z5r\" (UID: \"89432bb2-0b3f-48e4-b1c3-f22bdc5e7399\") " pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:44.602938 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.602842    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/89432bb2-0b3f-48e4-b1c3-f22bdc5e7399-ca-trust-extracted\") pod \"image-registry-5868589844-72z5r\" (UID: \"89432bb2-0b3f-48e4-b1c3-f22bdc5e7399\") " pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:44.602938 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.602870    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lfzw\" (UniqueName: \"kubernetes.io/projected/89432bb2-0b3f-48e4-b1c3-f22bdc5e7399-kube-api-access-4lfzw\") pod \"image-registry-5868589844-72z5r\" (UID: \"89432bb2-0b3f-48e4-b1c3-f22bdc5e7399\") " pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:44.602938 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.602923    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/89432bb2-0b3f-48e4-b1c3-f22bdc5e7399-registry-certificates\") pod \"image-registry-5868589844-72z5r\" (UID: \"89432bb2-0b3f-48e4-b1c3-f22bdc5e7399\") " pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:44.603180 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.602942    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89432bb2-0b3f-48e4-b1c3-f22bdc5e7399-bound-sa-token\") pod \"image-registry-5868589844-72z5r\" (UID: \"89432bb2-0b3f-48e4-b1c3-f22bdc5e7399\") " pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:44.603559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.603533    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/89432bb2-0b3f-48e4-b1c3-f22bdc5e7399-ca-trust-extracted\") pod \"image-registry-5868589844-72z5r\" (UID: \"89432bb2-0b3f-48e4-b1c3-f22bdc5e7399\") " pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:44.604011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.603990    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/89432bb2-0b3f-48e4-b1c3-f22bdc5e7399-registry-certificates\") pod \"image-registry-5868589844-72z5r\" (UID: \"89432bb2-0b3f-48e4-b1c3-f22bdc5e7399\") " pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:44.604581 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.604557    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/89432bb2-0b3f-48e4-b1c3-f22bdc5e7399-trusted-ca\") pod \"image-registry-5868589844-72z5r\" (UID: \"89432bb2-0b3f-48e4-b1c3-f22bdc5e7399\") " pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:44.605484 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.605460    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/89432bb2-0b3f-48e4-b1c3-f22bdc5e7399-installation-pull-secrets\") pod \"image-registry-5868589844-72z5r\" (UID: \"89432bb2-0b3f-48e4-b1c3-f22bdc5e7399\") " pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:44.605644 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.605624    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/89432bb2-0b3f-48e4-b1c3-f22bdc5e7399-registry-tls\") pod \"image-registry-5868589844-72z5r\" (UID: \"89432bb2-0b3f-48e4-b1c3-f22bdc5e7399\") " pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:44.605825 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.605812    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/89432bb2-0b3f-48e4-b1c3-f22bdc5e7399-image-registry-private-configuration\") pod \"image-registry-5868589844-72z5r\" (UID: \"89432bb2-0b3f-48e4-b1c3-f22bdc5e7399\") " pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:44.618148 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.618119    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lfzw\" (UniqueName: \"kubernetes.io/projected/89432bb2-0b3f-48e4-b1c3-f22bdc5e7399-kube-api-access-4lfzw\") pod \"image-registry-5868589844-72z5r\" (UID: \"89432bb2-0b3f-48e4-b1c3-f22bdc5e7399\") " pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:44.619978 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.619961    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89432bb2-0b3f-48e4-b1c3-f22bdc5e7399-bound-sa-token\") pod \"image-registry-5868589844-72z5r\" (UID: \"89432bb2-0b3f-48e4-b1c3-f22bdc5e7399\") " pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:44.741450 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.741376    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:44.758938 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:44.758848    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dc6476fb6-26x4n"]
Sep 18 22:01:44.760830 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:01:44.760807    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae77b449_9fb7_43ad_8380_d163100b2952.slice/crio-9fef1e151ff82c58cdf4095959ee041fbf40dd2cf74c9e2ff329d5a20bd2454d WatchSource:0}: Error finding container 9fef1e151ff82c58cdf4095959ee041fbf40dd2cf74c9e2ff329d5a20bd2454d: Status 404 returned error can't find the container with id 9fef1e151ff82c58cdf4095959ee041fbf40dd2cf74c9e2ff329d5a20bd2454d
Sep 18 22:01:45.020250 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:45.020176    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5868589844-72z5r"]
Sep 18 22:01:45.023369 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:01:45.023344    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89432bb2_0b3f_48e4_b1c3_f22bdc5e7399.slice/crio-3a444117f7753a076903d6d46d69db897fbe0703072e1719762ba561f9a04304 WatchSource:0}: Error finding container 3a444117f7753a076903d6d46d69db897fbe0703072e1719762ba561f9a04304: Status 404 returned error can't find the container with id 3a444117f7753a076903d6d46d69db897fbe0703072e1719762ba561f9a04304
Sep 18 22:01:45.107287 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:45.107261    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77a9d433-df3d-4200-b498-83d36e01cf77-service-ca-bundle\") pod \"router-default-6454c8d7fd-6mjst\" (UID: \"77a9d433-df3d-4200-b498-83d36e01cf77\") " pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:45.107844 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:45.107826    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77a9d433-df3d-4200-b498-83d36e01cf77-service-ca-bundle\") pod \"router-default-6454c8d7fd-6mjst\" (UID: \"77a9d433-df3d-4200-b498-83d36e01cf77\") " pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:45.305768 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:45.305694    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zwkcf\""
Sep 18 22:01:45.314011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:45.313988    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:45.593332 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:45.592901    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6454c8d7fd-6mjst"]
Sep 18 22:01:45.597089 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:01:45.597055    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77a9d433_df3d_4200_b498_83d36e01cf77.slice/crio-b13ca96ec9d7d7b9bf23c7960bcbcb8e4b2b5a9338ea8a0dbbeea01755d41db1 WatchSource:0}: Error finding container b13ca96ec9d7d7b9bf23c7960bcbcb8e4b2b5a9338ea8a0dbbeea01755d41db1: Status 404 returned error can't find the container with id b13ca96ec9d7d7b9bf23c7960bcbcb8e4b2b5a9338ea8a0dbbeea01755d41db1
Sep 18 22:01:45.723146 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:45.723100    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6454c8d7fd-6mjst" event={"ID":"77a9d433-df3d-4200-b498-83d36e01cf77","Type":"ContainerStarted","Data":"ba6e0b48d72e554f1e67e49dcfb3d100db7bda8dd6fb0c3142db58876c2509c7"}
Sep 18 22:01:45.723321 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:45.723179    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6454c8d7fd-6mjst" event={"ID":"77a9d433-df3d-4200-b498-83d36e01cf77","Type":"ContainerStarted","Data":"b13ca96ec9d7d7b9bf23c7960bcbcb8e4b2b5a9338ea8a0dbbeea01755d41db1"}
Sep 18 22:01:45.725484 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:45.725450    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5868589844-72z5r" event={"ID":"89432bb2-0b3f-48e4-b1c3-f22bdc5e7399","Type":"ContainerStarted","Data":"35bba90c48673ff37f1dbc9c0d3fd092ebeb3dc2d7956e70e38b8e7d2db80900"}
Sep 18 22:01:45.725611 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:45.725519    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5868589844-72z5r" event={"ID":"89432bb2-0b3f-48e4-b1c3-f22bdc5e7399","Type":"ContainerStarted","Data":"3a444117f7753a076903d6d46d69db897fbe0703072e1719762ba561f9a04304"}
Sep 18 22:01:45.725679 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:45.725638    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:01:45.727301 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:45.727274    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dc6476fb6-26x4n" event={"ID":"ae77b449-9fb7-43ad-8380-d163100b2952","Type":"ContainerStarted","Data":"9fef1e151ff82c58cdf4095959ee041fbf40dd2cf74c9e2ff329d5a20bd2454d"}
Sep 18 22:01:45.776427 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:45.776195    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6454c8d7fd-6mjst" podStartSLOduration=32.776170783 podStartE2EDuration="32.776170783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:01:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:01:45.763922368 +0000 UTC m=+80.895703451" watchObservedRunningTime="2026-09-18 22:01:45.776170783 +0000 UTC m=+80.907951865"
Sep 18 22:01:46.314445 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:46.314406    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:46.317380 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:46.317357    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:46.340101 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:46.340053    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5868589844-72z5r" podStartSLOduration=2.340039266 podStartE2EDuration="2.340039266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:01:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:01:45.82520214 +0000 UTC m=+80.956983249" watchObservedRunningTime="2026-09-18 22:01:46.340039266 +0000 UTC m=+81.471820348"
Sep 18 22:01:46.695633 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:46.695600    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bcxc9"
Sep 18 22:01:46.730747 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:46.730712    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:46.731823 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:46.731798    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6454c8d7fd-6mjst"
Sep 18 22:01:47.735518 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:47.735480    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dc6476fb6-26x4n" event={"ID":"ae77b449-9fb7-43ad-8380-d163100b2952","Type":"ContainerStarted","Data":"21595a80e015fa06972a8a28a8079cc18cfb24ae007c705cbc4f5a7a26ae79c2"}
Sep 18 22:01:47.753692 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:47.753647    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dc6476fb6-26x4n" podStartSLOduration=1.407598231 podStartE2EDuration="3.75362732s" totalImagesPullingTime="2.346029089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:01:47.752673117 +0000 UTC m=+82.884454197" watchObservedRunningTime="2026-09-18 22:01:47.75362732 +0000 UTC m=+82.885408401"
Sep 18 22:01:53.396422 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.396391    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79ddc7d877-c2b4z"]
Sep 18 22:01:53.403255 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.403231    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:01:53.405667 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.405646    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 18 22:01:53.405810 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.405691    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 18 22:01:53.405938 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.405925    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 18 22:01:53.406581 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.406566    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 18 22:01:53.406691 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.406661    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-x59bp\""
Sep 18 22:01:53.406881 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.406867    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 18 22:01:53.407294 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.407276    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 18 22:01:53.407632 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.407615    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 18 22:01:53.410861 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.410842    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 18 22:01:53.411008 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.410923    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79ddc7d877-c2b4z"]
Sep 18 22:01:53.467140 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.467114    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f52918-6ea7-4506-99a0-64e74b597d49-trusted-ca-bundle\") pod \"console-79ddc7d877-c2b4z\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") " pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:01:53.467236 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.467148    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75f52918-6ea7-4506-99a0-64e74b597d49-console-serving-cert\") pod \"console-79ddc7d877-c2b4z\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") " pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:01:53.467236 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.467169    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75f52918-6ea7-4506-99a0-64e74b597d49-console-oauth-config\") pod \"console-79ddc7d877-c2b4z\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") " pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:01:53.467236 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.467209    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75f52918-6ea7-4506-99a0-64e74b597d49-service-ca\") pod \"console-79ddc7d877-c2b4z\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") " pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:01:53.467335 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.467243    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75f52918-6ea7-4506-99a0-64e74b597d49-oauth-serving-cert\") pod \"console-79ddc7d877-c2b4z\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") " pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:01:53.467335 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.467274    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq4vv\" (UniqueName: \"kubernetes.io/projected/75f52918-6ea7-4506-99a0-64e74b597d49-kube-api-access-cq4vv\") pod \"console-79ddc7d877-c2b4z\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") " pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:01:53.467335 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.467294    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75f52918-6ea7-4506-99a0-64e74b597d49-console-config\") pod \"console-79ddc7d877-c2b4z\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") " pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:01:53.567779 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.567742    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75f52918-6ea7-4506-99a0-64e74b597d49-console-serving-cert\") pod \"console-79ddc7d877-c2b4z\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") " pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:01:53.567779 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.567784    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75f52918-6ea7-4506-99a0-64e74b597d49-console-oauth-config\") pod \"console-79ddc7d877-c2b4z\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") " pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:01:53.567985 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.567805    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75f52918-6ea7-4506-99a0-64e74b597d49-service-ca\") pod \"console-79ddc7d877-c2b4z\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") " pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:01:53.567985 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.567823    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75f52918-6ea7-4506-99a0-64e74b597d49-oauth-serving-cert\") pod \"console-79ddc7d877-c2b4z\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") " pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:01:53.567985 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.567848    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq4vv\" (UniqueName: \"kubernetes.io/projected/75f52918-6ea7-4506-99a0-64e74b597d49-kube-api-access-cq4vv\") pod \"console-79ddc7d877-c2b4z\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") " pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:01:53.567985 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.567879    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75f52918-6ea7-4506-99a0-64e74b597d49-console-config\") pod \"console-79ddc7d877-c2b4z\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") " pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:01:53.567985 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.567909    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f52918-6ea7-4506-99a0-64e74b597d49-trusted-ca-bundle\") pod \"console-79ddc7d877-c2b4z\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") " pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:01:53.568646 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.568623    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75f52918-6ea7-4506-99a0-64e74b597d49-service-ca\") pod \"console-79ddc7d877-c2b4z\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") " pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:01:53.568837 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.568814    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75f52918-6ea7-4506-99a0-64e74b597d49-console-config\") pod \"console-79ddc7d877-c2b4z\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") " pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:01:53.568901 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.568886    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f52918-6ea7-4506-99a0-64e74b597d49-trusted-ca-bundle\") pod \"console-79ddc7d877-c2b4z\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") " pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:01:53.569000 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.568980    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75f52918-6ea7-4506-99a0-64e74b597d49-oauth-serving-cert\") pod \"console-79ddc7d877-c2b4z\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") " pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:01:53.570228 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.570206    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75f52918-6ea7-4506-99a0-64e74b597d49-console-oauth-config\") pod \"console-79ddc7d877-c2b4z\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") " pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:01:53.570479 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.570461    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75f52918-6ea7-4506-99a0-64e74b597d49-console-serving-cert\") pod \"console-79ddc7d877-c2b4z\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") " pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:01:53.577619 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.577598    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq4vv\" (UniqueName: \"kubernetes.io/projected/75f52918-6ea7-4506-99a0-64e74b597d49-kube-api-access-cq4vv\") pod \"console-79ddc7d877-c2b4z\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") " pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:01:53.712839 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.712804    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:01:53.983575 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:53.983487    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79ddc7d877-c2b4z"]
Sep 18 22:01:53.986208 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:01:53.986182    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f52918_6ea7_4506_99a0_64e74b597d49.slice/crio-89f049dbe31e65368ff1d9d9416c6b600ba5e4c6a9e18754b4a60c6540c5f921 WatchSource:0}: Error finding container 89f049dbe31e65368ff1d9d9416c6b600ba5e4c6a9e18754b4a60c6540c5f921: Status 404 returned error can't find the container with id 89f049dbe31e65368ff1d9d9416c6b600ba5e4c6a9e18754b4a60c6540c5f921
Sep 18 22:01:54.762027 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:54.761992    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79ddc7d877-c2b4z" event={"ID":"75f52918-6ea7-4506-99a0-64e74b597d49","Type":"ContainerStarted","Data":"89f049dbe31e65368ff1d9d9416c6b600ba5e4c6a9e18754b4a60c6540c5f921"}
Sep 18 22:01:58.779386 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:01:58.779356    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79ddc7d877-c2b4z" event={"ID":"75f52918-6ea7-4506-99a0-64e74b597d49","Type":"ContainerStarted","Data":"29fdaa9984a0f7165abc07e30f4e8d6525ce5948a9fbac8366952967c4f5c0c0"}
Sep 18 22:02:02.670515 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:02.670471    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wj4fb"
Sep 18 22:02:02.688308 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:02.688266    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79ddc7d877-c2b4z" podStartSLOduration=5.704905549 podStartE2EDuration="9.688252467s" totalImagesPullingTime="3.983346918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:01:58.803091074 +0000 UTC m=+93.934872161" watchObservedRunningTime="2026-09-18 22:02:02.688252467 +0000 UTC m=+97.820033554"
Sep 18 22:02:03.713306 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:03.713274    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:02:03.713769 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:03.713330    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:02:03.718127 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:03.718101    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:02:03.799392 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:03.799365    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:02:06.735372 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:06.735347    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5868589844-72z5r"
Sep 18 22:02:09.682482 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.682445    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-fnhql"]
Sep 18 22:02:09.715266 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.715236    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-fnhql"]
Sep 18 22:02:09.715402 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.715275    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mmdtn"]
Sep 18 22:02:09.715402 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.715355    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fnhql"
Sep 18 22:02:09.718208 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.718187    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 18 22:02:09.720035 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.720013    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 18 22:02:09.720385 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.720370    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 18 22:02:09.720602 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.720577    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 18 22:02:09.720728 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.720653    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 18 22:02:09.729149 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.729133    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.729262 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.729243    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-vzz5c\""
Sep 18 22:02:09.731974 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.731957    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 18 22:02:09.732128 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.732114    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vz5jd\""
Sep 18 22:02:09.732275 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.732255    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 18 22:02:09.732600 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.732584    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 18 22:02:09.797903 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.797879    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b8000511-78a2-4532-b5f6-9747952ad979-node-exporter-textfile\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.798025 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.797913    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b8000511-78a2-4532-b5f6-9747952ad979-node-exporter-wtmp\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.798025 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.797931    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b8000511-78a2-4532-b5f6-9747952ad979-node-exporter-accelerators-collector-config\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.798025 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.797976    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f88c7ac8-1bf4-4cbc-8fca-0676e39fe460-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-fnhql\" (UID: \"f88c7ac8-1bf4-4cbc-8fca-0676e39fe460\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fnhql"
Sep 18 22:02:09.798025 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.798015    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b8000511-78a2-4532-b5f6-9747952ad979-root\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.798156 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.798037    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f88c7ac8-1bf4-4cbc-8fca-0676e39fe460-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-fnhql\" (UID: \"f88c7ac8-1bf4-4cbc-8fca-0676e39fe460\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fnhql"
Sep 18 22:02:09.798156 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.798053    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b8000511-78a2-4532-b5f6-9747952ad979-node-exporter-tls\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.798156 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.798069    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8000511-78a2-4532-b5f6-9747952ad979-metrics-client-ca\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.798156 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.798145    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b8000511-78a2-4532-b5f6-9747952ad979-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.798277 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.798165    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8crcf\" (UniqueName: \"kubernetes.io/projected/f88c7ac8-1bf4-4cbc-8fca-0676e39fe460-kube-api-access-8crcf\") pod \"openshift-state-metrics-86c5bc79d6-fnhql\" (UID: \"f88c7ac8-1bf4-4cbc-8fca-0676e39fe460\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fnhql"
Sep 18 22:02:09.798277 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.798187    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f88c7ac8-1bf4-4cbc-8fca-0676e39fe460-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-fnhql\" (UID: \"f88c7ac8-1bf4-4cbc-8fca-0676e39fe460\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fnhql"
Sep 18 22:02:09.798277 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.798204    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8000511-78a2-4532-b5f6-9747952ad979-sys\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.798277 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.798219    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slcwj\" (UniqueName: \"kubernetes.io/projected/b8000511-78a2-4532-b5f6-9747952ad979-kube-api-access-slcwj\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.899572 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.899534    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b8000511-78a2-4532-b5f6-9747952ad979-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.899572 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.899571    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8crcf\" (UniqueName: \"kubernetes.io/projected/f88c7ac8-1bf4-4cbc-8fca-0676e39fe460-kube-api-access-8crcf\") pod \"openshift-state-metrics-86c5bc79d6-fnhql\" (UID: \"f88c7ac8-1bf4-4cbc-8fca-0676e39fe460\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fnhql"
Sep 18 22:02:09.899828 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.899589    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f88c7ac8-1bf4-4cbc-8fca-0676e39fe460-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-fnhql\" (UID: \"f88c7ac8-1bf4-4cbc-8fca-0676e39fe460\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fnhql"
Sep 18 22:02:09.899828 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.899606    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8000511-78a2-4532-b5f6-9747952ad979-sys\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.899828 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.899624    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slcwj\" (UniqueName: \"kubernetes.io/projected/b8000511-78a2-4532-b5f6-9747952ad979-kube-api-access-slcwj\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.899828 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.899653    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b8000511-78a2-4532-b5f6-9747952ad979-node-exporter-textfile\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.899828 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.899677    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b8000511-78a2-4532-b5f6-9747952ad979-node-exporter-wtmp\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.899828 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.899685    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8000511-78a2-4532-b5f6-9747952ad979-sys\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.899828 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.899692    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b8000511-78a2-4532-b5f6-9747952ad979-node-exporter-accelerators-collector-config\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.899828 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.899765    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f88c7ac8-1bf4-4cbc-8fca-0676e39fe460-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-fnhql\" (UID: \"f88c7ac8-1bf4-4cbc-8fca-0676e39fe460\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fnhql"
Sep 18 22:02:09.899828 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.899800    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b8000511-78a2-4532-b5f6-9747952ad979-root\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.899828 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.899831    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f88c7ac8-1bf4-4cbc-8fca-0676e39fe460-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-fnhql\" (UID: \"f88c7ac8-1bf4-4cbc-8fca-0676e39fe460\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fnhql"
Sep 18 22:02:09.900315 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.899838    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b8000511-78a2-4532-b5f6-9747952ad979-node-exporter-wtmp\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.900315 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.899861    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b8000511-78a2-4532-b5f6-9747952ad979-node-exporter-tls\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.900315 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.899888    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8000511-78a2-4532-b5f6-9747952ad979-metrics-client-ca\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.900315 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.899899    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b8000511-78a2-4532-b5f6-9747952ad979-root\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.900315 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:02:09.899694    2574 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 18 22:02:09.900315 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:02:09.900011    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f88c7ac8-1bf4-4cbc-8fca-0676e39fe460-openshift-state-metrics-tls podName:f88c7ac8-1bf4-4cbc-8fca-0676e39fe460 nodeName:}" failed. No retries permitted until 2026-09-18 22:02:10.399990902 +0000 UTC m=+105.531771981 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f88c7ac8-1bf4-4cbc-8fca-0676e39fe460-openshift-state-metrics-tls") pod "openshift-state-metrics-86c5bc79d6-fnhql" (UID: "f88c7ac8-1bf4-4cbc-8fca-0676e39fe460") : secret "openshift-state-metrics-tls" not found
Sep 18 22:02:09.900315 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.900173    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b8000511-78a2-4532-b5f6-9747952ad979-node-exporter-textfile\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.900858 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.900407    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b8000511-78a2-4532-b5f6-9747952ad979-node-exporter-accelerators-collector-config\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.900858 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.900533    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f88c7ac8-1bf4-4cbc-8fca-0676e39fe460-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-fnhql\" (UID: \"f88c7ac8-1bf4-4cbc-8fca-0676e39fe460\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fnhql"
Sep 18 22:02:09.900858 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.900541    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8000511-78a2-4532-b5f6-9747952ad979-metrics-client-ca\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.902400 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.902382    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b8000511-78a2-4532-b5f6-9747952ad979-node-exporter-tls\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.902492 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.902413    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b8000511-78a2-4532-b5f6-9747952ad979-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.902572 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.902550    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f88c7ac8-1bf4-4cbc-8fca-0676e39fe460-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-fnhql\" (UID: \"f88c7ac8-1bf4-4cbc-8fca-0676e39fe460\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fnhql"
Sep 18 22:02:09.908872 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.908850    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slcwj\" (UniqueName: \"kubernetes.io/projected/b8000511-78a2-4532-b5f6-9747952ad979-kube-api-access-slcwj\") pod \"node-exporter-mmdtn\" (UID: \"b8000511-78a2-4532-b5f6-9747952ad979\") " pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:09.909232 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:09.909211    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8crcf\" (UniqueName: \"kubernetes.io/projected/f88c7ac8-1bf4-4cbc-8fca-0676e39fe460-kube-api-access-8crcf\") pod \"openshift-state-metrics-86c5bc79d6-fnhql\" (UID: \"f88c7ac8-1bf4-4cbc-8fca-0676e39fe460\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fnhql"
Sep 18 22:02:10.037350 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.037269    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mmdtn"
Sep 18 22:02:10.080891 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:02:10.080864    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8000511_78a2_4532_b5f6_9747952ad979.slice/crio-6c5dd1e1c076b75a701eb8effa6c8399292b1c4b6f4fa47779ebe37137dc58d4 WatchSource:0}: Error finding container 6c5dd1e1c076b75a701eb8effa6c8399292b1c4b6f4fa47779ebe37137dc58d4: Status 404 returned error can't find the container with id 6c5dd1e1c076b75a701eb8effa6c8399292b1c4b6f4fa47779ebe37137dc58d4
Sep 18 22:02:10.403649 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.403569    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f88c7ac8-1bf4-4cbc-8fca-0676e39fe460-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-fnhql\" (UID: \"f88c7ac8-1bf4-4cbc-8fca-0676e39fe460\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fnhql"
Sep 18 22:02:10.406031 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.406010    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f88c7ac8-1bf4-4cbc-8fca-0676e39fe460-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-fnhql\" (UID: \"f88c7ac8-1bf4-4cbc-8fca-0676e39fe460\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fnhql"
Sep 18 22:02:10.623860 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.623806    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fnhql"
Sep 18 22:02:10.728286 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.728254    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 22:02:10.732044 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.732022    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.735647 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.735622    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 18 22:02:10.735787 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.735765    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 18 22:02:10.736158 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.736138    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 18 22:02:10.738368 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.738345    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 18 22:02:10.738479 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.738423    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 18 22:02:10.738554 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.738525    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 18 22:02:10.739466 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.738742    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 18 22:02:10.739466 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.739214    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 18 22:02:10.739466 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.739450    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 18 22:02:10.741181 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.739726    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wpg4x\""
Sep 18 22:02:10.750770 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.750752    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 22:02:10.805970 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.805940    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cb79f4ad-4280-4592-bd9e-ec15548dee34-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.806106 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.805976    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cb79f4ad-4280-4592-bd9e-ec15548dee34-config-volume\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.806171 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.806148    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb79f4ad-4280-4592-bd9e-ec15548dee34-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.806230 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.806215    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhzqk\" (UniqueName: \"kubernetes.io/projected/cb79f4ad-4280-4592-bd9e-ec15548dee34-kube-api-access-qhzqk\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.806280 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.806244    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cb79f4ad-4280-4592-bd9e-ec15548dee34-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.806280 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.806267    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb79f4ad-4280-4592-bd9e-ec15548dee34-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.806675 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.806301    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb79f4ad-4280-4592-bd9e-ec15548dee34-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.806675 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.806371    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb79f4ad-4280-4592-bd9e-ec15548dee34-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.806675 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.806416    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb79f4ad-4280-4592-bd9e-ec15548dee34-web-config\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.806675 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.806448    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cb79f4ad-4280-4592-bd9e-ec15548dee34-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.806675 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.806482    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb79f4ad-4280-4592-bd9e-ec15548dee34-config-out\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.806675 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.806566    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cb79f4ad-4280-4592-bd9e-ec15548dee34-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.806675 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.806598    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb79f4ad-4280-4592-bd9e-ec15548dee34-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.819920 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.819891    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mmdtn" event={"ID":"b8000511-78a2-4532-b5f6-9747952ad979","Type":"ContainerStarted","Data":"6c5dd1e1c076b75a701eb8effa6c8399292b1c4b6f4fa47779ebe37137dc58d4"}
Sep 18 22:02:10.899361 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.899331    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-fnhql"]
Sep 18 22:02:10.907587 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.907566    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb79f4ad-4280-4592-bd9e-ec15548dee34-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.907707 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.907602    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb79f4ad-4280-4592-bd9e-ec15548dee34-web-config\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.907707 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.907628    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cb79f4ad-4280-4592-bd9e-ec15548dee34-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.907707 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.907659    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb79f4ad-4280-4592-bd9e-ec15548dee34-config-out\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.907876 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.907707    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cb79f4ad-4280-4592-bd9e-ec15548dee34-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.907876 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.907732    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb79f4ad-4280-4592-bd9e-ec15548dee34-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.907876 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.907760    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cb79f4ad-4280-4592-bd9e-ec15548dee34-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.907876 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.907803    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cb79f4ad-4280-4592-bd9e-ec15548dee34-config-volume\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.907876 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.907866    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb79f4ad-4280-4592-bd9e-ec15548dee34-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.909032 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.908687    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb79f4ad-4280-4592-bd9e-ec15548dee34-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.909032 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.908726    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cb79f4ad-4280-4592-bd9e-ec15548dee34-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.909032 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.908768    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhzqk\" (UniqueName: \"kubernetes.io/projected/cb79f4ad-4280-4592-bd9e-ec15548dee34-kube-api-access-qhzqk\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.909032 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.908803    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cb79f4ad-4280-4592-bd9e-ec15548dee34-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.909032 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.908829    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb79f4ad-4280-4592-bd9e-ec15548dee34-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.909032 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.908865    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb79f4ad-4280-4592-bd9e-ec15548dee34-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.910445 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.910415    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb79f4ad-4280-4592-bd9e-ec15548dee34-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.910999 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.910953    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb79f4ad-4280-4592-bd9e-ec15548dee34-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.911357 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.911335    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb79f4ad-4280-4592-bd9e-ec15548dee34-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.912237 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.912197    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb79f4ad-4280-4592-bd9e-ec15548dee34-web-config\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.912832 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.912784    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb79f4ad-4280-4592-bd9e-ec15548dee34-config-out\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.913066 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.913046    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cb79f4ad-4280-4592-bd9e-ec15548dee34-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.913574 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.913491    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cb79f4ad-4280-4592-bd9e-ec15548dee34-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.913658 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.913617    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb79f4ad-4280-4592-bd9e-ec15548dee34-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.913814 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.913790    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cb79f4ad-4280-4592-bd9e-ec15548dee34-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.913877 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.913852    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cb79f4ad-4280-4592-bd9e-ec15548dee34-config-volume\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:10.917873 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:10.917850    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhzqk\" (UniqueName: \"kubernetes.io/projected/cb79f4ad-4280-4592-bd9e-ec15548dee34-kube-api-access-qhzqk\") pod \"alertmanager-main-0\" (UID: \"cb79f4ad-4280-4592-bd9e-ec15548dee34\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:11.038377 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:02:11.038301    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf88c7ac8_1bf4_4cbc_8fca_0676e39fe460.slice/crio-951da9405404a2aebb1aea41ecdbf3649437afb9c54539361fce7501b487735a WatchSource:0}: Error finding container 951da9405404a2aebb1aea41ecdbf3649437afb9c54539361fce7501b487735a: Status 404 returned error can't find the container with id 951da9405404a2aebb1aea41ecdbf3649437afb9c54539361fce7501b487735a
Sep 18 22:02:11.046007 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:11.045981    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 18 22:02:11.376401 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:11.376373    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 18 22:02:11.378037 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:02:11.378007    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb79f4ad_4280_4592_bd9e_ec15548dee34.slice/crio-aead3088abb86ae39226d6dcc63728cba7e91df18577d877dad83fbe9b3c28e3 WatchSource:0}: Error finding container aead3088abb86ae39226d6dcc63728cba7e91df18577d877dad83fbe9b3c28e3: Status 404 returned error can't find the container with id aead3088abb86ae39226d6dcc63728cba7e91df18577d877dad83fbe9b3c28e3
Sep 18 22:02:11.825856 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:11.825819    2574 generic.go:356] "Generic (PLEG): container finished" podID="b8000511-78a2-4532-b5f6-9747952ad979" containerID="a5be81b517a74509d789631d85a3fe529c2d4ac1d8982728b86b33bf231790de" exitCode=0
Sep 18 22:02:11.826282 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:11.826105    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mmdtn" event={"ID":"b8000511-78a2-4532-b5f6-9747952ad979","Type":"ContainerDied","Data":"a5be81b517a74509d789631d85a3fe529c2d4ac1d8982728b86b33bf231790de"}
Sep 18 22:02:11.827841 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:11.827812    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb79f4ad-4280-4592-bd9e-ec15548dee34","Type":"ContainerStarted","Data":"aead3088abb86ae39226d6dcc63728cba7e91df18577d877dad83fbe9b3c28e3"}
Sep 18 22:02:11.830102 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:11.830070    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fnhql" event={"ID":"f88c7ac8-1bf4-4cbc-8fca-0676e39fe460","Type":"ContainerStarted","Data":"aafbe1f6f2062147ea1da6d38f7ae74bc1495f3562fa95c0cd2edaac6f4162c8"}
Sep 18 22:02:11.830208 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:11.830119    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fnhql" event={"ID":"f88c7ac8-1bf4-4cbc-8fca-0676e39fe460","Type":"ContainerStarted","Data":"301d1d9e361292b790233d4643bd03c1dfd7f56beb1b88a286c87d610f11f60f"}
Sep 18 22:02:11.830208 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:11.830141    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fnhql" event={"ID":"f88c7ac8-1bf4-4cbc-8fca-0676e39fe460","Type":"ContainerStarted","Data":"951da9405404a2aebb1aea41ecdbf3649437afb9c54539361fce7501b487735a"}
Sep 18 22:02:12.835104 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:12.835025    2574 generic.go:356] "Generic (PLEG): container finished" podID="cb79f4ad-4280-4592-bd9e-ec15548dee34" containerID="2be926b33e5eb09adc2527407eb605fce4330f0fedaf5a60254a5f4cfdfddecf" exitCode=0
Sep 18 22:02:12.835440 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:12.835112    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb79f4ad-4280-4592-bd9e-ec15548dee34","Type":"ContainerDied","Data":"2be926b33e5eb09adc2527407eb605fce4330f0fedaf5a60254a5f4cfdfddecf"}
Sep 18 22:02:12.837696 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:12.837662    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fnhql" event={"ID":"f88c7ac8-1bf4-4cbc-8fca-0676e39fe460","Type":"ContainerStarted","Data":"2723d62a40afd2c8dc6158d8c143a1a2c4dd8b99fd45b9afad7e407cc835de94"}
Sep 18 22:02:12.842415 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:12.842391    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mmdtn" event={"ID":"b8000511-78a2-4532-b5f6-9747952ad979","Type":"ContainerStarted","Data":"7e07d8f992188b4c74c0e0d41685ef3e6b3645e71c12cbddb99f3c5de086e399"}
Sep 18 22:02:12.842539 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:12.842437    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mmdtn" event={"ID":"b8000511-78a2-4532-b5f6-9747952ad979","Type":"ContainerStarted","Data":"c89f8f0b680890c20b207171194d580cee5dd42b12d0816e09ea07a4cb19bbc5"}
Sep 18 22:02:12.897265 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:12.897221    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mmdtn" podStartSLOduration=2.8339019050000003 podStartE2EDuration="3.897207952s" totalImagesPullingTime="984.085315ms" totalInitContainerRuntime="79.220732ms" isStatefulPod=true podCreationTimestamp="2026-09-18 22:02:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:02:12.89660365 +0000 UTC m=+108.028384733" watchObservedRunningTime="2026-09-18 22:02:12.897207952 +0000 UTC m=+108.028989028"
Sep 18 22:02:12.917748 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:12.917715    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fnhql" podStartSLOduration=2.873685547 podStartE2EDuration="3.917703633s" totalImagesPullingTime="1.044018086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:02:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:02:12.916380137 +0000 UTC m=+108.048161219" watchObservedRunningTime="2026-09-18 22:02:12.917703633 +0000 UTC m=+108.049484714"
Sep 18 22:02:14.417846 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:14.417810    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-g2wwm"]
Sep 18 22:02:14.420803 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:14.420778    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-g2wwm"
Sep 18 22:02:14.424216 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:14.424032    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-fvdpx\""
Sep 18 22:02:14.426960 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:14.426940    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 18 22:02:14.434866 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:14.434843    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-g2wwm"]
Sep 18 22:02:14.544857 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:14.544835    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84ef876b-2231-447e-956c-74b7ed846422-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-g2wwm\" (UID: \"84ef876b-2231-447e-956c-74b7ed846422\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-g2wwm"
Sep 18 22:02:14.544965 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:14.544870    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dlqw\" (UniqueName: \"kubernetes.io/projected/84ef876b-2231-447e-956c-74b7ed846422-kube-api-access-9dlqw\") pod \"monitoring-plugin-5984459ff8-g2wwm\" (UID: \"84ef876b-2231-447e-956c-74b7ed846422\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-g2wwm"
Sep 18 22:02:14.645425 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:14.645401    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84ef876b-2231-447e-956c-74b7ed846422-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-g2wwm\" (UID: \"84ef876b-2231-447e-956c-74b7ed846422\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-g2wwm"
Sep 18 22:02:14.645540 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:14.645431    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dlqw\" (UniqueName: \"kubernetes.io/projected/84ef876b-2231-447e-956c-74b7ed846422-kube-api-access-9dlqw\") pod \"monitoring-plugin-5984459ff8-g2wwm\" (UID: \"84ef876b-2231-447e-956c-74b7ed846422\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-g2wwm"
Sep 18 22:02:14.645611 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:02:14.645589    2574 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 18 22:02:14.645674 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:02:14.645663    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84ef876b-2231-447e-956c-74b7ed846422-monitoring-plugin-cert podName:84ef876b-2231-447e-956c-74b7ed846422 nodeName:}" failed. No retries permitted until 2026-09-18 22:02:15.14564385 +0000 UTC m=+110.277424924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/84ef876b-2231-447e-956c-74b7ed846422-monitoring-plugin-cert") pod "monitoring-plugin-5984459ff8-g2wwm" (UID: "84ef876b-2231-447e-956c-74b7ed846422") : secret "monitoring-plugin-cert" not found
Sep 18 22:02:14.658063 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:14.658038    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dlqw\" (UniqueName: \"kubernetes.io/projected/84ef876b-2231-447e-956c-74b7ed846422-kube-api-access-9dlqw\") pod \"monitoring-plugin-5984459ff8-g2wwm\" (UID: \"84ef876b-2231-447e-956c-74b7ed846422\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-g2wwm"
Sep 18 22:02:14.852898 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:14.852866    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb79f4ad-4280-4592-bd9e-ec15548dee34","Type":"ContainerStarted","Data":"3ac12684a3edf36cf5392365b60da723df221e6af5ce662ee610aa956175ce25"}
Sep 18 22:02:14.853024 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:14.852928    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb79f4ad-4280-4592-bd9e-ec15548dee34","Type":"ContainerStarted","Data":"abcfcde6b55d218c793070c553aa5c976b7e4d404e3d1226ce8f8467b9c75e77"}
Sep 18 22:02:14.853024 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:14.852954    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb79f4ad-4280-4592-bd9e-ec15548dee34","Type":"ContainerStarted","Data":"a93177c5084a1335c955dba1c56cda63cd963e14270c61e8dea7a42eeed6a34f"}
Sep 18 22:02:14.853024 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:14.852978    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb79f4ad-4280-4592-bd9e-ec15548dee34","Type":"ContainerStarted","Data":"92340f049a57d6fb7265df0a6ebcc7343d3ac3ac2dc415d2882a6af93b1dbdaa"}
Sep 18 22:02:14.853024 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:14.853001    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb79f4ad-4280-4592-bd9e-ec15548dee34","Type":"ContainerStarted","Data":"537bfc2ccc305b08b379606e844a470380833e260be18bb0a7bbeb204ce9ad62"}
Sep 18 22:02:15.149269 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:15.149180    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84ef876b-2231-447e-956c-74b7ed846422-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-g2wwm\" (UID: \"84ef876b-2231-447e-956c-74b7ed846422\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-g2wwm"
Sep 18 22:02:15.151885 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:15.151865    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84ef876b-2231-447e-956c-74b7ed846422-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-g2wwm\" (UID: \"84ef876b-2231-447e-956c-74b7ed846422\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-g2wwm"
Sep 18 22:02:15.331681 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:15.331651    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-g2wwm"
Sep 18 22:02:15.603640 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:15.603605    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-g2wwm"]
Sep 18 22:02:15.607365 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:02:15.607337    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84ef876b_2231_447e_956c_74b7ed846422.slice/crio-e45ad0b20deeeb7f4efcf59284b34b4a5f8dd7b9eb7d69ac5bdaaff50deb533b WatchSource:0}: Error finding container e45ad0b20deeeb7f4efcf59284b34b4a5f8dd7b9eb7d69ac5bdaaff50deb533b: Status 404 returned error can't find the container with id e45ad0b20deeeb7f4efcf59284b34b4a5f8dd7b9eb7d69ac5bdaaff50deb533b
Sep 18 22:02:15.857745 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:15.857719    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-g2wwm" event={"ID":"84ef876b-2231-447e-956c-74b7ed846422","Type":"ContainerStarted","Data":"e45ad0b20deeeb7f4efcf59284b34b4a5f8dd7b9eb7d69ac5bdaaff50deb533b"}
Sep 18 22:02:16.868178 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:16.868151    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb79f4ad-4280-4592-bd9e-ec15548dee34","Type":"ContainerStarted","Data":"891fda25a5ca90bd53e9b97021862189b547dfe84b63d145e842f24243e40580"}
Sep 18 22:02:16.899148 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:16.899102    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.077043233 podStartE2EDuration="6.899086559s" totalImagesPullingTime="3.808203278s" totalInitContainerRuntime="13.840048ms" isStatefulPod=false podCreationTimestamp="2026-09-18 22:02:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:02:16.897554588 +0000 UTC m=+112.029335670" watchObservedRunningTime="2026-09-18 22:02:16.899086559 +0000 UTC m=+112.030867645"
Sep 18 22:02:17.872859 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:17.872820    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-g2wwm" event={"ID":"84ef876b-2231-447e-956c-74b7ed846422","Type":"ContainerStarted","Data":"18e4f9e8826e73ebbeb80a48e8b8f56796c77b79ca8e5403e7d4d4ee8ccd2913"}
Sep 18 22:02:17.873284 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:17.873206    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-g2wwm"
Sep 18 22:02:17.877692 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:17.877668    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-g2wwm"
Sep 18 22:02:17.887990 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:17.887952    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-g2wwm" podStartSLOduration=2.653791012 podStartE2EDuration="3.887938999s" totalImagesPullingTime="1.234147987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:02:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:02:17.887322665 +0000 UTC m=+113.019103754" watchObservedRunningTime="2026-09-18 22:02:17.887938999 +0000 UTC m=+113.019720081"
Sep 18 22:02:32.533487 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:32.533445    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79ddc7d877-c2b4z"]
Sep 18 22:02:34.198652 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:34.198614    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs\") pod \"network-metrics-daemon-td6sj\" (UID: \"8a7392bf-ea47-4efe-b58a-fc15baaa7461\") " pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:02:34.201117 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:34.201097    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a7392bf-ea47-4efe-b58a-fc15baaa7461-metrics-certs\") pod \"network-metrics-daemon-td6sj\" (UID: \"8a7392bf-ea47-4efe-b58a-fc15baaa7461\") " pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:02:34.460279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:34.460198    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-27j86\""
Sep 18 22:02:34.468736 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:34.468708    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-td6sj"
Sep 18 22:02:34.752471 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:34.752395    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-td6sj"]
Sep 18 22:02:34.755223 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:02:34.755196    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a7392bf_ea47_4efe_b58a_fc15baaa7461.slice/crio-4a152a0926a51918ae56ca93db309a83c8b1bff660e2d12c0894f8a8b5617721 WatchSource:0}: Error finding container 4a152a0926a51918ae56ca93db309a83c8b1bff660e2d12c0894f8a8b5617721: Status 404 returned error can't find the container with id 4a152a0926a51918ae56ca93db309a83c8b1bff660e2d12c0894f8a8b5617721
Sep 18 22:02:34.937245 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:34.937213    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-td6sj" event={"ID":"8a7392bf-ea47-4efe-b58a-fc15baaa7461","Type":"ContainerStarted","Data":"4a152a0926a51918ae56ca93db309a83c8b1bff660e2d12c0894f8a8b5617721"}
Sep 18 22:02:35.942549 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:35.942516    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-td6sj" event={"ID":"8a7392bf-ea47-4efe-b58a-fc15baaa7461","Type":"ContainerStarted","Data":"53f4a29e562dfd2cd3d6d4802f8eb795538ef975b8f9c0b1a144e6a1ceb20346"}
Sep 18 22:02:35.942887 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:35.942570    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-td6sj" event={"ID":"8a7392bf-ea47-4efe-b58a-fc15baaa7461","Type":"ContainerStarted","Data":"fff042b2001b82b67307123403b276c36004ce908dba9b2b358da88b3a05bec2"}
Sep 18 22:02:35.965420 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:35.965377    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-td6sj" podStartSLOduration=130.066025051 podStartE2EDuration="2m10.965363069s" totalImagesPullingTime="899.338018ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:02:35.963402684 +0000 UTC m=+131.095183766" watchObservedRunningTime="2026-09-18 22:02:35.965363069 +0000 UTC m=+131.097144151"
Sep 18 22:02:41.967568 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:41.967494    2574 generic.go:356] "Generic (PLEG): container finished" podID="568547f4-50cc-41d7-a4a6-51ac3c1affb0" containerID="bbe0b1ca82164d1a05953e52169570afa875d9cb7e1f3c9e1ed46684ca3ba080" exitCode=0
Sep 18 22:02:41.967913 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:41.967535    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ggnkt" event={"ID":"568547f4-50cc-41d7-a4a6-51ac3c1affb0","Type":"ContainerDied","Data":"bbe0b1ca82164d1a05953e52169570afa875d9cb7e1f3c9e1ed46684ca3ba080"}
Sep 18 22:02:41.967913 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:41.967894    2574 scope.go:117] "RemoveContainer" containerID="bbe0b1ca82164d1a05953e52169570afa875d9cb7e1f3c9e1ed46684ca3ba080"
Sep 18 22:02:42.973200 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:42.973172    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-ggnkt" event={"ID":"568547f4-50cc-41d7-a4a6-51ac3c1affb0","Type":"ContainerStarted","Data":"88c632186ab9d87cdee66bd85fb595a6b1e9e0f4d5cdde2f165bc47b41abd210"}
Sep 18 22:02:57.552654 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:57.552575    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-79ddc7d877-c2b4z" podUID="75f52918-6ea7-4506-99a0-64e74b597d49" containerName="console" containerID="cri-o://29fdaa9984a0f7165abc07e30f4e8d6525ce5948a9fbac8366952967c4f5c0c0" gracePeriod=15
Sep 18 22:02:57.782354 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:57.782330    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:02:57.876263 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:57.876189    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75f52918-6ea7-4506-99a0-64e74b597d49-console-serving-cert\") pod \"75f52918-6ea7-4506-99a0-64e74b597d49\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") "
Sep 18 22:02:57.876263 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:57.876221    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cq4vv\" (UniqueName: \"kubernetes.io/projected/75f52918-6ea7-4506-99a0-64e74b597d49-kube-api-access-cq4vv\") pod \"75f52918-6ea7-4506-99a0-64e74b597d49\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") "
Sep 18 22:02:57.876263 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:57.876241    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75f52918-6ea7-4506-99a0-64e74b597d49-oauth-serving-cert\") pod \"75f52918-6ea7-4506-99a0-64e74b597d49\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") "
Sep 18 22:02:57.876544 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:57.876269    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f52918-6ea7-4506-99a0-64e74b597d49-trusted-ca-bundle\") pod \"75f52918-6ea7-4506-99a0-64e74b597d49\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") "
Sep 18 22:02:57.876544 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:57.876402    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75f52918-6ea7-4506-99a0-64e74b597d49-service-ca\") pod \"75f52918-6ea7-4506-99a0-64e74b597d49\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") "
Sep 18 22:02:57.876544 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:57.876458    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75f52918-6ea7-4506-99a0-64e74b597d49-console-config\") pod \"75f52918-6ea7-4506-99a0-64e74b597d49\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") "
Sep 18 22:02:57.876544 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:57.876492    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75f52918-6ea7-4506-99a0-64e74b597d49-console-oauth-config\") pod \"75f52918-6ea7-4506-99a0-64e74b597d49\" (UID: \"75f52918-6ea7-4506-99a0-64e74b597d49\") "
Sep 18 22:02:57.876800 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:57.876696    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75f52918-6ea7-4506-99a0-64e74b597d49-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "75f52918-6ea7-4506-99a0-64e74b597d49" (UID: "75f52918-6ea7-4506-99a0-64e74b597d49"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:02:57.876869 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:57.876783    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75f52918-6ea7-4506-99a0-64e74b597d49-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "75f52918-6ea7-4506-99a0-64e74b597d49" (UID: "75f52918-6ea7-4506-99a0-64e74b597d49"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:02:57.876930 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:57.876875    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75f52918-6ea7-4506-99a0-64e74b597d49-service-ca" (OuterVolumeSpecName: "service-ca") pod "75f52918-6ea7-4506-99a0-64e74b597d49" (UID: "75f52918-6ea7-4506-99a0-64e74b597d49"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:02:57.876930 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:57.876870    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75f52918-6ea7-4506-99a0-64e74b597d49-console-config" (OuterVolumeSpecName: "console-config") pod "75f52918-6ea7-4506-99a0-64e74b597d49" (UID: "75f52918-6ea7-4506-99a0-64e74b597d49"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:02:57.878757 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:57.878725    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75f52918-6ea7-4506-99a0-64e74b597d49-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "75f52918-6ea7-4506-99a0-64e74b597d49" (UID: "75f52918-6ea7-4506-99a0-64e74b597d49"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:02:57.878757 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:57.878734    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75f52918-6ea7-4506-99a0-64e74b597d49-kube-api-access-cq4vv" (OuterVolumeSpecName: "kube-api-access-cq4vv") pod "75f52918-6ea7-4506-99a0-64e74b597d49" (UID: "75f52918-6ea7-4506-99a0-64e74b597d49"). InnerVolumeSpecName "kube-api-access-cq4vv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:02:57.878888 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:57.878809    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75f52918-6ea7-4506-99a0-64e74b597d49-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "75f52918-6ea7-4506-99a0-64e74b597d49" (UID: "75f52918-6ea7-4506-99a0-64e74b597d49"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:02:57.977349 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:57.977302    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75f52918-6ea7-4506-99a0-64e74b597d49-service-ca\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:02:57.977349 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:57.977342    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75f52918-6ea7-4506-99a0-64e74b597d49-console-config\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:02:57.977349 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:57.977352    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75f52918-6ea7-4506-99a0-64e74b597d49-console-oauth-config\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:02:57.977349 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:57.977362    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75f52918-6ea7-4506-99a0-64e74b597d49-console-serving-cert\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:02:57.977612 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:57.977372    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cq4vv\" (UniqueName: \"kubernetes.io/projected/75f52918-6ea7-4506-99a0-64e74b597d49-kube-api-access-cq4vv\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:02:57.977612 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:57.977381    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75f52918-6ea7-4506-99a0-64e74b597d49-oauth-serving-cert\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:02:57.977612 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:57.977390    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75f52918-6ea7-4506-99a0-64e74b597d49-trusted-ca-bundle\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:02:58.029709 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:58.029677    2574 generic.go:356] "Generic (PLEG): container finished" podID="75f52918-6ea7-4506-99a0-64e74b597d49" containerID="29fdaa9984a0f7165abc07e30f4e8d6525ce5948a9fbac8366952967c4f5c0c0" exitCode=0
Sep 18 22:02:58.029824 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:58.029713    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79ddc7d877-c2b4z" event={"ID":"75f52918-6ea7-4506-99a0-64e74b597d49","Type":"ContainerDied","Data":"29fdaa9984a0f7165abc07e30f4e8d6525ce5948a9fbac8366952967c4f5c0c0"}
Sep 18 22:02:58.029824 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:58.029734    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79ddc7d877-c2b4z"
Sep 18 22:02:58.029824 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:58.029776    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79ddc7d877-c2b4z" event={"ID":"75f52918-6ea7-4506-99a0-64e74b597d49","Type":"ContainerDied","Data":"89f049dbe31e65368ff1d9d9416c6b600ba5e4c6a9e18754b4a60c6540c5f921"}
Sep 18 22:02:58.030398 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:58.030383    2574 scope.go:117] "RemoveContainer" containerID="29fdaa9984a0f7165abc07e30f4e8d6525ce5948a9fbac8366952967c4f5c0c0"
Sep 18 22:02:58.039134 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:58.039113    2574 scope.go:117] "RemoveContainer" containerID="29fdaa9984a0f7165abc07e30f4e8d6525ce5948a9fbac8366952967c4f5c0c0"
Sep 18 22:02:58.039378 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:02:58.039359    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29fdaa9984a0f7165abc07e30f4e8d6525ce5948a9fbac8366952967c4f5c0c0\": container with ID starting with 29fdaa9984a0f7165abc07e30f4e8d6525ce5948a9fbac8366952967c4f5c0c0 not found: ID does not exist" containerID="29fdaa9984a0f7165abc07e30f4e8d6525ce5948a9fbac8366952967c4f5c0c0"
Sep 18 22:02:58.039450 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:58.039383    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29fdaa9984a0f7165abc07e30f4e8d6525ce5948a9fbac8366952967c4f5c0c0"} err="failed to get container status \"29fdaa9984a0f7165abc07e30f4e8d6525ce5948a9fbac8366952967c4f5c0c0\": rpc error: code = NotFound desc = could not find container \"29fdaa9984a0f7165abc07e30f4e8d6525ce5948a9fbac8366952967c4f5c0c0\": container with ID starting with 29fdaa9984a0f7165abc07e30f4e8d6525ce5948a9fbac8366952967c4f5c0c0 not found: ID does not exist"
Sep 18 22:02:58.051486 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:58.051466    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79ddc7d877-c2b4z"]
Sep 18 22:02:58.056309 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:58.056291    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79ddc7d877-c2b4z"]
Sep 18 22:02:59.344609 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:02:59.344578    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75f52918-6ea7-4506-99a0-64e74b597d49" path="/var/lib/kubelet/pods/75f52918-6ea7-4506-99a0-64e74b597d49/volumes"
Sep 18 22:03:35.310168 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.310134    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7448578f56-85dg9"]
Sep 18 22:03:35.310615 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.310418    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75f52918-6ea7-4506-99a0-64e74b597d49" containerName="console"
Sep 18 22:03:35.310615 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.310428    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="75f52918-6ea7-4506-99a0-64e74b597d49" containerName="console"
Sep 18 22:03:35.310615 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.310498    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="75f52918-6ea7-4506-99a0-64e74b597d49" containerName="console"
Sep 18 22:03:35.313148 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.313127    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:03:35.316410 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.316380    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 18 22:03:35.316538 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.316418    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 18 22:03:35.317177 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.317155    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 18 22:03:35.317278 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.317165    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 18 22:03:35.317278 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.317183    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 18 22:03:35.317278 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.317203    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 18 22:03:35.317431 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.317403    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 18 22:03:35.317482 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.317463    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-x59bp\""
Sep 18 22:03:35.322317 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.322296    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 18 22:03:35.333810 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.333789    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7448578f56-85dg9"]
Sep 18 22:03:35.451755 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.451726    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcbxc\" (UniqueName: \"kubernetes.io/projected/4d8467f9-2a70-400c-93f5-5b230d8f3476-kube-api-access-pcbxc\") pod \"console-7448578f56-85dg9\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") " pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:03:35.451755 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.451759    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8467f9-2a70-400c-93f5-5b230d8f3476-service-ca\") pod \"console-7448578f56-85dg9\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") " pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:03:35.451938 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.451779    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d8467f9-2a70-400c-93f5-5b230d8f3476-oauth-serving-cert\") pod \"console-7448578f56-85dg9\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") " pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:03:35.451938 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.451835    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d8467f9-2a70-400c-93f5-5b230d8f3476-trusted-ca-bundle\") pod \"console-7448578f56-85dg9\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") " pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:03:35.451938 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.451861    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d8467f9-2a70-400c-93f5-5b230d8f3476-console-oauth-config\") pod \"console-7448578f56-85dg9\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") " pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:03:35.451938 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.451888    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d8467f9-2a70-400c-93f5-5b230d8f3476-console-serving-cert\") pod \"console-7448578f56-85dg9\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") " pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:03:35.451938 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.451923    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d8467f9-2a70-400c-93f5-5b230d8f3476-console-config\") pod \"console-7448578f56-85dg9\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") " pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:03:35.552294 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.552246    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8467f9-2a70-400c-93f5-5b230d8f3476-service-ca\") pod \"console-7448578f56-85dg9\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") " pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:03:35.552294 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.552301    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d8467f9-2a70-400c-93f5-5b230d8f3476-oauth-serving-cert\") pod \"console-7448578f56-85dg9\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") " pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:03:35.552567 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.552336    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d8467f9-2a70-400c-93f5-5b230d8f3476-trusted-ca-bundle\") pod \"console-7448578f56-85dg9\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") " pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:03:35.552567 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.552362    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d8467f9-2a70-400c-93f5-5b230d8f3476-console-oauth-config\") pod \"console-7448578f56-85dg9\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") " pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:03:35.552567 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.552384    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d8467f9-2a70-400c-93f5-5b230d8f3476-console-serving-cert\") pod \"console-7448578f56-85dg9\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") " pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:03:35.552567 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.552409    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d8467f9-2a70-400c-93f5-5b230d8f3476-console-config\") pod \"console-7448578f56-85dg9\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") " pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:03:35.552567 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.552485    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcbxc\" (UniqueName: \"kubernetes.io/projected/4d8467f9-2a70-400c-93f5-5b230d8f3476-kube-api-access-pcbxc\") pod \"console-7448578f56-85dg9\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") " pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:03:35.553094 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.553069    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8467f9-2a70-400c-93f5-5b230d8f3476-service-ca\") pod \"console-7448578f56-85dg9\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") " pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:03:35.553094 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.553086    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d8467f9-2a70-400c-93f5-5b230d8f3476-oauth-serving-cert\") pod \"console-7448578f56-85dg9\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") " pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:03:35.553232 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.553142    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d8467f9-2a70-400c-93f5-5b230d8f3476-console-config\") pod \"console-7448578f56-85dg9\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") " pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:03:35.553476 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.553453    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d8467f9-2a70-400c-93f5-5b230d8f3476-trusted-ca-bundle\") pod \"console-7448578f56-85dg9\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") " pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:03:35.554856 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.554832    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d8467f9-2a70-400c-93f5-5b230d8f3476-console-oauth-config\") pod \"console-7448578f56-85dg9\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") " pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:03:35.554943 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.554924    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d8467f9-2a70-400c-93f5-5b230d8f3476-console-serving-cert\") pod \"console-7448578f56-85dg9\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") " pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:03:35.562762 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.562717    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcbxc\" (UniqueName: \"kubernetes.io/projected/4d8467f9-2a70-400c-93f5-5b230d8f3476-kube-api-access-pcbxc\") pod \"console-7448578f56-85dg9\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") " pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:03:35.623734 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.623704    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:03:35.893673 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:35.893644    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7448578f56-85dg9"]
Sep 18 22:03:35.896029 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:03:35.896005    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d8467f9_2a70_400c_93f5_5b230d8f3476.slice/crio-4634b1d9d6046631840fe050c1243d43d5f2cc14a9d2b618c0f74e98c1692e74 WatchSource:0}: Error finding container 4634b1d9d6046631840fe050c1243d43d5f2cc14a9d2b618c0f74e98c1692e74: Status 404 returned error can't find the container with id 4634b1d9d6046631840fe050c1243d43d5f2cc14a9d2b618c0f74e98c1692e74
Sep 18 22:03:36.169309 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:36.169271    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7448578f56-85dg9" event={"ID":"4d8467f9-2a70-400c-93f5-5b230d8f3476","Type":"ContainerStarted","Data":"d50eee3fea499bd8ccdea276f6a9a17d1f03cddcde35cc580174c9ded2733723"}
Sep 18 22:03:36.169472 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:36.169331    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7448578f56-85dg9" event={"ID":"4d8467f9-2a70-400c-93f5-5b230d8f3476","Type":"ContainerStarted","Data":"4634b1d9d6046631840fe050c1243d43d5f2cc14a9d2b618c0f74e98c1692e74"}
Sep 18 22:03:36.190713 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:36.190669    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7448578f56-85dg9" podStartSLOduration=1.190654645 podStartE2EDuration="1.190654645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:03:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:03:36.189202823 +0000 UTC m=+191.320983905" watchObservedRunningTime="2026-09-18 22:03:36.190654645 +0000 UTC m=+191.322435727"
Sep 18 22:03:45.623981 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:45.623944    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:03:45.624402 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:45.624293    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:03:45.628750 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:45.628728    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:03:46.209624 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:03:46.209596    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:05:25.225601 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:05:25.225578    2574 kubelet.go:1648] "Image garbage collection succeeded"
Sep 18 22:06:11.257347 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:11.257311    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hrcml"]
Sep 18 22:06:11.259704 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:11.259688    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hrcml"
Sep 18 22:06:11.263133 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:11.263115    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 18 22:06:11.263790 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:11.263769    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 18 22:06:11.263895 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:11.263771    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-n288m\""
Sep 18 22:06:11.283381 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:11.283358    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hrcml"]
Sep 18 22:06:11.416588 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:11.416548    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04acffa0-3d20-4ed2-a539-b15ec84035f7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hrcml\" (UID: \"04acffa0-3d20-4ed2-a539-b15ec84035f7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hrcml"
Sep 18 22:06:11.416757 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:11.416619    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8prl8\" (UniqueName: \"kubernetes.io/projected/04acffa0-3d20-4ed2-a539-b15ec84035f7-kube-api-access-8prl8\") pod \"cert-manager-cainjector-559cdd8c87-hrcml\" (UID: \"04acffa0-3d20-4ed2-a539-b15ec84035f7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hrcml"
Sep 18 22:06:11.517162 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:11.517082    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8prl8\" (UniqueName: \"kubernetes.io/projected/04acffa0-3d20-4ed2-a539-b15ec84035f7-kube-api-access-8prl8\") pod \"cert-manager-cainjector-559cdd8c87-hrcml\" (UID: \"04acffa0-3d20-4ed2-a539-b15ec84035f7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hrcml"
Sep 18 22:06:11.517162 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:11.517134    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04acffa0-3d20-4ed2-a539-b15ec84035f7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hrcml\" (UID: \"04acffa0-3d20-4ed2-a539-b15ec84035f7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hrcml"
Sep 18 22:06:11.537866 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:11.537838    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04acffa0-3d20-4ed2-a539-b15ec84035f7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hrcml\" (UID: \"04acffa0-3d20-4ed2-a539-b15ec84035f7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hrcml"
Sep 18 22:06:11.538020 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:11.537903    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8prl8\" (UniqueName: \"kubernetes.io/projected/04acffa0-3d20-4ed2-a539-b15ec84035f7-kube-api-access-8prl8\") pod \"cert-manager-cainjector-559cdd8c87-hrcml\" (UID: \"04acffa0-3d20-4ed2-a539-b15ec84035f7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hrcml"
Sep 18 22:06:11.568759 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:11.568722    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hrcml"
Sep 18 22:06:11.847252 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:11.847174    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hrcml"]
Sep 18 22:06:11.850115 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:06:11.850090    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04acffa0_3d20_4ed2_a539_b15ec84035f7.slice/crio-23c0c29a6400668f246d703eb7349c39604706da11bcdbeadd3aae0fb58b787d WatchSource:0}: Error finding container 23c0c29a6400668f246d703eb7349c39604706da11bcdbeadd3aae0fb58b787d: Status 404 returned error can't find the container with id 23c0c29a6400668f246d703eb7349c39604706da11bcdbeadd3aae0fb58b787d
Sep 18 22:06:11.851878 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:11.851861    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 22:06:12.738808 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:12.738760    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hrcml" event={"ID":"04acffa0-3d20-4ed2-a539-b15ec84035f7","Type":"ContainerStarted","Data":"23c0c29a6400668f246d703eb7349c39604706da11bcdbeadd3aae0fb58b787d"}
Sep 18 22:06:15.754692 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:15.754654    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hrcml" event={"ID":"04acffa0-3d20-4ed2-a539-b15ec84035f7","Type":"ContainerStarted","Data":"903adf3b497ce89edc09f9e0192859f8ca0ac8a3f2071eca319245c12d11e645"}
Sep 18 22:06:15.773036 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:15.772985    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hrcml" podStartSLOduration=1.658103257 podStartE2EDuration="4.772971975s" totalImagesPullingTime="3.114868718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:06:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:06:15.771643694 +0000 UTC m=+350.903424762" watchObservedRunningTime="2026-09-18 22:06:15.772971975 +0000 UTC m=+350.904753057"
Sep 18 22:06:21.647022 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:21.646949    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rz8xx"]
Sep 18 22:06:21.648903 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:21.648888    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rz8xx"
Sep 18 22:06:21.651124 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:21.651092    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 18 22:06:21.651786 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:21.651746    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 18 22:06:21.651896 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:21.651748    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-gkwbc\""
Sep 18 22:06:21.661649 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:21.661628    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rz8xx"]
Sep 18 22:06:21.694639 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:21.694607    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64901fa0-3b26-4c21-bbd7-2796696f94cc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rz8xx\" (UID: \"64901fa0-3b26-4c21-bbd7-2796696f94cc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rz8xx"
Sep 18 22:06:21.694823 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:21.694683    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2mqb\" (UniqueName: \"kubernetes.io/projected/64901fa0-3b26-4c21-bbd7-2796696f94cc-kube-api-access-n2mqb\") pod \"openshift-lws-operator-fd8ccff4c-rz8xx\" (UID: \"64901fa0-3b26-4c21-bbd7-2796696f94cc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rz8xx"
Sep 18 22:06:21.795094 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:21.795064    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2mqb\" (UniqueName: \"kubernetes.io/projected/64901fa0-3b26-4c21-bbd7-2796696f94cc-kube-api-access-n2mqb\") pod \"openshift-lws-operator-fd8ccff4c-rz8xx\" (UID: \"64901fa0-3b26-4c21-bbd7-2796696f94cc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rz8xx"
Sep 18 22:06:21.795250 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:21.795110    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64901fa0-3b26-4c21-bbd7-2796696f94cc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rz8xx\" (UID: \"64901fa0-3b26-4c21-bbd7-2796696f94cc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rz8xx"
Sep 18 22:06:21.795401 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:21.795387    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64901fa0-3b26-4c21-bbd7-2796696f94cc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rz8xx\" (UID: \"64901fa0-3b26-4c21-bbd7-2796696f94cc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rz8xx"
Sep 18 22:06:21.805912 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:21.805878    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2mqb\" (UniqueName: \"kubernetes.io/projected/64901fa0-3b26-4c21-bbd7-2796696f94cc-kube-api-access-n2mqb\") pod \"openshift-lws-operator-fd8ccff4c-rz8xx\" (UID: \"64901fa0-3b26-4c21-bbd7-2796696f94cc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rz8xx"
Sep 18 22:06:21.957844 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:21.957817    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rz8xx"
Sep 18 22:06:22.253874 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:22.253800    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rz8xx"]
Sep 18 22:06:22.257341 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:06:22.257314    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64901fa0_3b26_4c21_bbd7_2796696f94cc.slice/crio-3662d79df96136062b80b29273ce8d4859c0887f9b05cb10e06a430635f61d07 WatchSource:0}: Error finding container 3662d79df96136062b80b29273ce8d4859c0887f9b05cb10e06a430635f61d07: Status 404 returned error can't find the container with id 3662d79df96136062b80b29273ce8d4859c0887f9b05cb10e06a430635f61d07
Sep 18 22:06:22.781819 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:22.781789    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rz8xx" event={"ID":"64901fa0-3b26-4c21-bbd7-2796696f94cc","Type":"ContainerStarted","Data":"3662d79df96136062b80b29273ce8d4859c0887f9b05cb10e06a430635f61d07"}
Sep 18 22:06:24.791908 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:24.791870    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rz8xx" event={"ID":"64901fa0-3b26-4c21-bbd7-2796696f94cc","Type":"ContainerStarted","Data":"f9ff13bf76611847af07adf5376b17ad14f329f1dadb80e93a6e69f43300ad86"}
Sep 18 22:06:24.810766 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:24.810701    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rz8xx" podStartSLOduration=1.4624020070000001 podStartE2EDuration="3.810684227s" totalImagesPullingTime="2.34828222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:06:24.809445109 +0000 UTC m=+359.941226248" watchObservedRunningTime="2026-09-18 22:06:24.810684227 +0000 UTC m=+359.942465309"
Sep 18 22:06:40.224762 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:40.224726    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8"]
Sep 18 22:06:40.228804 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:40.228784    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8"
Sep 18 22:06:40.231947 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:40.231925    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 18 22:06:40.233092 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:40.233075    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 18 22:06:40.233215 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:40.233095    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 18 22:06:40.233215 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:40.233081    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 18 22:06:40.233368 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:40.233355    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lkk4s\""
Sep 18 22:06:40.267612 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:40.267578    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8"]
Sep 18 22:06:40.340156 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:40.340120    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3a46f632-7b18-48f7-b24f-8fc3e34974f1-webhook-cert\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8\" (UID: \"3a46f632-7b18-48f7-b24f-8fc3e34974f1\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8"
Sep 18 22:06:40.340327 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:40.340164    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a46f632-7b18-48f7-b24f-8fc3e34974f1-tmp\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8\" (UID: \"3a46f632-7b18-48f7-b24f-8fc3e34974f1\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8"
Sep 18 22:06:40.340327 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:40.340231    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4xfl\" (UniqueName: \"kubernetes.io/projected/3a46f632-7b18-48f7-b24f-8fc3e34974f1-kube-api-access-m4xfl\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8\" (UID: \"3a46f632-7b18-48f7-b24f-8fc3e34974f1\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8"
Sep 18 22:06:40.340327 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:40.340262    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3a46f632-7b18-48f7-b24f-8fc3e34974f1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8\" (UID: \"3a46f632-7b18-48f7-b24f-8fc3e34974f1\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8"
Sep 18 22:06:40.340463 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:40.340330    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3a46f632-7b18-48f7-b24f-8fc3e34974f1-manifests\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8\" (UID: \"3a46f632-7b18-48f7-b24f-8fc3e34974f1\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8"
Sep 18 22:06:40.441781 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:40.441745    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3a46f632-7b18-48f7-b24f-8fc3e34974f1-webhook-cert\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8\" (UID: \"3a46f632-7b18-48f7-b24f-8fc3e34974f1\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8"
Sep 18 22:06:40.441781 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:40.441784    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a46f632-7b18-48f7-b24f-8fc3e34974f1-tmp\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8\" (UID: \"3a46f632-7b18-48f7-b24f-8fc3e34974f1\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8"
Sep 18 22:06:40.441987 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:40.441811    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4xfl\" (UniqueName: \"kubernetes.io/projected/3a46f632-7b18-48f7-b24f-8fc3e34974f1-kube-api-access-m4xfl\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8\" (UID: \"3a46f632-7b18-48f7-b24f-8fc3e34974f1\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8"
Sep 18 22:06:40.441987 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:40.441832    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3a46f632-7b18-48f7-b24f-8fc3e34974f1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8\" (UID: \"3a46f632-7b18-48f7-b24f-8fc3e34974f1\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8"
Sep 18 22:06:40.441987 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:40.441862    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3a46f632-7b18-48f7-b24f-8fc3e34974f1-manifests\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8\" (UID: \"3a46f632-7b18-48f7-b24f-8fc3e34974f1\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8"
Sep 18 22:06:40.442286 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:40.442264    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3a46f632-7b18-48f7-b24f-8fc3e34974f1-manifests\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8\" (UID: \"3a46f632-7b18-48f7-b24f-8fc3e34974f1\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8"
Sep 18 22:06:40.444285 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:40.444255    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a46f632-7b18-48f7-b24f-8fc3e34974f1-tmp\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8\" (UID: \"3a46f632-7b18-48f7-b24f-8fc3e34974f1\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8"
Sep 18 22:06:40.444402 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:40.444386    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3a46f632-7b18-48f7-b24f-8fc3e34974f1-webhook-cert\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8\" (UID: \"3a46f632-7b18-48f7-b24f-8fc3e34974f1\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8"
Sep 18 22:06:40.444483 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:40.444464    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3a46f632-7b18-48f7-b24f-8fc3e34974f1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8\" (UID: \"3a46f632-7b18-48f7-b24f-8fc3e34974f1\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8"
Sep 18 22:06:40.451164 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:40.451138    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4xfl\" (UniqueName: \"kubernetes.io/projected/3a46f632-7b18-48f7-b24f-8fc3e34974f1-kube-api-access-m4xfl\") pod \"opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8\" (UID: \"3a46f632-7b18-48f7-b24f-8fc3e34974f1\") " pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8"
Sep 18 22:06:40.538873 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:40.538799    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8"
Sep 18 22:06:40.849093 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:40.849068    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8"]
Sep 18 22:06:40.850397 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:06:40.850371    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a46f632_7b18_48f7_b24f_8fc3e34974f1.slice/crio-e93770ced5907d60c1170be8da4f6c342d14d26d92a588e011e3713e7769fe52 WatchSource:0}: Error finding container e93770ced5907d60c1170be8da4f6c342d14d26d92a588e011e3713e7769fe52: Status 404 returned error can't find the container with id e93770ced5907d60c1170be8da4f6c342d14d26d92a588e011e3713e7769fe52
Sep 18 22:06:41.859077 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:41.859038    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8" event={"ID":"3a46f632-7b18-48f7-b24f-8fc3e34974f1","Type":"ContainerStarted","Data":"e93770ced5907d60c1170be8da4f6c342d14d26d92a588e011e3713e7769fe52"}
Sep 18 22:06:44.879681 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:44.875813    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8" event={"ID":"3a46f632-7b18-48f7-b24f-8fc3e34974f1","Type":"ContainerStarted","Data":"f5a3f0f67007074a8a8644674dfaded669eca19a8a9d7c7995b39a933ece5814"}
Sep 18 22:06:45.881290 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:45.881258    2574 generic.go:356] "Generic (PLEG): container finished" podID="3a46f632-7b18-48f7-b24f-8fc3e34974f1" containerID="f5a3f0f67007074a8a8644674dfaded669eca19a8a9d7c7995b39a933ece5814" exitCode=0
Sep 18 22:06:45.881692 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:45.881326    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8" event={"ID":"3a46f632-7b18-48f7-b24f-8fc3e34974f1","Type":"ContainerDied","Data":"f5a3f0f67007074a8a8644674dfaded669eca19a8a9d7c7995b39a933ece5814"}
Sep 18 22:06:46.887714 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:46.887683    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8" event={"ID":"3a46f632-7b18-48f7-b24f-8fc3e34974f1","Type":"ContainerStarted","Data":"9de48f03319a813dc3172f2c1e9427d9638cdf38dcaccedfb69d5e772a5c4ff1"}
Sep 18 22:06:46.888113 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:46.887796    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8"
Sep 18 22:06:46.909463 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:46.909415    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8" podStartSLOduration=1.765206793 podStartE2EDuration="6.90940109s" totalImagesPullingTime="4.074842443s" totalInitContainerRuntime="1.069351854s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:06:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:06:46.908261577 +0000 UTC m=+382.040042659" watchObservedRunningTime="2026-09-18 22:06:46.90940109 +0000 UTC m=+382.041182169"
Sep 18 22:06:57.894062 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:06:57.894022    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8"
Sep 18 22:07:00.542621 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:00.542583    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5fd7755fbb-z6l22"]
Sep 18 22:07:00.549517 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:00.549482    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5fd7755fbb-z6l22"
Sep 18 22:07:00.552745 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:00.552724    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 18 22:07:00.552837 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:00.552744    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 18 22:07:00.552837 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:00.552723    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-7t69b\""
Sep 18 22:07:00.552837 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:00.552724    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 18 22:07:00.561584 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:00.561565    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5fd7755fbb-z6l22"]
Sep 18 22:07:00.703945 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:00.703914    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ace6c0d5-9d12-4514-858b-8783de080784-manager-config\") pod \"lws-controller-manager-5fd7755fbb-z6l22\" (UID: \"ace6c0d5-9d12-4514-858b-8783de080784\") " pod="openshift-lws-operator/lws-controller-manager-5fd7755fbb-z6l22"
Sep 18 22:07:00.704117 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:00.703974    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ace6c0d5-9d12-4514-858b-8783de080784-metrics-cert\") pod \"lws-controller-manager-5fd7755fbb-z6l22\" (UID: \"ace6c0d5-9d12-4514-858b-8783de080784\") " pod="openshift-lws-operator/lws-controller-manager-5fd7755fbb-z6l22"
Sep 18 22:07:00.704117 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:00.704034    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ace6c0d5-9d12-4514-858b-8783de080784-cert\") pod \"lws-controller-manager-5fd7755fbb-z6l22\" (UID: \"ace6c0d5-9d12-4514-858b-8783de080784\") " pod="openshift-lws-operator/lws-controller-manager-5fd7755fbb-z6l22"
Sep 18 22:07:00.704117 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:00.704052    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg222\" (UniqueName: \"kubernetes.io/projected/ace6c0d5-9d12-4514-858b-8783de080784-kube-api-access-zg222\") pod \"lws-controller-manager-5fd7755fbb-z6l22\" (UID: \"ace6c0d5-9d12-4514-858b-8783de080784\") " pod="openshift-lws-operator/lws-controller-manager-5fd7755fbb-z6l22"
Sep 18 22:07:00.805017 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:00.804929    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ace6c0d5-9d12-4514-858b-8783de080784-metrics-cert\") pod \"lws-controller-manager-5fd7755fbb-z6l22\" (UID: \"ace6c0d5-9d12-4514-858b-8783de080784\") " pod="openshift-lws-operator/lws-controller-manager-5fd7755fbb-z6l22"
Sep 18 22:07:00.805017 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:00.804984    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ace6c0d5-9d12-4514-858b-8783de080784-cert\") pod \"lws-controller-manager-5fd7755fbb-z6l22\" (UID: \"ace6c0d5-9d12-4514-858b-8783de080784\") " pod="openshift-lws-operator/lws-controller-manager-5fd7755fbb-z6l22"
Sep 18 22:07:00.805017 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:00.805010    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg222\" (UniqueName: \"kubernetes.io/projected/ace6c0d5-9d12-4514-858b-8783de080784-kube-api-access-zg222\") pod \"lws-controller-manager-5fd7755fbb-z6l22\" (UID: \"ace6c0d5-9d12-4514-858b-8783de080784\") " pod="openshift-lws-operator/lws-controller-manager-5fd7755fbb-z6l22"
Sep 18 22:07:00.805283 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:00.805042    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ace6c0d5-9d12-4514-858b-8783de080784-manager-config\") pod \"lws-controller-manager-5fd7755fbb-z6l22\" (UID: \"ace6c0d5-9d12-4514-858b-8783de080784\") " pod="openshift-lws-operator/lws-controller-manager-5fd7755fbb-z6l22"
Sep 18 22:07:00.805809 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:00.805789    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ace6c0d5-9d12-4514-858b-8783de080784-manager-config\") pod \"lws-controller-manager-5fd7755fbb-z6l22\" (UID: \"ace6c0d5-9d12-4514-858b-8783de080784\") " pod="openshift-lws-operator/lws-controller-manager-5fd7755fbb-z6l22"
Sep 18 22:07:00.807548 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:00.807501    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ace6c0d5-9d12-4514-858b-8783de080784-metrics-cert\") pod \"lws-controller-manager-5fd7755fbb-z6l22\" (UID: \"ace6c0d5-9d12-4514-858b-8783de080784\") " pod="openshift-lws-operator/lws-controller-manager-5fd7755fbb-z6l22"
Sep 18 22:07:00.807651 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:00.807617    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ace6c0d5-9d12-4514-858b-8783de080784-cert\") pod \"lws-controller-manager-5fd7755fbb-z6l22\" (UID: \"ace6c0d5-9d12-4514-858b-8783de080784\") " pod="openshift-lws-operator/lws-controller-manager-5fd7755fbb-z6l22"
Sep 18 22:07:00.817491 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:00.817464    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg222\" (UniqueName: \"kubernetes.io/projected/ace6c0d5-9d12-4514-858b-8783de080784-kube-api-access-zg222\") pod \"lws-controller-manager-5fd7755fbb-z6l22\" (UID: \"ace6c0d5-9d12-4514-858b-8783de080784\") " pod="openshift-lws-operator/lws-controller-manager-5fd7755fbb-z6l22"
Sep 18 22:07:00.858222 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:00.858187    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5fd7755fbb-z6l22"
Sep 18 22:07:01.171267 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:01.171237    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5fd7755fbb-z6l22"]
Sep 18 22:07:01.172892 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:07:01.172860    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podace6c0d5_9d12_4514_858b_8783de080784.slice/crio-cc09a8b37502c1d9f0447b863494d98a74d72b07d8db1e9301c2fb3330ddc303 WatchSource:0}: Error finding container cc09a8b37502c1d9f0447b863494d98a74d72b07d8db1e9301c2fb3330ddc303: Status 404 returned error can't find the container with id cc09a8b37502c1d9f0447b863494d98a74d72b07d8db1e9301c2fb3330ddc303
Sep 18 22:07:01.950842 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:01.950809    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5fd7755fbb-z6l22" event={"ID":"ace6c0d5-9d12-4514-858b-8783de080784","Type":"ContainerStarted","Data":"cc09a8b37502c1d9f0447b863494d98a74d72b07d8db1e9301c2fb3330ddc303"}
Sep 18 22:07:03.966115 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:03.966085    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5fd7755fbb-z6l22" event={"ID":"ace6c0d5-9d12-4514-858b-8783de080784","Type":"ContainerStarted","Data":"a143a18b2b689297da84dcc0477c7d9f6668885b7d3c98d7e726a3f1bca3bc67"}
Sep 18 22:07:03.966488 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:03.966211    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5fd7755fbb-z6l22"
Sep 18 22:07:03.995448 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:03.995397    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5fd7755fbb-z6l22" podStartSLOduration=2.197189647 podStartE2EDuration="3.995382816s" totalImagesPullingTime="1.798193169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:07:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:07:03.994749486 +0000 UTC m=+399.126530569" watchObservedRunningTime="2026-09-18 22:07:03.995382816 +0000 UTC m=+399.127163898"
Sep 18 22:07:05.948995 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:05.948963    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7448578f56-85dg9"]
Sep 18 22:07:11.307362 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:11.307330    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vp2mz"]
Sep 18 22:07:11.310795 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:11.310779    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vp2mz"
Sep 18 22:07:11.313448 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:11.313427    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 18 22:07:11.325825 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:11.325804    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vp2mz"]
Sep 18 22:07:11.490752 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:11.490718    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvvfn\" (UniqueName: \"kubernetes.io/projected/f20298f0-c5ca-4216-baec-f68350aeac3f-kube-api-access-dvvfn\") pod \"model-serving-api-54d89bd5fc-vp2mz\" (UID: \"f20298f0-c5ca-4216-baec-f68350aeac3f\") " pod="opendatahub/model-serving-api-54d89bd5fc-vp2mz"
Sep 18 22:07:11.490910 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:11.490758    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f20298f0-c5ca-4216-baec-f68350aeac3f-tls-certs\") pod \"model-serving-api-54d89bd5fc-vp2mz\" (UID: \"f20298f0-c5ca-4216-baec-f68350aeac3f\") " pod="opendatahub/model-serving-api-54d89bd5fc-vp2mz"
Sep 18 22:07:11.591198 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:11.591118    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvvfn\" (UniqueName: \"kubernetes.io/projected/f20298f0-c5ca-4216-baec-f68350aeac3f-kube-api-access-dvvfn\") pod \"model-serving-api-54d89bd5fc-vp2mz\" (UID: \"f20298f0-c5ca-4216-baec-f68350aeac3f\") " pod="opendatahub/model-serving-api-54d89bd5fc-vp2mz"
Sep 18 22:07:11.591198 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:11.591155    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f20298f0-c5ca-4216-baec-f68350aeac3f-tls-certs\") pod \"model-serving-api-54d89bd5fc-vp2mz\" (UID: \"f20298f0-c5ca-4216-baec-f68350aeac3f\") " pod="opendatahub/model-serving-api-54d89bd5fc-vp2mz"
Sep 18 22:07:11.591379 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:07:11.591247    2574 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 18 22:07:11.591379 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:07:11.591305    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f20298f0-c5ca-4216-baec-f68350aeac3f-tls-certs podName:f20298f0-c5ca-4216-baec-f68350aeac3f nodeName:}" failed. No retries permitted until 2026-09-18 22:07:12.091290671 +0000 UTC m=+407.223071732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f20298f0-c5ca-4216-baec-f68350aeac3f-tls-certs") pod "model-serving-api-54d89bd5fc-vp2mz" (UID: "f20298f0-c5ca-4216-baec-f68350aeac3f") : secret "model-serving-api-tls" not found
Sep 18 22:07:11.605635 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:11.605608    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvvfn\" (UniqueName: \"kubernetes.io/projected/f20298f0-c5ca-4216-baec-f68350aeac3f-kube-api-access-dvvfn\") pod \"model-serving-api-54d89bd5fc-vp2mz\" (UID: \"f20298f0-c5ca-4216-baec-f68350aeac3f\") " pod="opendatahub/model-serving-api-54d89bd5fc-vp2mz"
Sep 18 22:07:12.094731 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:12.094693    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f20298f0-c5ca-4216-baec-f68350aeac3f-tls-certs\") pod \"model-serving-api-54d89bd5fc-vp2mz\" (UID: \"f20298f0-c5ca-4216-baec-f68350aeac3f\") " pod="opendatahub/model-serving-api-54d89bd5fc-vp2mz"
Sep 18 22:07:12.097178 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:12.097160    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f20298f0-c5ca-4216-baec-f68350aeac3f-tls-certs\") pod \"model-serving-api-54d89bd5fc-vp2mz\" (UID: \"f20298f0-c5ca-4216-baec-f68350aeac3f\") " pod="opendatahub/model-serving-api-54d89bd5fc-vp2mz"
Sep 18 22:07:12.219863 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:12.219832    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vp2mz"
Sep 18 22:07:12.490038 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:12.490012    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vp2mz"]
Sep 18 22:07:12.492665 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:07:12.492634    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf20298f0_c5ca_4216_baec_f68350aeac3f.slice/crio-c1ab474f8f6e4d57dfb5c84f6e2b8e864aba7ac9d1be687dd5fbfb14cfee229f WatchSource:0}: Error finding container c1ab474f8f6e4d57dfb5c84f6e2b8e864aba7ac9d1be687dd5fbfb14cfee229f: Status 404 returned error can't find the container with id c1ab474f8f6e4d57dfb5c84f6e2b8e864aba7ac9d1be687dd5fbfb14cfee229f
Sep 18 22:07:13.004522 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:13.004476    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vp2mz" event={"ID":"f20298f0-c5ca-4216-baec-f68350aeac3f","Type":"ContainerStarted","Data":"c1ab474f8f6e4d57dfb5c84f6e2b8e864aba7ac9d1be687dd5fbfb14cfee229f"}
Sep 18 22:07:14.972146 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:14.972110    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5fd7755fbb-z6l22"
Sep 18 22:07:15.016052 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:15.016019    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vp2mz" event={"ID":"f20298f0-c5ca-4216-baec-f68350aeac3f","Type":"ContainerStarted","Data":"8b6325364e892a23772e8a9d64b408e22f444c92ed733a13b54fcbc265260e14"}
Sep 18 22:07:15.016197 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:15.016104    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-vp2mz"
Sep 18 22:07:15.121917 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:15.121819    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-vp2mz" podStartSLOduration=1.843646364 podStartE2EDuration="4.12179987s" totalImagesPullingTime="2.278153506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:07:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:07:15.119415551 +0000 UTC m=+410.251196633" watchObservedRunningTime="2026-09-18 22:07:15.12179987 +0000 UTC m=+410.253580988"
Sep 18 22:07:18.693679 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.693643    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"]
Sep 18 22:07:18.696925 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.696907    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"
Sep 18 22:07:18.701832 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.701810    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 18 22:07:18.701936 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.701814    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 18 22:07:18.702118 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.702096    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 18 22:07:18.702737 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.702712    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 18 22:07:18.702891 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.702871    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6s2nn\""
Sep 18 22:07:18.717007 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.716988    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"]
Sep 18 22:07:18.854272 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.854233    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq7mb\" (UniqueName: \"kubernetes.io/projected/cc447b07-c187-4bf9-8093-727cbd725dad-kube-api-access-pq7mb\") pod \"istiod-openshift-gateway-5677ccb49b-c59ml\" (UID: \"cc447b07-c187-4bf9-8093-727cbd725dad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"
Sep 18 22:07:18.854439 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.854321    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cc447b07-c187-4bf9-8093-727cbd725dad-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-c59ml\" (UID: \"cc447b07-c187-4bf9-8093-727cbd725dad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"
Sep 18 22:07:18.854439 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.854340    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cc447b07-c187-4bf9-8093-727cbd725dad-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-c59ml\" (UID: \"cc447b07-c187-4bf9-8093-727cbd725dad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"
Sep 18 22:07:18.854439 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.854366    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc447b07-c187-4bf9-8093-727cbd725dad-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-c59ml\" (UID: \"cc447b07-c187-4bf9-8093-727cbd725dad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"
Sep 18 22:07:18.854439 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.854393    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cc447b07-c187-4bf9-8093-727cbd725dad-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-c59ml\" (UID: \"cc447b07-c187-4bf9-8093-727cbd725dad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"
Sep 18 22:07:18.854439 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.854417    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc447b07-c187-4bf9-8093-727cbd725dad-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-c59ml\" (UID: \"cc447b07-c187-4bf9-8093-727cbd725dad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"
Sep 18 22:07:18.854439 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.854431    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cc447b07-c187-4bf9-8093-727cbd725dad-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-c59ml\" (UID: \"cc447b07-c187-4bf9-8093-727cbd725dad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"
Sep 18 22:07:18.955150 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.955073    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cc447b07-c187-4bf9-8093-727cbd725dad-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-c59ml\" (UID: \"cc447b07-c187-4bf9-8093-727cbd725dad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"
Sep 18 22:07:18.955150 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.955109    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cc447b07-c187-4bf9-8093-727cbd725dad-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-c59ml\" (UID: \"cc447b07-c187-4bf9-8093-727cbd725dad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"
Sep 18 22:07:18.955150 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.955138    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc447b07-c187-4bf9-8093-727cbd725dad-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-c59ml\" (UID: \"cc447b07-c187-4bf9-8093-727cbd725dad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"
Sep 18 22:07:18.955372 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.955169    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cc447b07-c187-4bf9-8093-727cbd725dad-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-c59ml\" (UID: \"cc447b07-c187-4bf9-8093-727cbd725dad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"
Sep 18 22:07:18.955372 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.955198    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc447b07-c187-4bf9-8093-727cbd725dad-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-c59ml\" (UID: \"cc447b07-c187-4bf9-8093-727cbd725dad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"
Sep 18 22:07:18.955372 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.955221    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cc447b07-c187-4bf9-8093-727cbd725dad-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-c59ml\" (UID: \"cc447b07-c187-4bf9-8093-727cbd725dad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"
Sep 18 22:07:18.955372 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.955259    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq7mb\" (UniqueName: \"kubernetes.io/projected/cc447b07-c187-4bf9-8093-727cbd725dad-kube-api-access-pq7mb\") pod \"istiod-openshift-gateway-5677ccb49b-c59ml\" (UID: \"cc447b07-c187-4bf9-8093-727cbd725dad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"
Sep 18 22:07:18.956214 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.956185    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cc447b07-c187-4bf9-8093-727cbd725dad-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-c59ml\" (UID: \"cc447b07-c187-4bf9-8093-727cbd725dad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"
Sep 18 22:07:18.957763 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.957731    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cc447b07-c187-4bf9-8093-727cbd725dad-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-c59ml\" (UID: \"cc447b07-c187-4bf9-8093-727cbd725dad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"
Sep 18 22:07:18.957875 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.957795    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cc447b07-c187-4bf9-8093-727cbd725dad-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-c59ml\" (UID: \"cc447b07-c187-4bf9-8093-727cbd725dad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"
Sep 18 22:07:18.957875 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.957803    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc447b07-c187-4bf9-8093-727cbd725dad-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-c59ml\" (UID: \"cc447b07-c187-4bf9-8093-727cbd725dad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"
Sep 18 22:07:18.957875 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.957851    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cc447b07-c187-4bf9-8093-727cbd725dad-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-c59ml\" (UID: \"cc447b07-c187-4bf9-8093-727cbd725dad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"
Sep 18 22:07:18.969614 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.969590    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc447b07-c187-4bf9-8093-727cbd725dad-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-c59ml\" (UID: \"cc447b07-c187-4bf9-8093-727cbd725dad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"
Sep 18 22:07:18.969826 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:18.969810    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq7mb\" (UniqueName: \"kubernetes.io/projected/cc447b07-c187-4bf9-8093-727cbd725dad-kube-api-access-pq7mb\") pod \"istiod-openshift-gateway-5677ccb49b-c59ml\" (UID: \"cc447b07-c187-4bf9-8093-727cbd725dad\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"
Sep 18 22:07:19.005570 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:19.005546    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"
Sep 18 22:07:19.328634 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:19.328607    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"]
Sep 18 22:07:19.330055 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:07:19.330033    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc447b07_c187_4bf9_8093_727cbd725dad.slice/crio-74f7d233c535bab0052fee18a38f3b30ad671e143bac674bcded9303fac854ff WatchSource:0}: Error finding container 74f7d233c535bab0052fee18a38f3b30ad671e143bac674bcded9303fac854ff: Status 404 returned error can't find the container with id 74f7d233c535bab0052fee18a38f3b30ad671e143bac674bcded9303fac854ff
Sep 18 22:07:20.042245 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:20.042204    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml" event={"ID":"cc447b07-c187-4bf9-8093-727cbd725dad","Type":"ContainerStarted","Data":"74f7d233c535bab0052fee18a38f3b30ad671e143bac674bcded9303fac854ff"}
Sep 18 22:07:21.548302 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:21.548267    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 18 22:07:21.548566 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:21.548334    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 18 22:07:22.052786 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:22.052731    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml" event={"ID":"cc447b07-c187-4bf9-8093-727cbd725dad","Type":"ContainerStarted","Data":"63484b035074f9d5465492ed3767992474a5cd84bcd01b03bdbe4a3067f3d0c1"}
Sep 18 22:07:22.052955 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:22.052847    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"
Sep 18 22:07:22.054302 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:22.054275    2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-c59ml container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 22:07:22.054407 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:22.054329    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml" podUID="cc447b07-c187-4bf9-8093-727cbd725dad" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 22:07:22.166480 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:22.166421    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml" podStartSLOduration=1.950437185 podStartE2EDuration="4.166401675s" totalImagesPullingTime="2.21596449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:07:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:07:22.16533559 +0000 UTC m=+417.297116697" watchObservedRunningTime="2026-09-18 22:07:22.166401675 +0000 UTC m=+417.298182758"
Sep 18 22:07:23.057565 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:23.057536    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-c59ml"
Sep 18 22:07:26.024291 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:26.024263    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-vp2mz"
Sep 18 22:07:30.968114 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:30.968045    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7448578f56-85dg9" podUID="4d8467f9-2a70-400c-93f5-5b230d8f3476" containerName="console" containerID="cri-o://d50eee3fea499bd8ccdea276f6a9a17d1f03cddcde35cc580174c9ded2733723" gracePeriod=15
Sep 18 22:07:31.093870 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:31.093844    2574 generic.go:356] "Generic (PLEG): container finished" podID="4d8467f9-2a70-400c-93f5-5b230d8f3476" containerID="d50eee3fea499bd8ccdea276f6a9a17d1f03cddcde35cc580174c9ded2733723" exitCode=0
Sep 18 22:07:31.094000 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:31.093914    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7448578f56-85dg9" event={"ID":"4d8467f9-2a70-400c-93f5-5b230d8f3476","Type":"ContainerDied","Data":"d50eee3fea499bd8ccdea276f6a9a17d1f03cddcde35cc580174c9ded2733723"}
Sep 18 22:07:31.205123 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:31.205098    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:07:31.249975 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:31.249907    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8467f9-2a70-400c-93f5-5b230d8f3476-service-ca\") pod \"4d8467f9-2a70-400c-93f5-5b230d8f3476\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") "
Sep 18 22:07:31.249975 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:31.249947    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d8467f9-2a70-400c-93f5-5b230d8f3476-console-config\") pod \"4d8467f9-2a70-400c-93f5-5b230d8f3476\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") "
Sep 18 22:07:31.249975 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:31.249967    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d8467f9-2a70-400c-93f5-5b230d8f3476-oauth-serving-cert\") pod \"4d8467f9-2a70-400c-93f5-5b230d8f3476\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") "
Sep 18 22:07:31.250202 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:31.249994    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcbxc\" (UniqueName: \"kubernetes.io/projected/4d8467f9-2a70-400c-93f5-5b230d8f3476-kube-api-access-pcbxc\") pod \"4d8467f9-2a70-400c-93f5-5b230d8f3476\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") "
Sep 18 22:07:31.250202 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:31.250028    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d8467f9-2a70-400c-93f5-5b230d8f3476-console-oauth-config\") pod \"4d8467f9-2a70-400c-93f5-5b230d8f3476\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") "
Sep 18 22:07:31.250202 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:31.250066    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d8467f9-2a70-400c-93f5-5b230d8f3476-trusted-ca-bundle\") pod \"4d8467f9-2a70-400c-93f5-5b230d8f3476\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") "
Sep 18 22:07:31.250335 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:31.250222    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d8467f9-2a70-400c-93f5-5b230d8f3476-console-serving-cert\") pod \"4d8467f9-2a70-400c-93f5-5b230d8f3476\" (UID: \"4d8467f9-2a70-400c-93f5-5b230d8f3476\") "
Sep 18 22:07:31.250396 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:31.250355    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d8467f9-2a70-400c-93f5-5b230d8f3476-service-ca" (OuterVolumeSpecName: "service-ca") pod "4d8467f9-2a70-400c-93f5-5b230d8f3476" (UID: "4d8467f9-2a70-400c-93f5-5b230d8f3476"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:07:31.250450 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:31.250392    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d8467f9-2a70-400c-93f5-5b230d8f3476-console-config" (OuterVolumeSpecName: "console-config") pod "4d8467f9-2a70-400c-93f5-5b230d8f3476" (UID: "4d8467f9-2a70-400c-93f5-5b230d8f3476"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:07:31.250450 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:31.250404    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d8467f9-2a70-400c-93f5-5b230d8f3476-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4d8467f9-2a70-400c-93f5-5b230d8f3476" (UID: "4d8467f9-2a70-400c-93f5-5b230d8f3476"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:07:31.250701 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:31.250664    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d8467f9-2a70-400c-93f5-5b230d8f3476-service-ca\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:07:31.250701 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:31.250693    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d8467f9-2a70-400c-93f5-5b230d8f3476-console-config\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:07:31.250838 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:31.250707    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d8467f9-2a70-400c-93f5-5b230d8f3476-oauth-serving-cert\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:07:31.250838 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:31.250758    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d8467f9-2a70-400c-93f5-5b230d8f3476-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4d8467f9-2a70-400c-93f5-5b230d8f3476" (UID: "4d8467f9-2a70-400c-93f5-5b230d8f3476"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:07:31.252405 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:31.252379    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d8467f9-2a70-400c-93f5-5b230d8f3476-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4d8467f9-2a70-400c-93f5-5b230d8f3476" (UID: "4d8467f9-2a70-400c-93f5-5b230d8f3476"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:07:31.252493 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:31.252427    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d8467f9-2a70-400c-93f5-5b230d8f3476-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4d8467f9-2a70-400c-93f5-5b230d8f3476" (UID: "4d8467f9-2a70-400c-93f5-5b230d8f3476"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:07:31.252565 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:31.252533    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d8467f9-2a70-400c-93f5-5b230d8f3476-kube-api-access-pcbxc" (OuterVolumeSpecName: "kube-api-access-pcbxc") pod "4d8467f9-2a70-400c-93f5-5b230d8f3476" (UID: "4d8467f9-2a70-400c-93f5-5b230d8f3476"). InnerVolumeSpecName "kube-api-access-pcbxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:07:31.351098 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:31.351069    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcbxc\" (UniqueName: \"kubernetes.io/projected/4d8467f9-2a70-400c-93f5-5b230d8f3476-kube-api-access-pcbxc\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:07:31.351098 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:31.351089    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d8467f9-2a70-400c-93f5-5b230d8f3476-console-oauth-config\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:07:31.351098 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:31.351099    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d8467f9-2a70-400c-93f5-5b230d8f3476-trusted-ca-bundle\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:07:31.351286 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:31.351107    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d8467f9-2a70-400c-93f5-5b230d8f3476-console-serving-cert\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:07:32.102131 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:32.102101    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7448578f56-85dg9"
Sep 18 22:07:32.102601 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:32.102129    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7448578f56-85dg9" event={"ID":"4d8467f9-2a70-400c-93f5-5b230d8f3476","Type":"ContainerDied","Data":"4634b1d9d6046631840fe050c1243d43d5f2cc14a9d2b618c0f74e98c1692e74"}
Sep 18 22:07:32.102601 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:32.102189    2574 scope.go:117] "RemoveContainer" containerID="d50eee3fea499bd8ccdea276f6a9a17d1f03cddcde35cc580174c9ded2733723"
Sep 18 22:07:32.136631 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:32.136598    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7448578f56-85dg9"]
Sep 18 22:07:32.144734 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:32.144696    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7448578f56-85dg9"]
Sep 18 22:07:33.345948 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:07:33.345917    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d8467f9-2a70-400c-93f5-5b230d8f3476" path="/var/lib/kubelet/pods/4d8467f9-2a70-400c-93f5-5b230d8f3476/volumes"
Sep 18 22:10:06.113753 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:06.113718    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6865b5c455-bl292"]
Sep 18 22:10:06.114258 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:06.114179    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d8467f9-2a70-400c-93f5-5b230d8f3476" containerName="console"
Sep 18 22:10:06.114258 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:06.114197    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d8467f9-2a70-400c-93f5-5b230d8f3476" containerName="console"
Sep 18 22:10:06.114368 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:06.114289    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d8467f9-2a70-400c-93f5-5b230d8f3476" containerName="console"
Sep 18 22:10:06.117150 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:06.117131    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6865b5c455-bl292"
Sep 18 22:10:06.123600 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:06.123239    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ww7bb\""
Sep 18 22:10:06.123754 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:06.123735    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 18 22:10:06.123816 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:06.123797    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 18 22:10:06.124075 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:06.124054    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 18 22:10:06.144085 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:06.144057    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6865b5c455-bl292"]
Sep 18 22:10:06.197078 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:06.197042    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm5m4\" (UniqueName: \"kubernetes.io/projected/35fc554d-0fa5-4de0-8424-35d5c6a3fe7b-kube-api-access-dm5m4\") pod \"maas-controller-6865b5c455-bl292\" (UID: \"35fc554d-0fa5-4de0-8424-35d5c6a3fe7b\") " pod="opendatahub/maas-controller-6865b5c455-bl292"
Sep 18 22:10:06.197078 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:06.197080    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35fc554d-0fa5-4de0-8424-35d5c6a3fe7b-metrics-certs\") pod \"maas-controller-6865b5c455-bl292\" (UID: \"35fc554d-0fa5-4de0-8424-35d5c6a3fe7b\") " pod="opendatahub/maas-controller-6865b5c455-bl292"
Sep 18 22:10:06.197323 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:06.197171    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35fc554d-0fa5-4de0-8424-35d5c6a3fe7b-webhook-cert\") pod \"maas-controller-6865b5c455-bl292\" (UID: \"35fc554d-0fa5-4de0-8424-35d5c6a3fe7b\") " pod="opendatahub/maas-controller-6865b5c455-bl292"
Sep 18 22:10:06.298342 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:06.298304    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35fc554d-0fa5-4de0-8424-35d5c6a3fe7b-webhook-cert\") pod \"maas-controller-6865b5c455-bl292\" (UID: \"35fc554d-0fa5-4de0-8424-35d5c6a3fe7b\") " pod="opendatahub/maas-controller-6865b5c455-bl292"
Sep 18 22:10:06.298570 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:06.298387    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm5m4\" (UniqueName: \"kubernetes.io/projected/35fc554d-0fa5-4de0-8424-35d5c6a3fe7b-kube-api-access-dm5m4\") pod \"maas-controller-6865b5c455-bl292\" (UID: \"35fc554d-0fa5-4de0-8424-35d5c6a3fe7b\") " pod="opendatahub/maas-controller-6865b5c455-bl292"
Sep 18 22:10:06.298570 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:06.298414    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35fc554d-0fa5-4de0-8424-35d5c6a3fe7b-metrics-certs\") pod \"maas-controller-6865b5c455-bl292\" (UID: \"35fc554d-0fa5-4de0-8424-35d5c6a3fe7b\") " pod="opendatahub/maas-controller-6865b5c455-bl292"
Sep 18 22:10:06.301006 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:06.300981    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35fc554d-0fa5-4de0-8424-35d5c6a3fe7b-webhook-cert\") pod \"maas-controller-6865b5c455-bl292\" (UID: \"35fc554d-0fa5-4de0-8424-35d5c6a3fe7b\") " pod="opendatahub/maas-controller-6865b5c455-bl292"
Sep 18 22:10:06.301116 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:06.301030    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35fc554d-0fa5-4de0-8424-35d5c6a3fe7b-metrics-certs\") pod \"maas-controller-6865b5c455-bl292\" (UID: \"35fc554d-0fa5-4de0-8424-35d5c6a3fe7b\") " pod="opendatahub/maas-controller-6865b5c455-bl292"
Sep 18 22:10:06.312162 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:06.312139    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm5m4\" (UniqueName: \"kubernetes.io/projected/35fc554d-0fa5-4de0-8424-35d5c6a3fe7b-kube-api-access-dm5m4\") pod \"maas-controller-6865b5c455-bl292\" (UID: \"35fc554d-0fa5-4de0-8424-35d5c6a3fe7b\") " pod="opendatahub/maas-controller-6865b5c455-bl292"
Sep 18 22:10:06.428518 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:06.428473    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6865b5c455-bl292"
Sep 18 22:10:06.707888 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:06.707819    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6865b5c455-bl292"]
Sep 18 22:10:06.711345 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:10:06.711319    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35fc554d_0fa5_4de0_8424_35d5c6a3fe7b.slice/crio-aaad1ae795b960e237035c53ea72b7b898f32f996f3a5db39b717fcf98cbfec5 WatchSource:0}: Error finding container aaad1ae795b960e237035c53ea72b7b898f32f996f3a5db39b717fcf98cbfec5: Status 404 returned error can't find the container with id aaad1ae795b960e237035c53ea72b7b898f32f996f3a5db39b717fcf98cbfec5
Sep 18 22:10:06.753876 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:06.753838    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6865b5c455-bl292" event={"ID":"35fc554d-0fa5-4de0-8424-35d5c6a3fe7b","Type":"ContainerStarted","Data":"aaad1ae795b960e237035c53ea72b7b898f32f996f3a5db39b717fcf98cbfec5"}
Sep 18 22:10:09.771109 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:09.771073    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6865b5c455-bl292" event={"ID":"35fc554d-0fa5-4de0-8424-35d5c6a3fe7b","Type":"ContainerStarted","Data":"74d75e2750884f836c8466b7de594b27b0e69851322256f1397b9e3f3f83eb7f"}
Sep 18 22:10:09.771542 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:09.771160    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6865b5c455-bl292"
Sep 18 22:10:09.799180 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:09.799124    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6865b5c455-bl292" podStartSLOduration=1.442944142 podStartE2EDuration="3.799109364s" totalImagesPullingTime="2.356165222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:10:09.798598389 +0000 UTC m=+584.930379472" watchObservedRunningTime="2026-09-18 22:10:09.799109364 +0000 UTC m=+584.930890443"
Sep 18 22:10:20.405475 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:20.405441    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6865b5c455-bl292"]
Sep 18 22:10:20.405903 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:20.405711    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6865b5c455-bl292" podUID="35fc554d-0fa5-4de0-8424-35d5c6a3fe7b" containerName="manager" containerID="cri-o://74d75e2750884f836c8466b7de594b27b0e69851322256f1397b9e3f3f83eb7f" gracePeriod=30
Sep 18 22:10:20.407580 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:20.407555    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6865b5c455-bl292"
Sep 18 22:10:20.642859 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:20.642834    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6865b5c455-bl292"
Sep 18 22:10:20.822108 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:20.822073    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35fc554d-0fa5-4de0-8424-35d5c6a3fe7b-metrics-certs\") pod \"35fc554d-0fa5-4de0-8424-35d5c6a3fe7b\" (UID: \"35fc554d-0fa5-4de0-8424-35d5c6a3fe7b\") "
Sep 18 22:10:20.822108 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:20.822112    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35fc554d-0fa5-4de0-8424-35d5c6a3fe7b-webhook-cert\") pod \"35fc554d-0fa5-4de0-8424-35d5c6a3fe7b\" (UID: \"35fc554d-0fa5-4de0-8424-35d5c6a3fe7b\") "
Sep 18 22:10:20.822380 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:20.822141    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dm5m4\" (UniqueName: \"kubernetes.io/projected/35fc554d-0fa5-4de0-8424-35d5c6a3fe7b-kube-api-access-dm5m4\") pod \"35fc554d-0fa5-4de0-8424-35d5c6a3fe7b\" (UID: \"35fc554d-0fa5-4de0-8424-35d5c6a3fe7b\") "
Sep 18 22:10:20.824558 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:20.824524    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35fc554d-0fa5-4de0-8424-35d5c6a3fe7b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "35fc554d-0fa5-4de0-8424-35d5c6a3fe7b" (UID: "35fc554d-0fa5-4de0-8424-35d5c6a3fe7b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:10:20.824660 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:20.824555    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35fc554d-0fa5-4de0-8424-35d5c6a3fe7b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "35fc554d-0fa5-4de0-8424-35d5c6a3fe7b" (UID: "35fc554d-0fa5-4de0-8424-35d5c6a3fe7b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:10:20.824660 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:20.824563    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35fc554d-0fa5-4de0-8424-35d5c6a3fe7b-kube-api-access-dm5m4" (OuterVolumeSpecName: "kube-api-access-dm5m4") pod "35fc554d-0fa5-4de0-8424-35d5c6a3fe7b" (UID: "35fc554d-0fa5-4de0-8424-35d5c6a3fe7b"). InnerVolumeSpecName "kube-api-access-dm5m4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:10:20.831881 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:20.831854    2574 generic.go:356] "Generic (PLEG): container finished" podID="35fc554d-0fa5-4de0-8424-35d5c6a3fe7b" containerID="74d75e2750884f836c8466b7de594b27b0e69851322256f1397b9e3f3f83eb7f" exitCode=0
Sep 18 22:10:20.831969 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:20.831916    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6865b5c455-bl292"
Sep 18 22:10:20.831969 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:20.831940    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6865b5c455-bl292" event={"ID":"35fc554d-0fa5-4de0-8424-35d5c6a3fe7b","Type":"ContainerDied","Data":"74d75e2750884f836c8466b7de594b27b0e69851322256f1397b9e3f3f83eb7f"}
Sep 18 22:10:20.832063 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:20.832001    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6865b5c455-bl292" event={"ID":"35fc554d-0fa5-4de0-8424-35d5c6a3fe7b","Type":"ContainerDied","Data":"aaad1ae795b960e237035c53ea72b7b898f32f996f3a5db39b717fcf98cbfec5"}
Sep 18 22:10:20.832063 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:20.832023    2574 scope.go:117] "RemoveContainer" containerID="74d75e2750884f836c8466b7de594b27b0e69851322256f1397b9e3f3f83eb7f"
Sep 18 22:10:20.844236 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:20.844217    2574 scope.go:117] "RemoveContainer" containerID="74d75e2750884f836c8466b7de594b27b0e69851322256f1397b9e3f3f83eb7f"
Sep 18 22:10:20.844483 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:10:20.844470    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74d75e2750884f836c8466b7de594b27b0e69851322256f1397b9e3f3f83eb7f\": container with ID starting with 74d75e2750884f836c8466b7de594b27b0e69851322256f1397b9e3f3f83eb7f not found: ID does not exist" containerID="74d75e2750884f836c8466b7de594b27b0e69851322256f1397b9e3f3f83eb7f"
Sep 18 22:10:20.844557 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:20.844492    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74d75e2750884f836c8466b7de594b27b0e69851322256f1397b9e3f3f83eb7f"} err="failed to get container status \"74d75e2750884f836c8466b7de594b27b0e69851322256f1397b9e3f3f83eb7f\": rpc error: code = NotFound desc = could not find container \"74d75e2750884f836c8466b7de594b27b0e69851322256f1397b9e3f3f83eb7f\": container with ID starting with 74d75e2750884f836c8466b7de594b27b0e69851322256f1397b9e3f3f83eb7f not found: ID does not exist"
Sep 18 22:10:20.855888 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:20.855862    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6865b5c455-bl292"]
Sep 18 22:10:20.861049 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:20.861021    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6865b5c455-bl292"]
Sep 18 22:10:20.922970 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:20.922931    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35fc554d-0fa5-4de0-8424-35d5c6a3fe7b-metrics-certs\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:10:20.922970 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:20.922960    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35fc554d-0fa5-4de0-8424-35d5c6a3fe7b-webhook-cert\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:10:20.922970 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:20.922969    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dm5m4\" (UniqueName: \"kubernetes.io/projected/35fc554d-0fa5-4de0-8424-35d5c6a3fe7b-kube-api-access-dm5m4\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:10:21.345053 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:21.345018    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35fc554d-0fa5-4de0-8424-35d5c6a3fe7b" path="/var/lib/kubelet/pods/35fc554d-0fa5-4de0-8424-35d5c6a3fe7b/volumes"
Sep 18 22:10:44.300567 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:44.300531    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-z62nt"]
Sep 18 22:10:44.301069 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:44.300827    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35fc554d-0fa5-4de0-8424-35d5c6a3fe7b" containerName="manager"
Sep 18 22:10:44.301069 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:44.300838    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="35fc554d-0fa5-4de0-8424-35d5c6a3fe7b" containerName="manager"
Sep 18 22:10:44.301069 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:44.300908    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="35fc554d-0fa5-4de0-8424-35d5c6a3fe7b" containerName="manager"
Sep 18 22:10:44.306537 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:44.306488    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-z62nt"
Sep 18 22:10:44.333864 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:44.333836    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-rdjmp\""
Sep 18 22:10:44.334245 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:44.334226    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 18 22:10:44.335576 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:44.335554    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-z62nt"]
Sep 18 22:10:44.403198 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:44.403168    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d3bcc3f-e11d-43d7-b7a9-6204cbd617ac-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-z62nt\" (UID: \"8d3bcc3f-e11d-43d7-b7a9-6204cbd617ac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-z62nt"
Sep 18 22:10:44.403465 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:44.403430    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4rc5\" (UniqueName: \"kubernetes.io/projected/8d3bcc3f-e11d-43d7-b7a9-6204cbd617ac-kube-api-access-b4rc5\") pod \"payload-processing-5b54b7fbb7-z62nt\" (UID: \"8d3bcc3f-e11d-43d7-b7a9-6204cbd617ac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-z62nt"
Sep 18 22:10:44.504855 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:44.504819    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4rc5\" (UniqueName: \"kubernetes.io/projected/8d3bcc3f-e11d-43d7-b7a9-6204cbd617ac-kube-api-access-b4rc5\") pod \"payload-processing-5b54b7fbb7-z62nt\" (UID: \"8d3bcc3f-e11d-43d7-b7a9-6204cbd617ac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-z62nt"
Sep 18 22:10:44.505056 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:44.504874    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d3bcc3f-e11d-43d7-b7a9-6204cbd617ac-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-z62nt\" (UID: \"8d3bcc3f-e11d-43d7-b7a9-6204cbd617ac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-z62nt"
Sep 18 22:10:44.505583 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:44.505563    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d3bcc3f-e11d-43d7-b7a9-6204cbd617ac-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-z62nt\" (UID: \"8d3bcc3f-e11d-43d7-b7a9-6204cbd617ac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-z62nt"
Sep 18 22:10:44.523207 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:44.523177    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4rc5\" (UniqueName: \"kubernetes.io/projected/8d3bcc3f-e11d-43d7-b7a9-6204cbd617ac-kube-api-access-b4rc5\") pod \"payload-processing-5b54b7fbb7-z62nt\" (UID: \"8d3bcc3f-e11d-43d7-b7a9-6204cbd617ac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-z62nt"
Sep 18 22:10:44.616591 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:44.616488    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-z62nt"
Sep 18 22:10:44.907366 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:44.907342    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-z62nt"]
Sep 18 22:10:44.909999 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:10:44.909964    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d3bcc3f_e11d_43d7_b7a9_6204cbd617ac.slice/crio-a47462cbe1b24af60a0392705f982abac61cfb69ea439c95db9c4a2be93e2e6d WatchSource:0}: Error finding container a47462cbe1b24af60a0392705f982abac61cfb69ea439c95db9c4a2be93e2e6d: Status 404 returned error can't find the container with id a47462cbe1b24af60a0392705f982abac61cfb69ea439c95db9c4a2be93e2e6d
Sep 18 22:10:44.939715 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:44.939683    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-z62nt" event={"ID":"8d3bcc3f-e11d-43d7-b7a9-6204cbd617ac","Type":"ContainerStarted","Data":"a47462cbe1b24af60a0392705f982abac61cfb69ea439c95db9c4a2be93e2e6d"}
Sep 18 22:10:46.951119 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:46.951080    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-z62nt" event={"ID":"8d3bcc3f-e11d-43d7-b7a9-6204cbd617ac","Type":"ContainerStarted","Data":"272116bda156b16eeb640a15e0b5eafe9df7ae77668a693df3e549aea26a69f4"}
Sep 18 22:10:46.951553 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:46.951200    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-z62nt"
Sep 18 22:10:46.980488 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:46.980431    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-z62nt" podStartSLOduration=1.615252905 podStartE2EDuration="2.98041692s" totalImagesPullingTime="1.365164015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:10:46.97906643 +0000 UTC m=+622.110847513" watchObservedRunningTime="2026-09-18 22:10:46.98041692 +0000 UTC m=+622.112198002"
Sep 18 22:10:57.957075 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:10:57.957038    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-z62nt"
Sep 18 22:11:32.300244 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.300216    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"]
Sep 18 22:11:32.304513 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.304490    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"
Sep 18 22:11:32.307757 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.307736    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wjjvs\""
Sep 18 22:11:32.308650 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.308622    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 18 22:11:32.308753 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.308676    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 18 22:11:32.308753 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.308709    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 18 22:11:32.314029 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.314008    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"]
Sep 18 22:11:32.385160 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.385129    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ztxpg\" (UID: \"1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"
Sep 18 22:11:32.385308 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.385169    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76xsh\" (UniqueName: \"kubernetes.io/projected/1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7-kube-api-access-76xsh\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ztxpg\" (UID: \"1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"
Sep 18 22:11:32.385308 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.385201    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ztxpg\" (UID: \"1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"
Sep 18 22:11:32.385308 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.385236    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ztxpg\" (UID: \"1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"
Sep 18 22:11:32.385308 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.385269    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ztxpg\" (UID: \"1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"
Sep 18 22:11:32.385460 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.385309    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ztxpg\" (UID: \"1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"
Sep 18 22:11:32.486239 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.486201    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ztxpg\" (UID: \"1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"
Sep 18 22:11:32.486408 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.486272    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ztxpg\" (UID: \"1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"
Sep 18 22:11:32.486408 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.486295    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76xsh\" (UniqueName: \"kubernetes.io/projected/1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7-kube-api-access-76xsh\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ztxpg\" (UID: \"1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"
Sep 18 22:11:32.486408 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.486328    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ztxpg\" (UID: \"1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"
Sep 18 22:11:32.486408 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.486349    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ztxpg\" (UID: \"1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"
Sep 18 22:11:32.486408 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.486372    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ztxpg\" (UID: \"1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"
Sep 18 22:11:32.486710 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.486689    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ztxpg\" (UID: \"1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"
Sep 18 22:11:32.486771 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.486746    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ztxpg\" (UID: \"1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"
Sep 18 22:11:32.486822 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.486777    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ztxpg\" (UID: \"1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"
Sep 18 22:11:32.488689 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.488663    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ztxpg\" (UID: \"1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"
Sep 18 22:11:32.488923 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.488906    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ztxpg\" (UID: \"1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"
Sep 18 22:11:32.494556 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.494535    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76xsh\" (UniqueName: \"kubernetes.io/projected/1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7-kube-api-access-76xsh\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ztxpg\" (UID: \"1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"
Sep 18 22:11:32.615737 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.615669    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"
Sep 18 22:11:32.894186 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.894163    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"]
Sep 18 22:11:32.896090 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:11:32.896062    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fd0cc7d_54d0_4cf6_82f6_a1b5610713c7.slice/crio-4c320e33ccd1c810dc534eb77a7e6a251b296ee23ae86854e134cb630b18eade WatchSource:0}: Error finding container 4c320e33ccd1c810dc534eb77a7e6a251b296ee23ae86854e134cb630b18eade: Status 404 returned error can't find the container with id 4c320e33ccd1c810dc534eb77a7e6a251b296ee23ae86854e134cb630b18eade
Sep 18 22:11:32.897320 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:32.897302    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 22:11:33.147232 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:33.147148    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg" event={"ID":"1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7","Type":"ContainerStarted","Data":"4c320e33ccd1c810dc534eb77a7e6a251b296ee23ae86854e134cb630b18eade"}
Sep 18 22:11:34.153696 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:34.153606    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg" event={"ID":"1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7","Type":"ContainerStarted","Data":"885c3e5ac0c57b155cdd2f32e6ad6b2adfa9d5708dc489e76eede2be770d7485"}
Sep 18 22:11:34.177301 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:34.177254    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg" podStartSLOduration=1.208035076 podStartE2EDuration="2.17723864s" totalImagesPullingTime="969.203564ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:11:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:11:34.176016505 +0000 UTC m=+669.307797611" watchObservedRunningTime="2026-09-18 22:11:34.17723864 +0000 UTC m=+669.309019721"
Sep 18 22:11:42.616135 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:42.616096    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"
Sep 18 22:11:42.616543 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:42.616166    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"
Sep 18 22:11:42.628670 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:42.628646    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"
Sep 18 22:11:43.202717 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:11:43.202690    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ztxpg"
Sep 18 22:12:08.131943 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:08.131907    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"]
Sep 18 22:12:08.135270 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:08.135253    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"
Sep 18 22:12:08.137570 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:08.137543    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 18 22:12:08.152692 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:08.152669    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"]
Sep 18 22:12:08.287946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:08.287914    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj7bz\" (UniqueName: \"kubernetes.io/projected/67ecb6fa-6a71-4686-baf8-c7847be6eef9-kube-api-access-tj7bz\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbdqg\" (UID: \"67ecb6fa-6a71-4686-baf8-c7847be6eef9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"
Sep 18 22:12:08.288091 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:08.287956    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67ecb6fa-6a71-4686-baf8-c7847be6eef9-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbdqg\" (UID: \"67ecb6fa-6a71-4686-baf8-c7847be6eef9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"
Sep 18 22:12:08.288091 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:08.288042    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67ecb6fa-6a71-4686-baf8-c7847be6eef9-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbdqg\" (UID: \"67ecb6fa-6a71-4686-baf8-c7847be6eef9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"
Sep 18 22:12:08.288091 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:08.288083    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67ecb6fa-6a71-4686-baf8-c7847be6eef9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbdqg\" (UID: \"67ecb6fa-6a71-4686-baf8-c7847be6eef9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"
Sep 18 22:12:08.288196 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:08.288128    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67ecb6fa-6a71-4686-baf8-c7847be6eef9-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbdqg\" (UID: \"67ecb6fa-6a71-4686-baf8-c7847be6eef9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"
Sep 18 22:12:08.288230 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:08.288201    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67ecb6fa-6a71-4686-baf8-c7847be6eef9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbdqg\" (UID: \"67ecb6fa-6a71-4686-baf8-c7847be6eef9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"
Sep 18 22:12:08.389409 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:08.389333    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67ecb6fa-6a71-4686-baf8-c7847be6eef9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbdqg\" (UID: \"67ecb6fa-6a71-4686-baf8-c7847be6eef9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"
Sep 18 22:12:08.389409 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:08.389367    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj7bz\" (UniqueName: \"kubernetes.io/projected/67ecb6fa-6a71-4686-baf8-c7847be6eef9-kube-api-access-tj7bz\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbdqg\" (UID: \"67ecb6fa-6a71-4686-baf8-c7847be6eef9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"
Sep 18 22:12:08.389409 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:08.389388    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67ecb6fa-6a71-4686-baf8-c7847be6eef9-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbdqg\" (UID: \"67ecb6fa-6a71-4686-baf8-c7847be6eef9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"
Sep 18 22:12:08.389669 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:08.389527    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67ecb6fa-6a71-4686-baf8-c7847be6eef9-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbdqg\" (UID: \"67ecb6fa-6a71-4686-baf8-c7847be6eef9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"
Sep 18 22:12:08.389669 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:08.389569    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67ecb6fa-6a71-4686-baf8-c7847be6eef9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbdqg\" (UID: \"67ecb6fa-6a71-4686-baf8-c7847be6eef9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"
Sep 18 22:12:08.389669 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:08.389606    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67ecb6fa-6a71-4686-baf8-c7847be6eef9-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbdqg\" (UID: \"67ecb6fa-6a71-4686-baf8-c7847be6eef9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"
Sep 18 22:12:08.389779 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:08.389729    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67ecb6fa-6a71-4686-baf8-c7847be6eef9-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbdqg\" (UID: \"67ecb6fa-6a71-4686-baf8-c7847be6eef9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"
Sep 18 22:12:08.390004 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:08.389979    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67ecb6fa-6a71-4686-baf8-c7847be6eef9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbdqg\" (UID: \"67ecb6fa-6a71-4686-baf8-c7847be6eef9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"
Sep 18 22:12:08.390096 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:08.389986    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67ecb6fa-6a71-4686-baf8-c7847be6eef9-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbdqg\" (UID: \"67ecb6fa-6a71-4686-baf8-c7847be6eef9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"
Sep 18 22:12:08.391842 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:08.391815    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67ecb6fa-6a71-4686-baf8-c7847be6eef9-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbdqg\" (UID: \"67ecb6fa-6a71-4686-baf8-c7847be6eef9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"
Sep 18 22:12:08.392105 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:08.392090    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67ecb6fa-6a71-4686-baf8-c7847be6eef9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbdqg\" (UID: \"67ecb6fa-6a71-4686-baf8-c7847be6eef9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"
Sep 18 22:12:08.408447 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:08.408419    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj7bz\" (UniqueName: \"kubernetes.io/projected/67ecb6fa-6a71-4686-baf8-c7847be6eef9-kube-api-access-tj7bz\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mbdqg\" (UID: \"67ecb6fa-6a71-4686-baf8-c7847be6eef9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"
Sep 18 22:12:08.445300 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:08.445277    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"
Sep 18 22:12:08.732746 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:12:08.732713    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67ecb6fa_6a71_4686_baf8_c7847be6eef9.slice/crio-bf5292f3e11c82faa10678b78d1b3510b439cac3634f34ffed640cd406bd0d5f WatchSource:0}: Error finding container bf5292f3e11c82faa10678b78d1b3510b439cac3634f34ffed640cd406bd0d5f: Status 404 returned error can't find the container with id bf5292f3e11c82faa10678b78d1b3510b439cac3634f34ffed640cd406bd0d5f
Sep 18 22:12:08.733757 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:08.733729    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"]
Sep 18 22:12:09.307235 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:09.307197    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg" event={"ID":"67ecb6fa-6a71-4686-baf8-c7847be6eef9","Type":"ContainerStarted","Data":"3a254146de40a0f4d91b0c0b5906d2d4ea520dae305e678c8a99ac99f9b09ff4"}
Sep 18 22:12:09.307766 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:09.307253    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg" event={"ID":"67ecb6fa-6a71-4686-baf8-c7847be6eef9","Type":"ContainerStarted","Data":"bf5292f3e11c82faa10678b78d1b3510b439cac3634f34ffed640cd406bd0d5f"}
Sep 18 22:12:09.327400 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:09.327354    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg" podStartSLOduration=1.137334927 podStartE2EDuration="1.327340154s" totalImagesPullingTime="190.005227ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:12:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:12:09.325535778 +0000 UTC m=+704.457316861" watchObservedRunningTime="2026-09-18 22:12:09.327340154 +0000 UTC m=+704.459121235"
Sep 18 22:12:18.446290 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:18.446212    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"
Sep 18 22:12:18.446290 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:18.446273    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"
Sep 18 22:12:18.458798 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:18.458771    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"
Sep 18 22:12:19.362900 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:19.362871    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mbdqg"
Sep 18 22:12:28.437780 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:28.437747    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"]
Sep 18 22:12:28.441074 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:28.441056    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"
Sep 18 22:12:28.444607 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:28.444585    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 18 22:12:28.453597 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:28.453575    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"]
Sep 18 22:12:28.561338 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:28.561303    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f20d405-508c-4682-b9a4-9569b43224e9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz57r\" (UID: \"9f20d405-508c-4682-b9a4-9569b43224e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"
Sep 18 22:12:28.561495 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:28.561349    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f20d405-508c-4682-b9a4-9569b43224e9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz57r\" (UID: \"9f20d405-508c-4682-b9a4-9569b43224e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"
Sep 18 22:12:28.561495 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:28.561380    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f20d405-508c-4682-b9a4-9569b43224e9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz57r\" (UID: \"9f20d405-508c-4682-b9a4-9569b43224e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"
Sep 18 22:12:28.561495 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:28.561418    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f20d405-508c-4682-b9a4-9569b43224e9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz57r\" (UID: \"9f20d405-508c-4682-b9a4-9569b43224e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"
Sep 18 22:12:28.561495 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:28.561439    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq7rh\" (UniqueName: \"kubernetes.io/projected/9f20d405-508c-4682-b9a4-9569b43224e9-kube-api-access-wq7rh\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz57r\" (UID: \"9f20d405-508c-4682-b9a4-9569b43224e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"
Sep 18 22:12:28.561495 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:28.561477    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f20d405-508c-4682-b9a4-9569b43224e9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz57r\" (UID: \"9f20d405-508c-4682-b9a4-9569b43224e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"
Sep 18 22:12:28.662787 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:28.662740    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f20d405-508c-4682-b9a4-9569b43224e9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz57r\" (UID: \"9f20d405-508c-4682-b9a4-9569b43224e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"
Sep 18 22:12:28.662944 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:28.662804    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f20d405-508c-4682-b9a4-9569b43224e9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz57r\" (UID: \"9f20d405-508c-4682-b9a4-9569b43224e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"
Sep 18 22:12:28.662944 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:28.662832    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f20d405-508c-4682-b9a4-9569b43224e9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz57r\" (UID: \"9f20d405-508c-4682-b9a4-9569b43224e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"
Sep 18 22:12:28.662944 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:28.662856    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f20d405-508c-4682-b9a4-9569b43224e9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz57r\" (UID: \"9f20d405-508c-4682-b9a4-9569b43224e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"
Sep 18 22:12:28.662944 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:28.662876    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq7rh\" (UniqueName: \"kubernetes.io/projected/9f20d405-508c-4682-b9a4-9569b43224e9-kube-api-access-wq7rh\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz57r\" (UID: \"9f20d405-508c-4682-b9a4-9569b43224e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"
Sep 18 22:12:28.662944 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:28.662894    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f20d405-508c-4682-b9a4-9569b43224e9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz57r\" (UID: \"9f20d405-508c-4682-b9a4-9569b43224e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"
Sep 18 22:12:28.663202 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:28.663185    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f20d405-508c-4682-b9a4-9569b43224e9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz57r\" (UID: \"9f20d405-508c-4682-b9a4-9569b43224e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"
Sep 18 22:12:28.663260 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:28.663199    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f20d405-508c-4682-b9a4-9569b43224e9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz57r\" (UID: \"9f20d405-508c-4682-b9a4-9569b43224e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"
Sep 18 22:12:28.663328 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:28.663299    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f20d405-508c-4682-b9a4-9569b43224e9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz57r\" (UID: \"9f20d405-508c-4682-b9a4-9569b43224e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"
Sep 18 22:12:28.665349 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:28.665327    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f20d405-508c-4682-b9a4-9569b43224e9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz57r\" (UID: \"9f20d405-508c-4682-b9a4-9569b43224e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"
Sep 18 22:12:28.665558 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:28.665541    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f20d405-508c-4682-b9a4-9569b43224e9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz57r\" (UID: \"9f20d405-508c-4682-b9a4-9569b43224e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"
Sep 18 22:12:28.671869 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:28.671844    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq7rh\" (UniqueName: \"kubernetes.io/projected/9f20d405-508c-4682-b9a4-9569b43224e9-kube-api-access-wq7rh\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zz57r\" (UID: \"9f20d405-508c-4682-b9a4-9569b43224e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"
Sep 18 22:12:28.751717 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:28.751660    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"
Sep 18 22:12:29.025846 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:29.025817    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"]
Sep 18 22:12:29.028354 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:12:29.028322    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f20d405_508c_4682_b9a4_9569b43224e9.slice/crio-3cd7b74eab408103a3d41c9b342bab08ffb5ee33d52155132325361f8385fa39 WatchSource:0}: Error finding container 3cd7b74eab408103a3d41c9b342bab08ffb5ee33d52155132325361f8385fa39: Status 404 returned error can't find the container with id 3cd7b74eab408103a3d41c9b342bab08ffb5ee33d52155132325361f8385fa39
Sep 18 22:12:29.395526 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:29.395468    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r" event={"ID":"9f20d405-508c-4682-b9a4-9569b43224e9","Type":"ContainerStarted","Data":"d0d71d38715c0ea3355549b1df01aec6e2f47111c4b2af86e9f2c5ce4d36b06c"}
Sep 18 22:12:29.395733 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:29.395539    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r" event={"ID":"9f20d405-508c-4682-b9a4-9569b43224e9","Type":"ContainerStarted","Data":"3cd7b74eab408103a3d41c9b342bab08ffb5ee33d52155132325361f8385fa39"}
Sep 18 22:12:29.415902 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:29.415844    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r" podStartSLOduration=1.213663617 podStartE2EDuration="1.4158289s" totalImagesPullingTime="202.165283ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:12:29.414090869 +0000 UTC m=+724.545871952" watchObservedRunningTime="2026-09-18 22:12:29.4158289 +0000 UTC m=+724.547610015"
Sep 18 22:12:38.752624 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:38.752584    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"
Sep 18 22:12:38.752987 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:38.752655    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"
Sep 18 22:12:38.765106 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:38.765084    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"
Sep 18 22:12:39.450053 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:12:39.450018    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zz57r"
Sep 18 22:14:01.348554 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:01.348462    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp"]
Sep 18 22:14:01.351603 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:01.351582    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp"
Sep 18 22:14:01.357717 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:01.357686    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-3d28c1-dockercfg-htmpk\""
Sep 18 22:14:01.357879 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:01.357860    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-3d28c1\""
Sep 18 22:14:01.360127 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:01.360106    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt"]
Sep 18 22:14:01.363320 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:01.363305    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt"
Sep 18 22:14:01.370207 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:01.370185    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp"]
Sep 18 22:14:01.390807 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:01.390786    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt"]
Sep 18 22:14:01.443142 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:01.443116    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mfgx\" (UniqueName: \"kubernetes.io/projected/9da0e798-4444-45c5-8cfe-76278d0624bf-kube-api-access-7mfgx\") pod \"payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt\" (UID: \"9da0e798-4444-45c5-8cfe-76278d0624bf\") " pod="openshift-ingress/payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt"
Sep 18 22:14:01.443284 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:01.443151    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9da0e798-4444-45c5-8cfe-76278d0624bf-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt\" (UID: \"9da0e798-4444-45c5-8cfe-76278d0624bf\") " pod="openshift-ingress/payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt"
Sep 18 22:14:01.443284 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:01.443171    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa24d601-26c7-4fa8-b71e-71fff9a6670b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp\" (UID: \"fa24d601-26c7-4fa8-b71e-71fff9a6670b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp"
Sep 18 22:14:01.443284 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:01.443203    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q46zh\" (UniqueName: \"kubernetes.io/projected/fa24d601-26c7-4fa8-b71e-71fff9a6670b-kube-api-access-q46zh\") pod \"payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp\" (UID: \"fa24d601-26c7-4fa8-b71e-71fff9a6670b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp"
Sep 18 22:14:01.543841 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:01.543809    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9da0e798-4444-45c5-8cfe-76278d0624bf-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt\" (UID: \"9da0e798-4444-45c5-8cfe-76278d0624bf\") " pod="openshift-ingress/payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt"
Sep 18 22:14:01.544006 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:01.543848    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa24d601-26c7-4fa8-b71e-71fff9a6670b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp\" (UID: \"fa24d601-26c7-4fa8-b71e-71fff9a6670b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp"
Sep 18 22:14:01.544006 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:01.543877    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q46zh\" (UniqueName: \"kubernetes.io/projected/fa24d601-26c7-4fa8-b71e-71fff9a6670b-kube-api-access-q46zh\") pod \"payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp\" (UID: \"fa24d601-26c7-4fa8-b71e-71fff9a6670b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp"
Sep 18 22:14:01.544006 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:01.543995    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mfgx\" (UniqueName: \"kubernetes.io/projected/9da0e798-4444-45c5-8cfe-76278d0624bf-kube-api-access-7mfgx\") pod \"payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt\" (UID: \"9da0e798-4444-45c5-8cfe-76278d0624bf\") " pod="openshift-ingress/payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt"
Sep 18 22:14:01.544576 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:01.544556    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9da0e798-4444-45c5-8cfe-76278d0624bf-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt\" (UID: \"9da0e798-4444-45c5-8cfe-76278d0624bf\") " pod="openshift-ingress/payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt"
Sep 18 22:14:01.544576 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:01.544567    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa24d601-26c7-4fa8-b71e-71fff9a6670b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp\" (UID: \"fa24d601-26c7-4fa8-b71e-71fff9a6670b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp"
Sep 18 22:14:01.560312 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:01.560280    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q46zh\" (UniqueName: \"kubernetes.io/projected/fa24d601-26c7-4fa8-b71e-71fff9a6670b-kube-api-access-q46zh\") pod \"payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp\" (UID: \"fa24d601-26c7-4fa8-b71e-71fff9a6670b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp"
Sep 18 22:14:01.560553 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:01.560537    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mfgx\" (UniqueName: \"kubernetes.io/projected/9da0e798-4444-45c5-8cfe-76278d0624bf-kube-api-access-7mfgx\") pod \"payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt\" (UID: \"9da0e798-4444-45c5-8cfe-76278d0624bf\") " pod="openshift-ingress/payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt"
Sep 18 22:14:01.661387 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:01.661320    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp"
Sep 18 22:14:01.673387 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:01.673368    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt"
Sep 18 22:14:01.945815 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:01.945788    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp"]
Sep 18 22:14:01.948185 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:14:01.948160    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa24d601_26c7_4fa8_b71e_71fff9a6670b.slice/crio-f91c54ec106fd80020a7d238ee04deed2fbc7f074740b6944c81c4c7347bdf9e WatchSource:0}: Error finding container f91c54ec106fd80020a7d238ee04deed2fbc7f074740b6944c81c4c7347bdf9e: Status 404 returned error can't find the container with id f91c54ec106fd80020a7d238ee04deed2fbc7f074740b6944c81c4c7347bdf9e
Sep 18 22:14:01.969400 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:01.969379    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt"]
Sep 18 22:14:01.978443 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:14:01.978415    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9da0e798_4444_45c5_8cfe_76278d0624bf.slice/crio-66c23b12008ca6287d72dc406031935498ce405ed3b37abfb1e89d6787a279d4 WatchSource:0}: Error finding container 66c23b12008ca6287d72dc406031935498ce405ed3b37abfb1e89d6787a279d4: Status 404 returned error can't find the container with id 66c23b12008ca6287d72dc406031935498ce405ed3b37abfb1e89d6787a279d4
Sep 18 22:14:02.812281 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:02.812188    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp" event={"ID":"fa24d601-26c7-4fa8-b71e-71fff9a6670b","Type":"ContainerStarted","Data":"16c6a3d6406a59dac96a829cbf153f5f009bad62c2eecc972a66d5c6489593c6"}
Sep 18 22:14:02.812281 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:02.812254    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp" event={"ID":"fa24d601-26c7-4fa8-b71e-71fff9a6670b","Type":"ContainerStarted","Data":"f91c54ec106fd80020a7d238ee04deed2fbc7f074740b6944c81c4c7347bdf9e"}
Sep 18 22:14:02.812281 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:02.812281    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp"
Sep 18 22:14:02.813901 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:02.813880    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt" event={"ID":"9da0e798-4444-45c5-8cfe-76278d0624bf","Type":"ContainerStarted","Data":"e547a9c72df08edffacc0fa1f434070e79a54bfcb6964987994972de9bb4f963"}
Sep 18 22:14:02.814033 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:02.813925    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt" event={"ID":"9da0e798-4444-45c5-8cfe-76278d0624bf","Type":"ContainerStarted","Data":"66c23b12008ca6287d72dc406031935498ce405ed3b37abfb1e89d6787a279d4"}
Sep 18 22:14:02.814033 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:02.813975    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt"
Sep 18 22:14:03.023667 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:03.023609    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp" podStartSLOduration=2.023593702 podStartE2EDuration="2.023593702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:14:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:14:02.961551629 +0000 UTC m=+818.093332711" watchObservedRunningTime="2026-09-18 22:14:03.023593702 +0000 UTC m=+818.155374803"
Sep 18 22:14:03.024185 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:03.024153    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt" podStartSLOduration=2.024143847 podStartE2EDuration="2.024143847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:14:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:14:03.023874766 +0000 UTC m=+818.155655848" watchObservedRunningTime="2026-09-18 22:14:03.024143847 +0000 UTC m=+818.155924928"
Sep 18 22:14:04.739249 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:04.739215    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4"]
Sep 18 22:14:04.742763 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:04.742742    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4"
Sep 18 22:14:04.746482 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:04.746463    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-59b357\""
Sep 18 22:14:04.746651 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:04.746634    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-59b357-dockercfg-rdcvt\""
Sep 18 22:14:04.753517 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:04.753488    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4"]
Sep 18 22:14:04.775302 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:04.775255    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2s9d\" (UniqueName: \"kubernetes.io/projected/62589d81-9fe3-4f3a-8715-3e453f397d4b-kube-api-access-v2s9d\") pod \"payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4\" (UID: \"62589d81-9fe3-4f3a-8715-3e453f397d4b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4"
Sep 18 22:14:04.775423 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:04.775401    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62589d81-9fe3-4f3a-8715-3e453f397d4b-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4\" (UID: \"62589d81-9fe3-4f3a-8715-3e453f397d4b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4"
Sep 18 22:14:04.827730 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:04.827696    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn"]
Sep 18 22:14:04.831282 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:04.831260    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn"
Sep 18 22:14:04.841858 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:04.841835    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn"]
Sep 18 22:14:04.876467 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:04.876437    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3871c08d-2953-4b12-96dd-f8e5cc491fde-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn\" (UID: \"3871c08d-2953-4b12-96dd-f8e5cc491fde\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn"
Sep 18 22:14:04.876639 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:04.876478    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9c5d\" (UniqueName: \"kubernetes.io/projected/3871c08d-2953-4b12-96dd-f8e5cc491fde-kube-api-access-n9c5d\") pod \"payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn\" (UID: \"3871c08d-2953-4b12-96dd-f8e5cc491fde\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn"
Sep 18 22:14:04.876639 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:04.876538    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62589d81-9fe3-4f3a-8715-3e453f397d4b-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4\" (UID: \"62589d81-9fe3-4f3a-8715-3e453f397d4b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4"
Sep 18 22:14:04.876639 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:04.876615    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2s9d\" (UniqueName: \"kubernetes.io/projected/62589d81-9fe3-4f3a-8715-3e453f397d4b-kube-api-access-v2s9d\") pod \"payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4\" (UID: \"62589d81-9fe3-4f3a-8715-3e453f397d4b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4"
Sep 18 22:14:04.877143 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:04.877126    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62589d81-9fe3-4f3a-8715-3e453f397d4b-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4\" (UID: \"62589d81-9fe3-4f3a-8715-3e453f397d4b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4"
Sep 18 22:14:04.888864 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:04.888836    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2s9d\" (UniqueName: \"kubernetes.io/projected/62589d81-9fe3-4f3a-8715-3e453f397d4b-kube-api-access-v2s9d\") pod \"payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4\" (UID: \"62589d81-9fe3-4f3a-8715-3e453f397d4b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4"
Sep 18 22:14:04.978004 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:04.977972    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3871c08d-2953-4b12-96dd-f8e5cc491fde-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn\" (UID: \"3871c08d-2953-4b12-96dd-f8e5cc491fde\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn"
Sep 18 22:14:04.978153 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:04.978026    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9c5d\" (UniqueName: \"kubernetes.io/projected/3871c08d-2953-4b12-96dd-f8e5cc491fde-kube-api-access-n9c5d\") pod \"payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn\" (UID: \"3871c08d-2953-4b12-96dd-f8e5cc491fde\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn"
Sep 18 22:14:04.978748 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:04.978729    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3871c08d-2953-4b12-96dd-f8e5cc491fde-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn\" (UID: \"3871c08d-2953-4b12-96dd-f8e5cc491fde\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn"
Sep 18 22:14:04.989602 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:04.989546    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9c5d\" (UniqueName: \"kubernetes.io/projected/3871c08d-2953-4b12-96dd-f8e5cc491fde-kube-api-access-n9c5d\") pod \"payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn\" (UID: \"3871c08d-2953-4b12-96dd-f8e5cc491fde\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn"
Sep 18 22:14:05.054397 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:05.054373    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4"
Sep 18 22:14:05.142473 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:05.142445    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn"
Sep 18 22:14:05.350560 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:05.350532    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4"]
Sep 18 22:14:05.352964 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:14:05.352938    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62589d81_9fe3_4f3a_8715_3e453f397d4b.slice/crio-cd8208737d0e7c0bd91202707cba2abee2a8af000645723d994440158b483712 WatchSource:0}: Error finding container cd8208737d0e7c0bd91202707cba2abee2a8af000645723d994440158b483712: Status 404 returned error can't find the container with id cd8208737d0e7c0bd91202707cba2abee2a8af000645723d994440158b483712
Sep 18 22:14:05.436748 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:05.436703    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn"]
Sep 18 22:14:05.438949 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:14:05.438923    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3871c08d_2953_4b12_96dd_f8e5cc491fde.slice/crio-b90411b1af8722d0b07b470f37be090f5ed1d85211a0329616d826057c133be9 WatchSource:0}: Error finding container b90411b1af8722d0b07b470f37be090f5ed1d85211a0329616d826057c133be9: Status 404 returned error can't find the container with id b90411b1af8722d0b07b470f37be090f5ed1d85211a0329616d826057c133be9
Sep 18 22:14:05.831703 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:05.831670    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn" event={"ID":"3871c08d-2953-4b12-96dd-f8e5cc491fde","Type":"ContainerStarted","Data":"19339692e928646a4cd46c31f1f759da24cdac169fa0a160e2d6cb7b6d79a600"}
Sep 18 22:14:05.832103 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:05.831723    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn" event={"ID":"3871c08d-2953-4b12-96dd-f8e5cc491fde","Type":"ContainerStarted","Data":"b90411b1af8722d0b07b470f37be090f5ed1d85211a0329616d826057c133be9"}
Sep 18 22:14:05.832103 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:05.831774    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn"
Sep 18 22:14:05.833312 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:05.833293    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4" event={"ID":"62589d81-9fe3-4f3a-8715-3e453f397d4b","Type":"ContainerStarted","Data":"a8a32a754b924025265087d05111626c5773171f24763fb4d91bf9035c5dc8b9"}
Sep 18 22:14:05.833400 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:05.833324    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4" event={"ID":"62589d81-9fe3-4f3a-8715-3e453f397d4b","Type":"ContainerStarted","Data":"cd8208737d0e7c0bd91202707cba2abee2a8af000645723d994440158b483712"}
Sep 18 22:14:05.833400 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:05.833364    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4"
Sep 18 22:14:05.859073 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:05.859025    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn" podStartSLOduration=1.8590121339999999 podStartE2EDuration="1.859012134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:14:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:14:05.858353244 +0000 UTC m=+820.990134329" watchObservedRunningTime="2026-09-18 22:14:05.859012134 +0000 UTC m=+820.990793280"
Sep 18 22:14:05.882844 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:05.882802    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4" podStartSLOduration=1.882786265 podStartE2EDuration="1.882786265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:14:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:14:05.88206792 +0000 UTC m=+821.013849004" watchObservedRunningTime="2026-09-18 22:14:05.882786265 +0000 UTC m=+821.014567348"
Sep 18 22:14:06.264160 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:06.264124    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4"]
Sep 18 22:14:06.267964 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:06.267940    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4"
Sep 18 22:14:06.270190 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:06.270169    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-a13357-dockercfg-hkklw\""
Sep 18 22:14:06.270425 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:06.270411    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-a13357\""
Sep 18 22:14:06.281586 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:06.281561    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4"]
Sep 18 22:14:06.392316 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:06.392280    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z99g7\" (UniqueName: \"kubernetes.io/projected/d1ff6fe3-8331-42d3-ae67-ff9a7d17f154-kube-api-access-z99g7\") pod \"payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4\" (UID: \"d1ff6fe3-8331-42d3-ae67-ff9a7d17f154\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4"
Sep 18 22:14:06.392465 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:06.392391    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1ff6fe3-8331-42d3-ae67-ff9a7d17f154-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4\" (UID: \"d1ff6fe3-8331-42d3-ae67-ff9a7d17f154\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4"
Sep 18 22:14:06.492851 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:06.492815    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z99g7\" (UniqueName: \"kubernetes.io/projected/d1ff6fe3-8331-42d3-ae67-ff9a7d17f154-kube-api-access-z99g7\") pod \"payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4\" (UID: \"d1ff6fe3-8331-42d3-ae67-ff9a7d17f154\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4"
Sep 18 22:14:06.493005 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:06.492878    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1ff6fe3-8331-42d3-ae67-ff9a7d17f154-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4\" (UID: \"d1ff6fe3-8331-42d3-ae67-ff9a7d17f154\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4"
Sep 18 22:14:06.493523 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:06.493490    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1ff6fe3-8331-42d3-ae67-ff9a7d17f154-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4\" (UID: \"d1ff6fe3-8331-42d3-ae67-ff9a7d17f154\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4"
Sep 18 22:14:06.502960 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:06.502927    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z99g7\" (UniqueName: \"kubernetes.io/projected/d1ff6fe3-8331-42d3-ae67-ff9a7d17f154-kube-api-access-z99g7\") pod \"payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4\" (UID: \"d1ff6fe3-8331-42d3-ae67-ff9a7d17f154\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4"
Sep 18 22:14:06.585582 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:06.585464    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4"
Sep 18 22:14:06.861640 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:06.861615    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4"]
Sep 18 22:14:06.863775 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:14:06.863735    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1ff6fe3_8331_42d3_ae67_ff9a7d17f154.slice/crio-5de4b05f76c27bc7619c087a67b08b51fc4963817a5b54db15e7cabbe42b981d WatchSource:0}: Error finding container 5de4b05f76c27bc7619c087a67b08b51fc4963817a5b54db15e7cabbe42b981d: Status 404 returned error can't find the container with id 5de4b05f76c27bc7619c087a67b08b51fc4963817a5b54db15e7cabbe42b981d
Sep 18 22:14:07.845269 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:07.845235    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4" event={"ID":"d1ff6fe3-8331-42d3-ae67-ff9a7d17f154","Type":"ContainerStarted","Data":"6ef10633026cd949d4ee3966bf3933e8398b0b38ae99bafaa4855d27a8221e7d"}
Sep 18 22:14:07.845461 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:07.845282    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4" event={"ID":"d1ff6fe3-8331-42d3-ae67-ff9a7d17f154","Type":"ContainerStarted","Data":"5de4b05f76c27bc7619c087a67b08b51fc4963817a5b54db15e7cabbe42b981d"}
Sep 18 22:14:07.845461 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:07.845379    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4"
Sep 18 22:14:07.908141 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:07.908086    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4" podStartSLOduration=1.908071971 podStartE2EDuration="1.908071971s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:14:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:14:07.906884416 +0000 UTC m=+823.038665497" watchObservedRunningTime="2026-09-18 22:14:07.908071971 +0000 UTC m=+823.039853053"
Sep 18 22:14:12.662974 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:12.662946    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll"]
Sep 18 22:14:12.666699 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:12.666682    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll"
Sep 18 22:14:12.670920 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:12.670892    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-0ffe43-dockercfg-2gjt4\""
Sep 18 22:14:12.671264 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:12.671242    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-0ffe43\""
Sep 18 22:14:12.697165 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:12.697128    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj"]
Sep 18 22:14:12.700906 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:12.700885    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll"]
Sep 18 22:14:12.700998 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:12.700967    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj"
Sep 18 22:14:12.719121 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:12.719097    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj"]
Sep 18 22:14:12.750581 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:12.750551    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll\" (UID: \"fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll"
Sep 18 22:14:12.750706 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:12.750593    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9xgz\" (UniqueName: \"kubernetes.io/projected/fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516-kube-api-access-s9xgz\") pod \"payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll\" (UID: \"fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll"
Sep 18 22:14:12.750706 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:12.750643    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f71c3bb-de4e-4cb7-a64a-f8eacc99a932-plugins-config-volume\") pod \"payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj\" (UID: \"9f71c3bb-de4e-4cb7-a64a-f8eacc99a932\") " pod="openshift-ingress/payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj"
Sep 18 22:14:12.750706 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:12.750693    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw55j\" (UniqueName: \"kubernetes.io/projected/9f71c3bb-de4e-4cb7-a64a-f8eacc99a932-kube-api-access-vw55j\") pod \"payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj\" (UID: \"9f71c3bb-de4e-4cb7-a64a-f8eacc99a932\") " pod="openshift-ingress/payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj"
Sep 18 22:14:12.851827 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:12.851792    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll\" (UID: \"fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll"
Sep 18 22:14:12.851827 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:12.851830    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9xgz\" (UniqueName: \"kubernetes.io/projected/fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516-kube-api-access-s9xgz\") pod \"payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll\" (UID: \"fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll"
Sep 18 22:14:12.852000 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:12.851856    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f71c3bb-de4e-4cb7-a64a-f8eacc99a932-plugins-config-volume\") pod \"payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj\" (UID: \"9f71c3bb-de4e-4cb7-a64a-f8eacc99a932\") " pod="openshift-ingress/payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj"
Sep 18 22:14:12.852000 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:12.851890    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw55j\" (UniqueName: \"kubernetes.io/projected/9f71c3bb-de4e-4cb7-a64a-f8eacc99a932-kube-api-access-vw55j\") pod \"payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj\" (UID: \"9f71c3bb-de4e-4cb7-a64a-f8eacc99a932\") " pod="openshift-ingress/payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj"
Sep 18 22:14:12.852570 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:12.852551    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll\" (UID: \"fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll"
Sep 18 22:14:12.852622 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:12.852587    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f71c3bb-de4e-4cb7-a64a-f8eacc99a932-plugins-config-volume\") pod \"payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj\" (UID: \"9f71c3bb-de4e-4cb7-a64a-f8eacc99a932\") " pod="openshift-ingress/payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj"
Sep 18 22:14:12.863386 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:12.863359    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw55j\" (UniqueName: \"kubernetes.io/projected/9f71c3bb-de4e-4cb7-a64a-f8eacc99a932-kube-api-access-vw55j\") pod \"payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj\" (UID: \"9f71c3bb-de4e-4cb7-a64a-f8eacc99a932\") " pod="openshift-ingress/payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj"
Sep 18 22:14:12.866833 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:12.866803    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9xgz\" (UniqueName: \"kubernetes.io/projected/fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516-kube-api-access-s9xgz\") pod \"payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll\" (UID: \"fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll"
Sep 18 22:14:12.976687 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:12.976611    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll"
Sep 18 22:14:13.010847 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:13.010813    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj"
Sep 18 22:14:13.259611 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:13.259590    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll"]
Sep 18 22:14:13.262060 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:14:13.262037    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb01fa9f_9f4c_49aa_aa7a_fb4753b4d516.slice/crio-b021187d54c70b8b074650ecf275ab86a17ec593cf6a5cb5cc958229a717cbae WatchSource:0}: Error finding container b021187d54c70b8b074650ecf275ab86a17ec593cf6a5cb5cc958229a717cbae: Status 404 returned error can't find the container with id b021187d54c70b8b074650ecf275ab86a17ec593cf6a5cb5cc958229a717cbae
Sep 18 22:14:13.297516 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:13.297481    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj"]
Sep 18 22:14:13.299915 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:14:13.299892    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f71c3bb_de4e_4cb7_a64a_f8eacc99a932.slice/crio-ecc769c065c1eec9459e0c5b5174eb71a195dd496f13d5f8d96e9435f7d0816a WatchSource:0}: Error finding container ecc769c065c1eec9459e0c5b5174eb71a195dd496f13d5f8d96e9435f7d0816a: Status 404 returned error can't find the container with id ecc769c065c1eec9459e0c5b5174eb71a195dd496f13d5f8d96e9435f7d0816a
Sep 18 22:14:13.821237 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:13.821208    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp"
Sep 18 22:14:13.821692 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:13.821320    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt"
Sep 18 22:14:13.880400 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:13.880371    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll" event={"ID":"fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516","Type":"ContainerStarted","Data":"71349be4a97a29996ccadbb7f51833ab5f56f2cc9525bf55ee3263dee6b9e9ba"}
Sep 18 22:14:13.880596 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:13.880429    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll" event={"ID":"fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516","Type":"ContainerStarted","Data":"b021187d54c70b8b074650ecf275ab86a17ec593cf6a5cb5cc958229a717cbae"}
Sep 18 22:14:13.880596 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:13.880458    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll"
Sep 18 22:14:13.882147 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:13.882112    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj" event={"ID":"9f71c3bb-de4e-4cb7-a64a-f8eacc99a932","Type":"ContainerStarted","Data":"a66422d7afc48400290a56fcd0ed3abe7c12c4ef01e92c636008eeec7c6d718d"}
Sep 18 22:14:13.882257 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:13.882160    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj" event={"ID":"9f71c3bb-de4e-4cb7-a64a-f8eacc99a932","Type":"ContainerStarted","Data":"ecc769c065c1eec9459e0c5b5174eb71a195dd496f13d5f8d96e9435f7d0816a"}
Sep 18 22:14:13.882257 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:13.882198    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj"
Sep 18 22:14:13.950143 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:13.950089    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj" podStartSLOduration=1.950070745 podStartE2EDuration="1.950070745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:14:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:14:13.949166033 +0000 UTC m=+829.080947116" watchObservedRunningTime="2026-09-18 22:14:13.950070745 +0000 UTC m=+829.081851827"
Sep 18 22:14:13.979157 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:13.979068    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll" podStartSLOduration=1.9790487140000002 podStartE2EDuration="1.979048714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:14:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:14:13.978955574 +0000 UTC m=+829.110736657" watchObservedRunningTime="2026-09-18 22:14:13.979048714 +0000 UTC m=+829.110829797"
Sep 18 22:14:16.841289 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:16.841257    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4"
Sep 18 22:14:16.841671 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:16.841423    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn"
Sep 18 22:14:18.303757 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:18.303725    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8"]
Sep 18 22:14:18.307386 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:18.307369    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8"
Sep 18 22:14:18.310078 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:18.310057    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-82b6dcec-dockercfg-cwr2v\""
Sep 18 22:14:18.310199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:18.310058    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-82b6dcec\""
Sep 18 22:14:18.324215 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:18.324188    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8"]
Sep 18 22:14:18.401924 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:18.401892    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmwzz\" (UniqueName: \"kubernetes.io/projected/30b8013e-a446-49c6-b492-09634879f986-kube-api-access-pmwzz\") pod \"payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8\" (UID: \"30b8013e-a446-49c6-b492-09634879f986\") " pod="openshift-ingress/payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8"
Sep 18 22:14:18.402086 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:18.401932    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30b8013e-a446-49c6-b492-09634879f986-plugins-config-volume\") pod \"payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8\" (UID: \"30b8013e-a446-49c6-b492-09634879f986\") " pod="openshift-ingress/payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8"
Sep 18 22:14:18.502817 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:18.502788    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmwzz\" (UniqueName: \"kubernetes.io/projected/30b8013e-a446-49c6-b492-09634879f986-kube-api-access-pmwzz\") pod \"payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8\" (UID: \"30b8013e-a446-49c6-b492-09634879f986\") " pod="openshift-ingress/payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8"
Sep 18 22:14:18.502984 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:18.502831    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30b8013e-a446-49c6-b492-09634879f986-plugins-config-volume\") pod \"payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8\" (UID: \"30b8013e-a446-49c6-b492-09634879f986\") " pod="openshift-ingress/payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8"
Sep 18 22:14:18.503574 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:18.503555    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30b8013e-a446-49c6-b492-09634879f986-plugins-config-volume\") pod \"payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8\" (UID: \"30b8013e-a446-49c6-b492-09634879f986\") " pod="openshift-ingress/payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8"
Sep 18 22:14:18.511394 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:18.511364    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmwzz\" (UniqueName: \"kubernetes.io/projected/30b8013e-a446-49c6-b492-09634879f986-kube-api-access-pmwzz\") pod \"payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8\" (UID: \"30b8013e-a446-49c6-b492-09634879f986\") " pod="openshift-ingress/payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8"
Sep 18 22:14:18.617286 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:18.617202    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8"
Sep 18 22:14:18.851691 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:18.851658    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4"
Sep 18 22:14:18.940012 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:18.939981    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8"]
Sep 18 22:14:18.949595 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:14:18.949532    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30b8013e_a446_49c6_b492_09634879f986.slice/crio-1f06a63ecca51da75a6c86b5fca493915b6c366778e3fa65d65e7df5fb86fac6 WatchSource:0}: Error finding container 1f06a63ecca51da75a6c86b5fca493915b6c366778e3fa65d65e7df5fb86fac6: Status 404 returned error can't find the container with id 1f06a63ecca51da75a6c86b5fca493915b6c366778e3fa65d65e7df5fb86fac6
Sep 18 22:14:19.915633 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:19.915586    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8" event={"ID":"30b8013e-a446-49c6-b492-09634879f986","Type":"ContainerStarted","Data":"1c397746fe904264579f20d37711b8481937d0c458c25dd4199df3ec6160d5cb"}
Sep 18 22:14:19.915994 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:19.915653    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8" event={"ID":"30b8013e-a446-49c6-b492-09634879f986","Type":"ContainerStarted","Data":"1f06a63ecca51da75a6c86b5fca493915b6c366778e3fa65d65e7df5fb86fac6"}
Sep 18 22:14:19.915994 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:19.915701    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8"
Sep 18 22:14:19.936460 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:19.936416    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8" podStartSLOduration=1.9364025360000001 podStartE2EDuration="1.936402536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:14:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:14:19.935665713 +0000 UTC m=+835.067446796" watchObservedRunningTime="2026-09-18 22:14:19.936402536 +0000 UTC m=+835.068183617"
Sep 18 22:14:24.889175 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:24.889147    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj"
Sep 18 22:14:24.889675 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:24.889434    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll"
Sep 18 22:14:30.926070 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:30.926037    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8"
Sep 18 22:14:31.244079 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:31.243984    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82b6dcec-nbv8r"]
Sep 18 22:14:31.247940 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:31.247918    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82b6dcec-nbv8r"
Sep 18 22:14:31.250427 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:31.250404    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 22:14:31.250536 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:31.250465    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9g7m4\""
Sep 18 22:14:31.260604 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:31.260571    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82b6dcec-nbv8r"]
Sep 18 22:14:31.415983 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:31.415945    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/377be7e7-2c51-40c4-b32b-dba11688afee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-82b6dcec-nbv8r\" (UID: \"377be7e7-2c51-40c4-b32b-dba11688afee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82b6dcec-nbv8r"
Sep 18 22:14:31.516877 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:31.516806    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/377be7e7-2c51-40c4-b32b-dba11688afee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-82b6dcec-nbv8r\" (UID: \"377be7e7-2c51-40c4-b32b-dba11688afee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82b6dcec-nbv8r"
Sep 18 22:14:31.517394 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:31.517375    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/377be7e7-2c51-40c4-b32b-dba11688afee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-82b6dcec-nbv8r\" (UID: \"377be7e7-2c51-40c4-b32b-dba11688afee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82b6dcec-nbv8r"
Sep 18 22:14:31.558401 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:31.558373    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82b6dcec-nbv8r"
Sep 18 22:14:31.831106 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:31.831081    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82b6dcec-nbv8r"]
Sep 18 22:14:31.833429 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:14:31.833400    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod377be7e7_2c51_40c4_b32b_dba11688afee.slice/crio-33361822669cfa51f39cfc295216945cc6f34a64097940c79656f602f8e1cb3a WatchSource:0}: Error finding container 33361822669cfa51f39cfc295216945cc6f34a64097940c79656f602f8e1cb3a: Status 404 returned error can't find the container with id 33361822669cfa51f39cfc295216945cc6f34a64097940c79656f602f8e1cb3a
Sep 18 22:14:31.982061 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:31.982025    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82b6dcec-nbv8r" event={"ID":"377be7e7-2c51-40c4-b32b-dba11688afee","Type":"ContainerStarted","Data":"33361822669cfa51f39cfc295216945cc6f34a64097940c79656f602f8e1cb3a"}
Sep 18 22:14:35.001462 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:35.001432    2574 generic.go:356] "Generic (PLEG): container finished" podID="377be7e7-2c51-40c4-b32b-dba11688afee" containerID="c9b86b3c5eef4723d81b2cef07f9e161a3e32c3991cce103dc8ae4c735362cb1" exitCode=0
Sep 18 22:14:35.001874 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:35.001500    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82b6dcec-nbv8r" event={"ID":"377be7e7-2c51-40c4-b32b-dba11688afee","Type":"ContainerDied","Data":"c9b86b3c5eef4723d81b2cef07f9e161a3e32c3991cce103dc8ae4c735362cb1"}
Sep 18 22:14:36.145901 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:36.145874    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82b6dcec-nbv8r"
Sep 18 22:14:36.263538 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:36.263411    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/377be7e7-2c51-40c4-b32b-dba11688afee-maas-api-service-ca\") pod \"377be7e7-2c51-40c4-b32b-dba11688afee\" (UID: \"377be7e7-2c51-40c4-b32b-dba11688afee\") "
Sep 18 22:14:36.263863 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:36.263839    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/377be7e7-2c51-40c4-b32b-dba11688afee-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "377be7e7-2c51-40c4-b32b-dba11688afee" (UID: "377be7e7-2c51-40c4-b32b-dba11688afee"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:14:36.364672 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:36.364630    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/377be7e7-2c51-40c4-b32b-dba11688afee-maas-api-service-ca\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:14:37.012575 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:37.012541    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82b6dcec-nbv8r" event={"ID":"377be7e7-2c51-40c4-b32b-dba11688afee","Type":"ContainerDied","Data":"33361822669cfa51f39cfc295216945cc6f34a64097940c79656f602f8e1cb3a"}
Sep 18 22:14:37.012575 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:37.012567    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82b6dcec-nbv8r"
Sep 18 22:14:37.012769 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:37.012590    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="33361822669cfa51f39cfc295216945cc6f34a64097940c79656f602f8e1cb3a"
Sep 18 22:14:42.102415 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:42.102386    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8"]
Sep 18 22:14:42.102842 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:42.102622    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8" podUID="30b8013e-a446-49c6-b492-09634879f986" containerName="payload-processing" containerID="cri-o://1c397746fe904264579f20d37711b8481937d0c458c25dd4199df3ec6160d5cb" gracePeriod=30
Sep 18 22:14:42.349333 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:42.349295    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82b6dcec-nbv8r"]
Sep 18 22:14:42.352859 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:42.352804    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82b6dcec-nbv8r"]
Sep 18 22:14:42.362174 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:42.362154    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8"
Sep 18 22:14:42.408707 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:42.408672    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmwzz\" (UniqueName: \"kubernetes.io/projected/30b8013e-a446-49c6-b492-09634879f986-kube-api-access-pmwzz\") pod \"30b8013e-a446-49c6-b492-09634879f986\" (UID: \"30b8013e-a446-49c6-b492-09634879f986\") "
Sep 18 22:14:42.408843 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:42.408751    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30b8013e-a446-49c6-b492-09634879f986-plugins-config-volume\") pod \"30b8013e-a446-49c6-b492-09634879f986\" (UID: \"30b8013e-a446-49c6-b492-09634879f986\") "
Sep 18 22:14:42.410147 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:42.410104    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30b8013e-a446-49c6-b492-09634879f986-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "30b8013e-a446-49c6-b492-09634879f986" (UID: "30b8013e-a446-49c6-b492-09634879f986"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:14:42.411424 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:42.411377    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30b8013e-a446-49c6-b492-09634879f986-kube-api-access-pmwzz" (OuterVolumeSpecName: "kube-api-access-pmwzz") pod "30b8013e-a446-49c6-b492-09634879f986" (UID: "30b8013e-a446-49c6-b492-09634879f986"). InnerVolumeSpecName "kube-api-access-pmwzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:14:42.510392 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:42.510359    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmwzz\" (UniqueName: \"kubernetes.io/projected/30b8013e-a446-49c6-b492-09634879f986-kube-api-access-pmwzz\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:14:42.510392 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:42.510391    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30b8013e-a446-49c6-b492-09634879f986-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:14:43.044436 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:43.044394    2574 generic.go:356] "Generic (PLEG): container finished" podID="30b8013e-a446-49c6-b492-09634879f986" containerID="1c397746fe904264579f20d37711b8481937d0c458c25dd4199df3ec6160d5cb" exitCode=0
Sep 18 22:14:43.044668 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:43.044443    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8" event={"ID":"30b8013e-a446-49c6-b492-09634879f986","Type":"ContainerDied","Data":"1c397746fe904264579f20d37711b8481937d0c458c25dd4199df3ec6160d5cb"}
Sep 18 22:14:43.044668 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:43.044492    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8"
Sep 18 22:14:43.044668 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:43.044528    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8" event={"ID":"30b8013e-a446-49c6-b492-09634879f986","Type":"ContainerDied","Data":"1f06a63ecca51da75a6c86b5fca493915b6c366778e3fa65d65e7df5fb86fac6"}
Sep 18 22:14:43.044668 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:43.044562    2574 scope.go:117] "RemoveContainer" containerID="1c397746fe904264579f20d37711b8481937d0c458c25dd4199df3ec6160d5cb"
Sep 18 22:14:43.054685 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:43.054668    2574 scope.go:117] "RemoveContainer" containerID="1c397746fe904264579f20d37711b8481937d0c458c25dd4199df3ec6160d5cb"
Sep 18 22:14:43.054958 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:14:43.054940    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c397746fe904264579f20d37711b8481937d0c458c25dd4199df3ec6160d5cb\": container with ID starting with 1c397746fe904264579f20d37711b8481937d0c458c25dd4199df3ec6160d5cb not found: ID does not exist" containerID="1c397746fe904264579f20d37711b8481937d0c458c25dd4199df3ec6160d5cb"
Sep 18 22:14:43.054995 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:43.054966    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c397746fe904264579f20d37711b8481937d0c458c25dd4199df3ec6160d5cb"} err="failed to get container status \"1c397746fe904264579f20d37711b8481937d0c458c25dd4199df3ec6160d5cb\": rpc error: code = NotFound desc = could not find container \"1c397746fe904264579f20d37711b8481937d0c458c25dd4199df3ec6160d5cb\": container with ID starting with 1c397746fe904264579f20d37711b8481937d0c458c25dd4199df3ec6160d5cb not found: ID does not exist"
Sep 18 22:14:43.120164 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:43.120128    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8"]
Sep 18 22:14:43.128550 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:43.128525    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-82b6dcec-c47f778d5-zt6s8"]
Sep 18 22:14:43.345684 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:43.345610    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30b8013e-a446-49c6-b492-09634879f986" path="/var/lib/kubelet/pods/30b8013e-a446-49c6-b492-09634879f986/volumes"
Sep 18 22:14:43.345960 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:43.345948    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="377be7e7-2c51-40c4-b32b-dba11688afee" path="/var/lib/kubelet/pods/377be7e7-2c51-40c4-b32b-dba11688afee/volumes"
Sep 18 22:14:55.309245 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:55.309204    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x"]
Sep 18 22:14:55.309842 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:55.309824    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="377be7e7-2c51-40c4-b32b-dba11688afee" containerName="revoke-keys"
Sep 18 22:14:55.309927 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:55.309844    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="377be7e7-2c51-40c4-b32b-dba11688afee" containerName="revoke-keys"
Sep 18 22:14:55.309927 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:55.309871    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30b8013e-a446-49c6-b492-09634879f986" containerName="payload-processing"
Sep 18 22:14:55.309927 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:55.309880    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="30b8013e-a446-49c6-b492-09634879f986" containerName="payload-processing"
Sep 18 22:14:55.310077 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:55.309997    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="30b8013e-a446-49c6-b492-09634879f986" containerName="payload-processing"
Sep 18 22:14:55.310077 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:55.310009    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="377be7e7-2c51-40c4-b32b-dba11688afee" containerName="revoke-keys"
Sep 18 22:14:55.313137 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:55.313116    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x"
Sep 18 22:14:55.316229 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:14:55.316200    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"payload-processing-plugins-e2e-migrate-8ed3d70b\" is forbidden: User \"system:node:ip-10-0-141-255.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-255.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-8ed3d70b\"" type="*v1.ConfigMap"
Sep 18 22:14:55.316229 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:14:55.316196    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x\" is forbidden: User \"system:node:ip-10-0-141-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-255.ec2.internal' and this object" podUID="125f932e-94b0-4874-9d76-7ebf8ff7e2e2" pod="openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x"
Sep 18 22:14:55.316372 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:14:55.316209    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"payload-processing-e2e-migrate-8ed3d70b-dockercfg-bs7pp\" is forbidden: User \"system:node:ip-10-0-141-255.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-255.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-8ed3d70b-dockercfg-bs7pp\"" type="*v1.Secret"
Sep 18 22:14:55.347735 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:55.347711    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x"]
Sep 18 22:14:55.418620 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:55.418593    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6"]
Sep 18 22:14:55.419960 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:55.419928    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/125f932e-94b0-4874-9d76-7ebf8ff7e2e2-plugins-config-volume\") pod \"payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x\" (UID: \"125f932e-94b0-4874-9d76-7ebf8ff7e2e2\") " pod="openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x"
Sep 18 22:14:55.419960 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:55.419959    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x74x\" (UniqueName: \"kubernetes.io/projected/125f932e-94b0-4874-9d76-7ebf8ff7e2e2-kube-api-access-2x74x\") pod \"payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x\" (UID: \"125f932e-94b0-4874-9d76-7ebf8ff7e2e2\") " pod="openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x"
Sep 18 22:14:55.421882 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:55.421863    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6"
Sep 18 22:14:55.449443 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:55.449411    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6"]
Sep 18 22:14:55.521035 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:55.521003    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/125f932e-94b0-4874-9d76-7ebf8ff7e2e2-plugins-config-volume\") pod \"payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x\" (UID: \"125f932e-94b0-4874-9d76-7ebf8ff7e2e2\") " pod="openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x"
Sep 18 22:14:55.521035 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:55.521036    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x74x\" (UniqueName: \"kubernetes.io/projected/125f932e-94b0-4874-9d76-7ebf8ff7e2e2-kube-api-access-2x74x\") pod \"payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x\" (UID: \"125f932e-94b0-4874-9d76-7ebf8ff7e2e2\") " pod="openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x"
Sep 18 22:14:55.521258 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:55.521086    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjt7b\" (UniqueName: \"kubernetes.io/projected/d8d0f53d-9a83-4b7c-a534-39beb484f6e4-kube-api-access-vjt7b\") pod \"payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6\" (UID: \"d8d0f53d-9a83-4b7c-a534-39beb484f6e4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6"
Sep 18 22:14:55.521258 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:55.521162    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8d0f53d-9a83-4b7c-a534-39beb484f6e4-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6\" (UID: \"d8d0f53d-9a83-4b7c-a534-39beb484f6e4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6"
Sep 18 22:14:55.549685 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:55.549664    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x74x\" (UniqueName: \"kubernetes.io/projected/125f932e-94b0-4874-9d76-7ebf8ff7e2e2-kube-api-access-2x74x\") pod \"payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x\" (UID: \"125f932e-94b0-4874-9d76-7ebf8ff7e2e2\") " pod="openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x"
Sep 18 22:14:55.622665 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:55.622587    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjt7b\" (UniqueName: \"kubernetes.io/projected/d8d0f53d-9a83-4b7c-a534-39beb484f6e4-kube-api-access-vjt7b\") pod \"payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6\" (UID: \"d8d0f53d-9a83-4b7c-a534-39beb484f6e4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6"
Sep 18 22:14:55.622665 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:55.622645    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8d0f53d-9a83-4b7c-a534-39beb484f6e4-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6\" (UID: \"d8d0f53d-9a83-4b7c-a534-39beb484f6e4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6"
Sep 18 22:14:55.651605 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:55.651579    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjt7b\" (UniqueName: \"kubernetes.io/projected/d8d0f53d-9a83-4b7c-a534-39beb484f6e4-kube-api-access-vjt7b\") pod \"payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6\" (UID: \"d8d0f53d-9a83-4b7c-a534-39beb484f6e4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6"
Sep 18 22:14:56.521333 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:14:56.521290    2574 configmap.go:193] Couldn't get configMap openshift-ingress/payload-processing-plugins-e2e-migrate-8ed3d70b: failed to sync configmap cache: timed out waiting for the condition
Sep 18 22:14:56.521774 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:14:56.521372    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/125f932e-94b0-4874-9d76-7ebf8ff7e2e2-plugins-config-volume podName:125f932e-94b0-4874-9d76-7ebf8ff7e2e2 nodeName:}" failed. No retries permitted until 2026-09-18 22:14:57.021355265 +0000 UTC m=+872.153136325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugins-config-volume" (UniqueName: "kubernetes.io/configmap/125f932e-94b0-4874-9d76-7ebf8ff7e2e2-plugins-config-volume") pod "payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x" (UID: "125f932e-94b0-4874-9d76-7ebf8ff7e2e2") : failed to sync configmap cache: timed out waiting for the condition
Sep 18 22:14:56.583682 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:56.583652    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-8ed3d70b-dockercfg-bs7pp\""
Sep 18 22:14:56.622972 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:14:56.622942    2574 configmap.go:193] Couldn't get configMap openshift-ingress/payload-processing-plugins-e2e-migrate-8ed3d70b: failed to sync configmap cache: timed out waiting for the condition
Sep 18 22:14:56.623112 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:14:56.623023    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d8d0f53d-9a83-4b7c-a534-39beb484f6e4-plugins-config-volume podName:d8d0f53d-9a83-4b7c-a534-39beb484f6e4 nodeName:}" failed. No retries permitted until 2026-09-18 22:14:57.123001441 +0000 UTC m=+872.254782509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugins-config-volume" (UniqueName: "kubernetes.io/configmap/d8d0f53d-9a83-4b7c-a534-39beb484f6e4-plugins-config-volume") pod "payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6" (UID: "d8d0f53d-9a83-4b7c-a534-39beb484f6e4") : failed to sync configmap cache: timed out waiting for the condition
Sep 18 22:14:56.627997 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:56.627978    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-8ed3d70b\""
Sep 18 22:14:57.036133 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:57.036103    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/125f932e-94b0-4874-9d76-7ebf8ff7e2e2-plugins-config-volume\") pod \"payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x\" (UID: \"125f932e-94b0-4874-9d76-7ebf8ff7e2e2\") " pod="openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x"
Sep 18 22:14:57.036867 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:57.036841    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/125f932e-94b0-4874-9d76-7ebf8ff7e2e2-plugins-config-volume\") pod \"payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x\" (UID: \"125f932e-94b0-4874-9d76-7ebf8ff7e2e2\") " pod="openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x"
Sep 18 22:14:57.125017 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:57.124984    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x"
Sep 18 22:14:57.137261 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:57.137237    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8d0f53d-9a83-4b7c-a534-39beb484f6e4-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6\" (UID: \"d8d0f53d-9a83-4b7c-a534-39beb484f6e4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6"
Sep 18 22:14:57.137916 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:57.137899    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8d0f53d-9a83-4b7c-a534-39beb484f6e4-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6\" (UID: \"d8d0f53d-9a83-4b7c-a534-39beb484f6e4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6"
Sep 18 22:14:57.231257 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:57.231224    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6"
Sep 18 22:14:57.435688 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:14:57.435660    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod125f932e_94b0_4874_9d76_7ebf8ff7e2e2.slice/crio-cf172ac1f179f8e6abd77bcdd183c5738061c3449597f61820c7096a7e6ab085 WatchSource:0}: Error finding container cf172ac1f179f8e6abd77bcdd183c5738061c3449597f61820c7096a7e6ab085: Status 404 returned error can't find the container with id cf172ac1f179f8e6abd77bcdd183c5738061c3449597f61820c7096a7e6ab085
Sep 18 22:14:57.436911 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:57.436891    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x"]
Sep 18 22:14:57.525078 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:57.525041    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6"]
Sep 18 22:14:57.527364 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:14:57.527338    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8d0f53d_9a83_4b7c_a534_39beb484f6e4.slice/crio-460c2106b265176943d97c3254ca2bd899ef17853b7430daba66a4316ff4eeb4 WatchSource:0}: Error finding container 460c2106b265176943d97c3254ca2bd899ef17853b7430daba66a4316ff4eeb4: Status 404 returned error can't find the container with id 460c2106b265176943d97c3254ca2bd899ef17853b7430daba66a4316ff4eeb4
Sep 18 22:14:58.118854 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:58.118821    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x" event={"ID":"125f932e-94b0-4874-9d76-7ebf8ff7e2e2","Type":"ContainerStarted","Data":"2840a2e5cebcabfefd39e5ee92ec19a11ce6d919176124efae4973a3b1247977"}
Sep 18 22:14:58.119039 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:58.118879    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x" event={"ID":"125f932e-94b0-4874-9d76-7ebf8ff7e2e2","Type":"ContainerStarted","Data":"cf172ac1f179f8e6abd77bcdd183c5738061c3449597f61820c7096a7e6ab085"}
Sep 18 22:14:58.119039 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:58.118918    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x"
Sep 18 22:14:58.120570 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:58.120543    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6" event={"ID":"d8d0f53d-9a83-4b7c-a534-39beb484f6e4","Type":"ContainerStarted","Data":"3e241f3a891bcd27b0a0aee332036b56a7a32a277f0868f1bc717bcfff9725f7"}
Sep 18 22:14:58.120698 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:58.120587    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6"
Sep 18 22:14:58.120698 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:58.120603    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6" event={"ID":"d8d0f53d-9a83-4b7c-a534-39beb484f6e4","Type":"ContainerStarted","Data":"460c2106b265176943d97c3254ca2bd899ef17853b7430daba66a4316ff4eeb4"}
Sep 18 22:14:58.156265 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:58.156213    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x" podStartSLOduration=3.156199069 podStartE2EDuration="3.156199069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:14:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:14:58.154399764 +0000 UTC m=+873.286180846" watchObservedRunningTime="2026-09-18 22:14:58.156199069 +0000 UTC m=+873.287980161"
Sep 18 22:14:58.187196 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:14:58.187150    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6" podStartSLOduration=3.187133516 podStartE2EDuration="3.187133516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:14:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:14:58.185107423 +0000 UTC m=+873.316888506" watchObservedRunningTime="2026-09-18 22:14:58.187133516 +0000 UTC m=+873.318914600"
Sep 18 22:15:00.164002 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:00.163960    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-8ed3d70b-29829495-7kvgm"]
Sep 18 22:15:00.168051 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:00.168022    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829495-xw78h"]
Sep 18 22:15:00.168198 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:00.168169    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-8ed3d70b-29829495-7kvgm"
Sep 18 22:15:00.171394 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:00.171365    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9g7m4\""
Sep 18 22:15:00.172196 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:00.172177    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829495-xw78h"
Sep 18 22:15:00.183009 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:00.182989    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-8ed3d70b-29829495-7kvgm"
Sep 18 22:15:00.185460 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:00.185435    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829495-xw78h"]
Sep 18 22:15:00.189731 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:00.189709    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-8ed3d70b-29829495-7kvgm"]
Sep 18 22:15:00.191131 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:00.191111    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829495-xw78h"
Sep 18 22:15:00.214986 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:00.214957    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3d28c1-29829495-bjrt6"]
Sep 18 22:15:00.220678 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:00.220655    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3d28c1-29829495-bjrt6"
Sep 18 22:15:00.235983 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:00.235958    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3d28c1-29829495-bjrt6"
Sep 18 22:15:00.236680 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:00.235984    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3d28c1-29829495-bjrt6"]
Sep 18 22:15:00.489747 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:00.489720    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-8ed3d70b-29829495-7kvgm"]
Sep 18 22:15:00.491725 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:15:00.491699    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55e4f7b1_d85a_4955_898e_054b80c66a94.slice/crio-797b173dbeda226af8b620bf097b3ed7ab225338aea5f1567c3f831a09438106 WatchSource:0}: Error finding container 797b173dbeda226af8b620bf097b3ed7ab225338aea5f1567c3f831a09438106: Status 404 returned error can't find the container with id 797b173dbeda226af8b620bf097b3ed7ab225338aea5f1567c3f831a09438106
Sep 18 22:15:00.506065 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:00.506040    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829495-xw78h"]
Sep 18 22:15:00.506919 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:15:00.506897    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode141295d_62de_4c82_b421_149360c89dfc.slice/crio-5f801b73e6ef1fe586d37cb1a79db23d601a0897618e3f53e65d832326907157 WatchSource:0}: Error finding container 5f801b73e6ef1fe586d37cb1a79db23d601a0897618e3f53e65d832326907157: Status 404 returned error can't find the container with id 5f801b73e6ef1fe586d37cb1a79db23d601a0897618e3f53e65d832326907157
Sep 18 22:15:00.575462 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:00.575440    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3d28c1-29829495-bjrt6"]
Sep 18 22:15:00.576394 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:15:00.576369    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae66312c_88ba_4519_8c8e_ed63c962c1ee.slice/crio-3e1b6c77c6743c8ee50d3c69118501d49dc48b84c1162be7b84e2aa1ed38210c WatchSource:0}: Error finding container 3e1b6c77c6743c8ee50d3c69118501d49dc48b84c1162be7b84e2aa1ed38210c: Status 404 returned error can't find the container with id 3e1b6c77c6743c8ee50d3c69118501d49dc48b84c1162be7b84e2aa1ed38210c
Sep 18 22:15:01.139976 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:01.139815    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829495-xw78h" event={"ID":"e141295d-62de-4c82-b421-149360c89dfc","Type":"ContainerStarted","Data":"e8147e2e6a076cd44857f5562404dd1b69c5e376559108abbed6d4c818c1218e"}
Sep 18 22:15:01.139976 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:01.139887    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829495-xw78h" event={"ID":"e141295d-62de-4c82-b421-149360c89dfc","Type":"ContainerStarted","Data":"5f801b73e6ef1fe586d37cb1a79db23d601a0897618e3f53e65d832326907157"}
Sep 18 22:15:01.141776 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:01.141747    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3d28c1-29829495-bjrt6" event={"ID":"ae66312c-88ba-4519-8c8e-ed63c962c1ee","Type":"ContainerStarted","Data":"01b0c66067f3fbd1129c59b273f8c1b4023f849b321b424ec0f0180fdd0e4e4e"}
Sep 18 22:15:01.142059 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:01.141800    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3d28c1-29829495-bjrt6" event={"ID":"ae66312c-88ba-4519-8c8e-ed63c962c1ee","Type":"ContainerStarted","Data":"3e1b6c77c6743c8ee50d3c69118501d49dc48b84c1162be7b84e2aa1ed38210c"}
Sep 18 22:15:01.143600 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:01.143577    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-8ed3d70b-29829495-7kvgm" event={"ID":"55e4f7b1-d85a-4955-898e-054b80c66a94","Type":"ContainerStarted","Data":"c446aef60949bf2abaefdc6a3136eb82b4b04d96df0482961e913877d4f83c8e"}
Sep 18 22:15:01.143793 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:01.143642    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-8ed3d70b-29829495-7kvgm" event={"ID":"55e4f7b1-d85a-4955-898e-054b80c66a94","Type":"ContainerStarted","Data":"797b173dbeda226af8b620bf097b3ed7ab225338aea5f1567c3f831a09438106"}
Sep 18 22:15:01.157967 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:01.157916    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829495-xw78h" podStartSLOduration=1.157897449 podStartE2EDuration="1.157897449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:15:01.157731474 +0000 UTC m=+876.289512557" watchObservedRunningTime="2026-09-18 22:15:01.157897449 +0000 UTC m=+876.289678526"
Sep 18 22:15:01.175747 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:01.175709    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-8ed3d70b-29829495-7kvgm" podStartSLOduration=1.175698756 podStartE2EDuration="1.175698756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:15:01.174031178 +0000 UTC m=+876.305812264" watchObservedRunningTime="2026-09-18 22:15:01.175698756 +0000 UTC m=+876.307479882"
Sep 18 22:15:01.191759 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:01.191712    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3d28c1-29829495-bjrt6" podStartSLOduration=1.191699255 podStartE2EDuration="1.191699255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:15:01.190138657 +0000 UTC m=+876.321919751" watchObservedRunningTime="2026-09-18 22:15:01.191699255 +0000 UTC m=+876.323480352"
Sep 18 22:15:02.150134 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:02.150099    2574 generic.go:356] "Generic (PLEG): container finished" podID="e141295d-62de-4c82-b421-149360c89dfc" containerID="e8147e2e6a076cd44857f5562404dd1b69c5e376559108abbed6d4c818c1218e" exitCode=0
Sep 18 22:15:02.150316 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:02.150178    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829495-xw78h" event={"ID":"e141295d-62de-4c82-b421-149360c89dfc","Type":"ContainerDied","Data":"e8147e2e6a076cd44857f5562404dd1b69c5e376559108abbed6d4c818c1218e"}
Sep 18 22:15:02.151608 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:02.151586    2574 generic.go:356] "Generic (PLEG): container finished" podID="ae66312c-88ba-4519-8c8e-ed63c962c1ee" containerID="01b0c66067f3fbd1129c59b273f8c1b4023f849b321b424ec0f0180fdd0e4e4e" exitCode=0
Sep 18 22:15:02.151734 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:02.151665    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3d28c1-29829495-bjrt6" event={"ID":"ae66312c-88ba-4519-8c8e-ed63c962c1ee","Type":"ContainerDied","Data":"01b0c66067f3fbd1129c59b273f8c1b4023f849b321b424ec0f0180fdd0e4e4e"}
Sep 18 22:15:02.153207 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:02.153182    2574 generic.go:356] "Generic (PLEG): container finished" podID="55e4f7b1-d85a-4955-898e-054b80c66a94" containerID="c446aef60949bf2abaefdc6a3136eb82b4b04d96df0482961e913877d4f83c8e" exitCode=7
Sep 18 22:15:02.153320 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:02.153215    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-8ed3d70b-29829495-7kvgm" event={"ID":"55e4f7b1-d85a-4955-898e-054b80c66a94","Type":"ContainerDied","Data":"c446aef60949bf2abaefdc6a3136eb82b4b04d96df0482961e913877d4f83c8e"}
Sep 18 22:15:02.153391 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:02.153375    2574 scope.go:117] "RemoveContainer" containerID="c446aef60949bf2abaefdc6a3136eb82b4b04d96df0482961e913877d4f83c8e"
Sep 18 22:15:03.160522 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:03.160475    2574 generic.go:356] "Generic (PLEG): container finished" podID="55e4f7b1-d85a-4955-898e-054b80c66a94" containerID="d287207639eafb4c857a5929c3cbdb1a04e0f2a3cc09d677a0e02c387edcd269" exitCode=0
Sep 18 22:15:03.160884 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:03.160567    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-8ed3d70b-29829495-7kvgm" event={"ID":"55e4f7b1-d85a-4955-898e-054b80c66a94","Type":"ContainerDied","Data":"d287207639eafb4c857a5929c3cbdb1a04e0f2a3cc09d677a0e02c387edcd269"}
Sep 18 22:15:03.160884 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:03.160628    2574 scope.go:117] "RemoveContainer" containerID="c446aef60949bf2abaefdc6a3136eb82b4b04d96df0482961e913877d4f83c8e"
Sep 18 22:15:03.311695 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:03.311673    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3d28c1-29829495-bjrt6"
Sep 18 22:15:03.327831 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:03.327812    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829495-xw78h"
Sep 18 22:15:04.169081 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:04.169051    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829495-xw78h"
Sep 18 22:15:04.169465 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:04.169056    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829495-xw78h" event={"ID":"e141295d-62de-4c82-b421-149360c89dfc","Type":"ContainerDied","Data":"5f801b73e6ef1fe586d37cb1a79db23d601a0897618e3f53e65d832326907157"}
Sep 18 22:15:04.169465 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:04.169170    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f801b73e6ef1fe586d37cb1a79db23d601a0897618e3f53e65d832326907157"
Sep 18 22:15:04.170462 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:04.170432    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3d28c1-29829495-bjrt6"
Sep 18 22:15:04.170564 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:04.170475    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3d28c1-29829495-bjrt6" event={"ID":"ae66312c-88ba-4519-8c8e-ed63c962c1ee","Type":"ContainerDied","Data":"3e1b6c77c6743c8ee50d3c69118501d49dc48b84c1162be7b84e2aa1ed38210c"}
Sep 18 22:15:04.170564 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:04.170529    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e1b6c77c6743c8ee50d3c69118501d49dc48b84c1162be7b84e2aa1ed38210c"
Sep 18 22:15:04.309189 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:04.309169    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-8ed3d70b-29829495-7kvgm"
Sep 18 22:15:05.178697 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:05.178667    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-8ed3d70b-29829495-7kvgm" event={"ID":"55e4f7b1-d85a-4955-898e-054b80c66a94","Type":"ContainerDied","Data":"797b173dbeda226af8b620bf097b3ed7ab225338aea5f1567c3f831a09438106"}
Sep 18 22:15:05.178697 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:05.178688    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-8ed3d70b-29829495-7kvgm"
Sep 18 22:15:05.178697 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:05.178711    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="797b173dbeda226af8b620bf097b3ed7ab225338aea5f1567c3f831a09438106"
Sep 18 22:15:09.129464 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:09.129433    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x"
Sep 18 22:15:09.129972 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:09.129623    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6"
Sep 18 22:15:32.600091 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:32.600045    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-8ed3d70b-29829495-7kvgm"]
Sep 18 22:15:32.603242 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:32.603217    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-8ed3d70b-29829495-7kvgm"]
Sep 18 22:15:32.644784 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:32.644749    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x"]
Sep 18 22:15:32.645004 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:32.644983    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x" podUID="125f932e-94b0-4874-9d76-7ebf8ff7e2e2" containerName="payload-processing" containerID="cri-o://2840a2e5cebcabfefd39e5ee92ec19a11ce6d919176124efae4973a3b1247977" gracePeriod=30
Sep 18 22:15:32.662613 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:32.662588    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6"]
Sep 18 22:15:32.662800 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:32.662765    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6" podUID="d8d0f53d-9a83-4b7c-a534-39beb484f6e4" containerName="payload-pre-processing" containerID="cri-o://3e241f3a891bcd27b0a0aee332036b56a7a32a277f0868f1bc717bcfff9725f7" gracePeriod=30
Sep 18 22:15:32.946878 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:32.946854    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x"
Sep 18 22:15:32.950419 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:32.950399    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2x74x\" (UniqueName: \"kubernetes.io/projected/125f932e-94b0-4874-9d76-7ebf8ff7e2e2-kube-api-access-2x74x\") pod \"125f932e-94b0-4874-9d76-7ebf8ff7e2e2\" (UID: \"125f932e-94b0-4874-9d76-7ebf8ff7e2e2\") "
Sep 18 22:15:32.950539 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:32.950429    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/125f932e-94b0-4874-9d76-7ebf8ff7e2e2-plugins-config-volume\") pod \"125f932e-94b0-4874-9d76-7ebf8ff7e2e2\" (UID: \"125f932e-94b0-4874-9d76-7ebf8ff7e2e2\") "
Sep 18 22:15:32.950843 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:32.950817    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/125f932e-94b0-4874-9d76-7ebf8ff7e2e2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "125f932e-94b0-4874-9d76-7ebf8ff7e2e2" (UID: "125f932e-94b0-4874-9d76-7ebf8ff7e2e2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:15:32.952676 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:32.952649    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/125f932e-94b0-4874-9d76-7ebf8ff7e2e2-kube-api-access-2x74x" (OuterVolumeSpecName: "kube-api-access-2x74x") pod "125f932e-94b0-4874-9d76-7ebf8ff7e2e2" (UID: "125f932e-94b0-4874-9d76-7ebf8ff7e2e2"). InnerVolumeSpecName "kube-api-access-2x74x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:15:32.964816 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:32.964794    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6"
Sep 18 22:15:33.051224 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.051190    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2x74x\" (UniqueName: \"kubernetes.io/projected/125f932e-94b0-4874-9d76-7ebf8ff7e2e2-kube-api-access-2x74x\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:15:33.051224 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.051216    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/125f932e-94b0-4874-9d76-7ebf8ff7e2e2-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:15:33.152312 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.152232    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjt7b\" (UniqueName: \"kubernetes.io/projected/d8d0f53d-9a83-4b7c-a534-39beb484f6e4-kube-api-access-vjt7b\") pod \"d8d0f53d-9a83-4b7c-a534-39beb484f6e4\" (UID: \"d8d0f53d-9a83-4b7c-a534-39beb484f6e4\") "
Sep 18 22:15:33.152312 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.152273    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8d0f53d-9a83-4b7c-a534-39beb484f6e4-plugins-config-volume\") pod \"d8d0f53d-9a83-4b7c-a534-39beb484f6e4\" (UID: \"d8d0f53d-9a83-4b7c-a534-39beb484f6e4\") "
Sep 18 22:15:33.152733 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.152706    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8d0f53d-9a83-4b7c-a534-39beb484f6e4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d8d0f53d-9a83-4b7c-a534-39beb484f6e4" (UID: "d8d0f53d-9a83-4b7c-a534-39beb484f6e4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:15:33.154406 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.154387    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8d0f53d-9a83-4b7c-a534-39beb484f6e4-kube-api-access-vjt7b" (OuterVolumeSpecName: "kube-api-access-vjt7b") pod "d8d0f53d-9a83-4b7c-a534-39beb484f6e4" (UID: "d8d0f53d-9a83-4b7c-a534-39beb484f6e4"). InnerVolumeSpecName "kube-api-access-vjt7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:15:33.252970 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.252938    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjt7b\" (UniqueName: \"kubernetes.io/projected/d8d0f53d-9a83-4b7c-a534-39beb484f6e4-kube-api-access-vjt7b\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:15:33.252970 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.252961    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8d0f53d-9a83-4b7c-a534-39beb484f6e4-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:15:33.329154 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.329126    2574 generic.go:356] "Generic (PLEG): container finished" podID="125f932e-94b0-4874-9d76-7ebf8ff7e2e2" containerID="2840a2e5cebcabfefd39e5ee92ec19a11ce6d919176124efae4973a3b1247977" exitCode=0
Sep 18 22:15:33.329291 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.329171    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x"
Sep 18 22:15:33.329291 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.329204    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x" event={"ID":"125f932e-94b0-4874-9d76-7ebf8ff7e2e2","Type":"ContainerDied","Data":"2840a2e5cebcabfefd39e5ee92ec19a11ce6d919176124efae4973a3b1247977"}
Sep 18 22:15:33.329291 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.329244    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x" event={"ID":"125f932e-94b0-4874-9d76-7ebf8ff7e2e2","Type":"ContainerDied","Data":"cf172ac1f179f8e6abd77bcdd183c5738061c3449597f61820c7096a7e6ab085"}
Sep 18 22:15:33.329291 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.329267    2574 scope.go:117] "RemoveContainer" containerID="2840a2e5cebcabfefd39e5ee92ec19a11ce6d919176124efae4973a3b1247977"
Sep 18 22:15:33.330607 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.330571    2574 generic.go:356] "Generic (PLEG): container finished" podID="d8d0f53d-9a83-4b7c-a534-39beb484f6e4" containerID="3e241f3a891bcd27b0a0aee332036b56a7a32a277f0868f1bc717bcfff9725f7" exitCode=0
Sep 18 22:15:33.330718 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.330603    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6" event={"ID":"d8d0f53d-9a83-4b7c-a534-39beb484f6e4","Type":"ContainerDied","Data":"3e241f3a891bcd27b0a0aee332036b56a7a32a277f0868f1bc717bcfff9725f7"}
Sep 18 22:15:33.330718 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.330650    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6" event={"ID":"d8d0f53d-9a83-4b7c-a534-39beb484f6e4","Type":"ContainerDied","Data":"460c2106b265176943d97c3254ca2bd899ef17853b7430daba66a4316ff4eeb4"}
Sep 18 22:15:33.330718 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.330611    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6"
Sep 18 22:15:33.344982 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.344933    2574 scope.go:117] "RemoveContainer" containerID="2840a2e5cebcabfefd39e5ee92ec19a11ce6d919176124efae4973a3b1247977"
Sep 18 22:15:33.345255 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:15:33.345235    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2840a2e5cebcabfefd39e5ee92ec19a11ce6d919176124efae4973a3b1247977\": container with ID starting with 2840a2e5cebcabfefd39e5ee92ec19a11ce6d919176124efae4973a3b1247977 not found: ID does not exist" containerID="2840a2e5cebcabfefd39e5ee92ec19a11ce6d919176124efae4973a3b1247977"
Sep 18 22:15:33.345322 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.345261    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2840a2e5cebcabfefd39e5ee92ec19a11ce6d919176124efae4973a3b1247977"} err="failed to get container status \"2840a2e5cebcabfefd39e5ee92ec19a11ce6d919176124efae4973a3b1247977\": rpc error: code = NotFound desc = could not find container \"2840a2e5cebcabfefd39e5ee92ec19a11ce6d919176124efae4973a3b1247977\": container with ID starting with 2840a2e5cebcabfefd39e5ee92ec19a11ce6d919176124efae4973a3b1247977 not found: ID does not exist"
Sep 18 22:15:33.345322 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.345282    2574 scope.go:117] "RemoveContainer" containerID="3e241f3a891bcd27b0a0aee332036b56a7a32a277f0868f1bc717bcfff9725f7"
Sep 18 22:15:33.348050 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.348028    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55e4f7b1-d85a-4955-898e-054b80c66a94" path="/var/lib/kubelet/pods/55e4f7b1-d85a-4955-898e-054b80c66a94/volumes"
Sep 18 22:15:33.354314 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.354299    2574 scope.go:117] "RemoveContainer" containerID="3e241f3a891bcd27b0a0aee332036b56a7a32a277f0868f1bc717bcfff9725f7"
Sep 18 22:15:33.354635 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:15:33.354615    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e241f3a891bcd27b0a0aee332036b56a7a32a277f0868f1bc717bcfff9725f7\": container with ID starting with 3e241f3a891bcd27b0a0aee332036b56a7a32a277f0868f1bc717bcfff9725f7 not found: ID does not exist" containerID="3e241f3a891bcd27b0a0aee332036b56a7a32a277f0868f1bc717bcfff9725f7"
Sep 18 22:15:33.354698 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.354644    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e241f3a891bcd27b0a0aee332036b56a7a32a277f0868f1bc717bcfff9725f7"} err="failed to get container status \"3e241f3a891bcd27b0a0aee332036b56a7a32a277f0868f1bc717bcfff9725f7\": rpc error: code = NotFound desc = could not find container \"3e241f3a891bcd27b0a0aee332036b56a7a32a277f0868f1bc717bcfff9725f7\": container with ID starting with 3e241f3a891bcd27b0a0aee332036b56a7a32a277f0868f1bc717bcfff9725f7 not found: ID does not exist"
Sep 18 22:15:33.358909 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.358889    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x"]
Sep 18 22:15:33.361968 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.361948    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-8ed3d70b-56ddd5dc7d-k699x"]
Sep 18 22:15:33.374470 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.374447    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6"]
Sep 18 22:15:33.382132 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:33.382113    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-8ed3d70b-76bd69d654-g88m6"]
Sep 18 22:15:35.345797 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:35.345764    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="125f932e-94b0-4874-9d76-7ebf8ff7e2e2" path="/var/lib/kubelet/pods/125f932e-94b0-4874-9d76-7ebf8ff7e2e2/volumes"
Sep 18 22:15:35.346197 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:35.346107    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8d0f53d-9a83-4b7c-a534-39beb484f6e4" path="/var/lib/kubelet/pods/d8d0f53d-9a83-4b7c-a534-39beb484f6e4/volumes"
Sep 18 22:15:41.079212 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.079174    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9"]
Sep 18 22:15:41.079686 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.079598    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e141295d-62de-4c82-b421-149360c89dfc" containerName="cleanup"
Sep 18 22:15:41.079686 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.079614    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e141295d-62de-4c82-b421-149360c89dfc" containerName="cleanup"
Sep 18 22:15:41.079686 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.079638    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="125f932e-94b0-4874-9d76-7ebf8ff7e2e2" containerName="payload-processing"
Sep 18 22:15:41.079686 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.079644    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="125f932e-94b0-4874-9d76-7ebf8ff7e2e2" containerName="payload-processing"
Sep 18 22:15:41.079686 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.079654    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55e4f7b1-d85a-4955-898e-054b80c66a94" containerName="cleanup"
Sep 18 22:15:41.079686 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.079662    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="55e4f7b1-d85a-4955-898e-054b80c66a94" containerName="cleanup"
Sep 18 22:15:41.079686 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.079675    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55e4f7b1-d85a-4955-898e-054b80c66a94" containerName="cleanup"
Sep 18 22:15:41.079686 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.079682    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="55e4f7b1-d85a-4955-898e-054b80c66a94" containerName="cleanup"
Sep 18 22:15:41.080026 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.079698    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8d0f53d-9a83-4b7c-a534-39beb484f6e4" containerName="payload-pre-processing"
Sep 18 22:15:41.080026 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.079708    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8d0f53d-9a83-4b7c-a534-39beb484f6e4" containerName="payload-pre-processing"
Sep 18 22:15:41.080026 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.079717    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae66312c-88ba-4519-8c8e-ed63c962c1ee" containerName="cleanup"
Sep 18 22:15:41.080026 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.079722    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae66312c-88ba-4519-8c8e-ed63c962c1ee" containerName="cleanup"
Sep 18 22:15:41.080026 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.079800    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="55e4f7b1-d85a-4955-898e-054b80c66a94" containerName="cleanup"
Sep 18 22:15:41.080026 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.079812    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8d0f53d-9a83-4b7c-a534-39beb484f6e4" containerName="payload-pre-processing"
Sep 18 22:15:41.080026 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.079819    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="55e4f7b1-d85a-4955-898e-054b80c66a94" containerName="cleanup"
Sep 18 22:15:41.080026 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.079830    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="125f932e-94b0-4874-9d76-7ebf8ff7e2e2" containerName="payload-processing"
Sep 18 22:15:41.080026 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.079839    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e141295d-62de-4c82-b421-149360c89dfc" containerName="cleanup"
Sep 18 22:15:41.080026 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.079846    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae66312c-88ba-4519-8c8e-ed63c962c1ee" containerName="cleanup"
Sep 18 22:15:41.084409 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.084392    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9"
Sep 18 22:15:41.093057 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.093036    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-0144e4de\""
Sep 18 22:15:41.120291 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.120258    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/760973cf-2292-4e2e-b8cb-6ab30dc23dec-plugins-config-volume\") pod \"payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9\" (UID: \"760973cf-2292-4e2e-b8cb-6ab30dc23dec\") " pod="openshift-ingress/payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9"
Sep 18 22:15:41.120418 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.120317    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccgn4\" (UniqueName: \"kubernetes.io/projected/760973cf-2292-4e2e-b8cb-6ab30dc23dec-kube-api-access-ccgn4\") pod \"payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9\" (UID: \"760973cf-2292-4e2e-b8cb-6ab30dc23dec\") " pod="openshift-ingress/payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9"
Sep 18 22:15:41.124732 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.124711    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9"]
Sep 18 22:15:41.157483 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.157453    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc"]
Sep 18 22:15:41.161003 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.160987    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc"
Sep 18 22:15:41.164660 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.164638    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-0144e4de-dockercfg-dpsq9\""
Sep 18 22:15:41.193435 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.193402    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc"]
Sep 18 22:15:41.221471 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.221442    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w98r9\" (UniqueName: \"kubernetes.io/projected/be660314-e234-4c82-bb05-725adbcbd3f2-kube-api-access-w98r9\") pod \"payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc\" (UID: \"be660314-e234-4c82-bb05-725adbcbd3f2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc"
Sep 18 22:15:41.221623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.221479    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be660314-e234-4c82-bb05-725adbcbd3f2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc\" (UID: \"be660314-e234-4c82-bb05-725adbcbd3f2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc"
Sep 18 22:15:41.221623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.221614    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/760973cf-2292-4e2e-b8cb-6ab30dc23dec-plugins-config-volume\") pod \"payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9\" (UID: \"760973cf-2292-4e2e-b8cb-6ab30dc23dec\") " pod="openshift-ingress/payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9"
Sep 18 22:15:41.221747 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.221674    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccgn4\" (UniqueName: \"kubernetes.io/projected/760973cf-2292-4e2e-b8cb-6ab30dc23dec-kube-api-access-ccgn4\") pod \"payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9\" (UID: \"760973cf-2292-4e2e-b8cb-6ab30dc23dec\") " pod="openshift-ingress/payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9"
Sep 18 22:15:41.222329 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.222308    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/760973cf-2292-4e2e-b8cb-6ab30dc23dec-plugins-config-volume\") pod \"payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9\" (UID: \"760973cf-2292-4e2e-b8cb-6ab30dc23dec\") " pod="openshift-ingress/payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9"
Sep 18 22:15:41.235903 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.235877    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccgn4\" (UniqueName: \"kubernetes.io/projected/760973cf-2292-4e2e-b8cb-6ab30dc23dec-kube-api-access-ccgn4\") pod \"payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9\" (UID: \"760973cf-2292-4e2e-b8cb-6ab30dc23dec\") " pod="openshift-ingress/payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9"
Sep 18 22:15:41.322144 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.322115    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w98r9\" (UniqueName: \"kubernetes.io/projected/be660314-e234-4c82-bb05-725adbcbd3f2-kube-api-access-w98r9\") pod \"payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc\" (UID: \"be660314-e234-4c82-bb05-725adbcbd3f2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc"
Sep 18 22:15:41.322312 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.322164    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be660314-e234-4c82-bb05-725adbcbd3f2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc\" (UID: \"be660314-e234-4c82-bb05-725adbcbd3f2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc"
Sep 18 22:15:41.322864 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.322845    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be660314-e234-4c82-bb05-725adbcbd3f2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc\" (UID: \"be660314-e234-4c82-bb05-725adbcbd3f2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc"
Sep 18 22:15:41.354121 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.354061    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w98r9\" (UniqueName: \"kubernetes.io/projected/be660314-e234-4c82-bb05-725adbcbd3f2-kube-api-access-w98r9\") pod \"payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc\" (UID: \"be660314-e234-4c82-bb05-725adbcbd3f2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc"
Sep 18 22:15:41.395244 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.395216    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9"
Sep 18 22:15:41.470868 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.470838    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc"
Sep 18 22:15:41.692498 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:15:41.692469    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod760973cf_2292_4e2e_b8cb_6ab30dc23dec.slice/crio-1e3d691e33036d5219be76541f0b9d79cd786fc570475c657bc65667cbc44562 WatchSource:0}: Error finding container 1e3d691e33036d5219be76541f0b9d79cd786fc570475c657bc65667cbc44562: Status 404 returned error can't find the container with id 1e3d691e33036d5219be76541f0b9d79cd786fc570475c657bc65667cbc44562
Sep 18 22:15:41.692950 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.692928    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9"]
Sep 18 22:15:41.762980 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:41.762956    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc"]
Sep 18 22:15:41.764893 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:15:41.764835    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe660314_e234_4c82_bb05_725adbcbd3f2.slice/crio-93b717ee846c501eefc0fab6f3826d44d5f00348156b2f823b4efb0f44fdfd00 WatchSource:0}: Error finding container 93b717ee846c501eefc0fab6f3826d44d5f00348156b2f823b4efb0f44fdfd00: Status 404 returned error can't find the container with id 93b717ee846c501eefc0fab6f3826d44d5f00348156b2f823b4efb0f44fdfd00
Sep 18 22:15:42.379773 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:42.379733    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9" event={"ID":"760973cf-2292-4e2e-b8cb-6ab30dc23dec","Type":"ContainerStarted","Data":"604d8ff1f691bbaed21d16b91b57ba1114aaeb5c22f0f3ee353850e48506089d"}
Sep 18 22:15:42.380199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:42.379796    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9" event={"ID":"760973cf-2292-4e2e-b8cb-6ab30dc23dec","Type":"ContainerStarted","Data":"1e3d691e33036d5219be76541f0b9d79cd786fc570475c657bc65667cbc44562"}
Sep 18 22:15:42.380199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:42.380126    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9"
Sep 18 22:15:42.381329 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:42.381309    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc" event={"ID":"be660314-e234-4c82-bb05-725adbcbd3f2","Type":"ContainerStarted","Data":"8e683a2e182ccbaaf66a3bba0627bc8c9ed8ca4cb5eeeed2db3de2c2abff3122"}
Sep 18 22:15:42.381416 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:42.381346    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc" event={"ID":"be660314-e234-4c82-bb05-725adbcbd3f2","Type":"ContainerStarted","Data":"93b717ee846c501eefc0fab6f3826d44d5f00348156b2f823b4efb0f44fdfd00"}
Sep 18 22:15:42.381452 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:42.381422    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc"
Sep 18 22:15:42.438611 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:42.438553    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9" podStartSLOduration=1.438532996 podStartE2EDuration="1.438532996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:15:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:15:42.437299718 +0000 UTC m=+917.569080802" watchObservedRunningTime="2026-09-18 22:15:42.438532996 +0000 UTC m=+917.570314077"
Sep 18 22:15:42.509034 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:42.508983    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc" podStartSLOduration=1.508964423 podStartE2EDuration="1.508964423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:15:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:15:42.50786756 +0000 UTC m=+917.639648655" watchObservedRunningTime="2026-09-18 22:15:42.508964423 +0000 UTC m=+917.640745504"
Sep 18 22:15:53.389700 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:53.389664    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc"
Sep 18 22:15:54.394230 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:15:54.394201    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9"
Sep 18 22:16:19.228922 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.228888    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9"]
Sep 18 22:16:19.229444 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.229121    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9" podUID="760973cf-2292-4e2e-b8cb-6ab30dc23dec" containerName="payload-processing" containerID="cri-o://604d8ff1f691bbaed21d16b91b57ba1114aaeb5c22f0f3ee353850e48506089d" gracePeriod=30
Sep 18 22:16:19.238433 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.238403    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc"]
Sep 18 22:16:19.238711 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.238658    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc" podUID="be660314-e234-4c82-bb05-725adbcbd3f2" containerName="payload-pre-processing" containerID="cri-o://8e683a2e182ccbaaf66a3bba0627bc8c9ed8ca4cb5eeeed2db3de2c2abff3122" gracePeriod=30
Sep 18 22:16:19.511478 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.511451    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9"
Sep 18 22:16:19.514617 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.514589    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc"
Sep 18 22:16:19.569231 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.569201    2574 generic.go:356] "Generic (PLEG): container finished" podID="be660314-e234-4c82-bb05-725adbcbd3f2" containerID="8e683a2e182ccbaaf66a3bba0627bc8c9ed8ca4cb5eeeed2db3de2c2abff3122" exitCode=0
Sep 18 22:16:19.569406 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.569249    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc"
Sep 18 22:16:19.569406 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.569289    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc" event={"ID":"be660314-e234-4c82-bb05-725adbcbd3f2","Type":"ContainerDied","Data":"8e683a2e182ccbaaf66a3bba0627bc8c9ed8ca4cb5eeeed2db3de2c2abff3122"}
Sep 18 22:16:19.569406 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.569345    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc" event={"ID":"be660314-e234-4c82-bb05-725adbcbd3f2","Type":"ContainerDied","Data":"93b717ee846c501eefc0fab6f3826d44d5f00348156b2f823b4efb0f44fdfd00"}
Sep 18 22:16:19.569406 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.569377    2574 scope.go:117] "RemoveContainer" containerID="8e683a2e182ccbaaf66a3bba0627bc8c9ed8ca4cb5eeeed2db3de2c2abff3122"
Sep 18 22:16:19.570781 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.570740    2574 generic.go:356] "Generic (PLEG): container finished" podID="760973cf-2292-4e2e-b8cb-6ab30dc23dec" containerID="604d8ff1f691bbaed21d16b91b57ba1114aaeb5c22f0f3ee353850e48506089d" exitCode=0
Sep 18 22:16:19.570892 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.570796    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9"
Sep 18 22:16:19.570892 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.570812    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9" event={"ID":"760973cf-2292-4e2e-b8cb-6ab30dc23dec","Type":"ContainerDied","Data":"604d8ff1f691bbaed21d16b91b57ba1114aaeb5c22f0f3ee353850e48506089d"}
Sep 18 22:16:19.570892 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.570856    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9" event={"ID":"760973cf-2292-4e2e-b8cb-6ab30dc23dec","Type":"ContainerDied","Data":"1e3d691e33036d5219be76541f0b9d79cd786fc570475c657bc65667cbc44562"}
Sep 18 22:16:19.578933 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.578913    2574 scope.go:117] "RemoveContainer" containerID="8e683a2e182ccbaaf66a3bba0627bc8c9ed8ca4cb5eeeed2db3de2c2abff3122"
Sep 18 22:16:19.579206 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:16:19.579182    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e683a2e182ccbaaf66a3bba0627bc8c9ed8ca4cb5eeeed2db3de2c2abff3122\": container with ID starting with 8e683a2e182ccbaaf66a3bba0627bc8c9ed8ca4cb5eeeed2db3de2c2abff3122 not found: ID does not exist" containerID="8e683a2e182ccbaaf66a3bba0627bc8c9ed8ca4cb5eeeed2db3de2c2abff3122"
Sep 18 22:16:19.579279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.579215    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e683a2e182ccbaaf66a3bba0627bc8c9ed8ca4cb5eeeed2db3de2c2abff3122"} err="failed to get container status \"8e683a2e182ccbaaf66a3bba0627bc8c9ed8ca4cb5eeeed2db3de2c2abff3122\": rpc error: code = NotFound desc = could not find container \"8e683a2e182ccbaaf66a3bba0627bc8c9ed8ca4cb5eeeed2db3de2c2abff3122\": container with ID starting with 8e683a2e182ccbaaf66a3bba0627bc8c9ed8ca4cb5eeeed2db3de2c2abff3122 not found: ID does not exist"
Sep 18 22:16:19.579279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.579233    2574 scope.go:117] "RemoveContainer" containerID="604d8ff1f691bbaed21d16b91b57ba1114aaeb5c22f0f3ee353850e48506089d"
Sep 18 22:16:19.588042 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.588025    2574 scope.go:117] "RemoveContainer" containerID="604d8ff1f691bbaed21d16b91b57ba1114aaeb5c22f0f3ee353850e48506089d"
Sep 18 22:16:19.588297 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:16:19.588279    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"604d8ff1f691bbaed21d16b91b57ba1114aaeb5c22f0f3ee353850e48506089d\": container with ID starting with 604d8ff1f691bbaed21d16b91b57ba1114aaeb5c22f0f3ee353850e48506089d not found: ID does not exist" containerID="604d8ff1f691bbaed21d16b91b57ba1114aaeb5c22f0f3ee353850e48506089d"
Sep 18 22:16:19.588334 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.588307    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"604d8ff1f691bbaed21d16b91b57ba1114aaeb5c22f0f3ee353850e48506089d"} err="failed to get container status \"604d8ff1f691bbaed21d16b91b57ba1114aaeb5c22f0f3ee353850e48506089d\": rpc error: code = NotFound desc = could not find container \"604d8ff1f691bbaed21d16b91b57ba1114aaeb5c22f0f3ee353850e48506089d\": container with ID starting with 604d8ff1f691bbaed21d16b91b57ba1114aaeb5c22f0f3ee353850e48506089d not found: ID does not exist"
Sep 18 22:16:19.654746 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.654724    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/760973cf-2292-4e2e-b8cb-6ab30dc23dec-plugins-config-volume\") pod \"760973cf-2292-4e2e-b8cb-6ab30dc23dec\" (UID: \"760973cf-2292-4e2e-b8cb-6ab30dc23dec\") "
Sep 18 22:16:19.654868 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.654763    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w98r9\" (UniqueName: \"kubernetes.io/projected/be660314-e234-4c82-bb05-725adbcbd3f2-kube-api-access-w98r9\") pod \"be660314-e234-4c82-bb05-725adbcbd3f2\" (UID: \"be660314-e234-4c82-bb05-725adbcbd3f2\") "
Sep 18 22:16:19.654868 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.654839    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccgn4\" (UniqueName: \"kubernetes.io/projected/760973cf-2292-4e2e-b8cb-6ab30dc23dec-kube-api-access-ccgn4\") pod \"760973cf-2292-4e2e-b8cb-6ab30dc23dec\" (UID: \"760973cf-2292-4e2e-b8cb-6ab30dc23dec\") "
Sep 18 22:16:19.654982 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.654871    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be660314-e234-4c82-bb05-725adbcbd3f2-plugins-config-volume\") pod \"be660314-e234-4c82-bb05-725adbcbd3f2\" (UID: \"be660314-e234-4c82-bb05-725adbcbd3f2\") "
Sep 18 22:16:19.655244 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.655118    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/760973cf-2292-4e2e-b8cb-6ab30dc23dec-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "760973cf-2292-4e2e-b8cb-6ab30dc23dec" (UID: "760973cf-2292-4e2e-b8cb-6ab30dc23dec"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:16:19.655318 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.655272    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be660314-e234-4c82-bb05-725adbcbd3f2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "be660314-e234-4c82-bb05-725adbcbd3f2" (UID: "be660314-e234-4c82-bb05-725adbcbd3f2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:16:19.656964 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.656940    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be660314-e234-4c82-bb05-725adbcbd3f2-kube-api-access-w98r9" (OuterVolumeSpecName: "kube-api-access-w98r9") pod "be660314-e234-4c82-bb05-725adbcbd3f2" (UID: "be660314-e234-4c82-bb05-725adbcbd3f2"). InnerVolumeSpecName "kube-api-access-w98r9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:16:19.657031 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.657017    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/760973cf-2292-4e2e-b8cb-6ab30dc23dec-kube-api-access-ccgn4" (OuterVolumeSpecName: "kube-api-access-ccgn4") pod "760973cf-2292-4e2e-b8cb-6ab30dc23dec" (UID: "760973cf-2292-4e2e-b8cb-6ab30dc23dec"). InnerVolumeSpecName "kube-api-access-ccgn4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:16:19.755648 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.755579    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be660314-e234-4c82-bb05-725adbcbd3f2-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:16:19.755648 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.755601    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/760973cf-2292-4e2e-b8cb-6ab30dc23dec-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:16:19.755648 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.755610    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w98r9\" (UniqueName: \"kubernetes.io/projected/be660314-e234-4c82-bb05-725adbcbd3f2-kube-api-access-w98r9\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:16:19.755648 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.755618    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccgn4\" (UniqueName: \"kubernetes.io/projected/760973cf-2292-4e2e-b8cb-6ab30dc23dec-kube-api-access-ccgn4\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:16:19.896596 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.896567    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc"]
Sep 18 22:16:19.904159 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.904137    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0144e4de-64bd79d4c4-pqjqc"]
Sep 18 22:16:19.915277 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.915256    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9"]
Sep 18 22:16:19.920764 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:19.920742    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0144e4de-78c954fdc7-hnhw9"]
Sep 18 22:16:21.346980 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:21.346936    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="760973cf-2292-4e2e-b8cb-6ab30dc23dec" path="/var/lib/kubelet/pods/760973cf-2292-4e2e-b8cb-6ab30dc23dec/volumes"
Sep 18 22:16:21.347500 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:21.347482    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be660314-e234-4c82-bb05-725adbcbd3f2" path="/var/lib/kubelet/pods/be660314-e234-4c82-bb05-725adbcbd3f2/volumes"
Sep 18 22:16:22.160336 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:22.160304    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ffe43-gtr5x"]
Sep 18 22:16:22.160723 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:22.160711    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="760973cf-2292-4e2e-b8cb-6ab30dc23dec" containerName="payload-processing"
Sep 18 22:16:22.160774 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:22.160725    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="760973cf-2292-4e2e-b8cb-6ab30dc23dec" containerName="payload-processing"
Sep 18 22:16:22.160774 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:22.160732    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be660314-e234-4c82-bb05-725adbcbd3f2" containerName="payload-pre-processing"
Sep 18 22:16:22.160774 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:22.160737    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="be660314-e234-4c82-bb05-725adbcbd3f2" containerName="payload-pre-processing"
Sep 18 22:16:22.160871 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:22.160797    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="760973cf-2292-4e2e-b8cb-6ab30dc23dec" containerName="payload-processing"
Sep 18 22:16:22.160871 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:22.160808    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="be660314-e234-4c82-bb05-725adbcbd3f2" containerName="payload-pre-processing"
Sep 18 22:16:22.163994 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:22.163978    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ffe43-gtr5x"
Sep 18 22:16:22.166901 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:22.166880    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 22:16:22.167201 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:22.167184    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9g7m4\""
Sep 18 22:16:22.174367 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:22.174345    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ffe43-gtr5x"]
Sep 18 22:16:22.275907 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:22.275873    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e5d04b6-6934-483e-9cbd-b2466673107c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-0ffe43-gtr5x\" (UID: \"5e5d04b6-6934-483e-9cbd-b2466673107c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ffe43-gtr5x"
Sep 18 22:16:22.376936 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:22.376900    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e5d04b6-6934-483e-9cbd-b2466673107c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-0ffe43-gtr5x\" (UID: \"5e5d04b6-6934-483e-9cbd-b2466673107c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ffe43-gtr5x"
Sep 18 22:16:22.377451 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:22.377431    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e5d04b6-6934-483e-9cbd-b2466673107c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-0ffe43-gtr5x\" (UID: \"5e5d04b6-6934-483e-9cbd-b2466673107c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ffe43-gtr5x"
Sep 18 22:16:22.475326 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:22.475303    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ffe43-gtr5x"
Sep 18 22:16:22.767729 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:22.767703    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ffe43-gtr5x"]
Sep 18 22:16:22.770004 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:16:22.769972    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e5d04b6_6934_483e_9cbd_b2466673107c.slice/crio-2b01b02f7994c98598859cf9e2afe073e18192fd4a821ea401dd9c9374d09d4e WatchSource:0}: Error finding container 2b01b02f7994c98598859cf9e2afe073e18192fd4a821ea401dd9c9374d09d4e: Status 404 returned error can't find the container with id 2b01b02f7994c98598859cf9e2afe073e18192fd4a821ea401dd9c9374d09d4e
Sep 18 22:16:23.597962 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:23.597931    2574 generic.go:356] "Generic (PLEG): container finished" podID="5e5d04b6-6934-483e-9cbd-b2466673107c" containerID="2b5a33351600825b795dc46c97fa09b9dd7c59395079f0c23f99ff9a2819785c" exitCode=0
Sep 18 22:16:23.598282 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:23.597977    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ffe43-gtr5x" event={"ID":"5e5d04b6-6934-483e-9cbd-b2466673107c","Type":"ContainerDied","Data":"2b5a33351600825b795dc46c97fa09b9dd7c59395079f0c23f99ff9a2819785c"}
Sep 18 22:16:23.598282 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:23.598021    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ffe43-gtr5x" event={"ID":"5e5d04b6-6934-483e-9cbd-b2466673107c","Type":"ContainerStarted","Data":"2b01b02f7994c98598859cf9e2afe073e18192fd4a821ea401dd9c9374d09d4e"}
Sep 18 22:16:24.736965 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:24.736939    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ffe43-gtr5x"
Sep 18 22:16:24.899261 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:24.899185    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e5d04b6-6934-483e-9cbd-b2466673107c-maas-api-service-ca\") pod \"5e5d04b6-6934-483e-9cbd-b2466673107c\" (UID: \"5e5d04b6-6934-483e-9cbd-b2466673107c\") "
Sep 18 22:16:24.899544 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:24.899495    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e5d04b6-6934-483e-9cbd-b2466673107c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5e5d04b6-6934-483e-9cbd-b2466673107c" (UID: "5e5d04b6-6934-483e-9cbd-b2466673107c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:16:25.000365 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:25.000333    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e5d04b6-6934-483e-9cbd-b2466673107c-maas-api-service-ca\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:16:25.609164 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:25.609084    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ffe43-gtr5x"
Sep 18 22:16:25.609298 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:25.609083    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ffe43-gtr5x" event={"ID":"5e5d04b6-6934-483e-9cbd-b2466673107c","Type":"ContainerDied","Data":"2b01b02f7994c98598859cf9e2afe073e18192fd4a821ea401dd9c9374d09d4e"}
Sep 18 22:16:25.609298 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:25.609204    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b01b02f7994c98598859cf9e2afe073e18192fd4a821ea401dd9c9374d09d4e"
Sep 18 22:16:28.990349 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:28.990307    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb"]
Sep 18 22:16:28.990851 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:28.990724    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e5d04b6-6934-483e-9cbd-b2466673107c" containerName="revoke-keys"
Sep 18 22:16:28.990851 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:28.990740    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e5d04b6-6934-483e-9cbd-b2466673107c" containerName="revoke-keys"
Sep 18 22:16:28.990851 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:28.990836    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e5d04b6-6934-483e-9cbd-b2466673107c" containerName="revoke-keys"
Sep 18 22:16:28.995718 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:28.995683    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb"
Sep 18 22:16:28.998209 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:28.998134    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-35758849-serving-cert\""
Sep 18 22:16:28.998209 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:28.998188    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 18 22:16:28.998417 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:28.998217    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 18 22:16:28.998417 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:28.998197    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 22:16:28.998417 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:28.998188    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-c6l9h\""
Sep 18 22:16:29.008789 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:29.008769    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb"]
Sep 18 22:16:29.134362 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:29.134327    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a9933a4-ca70-4f00-8020-214b4941d51b-metrics-certs\") pod \"maas-api-e2e-derive-35758849-67859f58-mjmvb\" (UID: \"3a9933a4-ca70-4f00-8020-214b4941d51b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb"
Sep 18 22:16:29.134551 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:29.134368    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a9933a4-ca70-4f00-8020-214b4941d51b-maas-api-tls\") pod \"maas-api-e2e-derive-35758849-67859f58-mjmvb\" (UID: \"3a9933a4-ca70-4f00-8020-214b4941d51b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb"
Sep 18 22:16:29.134551 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:29.134496    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a9933a4-ca70-4f00-8020-214b4941d51b-openshift-service-ca\") pod \"maas-api-e2e-derive-35758849-67859f58-mjmvb\" (UID: \"3a9933a4-ca70-4f00-8020-214b4941d51b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb"
Sep 18 22:16:29.134634 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:29.134570    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wzsz\" (UniqueName: \"kubernetes.io/projected/3a9933a4-ca70-4f00-8020-214b4941d51b-kube-api-access-7wzsz\") pod \"maas-api-e2e-derive-35758849-67859f58-mjmvb\" (UID: \"3a9933a4-ca70-4f00-8020-214b4941d51b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb"
Sep 18 22:16:29.235648 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:29.235607    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a9933a4-ca70-4f00-8020-214b4941d51b-metrics-certs\") pod \"maas-api-e2e-derive-35758849-67859f58-mjmvb\" (UID: \"3a9933a4-ca70-4f00-8020-214b4941d51b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb"
Sep 18 22:16:29.235796 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:29.235666    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a9933a4-ca70-4f00-8020-214b4941d51b-maas-api-tls\") pod \"maas-api-e2e-derive-35758849-67859f58-mjmvb\" (UID: \"3a9933a4-ca70-4f00-8020-214b4941d51b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb"
Sep 18 22:16:29.235796 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:29.235739    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a9933a4-ca70-4f00-8020-214b4941d51b-openshift-service-ca\") pod \"maas-api-e2e-derive-35758849-67859f58-mjmvb\" (UID: \"3a9933a4-ca70-4f00-8020-214b4941d51b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb"
Sep 18 22:16:29.235796 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:29.235790    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wzsz\" (UniqueName: \"kubernetes.io/projected/3a9933a4-ca70-4f00-8020-214b4941d51b-kube-api-access-7wzsz\") pod \"maas-api-e2e-derive-35758849-67859f58-mjmvb\" (UID: \"3a9933a4-ca70-4f00-8020-214b4941d51b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb"
Sep 18 22:16:29.236362 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:29.236334    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a9933a4-ca70-4f00-8020-214b4941d51b-openshift-service-ca\") pod \"maas-api-e2e-derive-35758849-67859f58-mjmvb\" (UID: \"3a9933a4-ca70-4f00-8020-214b4941d51b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb"
Sep 18 22:16:29.238254 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:29.238232    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a9933a4-ca70-4f00-8020-214b4941d51b-metrics-certs\") pod \"maas-api-e2e-derive-35758849-67859f58-mjmvb\" (UID: \"3a9933a4-ca70-4f00-8020-214b4941d51b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb"
Sep 18 22:16:29.238345 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:29.238258    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a9933a4-ca70-4f00-8020-214b4941d51b-maas-api-tls\") pod \"maas-api-e2e-derive-35758849-67859f58-mjmvb\" (UID: \"3a9933a4-ca70-4f00-8020-214b4941d51b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb"
Sep 18 22:16:29.250022 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:29.249956    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wzsz\" (UniqueName: \"kubernetes.io/projected/3a9933a4-ca70-4f00-8020-214b4941d51b-kube-api-access-7wzsz\") pod \"maas-api-e2e-derive-35758849-67859f58-mjmvb\" (UID: \"3a9933a4-ca70-4f00-8020-214b4941d51b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb"
Sep 18 22:16:29.307024 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:29.306996    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb"
Sep 18 22:16:29.612967 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:29.612914    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb"]
Sep 18 22:16:29.615576 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:16:29.615493    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a9933a4_ca70_4f00_8020_214b4941d51b.slice/crio-0f872901fbd1ebb75cd253ac8c888d785dcd4444fa5a4a524108b0d26d9bb9aa WatchSource:0}: Error finding container 0f872901fbd1ebb75cd253ac8c888d785dcd4444fa5a4a524108b0d26d9bb9aa: Status 404 returned error can't find the container with id 0f872901fbd1ebb75cd253ac8c888d785dcd4444fa5a4a524108b0d26d9bb9aa
Sep 18 22:16:29.631383 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:29.631344    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb" event={"ID":"3a9933a4-ca70-4f00-8020-214b4941d51b","Type":"ContainerStarted","Data":"0f872901fbd1ebb75cd253ac8c888d785dcd4444fa5a4a524108b0d26d9bb9aa"}
Sep 18 22:16:29.900467 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:29.900390    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8"]
Sep 18 22:16:29.907978 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:29.907945    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8"
Sep 18 22:16:29.910331 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:29.910310    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-35758849\""
Sep 18 22:16:29.910491 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:29.910425    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-35758849-dockercfg-h8l75\""
Sep 18 22:16:29.919695 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:29.919672    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8"]
Sep 18 22:16:29.941108 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:29.941076    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl"]
Sep 18 22:16:29.944769 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:29.944750    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl"
Sep 18 22:16:29.955251 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:29.955229    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl"]
Sep 18 22:16:30.043292 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:30.043253    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a7aba26-8161-42bb-9bb0-51f144358cbd-plugins-config-volume\") pod \"payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl\" (UID: \"3a7aba26-8161-42bb-9bb0-51f144358cbd\") " pod="openshift-ingress/payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl"
Sep 18 22:16:30.043725 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:30.043309    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlbm4\" (UniqueName: \"kubernetes.io/projected/3a7aba26-8161-42bb-9bb0-51f144358cbd-kube-api-access-hlbm4\") pod \"payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl\" (UID: \"3a7aba26-8161-42bb-9bb0-51f144358cbd\") " pod="openshift-ingress/payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl"
Sep 18 22:16:30.043725 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:30.043383    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e46b620-6090-44f6-b62a-0a0a743cefbb-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8\" (UID: \"1e46b620-6090-44f6-b62a-0a0a743cefbb\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8"
Sep 18 22:16:30.043725 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:30.043407    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzrnj\" (UniqueName: \"kubernetes.io/projected/1e46b620-6090-44f6-b62a-0a0a743cefbb-kube-api-access-xzrnj\") pod \"payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8\" (UID: \"1e46b620-6090-44f6-b62a-0a0a743cefbb\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8"
Sep 18 22:16:30.144822 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:30.144769    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a7aba26-8161-42bb-9bb0-51f144358cbd-plugins-config-volume\") pod \"payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl\" (UID: \"3a7aba26-8161-42bb-9bb0-51f144358cbd\") " pod="openshift-ingress/payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl"
Sep 18 22:16:30.144822 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:30.144830    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlbm4\" (UniqueName: \"kubernetes.io/projected/3a7aba26-8161-42bb-9bb0-51f144358cbd-kube-api-access-hlbm4\") pod \"payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl\" (UID: \"3a7aba26-8161-42bb-9bb0-51f144358cbd\") " pod="openshift-ingress/payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl"
Sep 18 22:16:30.145026 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:30.144865    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e46b620-6090-44f6-b62a-0a0a743cefbb-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8\" (UID: \"1e46b620-6090-44f6-b62a-0a0a743cefbb\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8"
Sep 18 22:16:30.145026 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:30.144880    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzrnj\" (UniqueName: \"kubernetes.io/projected/1e46b620-6090-44f6-b62a-0a0a743cefbb-kube-api-access-xzrnj\") pod \"payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8\" (UID: \"1e46b620-6090-44f6-b62a-0a0a743cefbb\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8"
Sep 18 22:16:30.145724 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:30.145702    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a7aba26-8161-42bb-9bb0-51f144358cbd-plugins-config-volume\") pod \"payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl\" (UID: \"3a7aba26-8161-42bb-9bb0-51f144358cbd\") " pod="openshift-ingress/payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl"
Sep 18 22:16:30.145795 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:30.145702    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e46b620-6090-44f6-b62a-0a0a743cefbb-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8\" (UID: \"1e46b620-6090-44f6-b62a-0a0a743cefbb\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8"
Sep 18 22:16:30.154177 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:30.154119    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzrnj\" (UniqueName: \"kubernetes.io/projected/1e46b620-6090-44f6-b62a-0a0a743cefbb-kube-api-access-xzrnj\") pod \"payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8\" (UID: \"1e46b620-6090-44f6-b62a-0a0a743cefbb\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8"
Sep 18 22:16:30.154177 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:30.154129    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlbm4\" (UniqueName: \"kubernetes.io/projected/3a7aba26-8161-42bb-9bb0-51f144358cbd-kube-api-access-hlbm4\") pod \"payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl\" (UID: \"3a7aba26-8161-42bb-9bb0-51f144358cbd\") " pod="openshift-ingress/payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl"
Sep 18 22:16:30.220525 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:30.220483    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8"
Sep 18 22:16:30.254810 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:30.254726    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl"
Sep 18 22:16:30.519010 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:30.518978    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8"]
Sep 18 22:16:30.519869 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:16:30.519838    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e46b620_6090_44f6_b62a_0a0a743cefbb.slice/crio-42782d293d37763f0e84bd640365ea70f6ca36b947c5531ac0379afe9290a18a WatchSource:0}: Error finding container 42782d293d37763f0e84bd640365ea70f6ca36b947c5531ac0379afe9290a18a: Status 404 returned error can't find the container with id 42782d293d37763f0e84bd640365ea70f6ca36b947c5531ac0379afe9290a18a
Sep 18 22:16:30.553648 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:30.553621    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl"]
Sep 18 22:16:30.557692 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:16:30.557667    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a7aba26_8161_42bb_9bb0_51f144358cbd.slice/crio-2cea8f3e8404f703d5ad74b24e4c60c15429495828060c5cb189ba206e845661 WatchSource:0}: Error finding container 2cea8f3e8404f703d5ad74b24e4c60c15429495828060c5cb189ba206e845661: Status 404 returned error can't find the container with id 2cea8f3e8404f703d5ad74b24e4c60c15429495828060c5cb189ba206e845661
Sep 18 22:16:30.638883 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:30.638844    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl" event={"ID":"3a7aba26-8161-42bb-9bb0-51f144358cbd","Type":"ContainerStarted","Data":"19cc6245b84e944037d3fb9e51680a5a31bebbf06d28558e432b04db2ba0fa99"}
Sep 18 22:16:30.639001 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:30.638914    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl" event={"ID":"3a7aba26-8161-42bb-9bb0-51f144358cbd","Type":"ContainerStarted","Data":"2cea8f3e8404f703d5ad74b24e4c60c15429495828060c5cb189ba206e845661"}
Sep 18 22:16:30.639215 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:30.639087    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl"
Sep 18 22:16:30.641538 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:30.641424    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8" event={"ID":"1e46b620-6090-44f6-b62a-0a0a743cefbb","Type":"ContainerStarted","Data":"5cb2b4b5d61b30be7df1cfcbb5b6b4000c3cfaf297a90c3d218da3fa98d7e14f"}
Sep 18 22:16:30.641538 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:30.641474    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8" event={"ID":"1e46b620-6090-44f6-b62a-0a0a743cefbb","Type":"ContainerStarted","Data":"42782d293d37763f0e84bd640365ea70f6ca36b947c5531ac0379afe9290a18a"}
Sep 18 22:16:30.641855 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:30.641818    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8"
Sep 18 22:16:30.661244 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:30.661192    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl" podStartSLOduration=1.6611775930000001 podStartE2EDuration="1.661177593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:16:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:16:30.660567722 +0000 UTC m=+965.792348805" watchObservedRunningTime="2026-09-18 22:16:30.661177593 +0000 UTC m=+965.792958678"
Sep 18 22:16:30.680348 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:30.680292    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8" podStartSLOduration=1.6802775890000001 podStartE2EDuration="1.680277589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:16:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:16:30.677862672 +0000 UTC m=+965.809643752" watchObservedRunningTime="2026-09-18 22:16:30.680277589 +0000 UTC m=+965.812058671"
Sep 18 22:16:31.648366 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:31.648275    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb" event={"ID":"3a9933a4-ca70-4f00-8020-214b4941d51b","Type":"ContainerStarted","Data":"2e322d20ebc6016a197d2d39ecc66e41b31b024e21636670c2ec4ea9fa6f0055"}
Sep 18 22:16:31.667527 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:31.667458    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb" podStartSLOduration=2.079564693 podStartE2EDuration="3.667443568s" totalImagesPullingTime="1.587878875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:16:31.665611492 +0000 UTC m=+966.797392600" watchObservedRunningTime="2026-09-18 22:16:31.667443568 +0000 UTC m=+966.799224891"
Sep 18 22:16:32.654146 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:32.654118    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb"
Sep 18 22:16:33.163621 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.163587    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj"]
Sep 18 22:16:33.163917 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.163863    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj" podUID="9f71c3bb-de4e-4cb7-a64a-f8eacc99a932" containerName="payload-processing" containerID="cri-o://a66422d7afc48400290a56fcd0ed3abe7c12c4ef01e92c636008eeec7c6d718d" gracePeriod=30
Sep 18 22:16:33.173398 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.173363    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll"]
Sep 18 22:16:33.174202 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.173625    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll" podUID="fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516" containerName="payload-pre-processing" containerID="cri-o://71349be4a97a29996ccadbb7f51833ab5f56f2cc9525bf55ee3263dee6b9e9ba" gracePeriod=30
Sep 18 22:16:33.363364 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.363335    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ffe43-gtr5x"]
Sep 18 22:16:33.366691 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.366666    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0ffe43-gtr5x"]
Sep 18 22:16:33.455071 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.455049    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj"
Sep 18 22:16:33.458066 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.458043    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll"
Sep 18 22:16:33.472319 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.472248    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f71c3bb-de4e-4cb7-a64a-f8eacc99a932-plugins-config-volume\") pod \"9f71c3bb-de4e-4cb7-a64a-f8eacc99a932\" (UID: \"9f71c3bb-de4e-4cb7-a64a-f8eacc99a932\") "
Sep 18 22:16:33.472319 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.472290    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516-plugins-config-volume\") pod \"fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516\" (UID: \"fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516\") "
Sep 18 22:16:33.472572 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.472403    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9xgz\" (UniqueName: \"kubernetes.io/projected/fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516-kube-api-access-s9xgz\") pod \"fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516\" (UID: \"fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516\") "
Sep 18 22:16:33.472572 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.472492    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vw55j\" (UniqueName: \"kubernetes.io/projected/9f71c3bb-de4e-4cb7-a64a-f8eacc99a932-kube-api-access-vw55j\") pod \"9f71c3bb-de4e-4cb7-a64a-f8eacc99a932\" (UID: \"9f71c3bb-de4e-4cb7-a64a-f8eacc99a932\") "
Sep 18 22:16:33.472789 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.472761    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f71c3bb-de4e-4cb7-a64a-f8eacc99a932-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9f71c3bb-de4e-4cb7-a64a-f8eacc99a932" (UID: "9f71c3bb-de4e-4cb7-a64a-f8eacc99a932"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:16:33.473314 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.473292    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516" (UID: "fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:16:33.475648 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.475618    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f71c3bb-de4e-4cb7-a64a-f8eacc99a932-kube-api-access-vw55j" (OuterVolumeSpecName: "kube-api-access-vw55j") pod "9f71c3bb-de4e-4cb7-a64a-f8eacc99a932" (UID: "9f71c3bb-de4e-4cb7-a64a-f8eacc99a932"). InnerVolumeSpecName "kube-api-access-vw55j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:16:33.475823 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.475792    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516-kube-api-access-s9xgz" (OuterVolumeSpecName: "kube-api-access-s9xgz") pod "fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516" (UID: "fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516"). InnerVolumeSpecName "kube-api-access-s9xgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:16:33.573486 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.573440    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9xgz\" (UniqueName: \"kubernetes.io/projected/fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516-kube-api-access-s9xgz\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:16:33.573486 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.573475    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vw55j\" (UniqueName: \"kubernetes.io/projected/9f71c3bb-de4e-4cb7-a64a-f8eacc99a932-kube-api-access-vw55j\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:16:33.573486 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.573485    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f71c3bb-de4e-4cb7-a64a-f8eacc99a932-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:16:33.573486 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.573494    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:16:33.660165 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.660135    2574 generic.go:356] "Generic (PLEG): container finished" podID="9f71c3bb-de4e-4cb7-a64a-f8eacc99a932" containerID="a66422d7afc48400290a56fcd0ed3abe7c12c4ef01e92c636008eeec7c6d718d" exitCode=0
Sep 18 22:16:33.660605 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.660178    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj"
Sep 18 22:16:33.660605 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.660234    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj" event={"ID":"9f71c3bb-de4e-4cb7-a64a-f8eacc99a932","Type":"ContainerDied","Data":"a66422d7afc48400290a56fcd0ed3abe7c12c4ef01e92c636008eeec7c6d718d"}
Sep 18 22:16:33.660605 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.660298    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj" event={"ID":"9f71c3bb-de4e-4cb7-a64a-f8eacc99a932","Type":"ContainerDied","Data":"ecc769c065c1eec9459e0c5b5174eb71a195dd496f13d5f8d96e9435f7d0816a"}
Sep 18 22:16:33.660605 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.660333    2574 scope.go:117] "RemoveContainer" containerID="a66422d7afc48400290a56fcd0ed3abe7c12c4ef01e92c636008eeec7c6d718d"
Sep 18 22:16:33.661710 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.661685    2574 generic.go:356] "Generic (PLEG): container finished" podID="fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516" containerID="71349be4a97a29996ccadbb7f51833ab5f56f2cc9525bf55ee3263dee6b9e9ba" exitCode=0
Sep 18 22:16:33.661831 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.661756    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll" event={"ID":"fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516","Type":"ContainerDied","Data":"71349be4a97a29996ccadbb7f51833ab5f56f2cc9525bf55ee3263dee6b9e9ba"}
Sep 18 22:16:33.661831 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.661793    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll"
Sep 18 22:16:33.661831 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.661809    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll" event={"ID":"fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516","Type":"ContainerDied","Data":"b021187d54c70b8b074650ecf275ab86a17ec593cf6a5cb5cc958229a717cbae"}
Sep 18 22:16:33.672851 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.672835    2574 scope.go:117] "RemoveContainer" containerID="a66422d7afc48400290a56fcd0ed3abe7c12c4ef01e92c636008eeec7c6d718d"
Sep 18 22:16:33.673177 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:16:33.673157    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a66422d7afc48400290a56fcd0ed3abe7c12c4ef01e92c636008eeec7c6d718d\": container with ID starting with a66422d7afc48400290a56fcd0ed3abe7c12c4ef01e92c636008eeec7c6d718d not found: ID does not exist" containerID="a66422d7afc48400290a56fcd0ed3abe7c12c4ef01e92c636008eeec7c6d718d"
Sep 18 22:16:33.673259 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.673185    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a66422d7afc48400290a56fcd0ed3abe7c12c4ef01e92c636008eeec7c6d718d"} err="failed to get container status \"a66422d7afc48400290a56fcd0ed3abe7c12c4ef01e92c636008eeec7c6d718d\": rpc error: code = NotFound desc = could not find container \"a66422d7afc48400290a56fcd0ed3abe7c12c4ef01e92c636008eeec7c6d718d\": container with ID starting with a66422d7afc48400290a56fcd0ed3abe7c12c4ef01e92c636008eeec7c6d718d not found: ID does not exist"
Sep 18 22:16:33.673259 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.673205    2574 scope.go:117] "RemoveContainer" containerID="71349be4a97a29996ccadbb7f51833ab5f56f2cc9525bf55ee3263dee6b9e9ba"
Sep 18 22:16:33.681448 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.681432    2574 scope.go:117] "RemoveContainer" containerID="71349be4a97a29996ccadbb7f51833ab5f56f2cc9525bf55ee3263dee6b9e9ba"
Sep 18 22:16:33.681741 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:16:33.681723    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71349be4a97a29996ccadbb7f51833ab5f56f2cc9525bf55ee3263dee6b9e9ba\": container with ID starting with 71349be4a97a29996ccadbb7f51833ab5f56f2cc9525bf55ee3263dee6b9e9ba not found: ID does not exist" containerID="71349be4a97a29996ccadbb7f51833ab5f56f2cc9525bf55ee3263dee6b9e9ba"
Sep 18 22:16:33.681813 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.681751    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71349be4a97a29996ccadbb7f51833ab5f56f2cc9525bf55ee3263dee6b9e9ba"} err="failed to get container status \"71349be4a97a29996ccadbb7f51833ab5f56f2cc9525bf55ee3263dee6b9e9ba\": rpc error: code = NotFound desc = could not find container \"71349be4a97a29996ccadbb7f51833ab5f56f2cc9525bf55ee3263dee6b9e9ba\": container with ID starting with 71349be4a97a29996ccadbb7f51833ab5f56f2cc9525bf55ee3263dee6b9e9ba not found: ID does not exist"
Sep 18 22:16:33.686213 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.686191    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj"]
Sep 18 22:16:33.691218 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.691198    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-0ffe43-56b9f9b997-74cbj"]
Sep 18 22:16:33.703869 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.703850    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll"]
Sep 18 22:16:33.708260 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:33.708240    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-0ffe43-7dcb8c5c6b-656ll"]
Sep 18 22:16:35.345650 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:35.345623    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e5d04b6-6934-483e-9cbd-b2466673107c" path="/var/lib/kubelet/pods/5e5d04b6-6934-483e-9cbd-b2466673107c/volumes"
Sep 18 22:16:35.346019 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:35.345945    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f71c3bb-de4e-4cb7-a64a-f8eacc99a932" path="/var/lib/kubelet/pods/9f71c3bb-de4e-4cb7-a64a-f8eacc99a932/volumes"
Sep 18 22:16:35.346256 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:35.346243    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516" path="/var/lib/kubelet/pods/fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516/volumes"
Sep 18 22:16:38.667775 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:38.667749    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb"
Sep 18 22:16:41.650883 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:41.650855    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8"
Sep 18 22:16:41.651284 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:16:41.650921    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl"
Sep 18 22:17:06.434671 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.434637    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb"]
Sep 18 22:17:06.435140 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.434836    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb" podUID="3a9933a4-ca70-4f00-8020-214b4941d51b" containerName="maas-api" containerID="cri-o://2e322d20ebc6016a197d2d39ecc66e41b31b024e21636670c2ec4ea9fa6f0055" gracePeriod=30
Sep 18 22:17:06.524040 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.524006    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl"]
Sep 18 22:17:06.524363 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.524310    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl" podUID="3a7aba26-8161-42bb-9bb0-51f144358cbd" containerName="payload-processing" containerID="cri-o://19cc6245b84e944037d3fb9e51680a5a31bebbf06d28558e432b04db2ba0fa99" gracePeriod=30
Sep 18 22:17:06.531548 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.531522    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8"]
Sep 18 22:17:06.531762 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.531736    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8" podUID="1e46b620-6090-44f6-b62a-0a0a743cefbb" containerName="payload-pre-processing" containerID="cri-o://5cb2b4b5d61b30be7df1cfcbb5b6b4000c3cfaf297a90c3d218da3fa98d7e14f" gracePeriod=30
Sep 18 22:17:06.786545 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.786459    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb"
Sep 18 22:17:06.822354 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.822331    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl"
Sep 18 22:17:06.832000 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.831970    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8"
Sep 18 22:17:06.843593 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.843565    2574 generic.go:356] "Generic (PLEG): container finished" podID="3a9933a4-ca70-4f00-8020-214b4941d51b" containerID="2e322d20ebc6016a197d2d39ecc66e41b31b024e21636670c2ec4ea9fa6f0055" exitCode=0
Sep 18 22:17:06.843733 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.843621    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb"
Sep 18 22:17:06.843807 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.843739    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb" event={"ID":"3a9933a4-ca70-4f00-8020-214b4941d51b","Type":"ContainerDied","Data":"2e322d20ebc6016a197d2d39ecc66e41b31b024e21636670c2ec4ea9fa6f0055"}
Sep 18 22:17:06.843807 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.843792    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb" event={"ID":"3a9933a4-ca70-4f00-8020-214b4941d51b","Type":"ContainerDied","Data":"0f872901fbd1ebb75cd253ac8c888d785dcd4444fa5a4a524108b0d26d9bb9aa"}
Sep 18 22:17:06.843916 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.843829    2574 scope.go:117] "RemoveContainer" containerID="2e322d20ebc6016a197d2d39ecc66e41b31b024e21636670c2ec4ea9fa6f0055"
Sep 18 22:17:06.845791 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.845732    2574 generic.go:356] "Generic (PLEG): container finished" podID="1e46b620-6090-44f6-b62a-0a0a743cefbb" containerID="5cb2b4b5d61b30be7df1cfcbb5b6b4000c3cfaf297a90c3d218da3fa98d7e14f" exitCode=0
Sep 18 22:17:06.845880 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.845859    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8" event={"ID":"1e46b620-6090-44f6-b62a-0a0a743cefbb","Type":"ContainerDied","Data":"5cb2b4b5d61b30be7df1cfcbb5b6b4000c3cfaf297a90c3d218da3fa98d7e14f"}
Sep 18 22:17:06.845939 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.845912    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8" event={"ID":"1e46b620-6090-44f6-b62a-0a0a743cefbb","Type":"ContainerDied","Data":"42782d293d37763f0e84bd640365ea70f6ca36b947c5531ac0379afe9290a18a"}
Sep 18 22:17:06.845998 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.845985    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8"
Sep 18 22:17:06.847616 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.847590    2574 generic.go:356] "Generic (PLEG): container finished" podID="3a7aba26-8161-42bb-9bb0-51f144358cbd" containerID="19cc6245b84e944037d3fb9e51680a5a31bebbf06d28558e432b04db2ba0fa99" exitCode=0
Sep 18 22:17:06.847737 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.847644    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl"
Sep 18 22:17:06.847737 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.847687    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl" event={"ID":"3a7aba26-8161-42bb-9bb0-51f144358cbd","Type":"ContainerDied","Data":"19cc6245b84e944037d3fb9e51680a5a31bebbf06d28558e432b04db2ba0fa99"}
Sep 18 22:17:06.847737 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.847729    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl" event={"ID":"3a7aba26-8161-42bb-9bb0-51f144358cbd","Type":"ContainerDied","Data":"2cea8f3e8404f703d5ad74b24e4c60c15429495828060c5cb189ba206e845661"}
Sep 18 22:17:06.856405 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.856385    2574 scope.go:117] "RemoveContainer" containerID="2e322d20ebc6016a197d2d39ecc66e41b31b024e21636670c2ec4ea9fa6f0055"
Sep 18 22:17:06.856957 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:17:06.856935    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e322d20ebc6016a197d2d39ecc66e41b31b024e21636670c2ec4ea9fa6f0055\": container with ID starting with 2e322d20ebc6016a197d2d39ecc66e41b31b024e21636670c2ec4ea9fa6f0055 not found: ID does not exist" containerID="2e322d20ebc6016a197d2d39ecc66e41b31b024e21636670c2ec4ea9fa6f0055"
Sep 18 22:17:06.857067 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.856963    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e322d20ebc6016a197d2d39ecc66e41b31b024e21636670c2ec4ea9fa6f0055"} err="failed to get container status \"2e322d20ebc6016a197d2d39ecc66e41b31b024e21636670c2ec4ea9fa6f0055\": rpc error: code = NotFound desc = could not find container \"2e322d20ebc6016a197d2d39ecc66e41b31b024e21636670c2ec4ea9fa6f0055\": container with ID starting with 2e322d20ebc6016a197d2d39ecc66e41b31b024e21636670c2ec4ea9fa6f0055 not found: ID does not exist"
Sep 18 22:17:06.857067 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.856981    2574 scope.go:117] "RemoveContainer" containerID="5cb2b4b5d61b30be7df1cfcbb5b6b4000c3cfaf297a90c3d218da3fa98d7e14f"
Sep 18 22:17:06.865173 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.865157    2574 scope.go:117] "RemoveContainer" containerID="5cb2b4b5d61b30be7df1cfcbb5b6b4000c3cfaf297a90c3d218da3fa98d7e14f"
Sep 18 22:17:06.865456 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:17:06.865429    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cb2b4b5d61b30be7df1cfcbb5b6b4000c3cfaf297a90c3d218da3fa98d7e14f\": container with ID starting with 5cb2b4b5d61b30be7df1cfcbb5b6b4000c3cfaf297a90c3d218da3fa98d7e14f not found: ID does not exist" containerID="5cb2b4b5d61b30be7df1cfcbb5b6b4000c3cfaf297a90c3d218da3fa98d7e14f"
Sep 18 22:17:06.865567 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.865462    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cb2b4b5d61b30be7df1cfcbb5b6b4000c3cfaf297a90c3d218da3fa98d7e14f"} err="failed to get container status \"5cb2b4b5d61b30be7df1cfcbb5b6b4000c3cfaf297a90c3d218da3fa98d7e14f\": rpc error: code = NotFound desc = could not find container \"5cb2b4b5d61b30be7df1cfcbb5b6b4000c3cfaf297a90c3d218da3fa98d7e14f\": container with ID starting with 5cb2b4b5d61b30be7df1cfcbb5b6b4000c3cfaf297a90c3d218da3fa98d7e14f not found: ID does not exist"
Sep 18 22:17:06.865567 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.865478    2574 scope.go:117] "RemoveContainer" containerID="19cc6245b84e944037d3fb9e51680a5a31bebbf06d28558e432b04db2ba0fa99"
Sep 18 22:17:06.875055 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.875034    2574 scope.go:117] "RemoveContainer" containerID="19cc6245b84e944037d3fb9e51680a5a31bebbf06d28558e432b04db2ba0fa99"
Sep 18 22:17:06.875336 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:17:06.875320    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19cc6245b84e944037d3fb9e51680a5a31bebbf06d28558e432b04db2ba0fa99\": container with ID starting with 19cc6245b84e944037d3fb9e51680a5a31bebbf06d28558e432b04db2ba0fa99 not found: ID does not exist" containerID="19cc6245b84e944037d3fb9e51680a5a31bebbf06d28558e432b04db2ba0fa99"
Sep 18 22:17:06.875392 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.875346    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19cc6245b84e944037d3fb9e51680a5a31bebbf06d28558e432b04db2ba0fa99"} err="failed to get container status \"19cc6245b84e944037d3fb9e51680a5a31bebbf06d28558e432b04db2ba0fa99\": rpc error: code = NotFound desc = could not find container \"19cc6245b84e944037d3fb9e51680a5a31bebbf06d28558e432b04db2ba0fa99\": container with ID starting with 19cc6245b84e944037d3fb9e51680a5a31bebbf06d28558e432b04db2ba0fa99 not found: ID does not exist"
Sep 18 22:17:06.875438 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.875394    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a9933a4-ca70-4f00-8020-214b4941d51b-openshift-service-ca\") pod \"3a9933a4-ca70-4f00-8020-214b4941d51b\" (UID: \"3a9933a4-ca70-4f00-8020-214b4941d51b\") "
Sep 18 22:17:06.875438 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.875423    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a9933a4-ca70-4f00-8020-214b4941d51b-maas-api-tls\") pod \"3a9933a4-ca70-4f00-8020-214b4941d51b\" (UID: \"3a9933a4-ca70-4f00-8020-214b4941d51b\") "
Sep 18 22:17:06.875567 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.875454    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wzsz\" (UniqueName: \"kubernetes.io/projected/3a9933a4-ca70-4f00-8020-214b4941d51b-kube-api-access-7wzsz\") pod \"3a9933a4-ca70-4f00-8020-214b4941d51b\" (UID: \"3a9933a4-ca70-4f00-8020-214b4941d51b\") "
Sep 18 22:17:06.875567 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.875543    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a9933a4-ca70-4f00-8020-214b4941d51b-metrics-certs\") pod \"3a9933a4-ca70-4f00-8020-214b4941d51b\" (UID: \"3a9933a4-ca70-4f00-8020-214b4941d51b\") "
Sep 18 22:17:06.876025 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.875902    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a9933a4-ca70-4f00-8020-214b4941d51b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3a9933a4-ca70-4f00-8020-214b4941d51b" (UID: "3a9933a4-ca70-4f00-8020-214b4941d51b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:17:06.880059 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.880033    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a9933a4-ca70-4f00-8020-214b4941d51b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3a9933a4-ca70-4f00-8020-214b4941d51b" (UID: "3a9933a4-ca70-4f00-8020-214b4941d51b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:17:06.880203 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.880132    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a9933a4-ca70-4f00-8020-214b4941d51b-kube-api-access-7wzsz" (OuterVolumeSpecName: "kube-api-access-7wzsz") pod "3a9933a4-ca70-4f00-8020-214b4941d51b" (UID: "3a9933a4-ca70-4f00-8020-214b4941d51b"). InnerVolumeSpecName "kube-api-access-7wzsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:17:06.880296 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.880202    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a9933a4-ca70-4f00-8020-214b4941d51b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3a9933a4-ca70-4f00-8020-214b4941d51b" (UID: "3a9933a4-ca70-4f00-8020-214b4941d51b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:17:06.976606 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.976497    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a7aba26-8161-42bb-9bb0-51f144358cbd-plugins-config-volume\") pod \"3a7aba26-8161-42bb-9bb0-51f144358cbd\" (UID: \"3a7aba26-8161-42bb-9bb0-51f144358cbd\") "
Sep 18 22:17:06.976763 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.976662    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlbm4\" (UniqueName: \"kubernetes.io/projected/3a7aba26-8161-42bb-9bb0-51f144358cbd-kube-api-access-hlbm4\") pod \"3a7aba26-8161-42bb-9bb0-51f144358cbd\" (UID: \"3a7aba26-8161-42bb-9bb0-51f144358cbd\") "
Sep 18 22:17:06.976763 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.976689    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e46b620-6090-44f6-b62a-0a0a743cefbb-plugins-config-volume\") pod \"1e46b620-6090-44f6-b62a-0a0a743cefbb\" (UID: \"1e46b620-6090-44f6-b62a-0a0a743cefbb\") "
Sep 18 22:17:06.976763 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.976710    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzrnj\" (UniqueName: \"kubernetes.io/projected/1e46b620-6090-44f6-b62a-0a0a743cefbb-kube-api-access-xzrnj\") pod \"1e46b620-6090-44f6-b62a-0a0a743cefbb\" (UID: \"1e46b620-6090-44f6-b62a-0a0a743cefbb\") "
Sep 18 22:17:06.976919 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.976849    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a7aba26-8161-42bb-9bb0-51f144358cbd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3a7aba26-8161-42bb-9bb0-51f144358cbd" (UID: "3a7aba26-8161-42bb-9bb0-51f144358cbd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:17:06.977057 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.977021    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e46b620-6090-44f6-b62a-0a0a743cefbb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1e46b620-6090-44f6-b62a-0a0a743cefbb" (UID: "1e46b620-6090-44f6-b62a-0a0a743cefbb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:17:06.977057 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.977059    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a9933a4-ca70-4f00-8020-214b4941d51b-openshift-service-ca\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:17:06.977212 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.977071    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a9933a4-ca70-4f00-8020-214b4941d51b-maas-api-tls\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:17:06.977212 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.977080    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wzsz\" (UniqueName: \"kubernetes.io/projected/3a9933a4-ca70-4f00-8020-214b4941d51b-kube-api-access-7wzsz\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:17:06.977212 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.977089    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a9933a4-ca70-4f00-8020-214b4941d51b-metrics-certs\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:17:06.977212 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.977097    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a7aba26-8161-42bb-9bb0-51f144358cbd-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:17:06.978899 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.978879    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e46b620-6090-44f6-b62a-0a0a743cefbb-kube-api-access-xzrnj" (OuterVolumeSpecName: "kube-api-access-xzrnj") pod "1e46b620-6090-44f6-b62a-0a0a743cefbb" (UID: "1e46b620-6090-44f6-b62a-0a0a743cefbb"). InnerVolumeSpecName "kube-api-access-xzrnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:17:06.978964 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:06.978950    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a7aba26-8161-42bb-9bb0-51f144358cbd-kube-api-access-hlbm4" (OuterVolumeSpecName: "kube-api-access-hlbm4") pod "3a7aba26-8161-42bb-9bb0-51f144358cbd" (UID: "3a7aba26-8161-42bb-9bb0-51f144358cbd"). InnerVolumeSpecName "kube-api-access-hlbm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:17:07.077775 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:07.077736    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlbm4\" (UniqueName: \"kubernetes.io/projected/3a7aba26-8161-42bb-9bb0-51f144358cbd-kube-api-access-hlbm4\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:17:07.077775 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:07.077768    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e46b620-6090-44f6-b62a-0a0a743cefbb-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:17:07.077775 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:07.077777    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzrnj\" (UniqueName: \"kubernetes.io/projected/1e46b620-6090-44f6-b62a-0a0a743cefbb-kube-api-access-xzrnj\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:17:07.182767 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:07.182739    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb"]
Sep 18 22:17:07.192113 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:07.192087    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-35758849-67859f58-mjmvb"]
Sep 18 22:17:07.211434 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:07.211405    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl"]
Sep 18 22:17:07.215541 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:07.215521    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-35758849-5c8cc9476f-gf6wl"]
Sep 18 22:17:07.232845 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:07.232787    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8"]
Sep 18 22:17:07.236605 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:07.236580    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-35758849-5df745b4f8-k4mw8"]
Sep 18 22:17:07.345356 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:07.345314    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e46b620-6090-44f6-b62a-0a0a743cefbb" path="/var/lib/kubelet/pods/1e46b620-6090-44f6-b62a-0a0a743cefbb/volumes"
Sep 18 22:17:07.345772 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:07.345753    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a7aba26-8161-42bb-9bb0-51f144358cbd" path="/var/lib/kubelet/pods/3a7aba26-8161-42bb-9bb0-51f144358cbd/volumes"
Sep 18 22:17:07.346152 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:07.346134    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a9933a4-ca70-4f00-8020-214b4941d51b" path="/var/lib/kubelet/pods/3a9933a4-ca70-4f00-8020-214b4941d51b/volumes"
Sep 18 22:17:29.835556 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:29.835518    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a13357-m8g8p"]
Sep 18 22:17:29.835969 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:29.835954    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f71c3bb-de4e-4cb7-a64a-f8eacc99a932" containerName="payload-processing"
Sep 18 22:17:29.836019 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:29.835973    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f71c3bb-de4e-4cb7-a64a-f8eacc99a932" containerName="payload-processing"
Sep 18 22:17:29.836019 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:29.835985    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a9933a4-ca70-4f00-8020-214b4941d51b" containerName="maas-api"
Sep 18 22:17:29.836019 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:29.835990    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a9933a4-ca70-4f00-8020-214b4941d51b" containerName="maas-api"
Sep 18 22:17:29.836019 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:29.835997    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516" containerName="payload-pre-processing"
Sep 18 22:17:29.836019 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:29.836003    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516" containerName="payload-pre-processing"
Sep 18 22:17:29.836019 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:29.836011    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a7aba26-8161-42bb-9bb0-51f144358cbd" containerName="payload-processing"
Sep 18 22:17:29.836019 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:29.836016    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a7aba26-8161-42bb-9bb0-51f144358cbd" containerName="payload-processing"
Sep 18 22:17:29.836352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:29.836029    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e46b620-6090-44f6-b62a-0a0a743cefbb" containerName="payload-pre-processing"
Sep 18 22:17:29.836352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:29.836034    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e46b620-6090-44f6-b62a-0a0a743cefbb" containerName="payload-pre-processing"
Sep 18 22:17:29.836352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:29.836103    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f71c3bb-de4e-4cb7-a64a-f8eacc99a932" containerName="payload-processing"
Sep 18 22:17:29.836352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:29.836113    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a9933a4-ca70-4f00-8020-214b4941d51b" containerName="maas-api"
Sep 18 22:17:29.836352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:29.836123    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a7aba26-8161-42bb-9bb0-51f144358cbd" containerName="payload-processing"
Sep 18 22:17:29.836352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:29.836134    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e46b620-6090-44f6-b62a-0a0a743cefbb" containerName="payload-pre-processing"
Sep 18 22:17:29.836352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:29.836141    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb01fa9f-9f4c-49aa-aa7a-fb4753b4d516" containerName="payload-pre-processing"
Sep 18 22:17:29.840737 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:29.840721    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a13357-m8g8p"
Sep 18 22:17:29.843145 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:29.843114    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 22:17:29.843257 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:29.843211    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9g7m4\""
Sep 18 22:17:29.849018 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:29.848997    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a13357-m8g8p"]
Sep 18 22:17:29.868838 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:29.868802    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26d7bc84-bd1d-41d3-b808-8873b071f2b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-a13357-m8g8p\" (UID: \"26d7bc84-bd1d-41d3-b808-8873b071f2b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a13357-m8g8p"
Sep 18 22:17:29.969643 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:29.969608    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26d7bc84-bd1d-41d3-b808-8873b071f2b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-a13357-m8g8p\" (UID: \"26d7bc84-bd1d-41d3-b808-8873b071f2b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a13357-m8g8p"
Sep 18 22:17:29.970222 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:29.970202    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26d7bc84-bd1d-41d3-b808-8873b071f2b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-a13357-m8g8p\" (UID: \"26d7bc84-bd1d-41d3-b808-8873b071f2b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a13357-m8g8p"
Sep 18 22:17:30.152631 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.152551    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a13357-m8g8p"
Sep 18 22:17:30.369472 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.369439    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8"]
Sep 18 22:17:30.373102 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.373086    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8"
Sep 18 22:17:30.377465 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.376899    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 18 22:17:30.377465 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.377046    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-c6l9h\""
Sep 18 22:17:30.377465 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.377126    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 18 22:17:30.377465 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.377228    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-4209a4-serving-cert\""
Sep 18 22:17:30.385741 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.385719    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8"]
Sep 18 22:17:30.426715 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.426692    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a13357-m8g8p"]
Sep 18 22:17:30.428609 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:17:30.428582    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26d7bc84_bd1d_41d3_b808_8873b071f2b2.slice/crio-2c9c6427c89e1f645d8c892d47b3a93cf6585628bacea882f747231516bcfa6d WatchSource:0}: Error finding container 2c9c6427c89e1f645d8c892d47b3a93cf6585628bacea882f747231516bcfa6d: Status 404 returned error can't find the container with id 2c9c6427c89e1f645d8c892d47b3a93cf6585628bacea882f747231516bcfa6d
Sep 18 22:17:30.474479 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.474435    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx28k\" (UniqueName: \"kubernetes.io/projected/5c748cef-da26-4026-85f9-112ffa6cce21-kube-api-access-hx28k\") pod \"maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8\" (UID: \"5c748cef-da26-4026-85f9-112ffa6cce21\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8"
Sep 18 22:17:30.474595 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.474573    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c748cef-da26-4026-85f9-112ffa6cce21-maas-api-tls\") pod \"maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8\" (UID: \"5c748cef-da26-4026-85f9-112ffa6cce21\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8"
Sep 18 22:17:30.474658 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.474598    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c748cef-da26-4026-85f9-112ffa6cce21-openshift-service-ca\") pod \"maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8\" (UID: \"5c748cef-da26-4026-85f9-112ffa6cce21\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8"
Sep 18 22:17:30.474658 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.474641    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c748cef-da26-4026-85f9-112ffa6cce21-metrics-certs\") pod \"maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8\" (UID: \"5c748cef-da26-4026-85f9-112ffa6cce21\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8"
Sep 18 22:17:30.575256 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.575218    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx28k\" (UniqueName: \"kubernetes.io/projected/5c748cef-da26-4026-85f9-112ffa6cce21-kube-api-access-hx28k\") pod \"maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8\" (UID: \"5c748cef-da26-4026-85f9-112ffa6cce21\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8"
Sep 18 22:17:30.575436 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.575319    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c748cef-da26-4026-85f9-112ffa6cce21-maas-api-tls\") pod \"maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8\" (UID: \"5c748cef-da26-4026-85f9-112ffa6cce21\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8"
Sep 18 22:17:30.575436 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.575343    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c748cef-da26-4026-85f9-112ffa6cce21-openshift-service-ca\") pod \"maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8\" (UID: \"5c748cef-da26-4026-85f9-112ffa6cce21\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8"
Sep 18 22:17:30.575436 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.575396    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c748cef-da26-4026-85f9-112ffa6cce21-metrics-certs\") pod \"maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8\" (UID: \"5c748cef-da26-4026-85f9-112ffa6cce21\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8"
Sep 18 22:17:30.576032 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.576010    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c748cef-da26-4026-85f9-112ffa6cce21-openshift-service-ca\") pod \"maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8\" (UID: \"5c748cef-da26-4026-85f9-112ffa6cce21\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8"
Sep 18 22:17:30.578018 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.577996    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c748cef-da26-4026-85f9-112ffa6cce21-metrics-certs\") pod \"maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8\" (UID: \"5c748cef-da26-4026-85f9-112ffa6cce21\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8"
Sep 18 22:17:30.578164 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.578146    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c748cef-da26-4026-85f9-112ffa6cce21-maas-api-tls\") pod \"maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8\" (UID: \"5c748cef-da26-4026-85f9-112ffa6cce21\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8"
Sep 18 22:17:30.584485 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.584465    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx28k\" (UniqueName: \"kubernetes.io/projected/5c748cef-da26-4026-85f9-112ffa6cce21-kube-api-access-hx28k\") pod \"maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8\" (UID: \"5c748cef-da26-4026-85f9-112ffa6cce21\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8"
Sep 18 22:17:30.686185 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.686111    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8"
Sep 18 22:17:30.972539 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.972441    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a13357-m8g8p" event={"ID":"26d7bc84-bd1d-41d3-b808-8873b071f2b2","Type":"ContainerStarted","Data":"8bca19e31dcfe305d4f3d3c139422046764885630c92ed1f8dc52f9bea39efc3"}
Sep 18 22:17:30.972539 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.972490    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a13357-m8g8p" event={"ID":"26d7bc84-bd1d-41d3-b808-8873b071f2b2","Type":"ContainerStarted","Data":"2c9c6427c89e1f645d8c892d47b3a93cf6585628bacea882f747231516bcfa6d"}
Sep 18 22:17:30.973769 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.973748    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8"]
Sep 18 22:17:30.975584 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:17:30.975563    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c748cef_da26_4026_85f9_112ffa6cce21.slice/crio-7119c7493ee7669c5c3a5ee79ccd139bc29116a20fba745f0a33b777cb72fe5f WatchSource:0}: Error finding container 7119c7493ee7669c5c3a5ee79ccd139bc29116a20fba745f0a33b777cb72fe5f: Status 404 returned error can't find the container with id 7119c7493ee7669c5c3a5ee79ccd139bc29116a20fba745f0a33b777cb72fe5f
Sep 18 22:17:30.976887 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.976870    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 22:17:30.996807 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:30.996763    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a13357-m8g8p" podStartSLOduration=1.996747782 podStartE2EDuration="1.996747782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:17:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:17:30.995183564 +0000 UTC m=+1026.126964646" watchObservedRunningTime="2026-09-18 22:17:30.996747782 +0000 UTC m=+1026.128528864"
Sep 18 22:17:31.131024 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.130988    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8"]
Sep 18 22:17:31.134760 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.134729    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8"
Sep 18 22:17:31.137793 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.137770    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-4209a4\""
Sep 18 22:17:31.149073 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.149049    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8"]
Sep 18 22:17:31.181415 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.181381    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49860714-0064-457e-823d-147c17bd64bb-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8\" (UID: \"49860714-0064-457e-823d-147c17bd64bb\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8"
Sep 18 22:17:31.181415 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.181417    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgvpr\" (UniqueName: \"kubernetes.io/projected/49860714-0064-457e-823d-147c17bd64bb-kube-api-access-zgvpr\") pod \"payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8\" (UID: \"49860714-0064-457e-823d-147c17bd64bb\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8"
Sep 18 22:17:31.260782 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.260755    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp"]
Sep 18 22:17:31.264128 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.264108    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp"
Sep 18 22:17:31.270734 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.270711    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-4209a4-dockercfg-82zf4\""
Sep 18 22:17:31.282885 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.282859    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49860714-0064-457e-823d-147c17bd64bb-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8\" (UID: \"49860714-0064-457e-823d-147c17bd64bb\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8"
Sep 18 22:17:31.282986 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.282907    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgvpr\" (UniqueName: \"kubernetes.io/projected/49860714-0064-457e-823d-147c17bd64bb-kube-api-access-zgvpr\") pod \"payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8\" (UID: \"49860714-0064-457e-823d-147c17bd64bb\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8"
Sep 18 22:17:31.283585 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.283567    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49860714-0064-457e-823d-147c17bd64bb-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8\" (UID: \"49860714-0064-457e-823d-147c17bd64bb\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8"
Sep 18 22:17:31.290092 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.290071    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp"]
Sep 18 22:17:31.301799 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.301768    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgvpr\" (UniqueName: \"kubernetes.io/projected/49860714-0064-457e-823d-147c17bd64bb-kube-api-access-zgvpr\") pod \"payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8\" (UID: \"49860714-0064-457e-823d-147c17bd64bb\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8"
Sep 18 22:17:31.383449 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.383426    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bdf77b8-2321-4720-97d8-3aa4e031cdcb-plugins-config-volume\") pod \"payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp\" (UID: \"8bdf77b8-2321-4720-97d8-3aa4e031cdcb\") " pod="openshift-ingress/payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp"
Sep 18 22:17:31.383591 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.383572    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jxjh\" (UniqueName: \"kubernetes.io/projected/8bdf77b8-2321-4720-97d8-3aa4e031cdcb-kube-api-access-7jxjh\") pod \"payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp\" (UID: \"8bdf77b8-2321-4720-97d8-3aa4e031cdcb\") " pod="openshift-ingress/payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp"
Sep 18 22:17:31.446869 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.446834    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8"
Sep 18 22:17:31.484282 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.484245    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jxjh\" (UniqueName: \"kubernetes.io/projected/8bdf77b8-2321-4720-97d8-3aa4e031cdcb-kube-api-access-7jxjh\") pod \"payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp\" (UID: \"8bdf77b8-2321-4720-97d8-3aa4e031cdcb\") " pod="openshift-ingress/payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp"
Sep 18 22:17:31.484415 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.484295    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bdf77b8-2321-4720-97d8-3aa4e031cdcb-plugins-config-volume\") pod \"payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp\" (UID: \"8bdf77b8-2321-4720-97d8-3aa4e031cdcb\") " pod="openshift-ingress/payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp"
Sep 18 22:17:31.485075 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.485037    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bdf77b8-2321-4720-97d8-3aa4e031cdcb-plugins-config-volume\") pod \"payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp\" (UID: \"8bdf77b8-2321-4720-97d8-3aa4e031cdcb\") " pod="openshift-ingress/payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp"
Sep 18 22:17:31.495949 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.495925    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jxjh\" (UniqueName: \"kubernetes.io/projected/8bdf77b8-2321-4720-97d8-3aa4e031cdcb-kube-api-access-7jxjh\") pod \"payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp\" (UID: \"8bdf77b8-2321-4720-97d8-3aa4e031cdcb\") " pod="openshift-ingress/payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp"
Sep 18 22:17:31.619100 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.619063    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp"
Sep 18 22:17:31.725030 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.724996    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8"]
Sep 18 22:17:31.725663 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:17:31.725633    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49860714_0064_457e_823d_147c17bd64bb.slice/crio-7cd1fccd48d0ecce7cba14d77c76a08e93d025ace9b7317ac57d0e8168e34668 WatchSource:0}: Error finding container 7cd1fccd48d0ecce7cba14d77c76a08e93d025ace9b7317ac57d0e8168e34668: Status 404 returned error can't find the container with id 7cd1fccd48d0ecce7cba14d77c76a08e93d025ace9b7317ac57d0e8168e34668
Sep 18 22:17:31.895020 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.894992    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp"]
Sep 18 22:17:31.897333 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:17:31.897309    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bdf77b8_2321_4720_97d8_3aa4e031cdcb.slice/crio-aab3953308210f028d4385c03b789680db20cd102376ce5b93c092f4d29429c8 WatchSource:0}: Error finding container aab3953308210f028d4385c03b789680db20cd102376ce5b93c092f4d29429c8: Status 404 returned error can't find the container with id aab3953308210f028d4385c03b789680db20cd102376ce5b93c092f4d29429c8
Sep 18 22:17:31.979723 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.979684    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8" event={"ID":"5c748cef-da26-4026-85f9-112ffa6cce21","Type":"ContainerStarted","Data":"9a2559c8d4c8f9796d22d2223627e44360b60f28b6d386c09a85c183616e1d95"}
Sep 18 22:17:31.980098 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.979741    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8" event={"ID":"5c748cef-da26-4026-85f9-112ffa6cce21","Type":"ContainerStarted","Data":"7119c7493ee7669c5c3a5ee79ccd139bc29116a20fba745f0a33b777cb72fe5f"}
Sep 18 22:17:31.980098 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.979885    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8"
Sep 18 22:17:31.981668 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.981644    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp" event={"ID":"8bdf77b8-2321-4720-97d8-3aa4e031cdcb","Type":"ContainerStarted","Data":"53989da4f6ce0e000a435970c73ff79d895184628da72e97af745405d586ab2b"}
Sep 18 22:17:31.981871 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.981857    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp"
Sep 18 22:17:31.981999 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.981979    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp" event={"ID":"8bdf77b8-2321-4720-97d8-3aa4e031cdcb","Type":"ContainerStarted","Data":"aab3953308210f028d4385c03b789680db20cd102376ce5b93c092f4d29429c8"}
Sep 18 22:17:31.983304 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.983269    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8" event={"ID":"49860714-0064-457e-823d-147c17bd64bb","Type":"ContainerStarted","Data":"969daeb67f7eb725ecb1bd54c42b95fe4bdb44347dcd8eaa1be17c9360b2d9f3"}
Sep 18 22:17:31.983407 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.983355    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8" event={"ID":"49860714-0064-457e-823d-147c17bd64bb","Type":"ContainerStarted","Data":"7cd1fccd48d0ecce7cba14d77c76a08e93d025ace9b7317ac57d0e8168e34668"}
Sep 18 22:17:31.983407 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.983380    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8"
Sep 18 22:17:31.985236 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.985213    2574 generic.go:356] "Generic (PLEG): container finished" podID="26d7bc84-bd1d-41d3-b808-8873b071f2b2" containerID="8bca19e31dcfe305d4f3d3c139422046764885630c92ed1f8dc52f9bea39efc3" exitCode=0
Sep 18 22:17:31.985343 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:31.985269    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a13357-m8g8p" event={"ID":"26d7bc84-bd1d-41d3-b808-8873b071f2b2","Type":"ContainerDied","Data":"8bca19e31dcfe305d4f3d3c139422046764885630c92ed1f8dc52f9bea39efc3"}
Sep 18 22:17:32.001629 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:32.001552    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8" podStartSLOduration=1.606007869 podStartE2EDuration="2.001538136s" totalImagesPullingTime="395.530267ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:17:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:17:32.000666024 +0000 UTC m=+1027.132447107" watchObservedRunningTime="2026-09-18 22:17:32.001538136 +0000 UTC m=+1027.133319209"
Sep 18 22:17:32.023080 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:32.023024    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8" podStartSLOduration=1.023004027 podStartE2EDuration="1.023004027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:17:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:17:32.020868412 +0000 UTC m=+1027.152649495" watchObservedRunningTime="2026-09-18 22:17:32.023004027 +0000 UTC m=+1027.154785113"
Sep 18 22:17:32.050812 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:32.050758    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp" podStartSLOduration=1.050743734 podStartE2EDuration="1.050743734s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:17:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:17:32.04809625 +0000 UTC m=+1027.179877331" watchObservedRunningTime="2026-09-18 22:17:32.050743734 +0000 UTC m=+1027.182524815"
Sep 18 22:17:33.129704 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:33.129676    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a13357-m8g8p"
Sep 18 22:17:33.198590 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:33.198554    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26d7bc84-bd1d-41d3-b808-8873b071f2b2-maas-api-service-ca\") pod \"26d7bc84-bd1d-41d3-b808-8873b071f2b2\" (UID: \"26d7bc84-bd1d-41d3-b808-8873b071f2b2\") "
Sep 18 22:17:33.198853 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:33.198833    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26d7bc84-bd1d-41d3-b808-8873b071f2b2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "26d7bc84-bd1d-41d3-b808-8873b071f2b2" (UID: "26d7bc84-bd1d-41d3-b808-8873b071f2b2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:17:33.299418 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:33.299336    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26d7bc84-bd1d-41d3-b808-8873b071f2b2-maas-api-service-ca\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:17:33.998235 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:33.998203    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a13357-m8g8p"
Sep 18 22:17:33.998430 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:33.998247    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a13357-m8g8p" event={"ID":"26d7bc84-bd1d-41d3-b808-8873b071f2b2","Type":"ContainerDied","Data":"2c9c6427c89e1f645d8c892d47b3a93cf6585628bacea882f747231516bcfa6d"}
Sep 18 22:17:33.998430 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:33.998295    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c9c6427c89e1f645d8c892d47b3a93cf6585628bacea882f747231516bcfa6d"
Sep 18 22:17:37.996291 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:37.996258    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8"
Sep 18 22:17:41.083005 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:41.082971    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4"]
Sep 18 22:17:41.083625 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:41.083192    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4" podUID="d1ff6fe3-8331-42d3-ae67-ff9a7d17f154" containerName="payload-processing" containerID="cri-o://6ef10633026cd949d4ee3966bf3933e8398b0b38ae99bafaa4855d27a8221e7d" gracePeriod=30
Sep 18 22:17:41.350303 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:41.350274    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4"
Sep 18 22:17:41.472603 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:41.472569    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z99g7\" (UniqueName: \"kubernetes.io/projected/d1ff6fe3-8331-42d3-ae67-ff9a7d17f154-kube-api-access-z99g7\") pod \"d1ff6fe3-8331-42d3-ae67-ff9a7d17f154\" (UID: \"d1ff6fe3-8331-42d3-ae67-ff9a7d17f154\") "
Sep 18 22:17:41.472772 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:41.472663    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1ff6fe3-8331-42d3-ae67-ff9a7d17f154-plugins-config-volume\") pod \"d1ff6fe3-8331-42d3-ae67-ff9a7d17f154\" (UID: \"d1ff6fe3-8331-42d3-ae67-ff9a7d17f154\") "
Sep 18 22:17:41.473061 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:41.473038    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1ff6fe3-8331-42d3-ae67-ff9a7d17f154-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d1ff6fe3-8331-42d3-ae67-ff9a7d17f154" (UID: "d1ff6fe3-8331-42d3-ae67-ff9a7d17f154"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:17:41.474944 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:41.474919    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1ff6fe3-8331-42d3-ae67-ff9a7d17f154-kube-api-access-z99g7" (OuterVolumeSpecName: "kube-api-access-z99g7") pod "d1ff6fe3-8331-42d3-ae67-ff9a7d17f154" (UID: "d1ff6fe3-8331-42d3-ae67-ff9a7d17f154"). InnerVolumeSpecName "kube-api-access-z99g7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:17:41.573681 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:41.573651    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1ff6fe3-8331-42d3-ae67-ff9a7d17f154-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:17:41.573681 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:41.573676    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z99g7\" (UniqueName: \"kubernetes.io/projected/d1ff6fe3-8331-42d3-ae67-ff9a7d17f154-kube-api-access-z99g7\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:17:41.621240 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:41.621164    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a13357-m8g8p"]
Sep 18 22:17:41.630324 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:41.630289    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-a13357-m8g8p"]
Sep 18 22:17:42.042185 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:42.042149    2574 generic.go:356] "Generic (PLEG): container finished" podID="d1ff6fe3-8331-42d3-ae67-ff9a7d17f154" containerID="6ef10633026cd949d4ee3966bf3933e8398b0b38ae99bafaa4855d27a8221e7d" exitCode=0
Sep 18 22:17:42.042371 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:42.042190    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4"
Sep 18 22:17:42.042371 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:42.042228    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4" event={"ID":"d1ff6fe3-8331-42d3-ae67-ff9a7d17f154","Type":"ContainerDied","Data":"6ef10633026cd949d4ee3966bf3933e8398b0b38ae99bafaa4855d27a8221e7d"}
Sep 18 22:17:42.042371 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:42.042268    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4" event={"ID":"d1ff6fe3-8331-42d3-ae67-ff9a7d17f154","Type":"ContainerDied","Data":"5de4b05f76c27bc7619c087a67b08b51fc4963817a5b54db15e7cabbe42b981d"}
Sep 18 22:17:42.042371 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:42.042289    2574 scope.go:117] "RemoveContainer" containerID="6ef10633026cd949d4ee3966bf3933e8398b0b38ae99bafaa4855d27a8221e7d"
Sep 18 22:17:42.055772 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:42.054551    2574 scope.go:117] "RemoveContainer" containerID="6ef10633026cd949d4ee3966bf3933e8398b0b38ae99bafaa4855d27a8221e7d"
Sep 18 22:17:42.056462 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:17:42.056378    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ef10633026cd949d4ee3966bf3933e8398b0b38ae99bafaa4855d27a8221e7d\": container with ID starting with 6ef10633026cd949d4ee3966bf3933e8398b0b38ae99bafaa4855d27a8221e7d not found: ID does not exist" containerID="6ef10633026cd949d4ee3966bf3933e8398b0b38ae99bafaa4855d27a8221e7d"
Sep 18 22:17:42.056462 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:42.056425    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ef10633026cd949d4ee3966bf3933e8398b0b38ae99bafaa4855d27a8221e7d"} err="failed to get container status \"6ef10633026cd949d4ee3966bf3933e8398b0b38ae99bafaa4855d27a8221e7d\": rpc error: code = NotFound desc = could not find container \"6ef10633026cd949d4ee3966bf3933e8398b0b38ae99bafaa4855d27a8221e7d\": container with ID starting with 6ef10633026cd949d4ee3966bf3933e8398b0b38ae99bafaa4855d27a8221e7d not found: ID does not exist"
Sep 18 22:17:42.080167 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:42.080138    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4"]
Sep 18 22:17:42.085351 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:42.085324    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-a13357-55fb4c4c95-mrhv4"]
Sep 18 22:17:42.993321 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:42.993293    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8"
Sep 18 22:17:43.345657 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:43.345581    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26d7bc84-bd1d-41d3-b808-8873b071f2b2" path="/var/lib/kubelet/pods/26d7bc84-bd1d-41d3-b808-8873b071f2b2/volumes"
Sep 18 22:17:43.346001 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:43.345942    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1ff6fe3-8331-42d3-ae67-ff9a7d17f154" path="/var/lib/kubelet/pods/d1ff6fe3-8331-42d3-ae67-ff9a7d17f154/volumes"
Sep 18 22:17:44.000720 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:17:44.000683    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp"
Sep 18 22:18:35.258772 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.258738    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"]
Sep 18 22:18:35.259260 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.259123    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26d7bc84-bd1d-41d3-b808-8873b071f2b2" containerName="revoke-keys"
Sep 18 22:18:35.259260 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.259134    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="26d7bc84-bd1d-41d3-b808-8873b071f2b2" containerName="revoke-keys"
Sep 18 22:18:35.259260 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.259155    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1ff6fe3-8331-42d3-ae67-ff9a7d17f154" containerName="payload-processing"
Sep 18 22:18:35.259260 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.259160    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1ff6fe3-8331-42d3-ae67-ff9a7d17f154" containerName="payload-processing"
Sep 18 22:18:35.259260 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.259230    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="26d7bc84-bd1d-41d3-b808-8873b071f2b2" containerName="revoke-keys"
Sep 18 22:18:35.259260 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.259239    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1ff6fe3-8331-42d3-ae67-ff9a7d17f154" containerName="payload-processing"
Sep 18 22:18:35.263763 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.263746    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"
Sep 18 22:18:35.269730 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.269702    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ab559b\"/\"default-dockercfg-fmfg2\""
Sep 18 22:18:35.269865 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.269727    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ab559b\"/\"kube-root-ca.crt\""
Sep 18 22:18:35.269865 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.269702    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ab559b\"/\"openshift-service-ca.crt\""
Sep 18 22:18:35.269865 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.269786    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ab559b\"/\"test-model-ab559b-kserve-self-signed-certs\""
Sep 18 22:18:35.287025 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.286994    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"]
Sep 18 22:18:35.352429 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.352398    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a91e485-4165-4bc9-8866-180ccd4368ee-model-cache\") pod \"test-model-ab559b-kserve-6c6cf7bdc7-5mnx8\" (UID: \"9a91e485-4165-4bc9-8866-180ccd4368ee\") " pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"
Sep 18 22:18:35.352625 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.352440    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a91e485-4165-4bc9-8866-180ccd4368ee-tls-certs\") pod \"test-model-ab559b-kserve-6c6cf7bdc7-5mnx8\" (UID: \"9a91e485-4165-4bc9-8866-180ccd4368ee\") " pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"
Sep 18 22:18:35.352625 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.352492    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a91e485-4165-4bc9-8866-180ccd4368ee-dshm\") pod \"test-model-ab559b-kserve-6c6cf7bdc7-5mnx8\" (UID: \"9a91e485-4165-4bc9-8866-180ccd4368ee\") " pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"
Sep 18 22:18:35.352625 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.352560    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkwgw\" (UniqueName: \"kubernetes.io/projected/9a91e485-4165-4bc9-8866-180ccd4368ee-kube-api-access-tkwgw\") pod \"test-model-ab559b-kserve-6c6cf7bdc7-5mnx8\" (UID: \"9a91e485-4165-4bc9-8866-180ccd4368ee\") " pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"
Sep 18 22:18:35.352625 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.352592    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a91e485-4165-4bc9-8866-180ccd4368ee-home\") pod \"test-model-ab559b-kserve-6c6cf7bdc7-5mnx8\" (UID: \"9a91e485-4165-4bc9-8866-180ccd4368ee\") " pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"
Sep 18 22:18:35.352625 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.352618    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a91e485-4165-4bc9-8866-180ccd4368ee-tmp-dir\") pod \"test-model-ab559b-kserve-6c6cf7bdc7-5mnx8\" (UID: \"9a91e485-4165-4bc9-8866-180ccd4368ee\") " pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"
Sep 18 22:18:35.453441 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.453413    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a91e485-4165-4bc9-8866-180ccd4368ee-model-cache\") pod \"test-model-ab559b-kserve-6c6cf7bdc7-5mnx8\" (UID: \"9a91e485-4165-4bc9-8866-180ccd4368ee\") " pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"
Sep 18 22:18:35.453622 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.453479    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a91e485-4165-4bc9-8866-180ccd4368ee-tls-certs\") pod \"test-model-ab559b-kserve-6c6cf7bdc7-5mnx8\" (UID: \"9a91e485-4165-4bc9-8866-180ccd4368ee\") " pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"
Sep 18 22:18:35.453622 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.453550    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a91e485-4165-4bc9-8866-180ccd4368ee-dshm\") pod \"test-model-ab559b-kserve-6c6cf7bdc7-5mnx8\" (UID: \"9a91e485-4165-4bc9-8866-180ccd4368ee\") " pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"
Sep 18 22:18:35.453622 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.453592    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkwgw\" (UniqueName: \"kubernetes.io/projected/9a91e485-4165-4bc9-8866-180ccd4368ee-kube-api-access-tkwgw\") pod \"test-model-ab559b-kserve-6c6cf7bdc7-5mnx8\" (UID: \"9a91e485-4165-4bc9-8866-180ccd4368ee\") " pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"
Sep 18 22:18:35.453863 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.453630    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a91e485-4165-4bc9-8866-180ccd4368ee-home\") pod \"test-model-ab559b-kserve-6c6cf7bdc7-5mnx8\" (UID: \"9a91e485-4165-4bc9-8866-180ccd4368ee\") " pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"
Sep 18 22:18:35.453863 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.453778    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a91e485-4165-4bc9-8866-180ccd4368ee-tmp-dir\") pod \"test-model-ab559b-kserve-6c6cf7bdc7-5mnx8\" (UID: \"9a91e485-4165-4bc9-8866-180ccd4368ee\") " pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"
Sep 18 22:18:35.454015 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.453996    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a91e485-4165-4bc9-8866-180ccd4368ee-home\") pod \"test-model-ab559b-kserve-6c6cf7bdc7-5mnx8\" (UID: \"9a91e485-4165-4bc9-8866-180ccd4368ee\") " pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"
Sep 18 22:18:35.454077 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.454040    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a91e485-4165-4bc9-8866-180ccd4368ee-tmp-dir\") pod \"test-model-ab559b-kserve-6c6cf7bdc7-5mnx8\" (UID: \"9a91e485-4165-4bc9-8866-180ccd4368ee\") " pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"
Sep 18 22:18:35.454392 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.454372    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a91e485-4165-4bc9-8866-180ccd4368ee-model-cache\") pod \"test-model-ab559b-kserve-6c6cf7bdc7-5mnx8\" (UID: \"9a91e485-4165-4bc9-8866-180ccd4368ee\") " pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"
Sep 18 22:18:35.455759 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.455736    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a91e485-4165-4bc9-8866-180ccd4368ee-dshm\") pod \"test-model-ab559b-kserve-6c6cf7bdc7-5mnx8\" (UID: \"9a91e485-4165-4bc9-8866-180ccd4368ee\") " pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"
Sep 18 22:18:35.456027 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.456011    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a91e485-4165-4bc9-8866-180ccd4368ee-tls-certs\") pod \"test-model-ab559b-kserve-6c6cf7bdc7-5mnx8\" (UID: \"9a91e485-4165-4bc9-8866-180ccd4368ee\") " pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"
Sep 18 22:18:35.464347 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.464322    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkwgw\" (UniqueName: \"kubernetes.io/projected/9a91e485-4165-4bc9-8866-180ccd4368ee-kube-api-access-tkwgw\") pod \"test-model-ab559b-kserve-6c6cf7bdc7-5mnx8\" (UID: \"9a91e485-4165-4bc9-8866-180ccd4368ee\") " pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"
Sep 18 22:18:35.573334 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.573249    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"
Sep 18 22:18:35.863028 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:35.862953    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"]
Sep 18 22:18:35.866282 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:18:35.866256    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a91e485_4165_4bc9_8866_180ccd4368ee.slice/crio-1033bf8b4666dfa2b759c288fa9cb55f17d6bfec4f161d97d4eb9dbb9f7b9525 WatchSource:0}: Error finding container 1033bf8b4666dfa2b759c288fa9cb55f17d6bfec4f161d97d4eb9dbb9f7b9525: Status 404 returned error can't find the container with id 1033bf8b4666dfa2b759c288fa9cb55f17d6bfec4f161d97d4eb9dbb9f7b9525
Sep 18 22:18:36.326025 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:36.325983    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8" event={"ID":"9a91e485-4165-4bc9-8866-180ccd4368ee","Type":"ContainerStarted","Data":"4f27765593302aa0d161c0192c354ef4bd3a95dad6eec501f5a37d842db5296e"}
Sep 18 22:18:36.326025 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:36.326033    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8" event={"ID":"9a91e485-4165-4bc9-8866-180ccd4368ee","Type":"ContainerStarted","Data":"1033bf8b4666dfa2b759c288fa9cb55f17d6bfec4f161d97d4eb9dbb9f7b9525"}
Sep 18 22:18:36.348432 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:36.348384    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8" podStartSLOduration=1.348368945 podStartE2EDuration="1.348368945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:18:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:18:36.347388054 +0000 UTC m=+1091.479169138" watchObservedRunningTime="2026-09-18 22:18:36.348368945 +0000 UTC m=+1091.480150027"
Sep 18 22:18:45.573449 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:45.573416    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"
Sep 18 22:18:45.573903 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:45.573462    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"
Sep 18 22:18:45.586501 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:45.586468    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"
Sep 18 22:18:46.388776 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:18:46.388751    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"
Sep 18 22:19:05.537391 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:05.537355    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m"]
Sep 18 22:19:05.540985 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:05.540970    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m"
Sep 18 22:19:05.543556 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:05.543534    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-6ad61446\""
Sep 18 22:19:05.543690 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:05.543671    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-6ad61446-dockercfg-cwp9f\""
Sep 18 22:19:05.551752 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:05.551725    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m"]
Sep 18 22:19:05.614987 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:05.614947    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzmfq\" (UniqueName: \"kubernetes.io/projected/dccb00ab-37ba-4f6d-8157-cd7b6ed68381-kube-api-access-mzmfq\") pod \"payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m\" (UID: \"dccb00ab-37ba-4f6d-8157-cd7b6ed68381\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m"
Sep 18 22:19:05.615130 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:05.615014    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dccb00ab-37ba-4f6d-8157-cd7b6ed68381-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m\" (UID: \"dccb00ab-37ba-4f6d-8157-cd7b6ed68381\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m"
Sep 18 22:19:05.716050 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:05.716015    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzmfq\" (UniqueName: \"kubernetes.io/projected/dccb00ab-37ba-4f6d-8157-cd7b6ed68381-kube-api-access-mzmfq\") pod \"payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m\" (UID: \"dccb00ab-37ba-4f6d-8157-cd7b6ed68381\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m"
Sep 18 22:19:05.716251 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:05.716059    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dccb00ab-37ba-4f6d-8157-cd7b6ed68381-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m\" (UID: \"dccb00ab-37ba-4f6d-8157-cd7b6ed68381\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m"
Sep 18 22:19:05.716726 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:05.716708    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dccb00ab-37ba-4f6d-8157-cd7b6ed68381-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m\" (UID: \"dccb00ab-37ba-4f6d-8157-cd7b6ed68381\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m"
Sep 18 22:19:05.724815 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:05.724794    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzmfq\" (UniqueName: \"kubernetes.io/projected/dccb00ab-37ba-4f6d-8157-cd7b6ed68381-kube-api-access-mzmfq\") pod \"payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m\" (UID: \"dccb00ab-37ba-4f6d-8157-cd7b6ed68381\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m"
Sep 18 22:19:05.852911 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:05.852843    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m"
Sep 18 22:19:06.124677 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:06.124652    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m"]
Sep 18 22:19:06.127044 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:19:06.127018    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddccb00ab_37ba_4f6d_8157_cd7b6ed68381.slice/crio-22bb9576e2f46f9f3c57f189a23504082f3b19ffd8e1c84e903260f4cc56d2d5 WatchSource:0}: Error finding container 22bb9576e2f46f9f3c57f189a23504082f3b19ffd8e1c84e903260f4cc56d2d5: Status 404 returned error can't find the container with id 22bb9576e2f46f9f3c57f189a23504082f3b19ffd8e1c84e903260f4cc56d2d5
Sep 18 22:19:06.488325 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:06.488287    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m" event={"ID":"dccb00ab-37ba-4f6d-8157-cd7b6ed68381","Type":"ContainerStarted","Data":"965bb73c1e8cb505728478f989e778409182b38682e59154cec20780a569483f"}
Sep 18 22:19:06.488583 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:06.488341    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m" event={"ID":"dccb00ab-37ba-4f6d-8157-cd7b6ed68381","Type":"ContainerStarted","Data":"22bb9576e2f46f9f3c57f189a23504082f3b19ffd8e1c84e903260f4cc56d2d5"}
Sep 18 22:19:06.488583 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:06.488409    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m"
Sep 18 22:19:06.509577 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:06.509500    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m" podStartSLOduration=1.50948607 podStartE2EDuration="1.50948607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:19:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:19:06.508353045 +0000 UTC m=+1121.640134128" watchObservedRunningTime="2026-09-18 22:19:06.50948607 +0000 UTC m=+1121.641267163"
Sep 18 22:19:10.924879 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:10.924848    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8"]
Sep 18 22:19:10.925323 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:10.925091    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8" podUID="5c748cef-da26-4026-85f9-112ffa6cce21" containerName="maas-api" containerID="cri-o://9a2559c8d4c8f9796d22d2223627e44360b60f28b6d386c09a85c183616e1d95" gracePeriod=30
Sep 18 22:19:11.039049 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.039001    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp"]
Sep 18 22:19:11.039287 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.039236    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp" podUID="8bdf77b8-2321-4720-97d8-3aa4e031cdcb" containerName="payload-processing" containerID="cri-o://53989da4f6ce0e000a435970c73ff79d895184628da72e97af745405d586ab2b" gracePeriod=30
Sep 18 22:19:11.047302 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.047273    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8"]
Sep 18 22:19:11.047738 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.047486    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8" podUID="49860714-0064-457e-823d-147c17bd64bb" containerName="payload-pre-processing" containerID="cri-o://969daeb67f7eb725ecb1bd54c42b95fe4bdb44347dcd8eaa1be17c9360b2d9f3" gracePeriod=30
Sep 18 22:19:11.184748 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.184675    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8"
Sep 18 22:19:11.263327 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.263296    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx28k\" (UniqueName: \"kubernetes.io/projected/5c748cef-da26-4026-85f9-112ffa6cce21-kube-api-access-hx28k\") pod \"5c748cef-da26-4026-85f9-112ffa6cce21\" (UID: \"5c748cef-da26-4026-85f9-112ffa6cce21\") "
Sep 18 22:19:11.263565 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.263377    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c748cef-da26-4026-85f9-112ffa6cce21-maas-api-tls\") pod \"5c748cef-da26-4026-85f9-112ffa6cce21\" (UID: \"5c748cef-da26-4026-85f9-112ffa6cce21\") "
Sep 18 22:19:11.263565 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.263418    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c748cef-da26-4026-85f9-112ffa6cce21-metrics-certs\") pod \"5c748cef-da26-4026-85f9-112ffa6cce21\" (UID: \"5c748cef-da26-4026-85f9-112ffa6cce21\") "
Sep 18 22:19:11.263565 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.263480    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c748cef-da26-4026-85f9-112ffa6cce21-openshift-service-ca\") pod \"5c748cef-da26-4026-85f9-112ffa6cce21\" (UID: \"5c748cef-da26-4026-85f9-112ffa6cce21\") "
Sep 18 22:19:11.264224 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.264194    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c748cef-da26-4026-85f9-112ffa6cce21-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5c748cef-da26-4026-85f9-112ffa6cce21" (UID: "5c748cef-da26-4026-85f9-112ffa6cce21"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:19:11.266978 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.266627    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c748cef-da26-4026-85f9-112ffa6cce21-kube-api-access-hx28k" (OuterVolumeSpecName: "kube-api-access-hx28k") pod "5c748cef-da26-4026-85f9-112ffa6cce21" (UID: "5c748cef-da26-4026-85f9-112ffa6cce21"). InnerVolumeSpecName "kube-api-access-hx28k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:19:11.266978 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.266802    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c748cef-da26-4026-85f9-112ffa6cce21-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5c748cef-da26-4026-85f9-112ffa6cce21" (UID: "5c748cef-da26-4026-85f9-112ffa6cce21"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:19:11.267126 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.267018    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c748cef-da26-4026-85f9-112ffa6cce21-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5c748cef-da26-4026-85f9-112ffa6cce21" (UID: "5c748cef-da26-4026-85f9-112ffa6cce21"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:19:11.323538 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.323494    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp"
Sep 18 22:19:11.333477 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.333451    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8"
Sep 18 22:19:11.364394 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.364368    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jxjh\" (UniqueName: \"kubernetes.io/projected/8bdf77b8-2321-4720-97d8-3aa4e031cdcb-kube-api-access-7jxjh\") pod \"8bdf77b8-2321-4720-97d8-3aa4e031cdcb\" (UID: \"8bdf77b8-2321-4720-97d8-3aa4e031cdcb\") "
Sep 18 22:19:11.364562 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.364434    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bdf77b8-2321-4720-97d8-3aa4e031cdcb-plugins-config-volume\") pod \"8bdf77b8-2321-4720-97d8-3aa4e031cdcb\" (UID: \"8bdf77b8-2321-4720-97d8-3aa4e031cdcb\") "
Sep 18 22:19:11.364562 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.364496    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49860714-0064-457e-823d-147c17bd64bb-plugins-config-volume\") pod \"49860714-0064-457e-823d-147c17bd64bb\" (UID: \"49860714-0064-457e-823d-147c17bd64bb\") "
Sep 18 22:19:11.364689 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.364576    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgvpr\" (UniqueName: \"kubernetes.io/projected/49860714-0064-457e-823d-147c17bd64bb-kube-api-access-zgvpr\") pod \"49860714-0064-457e-823d-147c17bd64bb\" (UID: \"49860714-0064-457e-823d-147c17bd64bb\") "
Sep 18 22:19:11.365132 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.364865    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx28k\" (UniqueName: \"kubernetes.io/projected/5c748cef-da26-4026-85f9-112ffa6cce21-kube-api-access-hx28k\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:19:11.365132 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.364914    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c748cef-da26-4026-85f9-112ffa6cce21-maas-api-tls\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:19:11.365132 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.364941    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c748cef-da26-4026-85f9-112ffa6cce21-metrics-certs\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:19:11.365132 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.364956    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c748cef-da26-4026-85f9-112ffa6cce21-openshift-service-ca\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:19:11.365132 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.365001    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49860714-0064-457e-823d-147c17bd64bb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "49860714-0064-457e-823d-147c17bd64bb" (UID: "49860714-0064-457e-823d-147c17bd64bb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:19:11.365652 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.365588    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bdf77b8-2321-4720-97d8-3aa4e031cdcb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8bdf77b8-2321-4720-97d8-3aa4e031cdcb" (UID: "8bdf77b8-2321-4720-97d8-3aa4e031cdcb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:19:11.367492 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.367467    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bdf77b8-2321-4720-97d8-3aa4e031cdcb-kube-api-access-7jxjh" (OuterVolumeSpecName: "kube-api-access-7jxjh") pod "8bdf77b8-2321-4720-97d8-3aa4e031cdcb" (UID: "8bdf77b8-2321-4720-97d8-3aa4e031cdcb"). InnerVolumeSpecName "kube-api-access-7jxjh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:19:11.367586 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.367488    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49860714-0064-457e-823d-147c17bd64bb-kube-api-access-zgvpr" (OuterVolumeSpecName: "kube-api-access-zgvpr") pod "49860714-0064-457e-823d-147c17bd64bb" (UID: "49860714-0064-457e-823d-147c17bd64bb"). InnerVolumeSpecName "kube-api-access-zgvpr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:19:11.465923 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.465854    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgvpr\" (UniqueName: \"kubernetes.io/projected/49860714-0064-457e-823d-147c17bd64bb-kube-api-access-zgvpr\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:19:11.465923 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.465876    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jxjh\" (UniqueName: \"kubernetes.io/projected/8bdf77b8-2321-4720-97d8-3aa4e031cdcb-kube-api-access-7jxjh\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:19:11.465923 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.465888    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bdf77b8-2321-4720-97d8-3aa4e031cdcb-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:19:11.465923 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.465896    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49860714-0064-457e-823d-147c17bd64bb-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:19:11.514075 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.514042    2574 generic.go:356] "Generic (PLEG): container finished" podID="5c748cef-da26-4026-85f9-112ffa6cce21" containerID="9a2559c8d4c8f9796d22d2223627e44360b60f28b6d386c09a85c183616e1d95" exitCode=0
Sep 18 22:19:11.514209 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.514088    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8"
Sep 18 22:19:11.514209 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.514131    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8" event={"ID":"5c748cef-da26-4026-85f9-112ffa6cce21","Type":"ContainerDied","Data":"9a2559c8d4c8f9796d22d2223627e44360b60f28b6d386c09a85c183616e1d95"}
Sep 18 22:19:11.514209 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.514192    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8" event={"ID":"5c748cef-da26-4026-85f9-112ffa6cce21","Type":"ContainerDied","Data":"7119c7493ee7669c5c3a5ee79ccd139bc29116a20fba745f0a33b777cb72fe5f"}
Sep 18 22:19:11.514368 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.514225    2574 scope.go:117] "RemoveContainer" containerID="9a2559c8d4c8f9796d22d2223627e44360b60f28b6d386c09a85c183616e1d95"
Sep 18 22:19:11.515626 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.515601    2574 generic.go:356] "Generic (PLEG): container finished" podID="8bdf77b8-2321-4720-97d8-3aa4e031cdcb" containerID="53989da4f6ce0e000a435970c73ff79d895184628da72e97af745405d586ab2b" exitCode=0
Sep 18 22:19:11.515750 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.515639    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp" event={"ID":"8bdf77b8-2321-4720-97d8-3aa4e031cdcb","Type":"ContainerDied","Data":"53989da4f6ce0e000a435970c73ff79d895184628da72e97af745405d586ab2b"}
Sep 18 22:19:11.515750 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.515663    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp"
Sep 18 22:19:11.515750 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.515713    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp" event={"ID":"8bdf77b8-2321-4720-97d8-3aa4e031cdcb","Type":"ContainerDied","Data":"aab3953308210f028d4385c03b789680db20cd102376ce5b93c092f4d29429c8"}
Sep 18 22:19:11.517237 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.517216    2574 generic.go:356] "Generic (PLEG): container finished" podID="49860714-0064-457e-823d-147c17bd64bb" containerID="969daeb67f7eb725ecb1bd54c42b95fe4bdb44347dcd8eaa1be17c9360b2d9f3" exitCode=0
Sep 18 22:19:11.517237 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.517238    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8" event={"ID":"49860714-0064-457e-823d-147c17bd64bb","Type":"ContainerDied","Data":"969daeb67f7eb725ecb1bd54c42b95fe4bdb44347dcd8eaa1be17c9360b2d9f3"}
Sep 18 22:19:11.517383 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.517286    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8" event={"ID":"49860714-0064-457e-823d-147c17bd64bb","Type":"ContainerDied","Data":"7cd1fccd48d0ecce7cba14d77c76a08e93d025ace9b7317ac57d0e8168e34668"}
Sep 18 22:19:11.517383 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.517295    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8"
Sep 18 22:19:11.527817 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.527755    2574 scope.go:117] "RemoveContainer" containerID="9a2559c8d4c8f9796d22d2223627e44360b60f28b6d386c09a85c183616e1d95"
Sep 18 22:19:11.528328 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:19:11.528295    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a2559c8d4c8f9796d22d2223627e44360b60f28b6d386c09a85c183616e1d95\": container with ID starting with 9a2559c8d4c8f9796d22d2223627e44360b60f28b6d386c09a85c183616e1d95 not found: ID does not exist" containerID="9a2559c8d4c8f9796d22d2223627e44360b60f28b6d386c09a85c183616e1d95"
Sep 18 22:19:11.528421 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.528338    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a2559c8d4c8f9796d22d2223627e44360b60f28b6d386c09a85c183616e1d95"} err="failed to get container status \"9a2559c8d4c8f9796d22d2223627e44360b60f28b6d386c09a85c183616e1d95\": rpc error: code = NotFound desc = could not find container \"9a2559c8d4c8f9796d22d2223627e44360b60f28b6d386c09a85c183616e1d95\": container with ID starting with 9a2559c8d4c8f9796d22d2223627e44360b60f28b6d386c09a85c183616e1d95 not found: ID does not exist"
Sep 18 22:19:11.528421 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.528365    2574 scope.go:117] "RemoveContainer" containerID="53989da4f6ce0e000a435970c73ff79d895184628da72e97af745405d586ab2b"
Sep 18 22:19:11.541619 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.541599    2574 scope.go:117] "RemoveContainer" containerID="53989da4f6ce0e000a435970c73ff79d895184628da72e97af745405d586ab2b"
Sep 18 22:19:11.541871 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:19:11.541854    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53989da4f6ce0e000a435970c73ff79d895184628da72e97af745405d586ab2b\": container with ID starting with 53989da4f6ce0e000a435970c73ff79d895184628da72e97af745405d586ab2b not found: ID does not exist" containerID="53989da4f6ce0e000a435970c73ff79d895184628da72e97af745405d586ab2b"
Sep 18 22:19:11.541911 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.541879    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53989da4f6ce0e000a435970c73ff79d895184628da72e97af745405d586ab2b"} err="failed to get container status \"53989da4f6ce0e000a435970c73ff79d895184628da72e97af745405d586ab2b\": rpc error: code = NotFound desc = could not find container \"53989da4f6ce0e000a435970c73ff79d895184628da72e97af745405d586ab2b\": container with ID starting with 53989da4f6ce0e000a435970c73ff79d895184628da72e97af745405d586ab2b not found: ID does not exist"
Sep 18 22:19:11.541911 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.541894    2574 scope.go:117] "RemoveContainer" containerID="969daeb67f7eb725ecb1bd54c42b95fe4bdb44347dcd8eaa1be17c9360b2d9f3"
Sep 18 22:19:11.549487 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.549469    2574 scope.go:117] "RemoveContainer" containerID="969daeb67f7eb725ecb1bd54c42b95fe4bdb44347dcd8eaa1be17c9360b2d9f3"
Sep 18 22:19:11.549781 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:19:11.549762    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"969daeb67f7eb725ecb1bd54c42b95fe4bdb44347dcd8eaa1be17c9360b2d9f3\": container with ID starting with 969daeb67f7eb725ecb1bd54c42b95fe4bdb44347dcd8eaa1be17c9360b2d9f3 not found: ID does not exist" containerID="969daeb67f7eb725ecb1bd54c42b95fe4bdb44347dcd8eaa1be17c9360b2d9f3"
Sep 18 22:19:11.549828 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.549789    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"969daeb67f7eb725ecb1bd54c42b95fe4bdb44347dcd8eaa1be17c9360b2d9f3"} err="failed to get container status \"969daeb67f7eb725ecb1bd54c42b95fe4bdb44347dcd8eaa1be17c9360b2d9f3\": rpc error: code = NotFound desc = could not find container \"969daeb67f7eb725ecb1bd54c42b95fe4bdb44347dcd8eaa1be17c9360b2d9f3\": container with ID starting with 969daeb67f7eb725ecb1bd54c42b95fe4bdb44347dcd8eaa1be17c9360b2d9f3 not found: ID does not exist"
Sep 18 22:19:11.562303 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.562279    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8"]
Sep 18 22:19:11.572798 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.572778    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-4209a4-74dd5c9756-6dsx8"]
Sep 18 22:19:11.622031 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.622011    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8"]
Sep 18 22:19:11.634328 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.634302    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-4209a4-7b767c9766-hc7g8"]
Sep 18 22:19:11.656131 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.656108    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp"]
Sep 18 22:19:11.664953 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:11.664927    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-4209a4-679b78d797-xfmbp"]
Sep 18 22:19:13.345702 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:13.345669    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49860714-0064-457e-823d-147c17bd64bb" path="/var/lib/kubelet/pods/49860714-0064-457e-823d-147c17bd64bb/volumes"
Sep 18 22:19:13.346091 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:13.346048    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c748cef-da26-4026-85f9-112ffa6cce21" path="/var/lib/kubelet/pods/5c748cef-da26-4026-85f9-112ffa6cce21/volumes"
Sep 18 22:19:13.346350 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:13.346338    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bdf77b8-2321-4720-97d8-3aa4e031cdcb" path="/var/lib/kubelet/pods/8bdf77b8-2321-4720-97d8-3aa4e031cdcb/volumes"
Sep 18 22:19:17.495718 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:17.495694    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m"
Sep 18 22:19:28.709577 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:28.709544    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6ad61446-4qvjd"]
Sep 18 22:19:28.709928 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:28.709913    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49860714-0064-457e-823d-147c17bd64bb" containerName="payload-pre-processing"
Sep 18 22:19:28.709928 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:28.709924    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="49860714-0064-457e-823d-147c17bd64bb" containerName="payload-pre-processing"
Sep 18 22:19:28.710004 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:28.709931    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bdf77b8-2321-4720-97d8-3aa4e031cdcb" containerName="payload-processing"
Sep 18 22:19:28.710004 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:28.709937    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bdf77b8-2321-4720-97d8-3aa4e031cdcb" containerName="payload-processing"
Sep 18 22:19:28.710004 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:28.709949    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c748cef-da26-4026-85f9-112ffa6cce21" containerName="maas-api"
Sep 18 22:19:28.710004 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:28.709955    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c748cef-da26-4026-85f9-112ffa6cce21" containerName="maas-api"
Sep 18 22:19:28.710122 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:28.710018    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bdf77b8-2321-4720-97d8-3aa4e031cdcb" containerName="payload-processing"
Sep 18 22:19:28.710122 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:28.710027    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="49860714-0064-457e-823d-147c17bd64bb" containerName="payload-pre-processing"
Sep 18 22:19:28.710122 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:28.710034    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c748cef-da26-4026-85f9-112ffa6cce21" containerName="maas-api"
Sep 18 22:19:28.714111 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:28.714091    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6ad61446-4qvjd"
Sep 18 22:19:28.720700 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:28.720491    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 22:19:28.720700 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:28.720552    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9g7m4\""
Sep 18 22:19:28.746356 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:28.746326    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6ad61446-4qvjd"]
Sep 18 22:19:28.813662 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:28.813630    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6182843e-6842-4b74-b0a3-7913c05913a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6ad61446-4qvjd\" (UID: \"6182843e-6842-4b74-b0a3-7913c05913a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6ad61446-4qvjd"
Sep 18 22:19:28.920343 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:28.920247    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6182843e-6842-4b74-b0a3-7913c05913a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6ad61446-4qvjd\" (UID: \"6182843e-6842-4b74-b0a3-7913c05913a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6ad61446-4qvjd"
Sep 18 22:19:28.921424 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:28.921399    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6182843e-6842-4b74-b0a3-7913c05913a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6ad61446-4qvjd\" (UID: \"6182843e-6842-4b74-b0a3-7913c05913a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6ad61446-4qvjd"
Sep 18 22:19:29.024423 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:29.024339    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6ad61446-4qvjd"
Sep 18 22:19:29.297381 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:29.297358    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6ad61446-4qvjd"]
Sep 18 22:19:29.299668 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:19:29.299631    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6182843e_6842_4b74_b0a3_7913c05913a0.slice/crio-93b7194ef1f4ee00f8b6aa21bfbc9ba7e2105d2736b2ef84f94dc0d677c25ed9 WatchSource:0}: Error finding container 93b7194ef1f4ee00f8b6aa21bfbc9ba7e2105d2736b2ef84f94dc0d677c25ed9: Status 404 returned error can't find the container with id 93b7194ef1f4ee00f8b6aa21bfbc9ba7e2105d2736b2ef84f94dc0d677c25ed9
Sep 18 22:19:29.615165 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:29.615076    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6ad61446-4qvjd" event={"ID":"6182843e-6842-4b74-b0a3-7913c05913a0","Type":"ContainerStarted","Data":"74392f5d1318dca26fb6eab6090646620f25b1e7a746b02f541efc9b6d193c38"}
Sep 18 22:19:29.615165 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:29.615127    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6ad61446-4qvjd" event={"ID":"6182843e-6842-4b74-b0a3-7913c05913a0","Type":"ContainerStarted","Data":"93b7194ef1f4ee00f8b6aa21bfbc9ba7e2105d2736b2ef84f94dc0d677c25ed9"}
Sep 18 22:19:29.634368 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:29.634317    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6ad61446-4qvjd" podStartSLOduration=1.634301512 podStartE2EDuration="1.634301512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:19:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:19:29.631663437 +0000 UTC m=+1144.763444496" watchObservedRunningTime="2026-09-18 22:19:29.634301512 +0000 UTC m=+1144.766082595"
Sep 18 22:19:30.622601 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:30.622567    2574 generic.go:356] "Generic (PLEG): container finished" podID="6182843e-6842-4b74-b0a3-7913c05913a0" containerID="74392f5d1318dca26fb6eab6090646620f25b1e7a746b02f541efc9b6d193c38" exitCode=0
Sep 18 22:19:30.622966 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:30.622615    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6ad61446-4qvjd" event={"ID":"6182843e-6842-4b74-b0a3-7913c05913a0","Type":"ContainerDied","Data":"74392f5d1318dca26fb6eab6090646620f25b1e7a746b02f541efc9b6d193c38"}
Sep 18 22:19:30.902543 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:30.902442    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"]
Sep 18 22:19:30.906085 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:30.906068    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"
Sep 18 22:19:30.908297 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:30.908273    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-59b357\"/\"kube-root-ca.crt\""
Sep 18 22:19:30.909070 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:30.909050    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-59b357\"/\"openshift-service-ca.crt\""
Sep 18 22:19:30.909147 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:30.909084    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-59b357\"/\"default-dockercfg-mtlw6\""
Sep 18 22:19:30.909227 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:30.909144    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-59b357\"/\"e2e-conflict-a-97f2ccbd-kserve-self-signed-certs\""
Sep 18 22:19:30.917636 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:30.917618    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"]
Sep 18 22:19:31.042066 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.042028    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-model-cache\") pod \"e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj\" (UID: \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"
Sep 18 22:19:31.042229 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.042074    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slk5p\" (UniqueName: \"kubernetes.io/projected/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-kube-api-access-slk5p\") pod \"e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj\" (UID: \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"
Sep 18 22:19:31.042229 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.042183    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-tls-certs\") pod \"e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj\" (UID: \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"
Sep 18 22:19:31.042229 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.042218    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-home\") pod \"e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj\" (UID: \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"
Sep 18 22:19:31.042338 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.042250    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-dshm\") pod \"e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj\" (UID: \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"
Sep 18 22:19:31.042338 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.042269    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-tmp-dir\") pod \"e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj\" (UID: \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"
Sep 18 22:19:31.143399 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.143359    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-model-cache\") pod \"e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj\" (UID: \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"
Sep 18 22:19:31.143399 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.143409    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slk5p\" (UniqueName: \"kubernetes.io/projected/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-kube-api-access-slk5p\") pod \"e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj\" (UID: \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"
Sep 18 22:19:31.143706 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.143447    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-tls-certs\") pod \"e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj\" (UID: \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"
Sep 18 22:19:31.143706 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.143470    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-home\") pod \"e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj\" (UID: \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"
Sep 18 22:19:31.143706 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.143608    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-dshm\") pod \"e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj\" (UID: \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"
Sep 18 22:19:31.143706 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.143635    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-tmp-dir\") pod \"e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj\" (UID: \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"
Sep 18 22:19:31.143900 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.143854    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-model-cache\") pod \"e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj\" (UID: \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"
Sep 18 22:19:31.143900 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.143883    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-home\") pod \"e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj\" (UID: \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"
Sep 18 22:19:31.143970 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.143950    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-tmp-dir\") pod \"e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj\" (UID: \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"
Sep 18 22:19:31.145924 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.145901    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-dshm\") pod \"e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj\" (UID: \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"
Sep 18 22:19:31.146189 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.146175    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-tls-certs\") pod \"e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj\" (UID: \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"
Sep 18 22:19:31.153568 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.153490    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slk5p\" (UniqueName: \"kubernetes.io/projected/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-kube-api-access-slk5p\") pod \"e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj\" (UID: \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\") " pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"
Sep 18 22:19:31.215283 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.215247    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"
Sep 18 22:19:31.494351 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.494326    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"]
Sep 18 22:19:31.496177 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:19:31.496149    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe2e3002_fd83_42c0_93fd_fa4e4a3c3a76.slice/crio-2fc96ae222d7c109de55d593763cb746481023b516463fd9e3207875564bae6a WatchSource:0}: Error finding container 2fc96ae222d7c109de55d593763cb746481023b516463fd9e3207875564bae6a: Status 404 returned error can't find the container with id 2fc96ae222d7c109de55d593763cb746481023b516463fd9e3207875564bae6a
Sep 18 22:19:31.631210 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.631172    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj" event={"ID":"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76","Type":"ContainerStarted","Data":"297659c2dbe706238bb5e256b98e04a97cc4927c498502a55b41ab93462aee8a"}
Sep 18 22:19:31.631656 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.631218    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj" event={"ID":"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76","Type":"ContainerStarted","Data":"2fc96ae222d7c109de55d593763cb746481023b516463fd9e3207875564bae6a"}
Sep 18 22:19:31.738631 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.738606    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6ad61446-4qvjd"
Sep 18 22:19:31.756544 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.756416    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj" podStartSLOduration=1.756400266 podStartE2EDuration="1.756400266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:19:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:19:31.649579425 +0000 UTC m=+1146.781360508" watchObservedRunningTime="2026-09-18 22:19:31.756400266 +0000 UTC m=+1146.888181348"
Sep 18 22:19:31.850338 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.850300    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6182843e-6842-4b74-b0a3-7913c05913a0-maas-api-service-ca\") pod \"6182843e-6842-4b74-b0a3-7913c05913a0\" (UID: \"6182843e-6842-4b74-b0a3-7913c05913a0\") "
Sep 18 22:19:31.850687 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.850666    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6182843e-6842-4b74-b0a3-7913c05913a0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6182843e-6842-4b74-b0a3-7913c05913a0" (UID: "6182843e-6842-4b74-b0a3-7913c05913a0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:19:31.951326 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:31.951294    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6182843e-6842-4b74-b0a3-7913c05913a0-maas-api-service-ca\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:19:32.637401 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:32.637376    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6ad61446-4qvjd"
Sep 18 22:19:32.637816 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:32.637415    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6ad61446-4qvjd" event={"ID":"6182843e-6842-4b74-b0a3-7913c05913a0","Type":"ContainerDied","Data":"93b7194ef1f4ee00f8b6aa21bfbc9ba7e2105d2736b2ef84f94dc0d677c25ed9"}
Sep 18 22:19:32.637816 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:32.637467    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="93b7194ef1f4ee00f8b6aa21bfbc9ba7e2105d2736b2ef84f94dc0d677c25ed9"
Sep 18 22:19:41.216047 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:41.216006    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"
Sep 18 22:19:41.216546 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:41.216070    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"
Sep 18 22:19:41.228674 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:41.228649    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"
Sep 18 22:19:41.695237 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:41.695211    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"
Sep 18 22:19:42.643394 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:42.643358    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m"]
Sep 18 22:19:42.643806 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:42.643629    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m" podUID="dccb00ab-37ba-4f6d-8157-cd7b6ed68381" containerName="payload-pre-processing" containerID="cri-o://965bb73c1e8cb505728478f989e778409182b38682e59154cec20780a569483f" gracePeriod=30
Sep 18 22:19:42.898204 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:42.898137    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m"
Sep 18 22:19:43.009018 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:43.008987    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6ad61446-4qvjd"]
Sep 18 22:19:43.017117 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:43.017095    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6ad61446-4qvjd"]
Sep 18 22:19:43.061617 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:43.060732    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzmfq\" (UniqueName: \"kubernetes.io/projected/dccb00ab-37ba-4f6d-8157-cd7b6ed68381-kube-api-access-mzmfq\") pod \"dccb00ab-37ba-4f6d-8157-cd7b6ed68381\" (UID: \"dccb00ab-37ba-4f6d-8157-cd7b6ed68381\") "
Sep 18 22:19:43.061617 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:43.060828    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dccb00ab-37ba-4f6d-8157-cd7b6ed68381-plugins-config-volume\") pod \"dccb00ab-37ba-4f6d-8157-cd7b6ed68381\" (UID: \"dccb00ab-37ba-4f6d-8157-cd7b6ed68381\") "
Sep 18 22:19:43.061617 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:43.061571    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dccb00ab-37ba-4f6d-8157-cd7b6ed68381-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dccb00ab-37ba-4f6d-8157-cd7b6ed68381" (UID: "dccb00ab-37ba-4f6d-8157-cd7b6ed68381"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:19:43.063294 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:43.063268    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dccb00ab-37ba-4f6d-8157-cd7b6ed68381-kube-api-access-mzmfq" (OuterVolumeSpecName: "kube-api-access-mzmfq") pod "dccb00ab-37ba-4f6d-8157-cd7b6ed68381" (UID: "dccb00ab-37ba-4f6d-8157-cd7b6ed68381"). InnerVolumeSpecName "kube-api-access-mzmfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:19:43.161906 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:43.161840    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dccb00ab-37ba-4f6d-8157-cd7b6ed68381-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:19:43.161906 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:43.161871    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzmfq\" (UniqueName: \"kubernetes.io/projected/dccb00ab-37ba-4f6d-8157-cd7b6ed68381-kube-api-access-mzmfq\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:19:43.346238 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:43.346195    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6182843e-6842-4b74-b0a3-7913c05913a0" path="/var/lib/kubelet/pods/6182843e-6842-4b74-b0a3-7913c05913a0/volumes"
Sep 18 22:19:43.697339 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:43.697306    2574 generic.go:356] "Generic (PLEG): container finished" podID="dccb00ab-37ba-4f6d-8157-cd7b6ed68381" containerID="965bb73c1e8cb505728478f989e778409182b38682e59154cec20780a569483f" exitCode=0
Sep 18 22:19:43.697839 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:43.697351    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m" event={"ID":"dccb00ab-37ba-4f6d-8157-cd7b6ed68381","Type":"ContainerDied","Data":"965bb73c1e8cb505728478f989e778409182b38682e59154cec20780a569483f"}
Sep 18 22:19:43.697839 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:43.697361    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m"
Sep 18 22:19:43.697839 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:43.697403    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m" event={"ID":"dccb00ab-37ba-4f6d-8157-cd7b6ed68381","Type":"ContainerDied","Data":"22bb9576e2f46f9f3c57f189a23504082f3b19ffd8e1c84e903260f4cc56d2d5"}
Sep 18 22:19:43.697839 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:43.697436    2574 scope.go:117] "RemoveContainer" containerID="965bb73c1e8cb505728478f989e778409182b38682e59154cec20780a569483f"
Sep 18 22:19:43.707412 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:43.707386    2574 scope.go:117] "RemoveContainer" containerID="965bb73c1e8cb505728478f989e778409182b38682e59154cec20780a569483f"
Sep 18 22:19:43.707705 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:19:43.707684    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"965bb73c1e8cb505728478f989e778409182b38682e59154cec20780a569483f\": container with ID starting with 965bb73c1e8cb505728478f989e778409182b38682e59154cec20780a569483f not found: ID does not exist" containerID="965bb73c1e8cb505728478f989e778409182b38682e59154cec20780a569483f"
Sep 18 22:19:43.707783 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:43.707714    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"965bb73c1e8cb505728478f989e778409182b38682e59154cec20780a569483f"} err="failed to get container status \"965bb73c1e8cb505728478f989e778409182b38682e59154cec20780a569483f\": rpc error: code = NotFound desc = could not find container \"965bb73c1e8cb505728478f989e778409182b38682e59154cec20780a569483f\": container with ID starting with 965bb73c1e8cb505728478f989e778409182b38682e59154cec20780a569483f not found: ID does not exist"
Sep 18 22:19:43.727360 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:43.727328    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m"]
Sep 18 22:19:43.729210 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:43.729189    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6ad61446-f4f6c84f4-9ks2m"]
Sep 18 22:19:45.345667 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:19:45.345633    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dccb00ab-37ba-4f6d-8157-cd7b6ed68381" path="/var/lib/kubelet/pods/dccb00ab-37ba-4f6d-8157-cd7b6ed68381/volumes"
Sep 18 22:20:18.597140 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.597105    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8"]
Sep 18 22:20:18.597910 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.597886    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dccb00ab-37ba-4f6d-8157-cd7b6ed68381" containerName="payload-pre-processing"
Sep 18 22:20:18.598035 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.597970    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dccb00ab-37ba-4f6d-8157-cd7b6ed68381" containerName="payload-pre-processing"
Sep 18 22:20:18.598035 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.597999    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6182843e-6842-4b74-b0a3-7913c05913a0" containerName="revoke-keys"
Sep 18 22:20:18.598035 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.598007    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6182843e-6842-4b74-b0a3-7913c05913a0" containerName="revoke-keys"
Sep 18 22:20:18.598243 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.598125    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6182843e-6842-4b74-b0a3-7913c05913a0" containerName="revoke-keys"
Sep 18 22:20:18.598243 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.598141    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dccb00ab-37ba-4f6d-8157-cd7b6ed68381" containerName="payload-pre-processing"
Sep 18 22:20:18.601298 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.601274    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8"
Sep 18 22:20:18.606800 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.606776    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 22:20:18.606946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.606776    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 18 22:20:18.607477 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.607457    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 18 22:20:18.607644 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.607624    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-c6l9h\""
Sep 18 22:20:18.609234 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.609214    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-62f806-serving-cert\""
Sep 18 22:20:18.621203 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.621174    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8"]
Sep 18 22:20:18.679754 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.679728    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc95d937-ff26-443a-bd90-c50a39e542c9-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8\" (UID: \"bc95d937-ff26-443a-bd90-c50a39e542c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8"
Sep 18 22:20:18.679882 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.679773    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rwjm\" (UniqueName: \"kubernetes.io/projected/bc95d937-ff26-443a-bd90-c50a39e542c9-kube-api-access-9rwjm\") pod \"maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8\" (UID: \"bc95d937-ff26-443a-bd90-c50a39e542c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8"
Sep 18 22:20:18.679882 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.679842    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc95d937-ff26-443a-bd90-c50a39e542c9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8\" (UID: \"bc95d937-ff26-443a-bd90-c50a39e542c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8"
Sep 18 22:20:18.679956 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.679884    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc95d937-ff26-443a-bd90-c50a39e542c9-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8\" (UID: \"bc95d937-ff26-443a-bd90-c50a39e542c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8"
Sep 18 22:20:18.781179 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.781151    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc95d937-ff26-443a-bd90-c50a39e542c9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8\" (UID: \"bc95d937-ff26-443a-bd90-c50a39e542c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8"
Sep 18 22:20:18.781331 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.781207    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc95d937-ff26-443a-bd90-c50a39e542c9-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8\" (UID: \"bc95d937-ff26-443a-bd90-c50a39e542c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8"
Sep 18 22:20:18.781331 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.781242    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc95d937-ff26-443a-bd90-c50a39e542c9-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8\" (UID: \"bc95d937-ff26-443a-bd90-c50a39e542c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8"
Sep 18 22:20:18.781331 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.781275    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rwjm\" (UniqueName: \"kubernetes.io/projected/bc95d937-ff26-443a-bd90-c50a39e542c9-kube-api-access-9rwjm\") pod \"maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8\" (UID: \"bc95d937-ff26-443a-bd90-c50a39e542c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8"
Sep 18 22:20:18.781838 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.781816    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc95d937-ff26-443a-bd90-c50a39e542c9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8\" (UID: \"bc95d937-ff26-443a-bd90-c50a39e542c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8"
Sep 18 22:20:18.784523 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.784463    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc95d937-ff26-443a-bd90-c50a39e542c9-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8\" (UID: \"bc95d937-ff26-443a-bd90-c50a39e542c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8"
Sep 18 22:20:18.784667 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.784575    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc95d937-ff26-443a-bd90-c50a39e542c9-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8\" (UID: \"bc95d937-ff26-443a-bd90-c50a39e542c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8"
Sep 18 22:20:18.792186 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.792161    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rwjm\" (UniqueName: \"kubernetes.io/projected/bc95d937-ff26-443a-bd90-c50a39e542c9-kube-api-access-9rwjm\") pod \"maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8\" (UID: \"bc95d937-ff26-443a-bd90-c50a39e542c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8"
Sep 18 22:20:18.911880 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:18.911787    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8"
Sep 18 22:20:19.203019 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:19.202991    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8"]
Sep 18 22:20:19.205074 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:20:19.205039    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc95d937_ff26_443a_bd90_c50a39e542c9.slice/crio-96dd572a4fbd1ddce3e73c9b222ed0c22d9dadf4bc0e9797de4f962ea25511c4 WatchSource:0}: Error finding container 96dd572a4fbd1ddce3e73c9b222ed0c22d9dadf4bc0e9797de4f962ea25511c4: Status 404 returned error can't find the container with id 96dd572a4fbd1ddce3e73c9b222ed0c22d9dadf4bc0e9797de4f962ea25511c4
Sep 18 22:20:19.416214 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:19.416187    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8"]
Sep 18 22:20:19.420691 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:19.420674    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8"
Sep 18 22:20:19.424204 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:19.424176    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-62f806-dockercfg-b4lt5\""
Sep 18 22:20:19.424204 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:19.424197    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-62f806\""
Sep 18 22:20:19.434626 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:19.434604    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8"]
Sep 18 22:20:19.590891 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:19.590815    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54rkr\" (UniqueName: \"kubernetes.io/projected/9e8d9811-15c2-4f2e-b681-2defe2119735-kube-api-access-54rkr\") pod \"payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8\" (UID: \"9e8d9811-15c2-4f2e-b681-2defe2119735\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8"
Sep 18 22:20:19.590891 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:19.590873    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e8d9811-15c2-4f2e-b681-2defe2119735-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8\" (UID: \"9e8d9811-15c2-4f2e-b681-2defe2119735\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8"
Sep 18 22:20:19.691372 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:19.691338    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54rkr\" (UniqueName: \"kubernetes.io/projected/9e8d9811-15c2-4f2e-b681-2defe2119735-kube-api-access-54rkr\") pod \"payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8\" (UID: \"9e8d9811-15c2-4f2e-b681-2defe2119735\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8"
Sep 18 22:20:19.691697 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:19.691402    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e8d9811-15c2-4f2e-b681-2defe2119735-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8\" (UID: \"9e8d9811-15c2-4f2e-b681-2defe2119735\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8"
Sep 18 22:20:19.692101 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:19.692084    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e8d9811-15c2-4f2e-b681-2defe2119735-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8\" (UID: \"9e8d9811-15c2-4f2e-b681-2defe2119735\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8"
Sep 18 22:20:19.708740 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:19.708720    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54rkr\" (UniqueName: \"kubernetes.io/projected/9e8d9811-15c2-4f2e-b681-2defe2119735-kube-api-access-54rkr\") pod \"payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8\" (UID: \"9e8d9811-15c2-4f2e-b681-2defe2119735\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8"
Sep 18 22:20:19.731792 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:19.731771    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8"
Sep 18 22:20:19.887619 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:19.887543    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8" event={"ID":"bc95d937-ff26-443a-bd90-c50a39e542c9","Type":"ContainerStarted","Data":"3f2e45fcc4d74a93508f1367e9a618d53dc9bd0c7741d1ef84161f3ac78f3c43"}
Sep 18 22:20:19.887619 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:19.887594    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8" event={"ID":"bc95d937-ff26-443a-bd90-c50a39e542c9","Type":"ContainerStarted","Data":"96dd572a4fbd1ddce3e73c9b222ed0c22d9dadf4bc0e9797de4f962ea25511c4"}
Sep 18 22:20:19.887796 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:19.887625    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8"
Sep 18 22:20:19.911738 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:19.911693    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8" podStartSLOduration=1.454140271 podStartE2EDuration="1.911679035s" totalImagesPullingTime="457.538764ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:20:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:20:19.911013622 +0000 UTC m=+1195.042794707" watchObservedRunningTime="2026-09-18 22:20:19.911679035 +0000 UTC m=+1195.043460172"
Sep 18 22:20:20.004447 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:20.004277    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8"]
Sep 18 22:20:20.007210 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:20:20.007185    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e8d9811_15c2_4f2e_b681_2defe2119735.slice/crio-ab0bcfd7c10abf9e22816c8019f7f9769246f892ebb3854c8c39eaab4d9ad7b6 WatchSource:0}: Error finding container ab0bcfd7c10abf9e22816c8019f7f9769246f892ebb3854c8c39eaab4d9ad7b6: Status 404 returned error can't find the container with id ab0bcfd7c10abf9e22816c8019f7f9769246f892ebb3854c8c39eaab4d9ad7b6
Sep 18 22:20:20.894702 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:20.894670    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8" event={"ID":"9e8d9811-15c2-4f2e-b681-2defe2119735","Type":"ContainerStarted","Data":"f4b6e252b0bd7d013c4adf55ceefe8d25efe743fd440f49f6180cccd2ef04c78"}
Sep 18 22:20:20.895102 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:20.894715    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8" event={"ID":"9e8d9811-15c2-4f2e-b681-2defe2119735","Type":"ContainerStarted","Data":"ab0bcfd7c10abf9e22816c8019f7f9769246f892ebb3854c8c39eaab4d9ad7b6"}
Sep 18 22:20:20.913620 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:20.913575    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8" podStartSLOduration=1.913559714 podStartE2EDuration="1.913559714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:20:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:20:20.912084659 +0000 UTC m=+1196.043865735" watchObservedRunningTime="2026-09-18 22:20:20.913559714 +0000 UTC m=+1196.045340795"
Sep 18 22:20:21.901105 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:21.901074    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8"
Sep 18 22:20:25.900357 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:25.900329    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8"
Sep 18 22:20:32.908609 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:32.908572    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8"
Sep 18 22:20:33.374625 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:33.374590    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"]
Sep 18 22:20:37.547298 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:37.547260    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"]
Sep 18 22:20:47.032417 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:47.032384    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3d28c1-29829495-bjrt6"]
Sep 18 22:20:47.035845 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:47.035814    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-3d28c1-29829495-bjrt6"]
Sep 18 22:20:47.162313 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:47.162280    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt"]
Sep 18 22:20:47.162557 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:47.162532    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt" podUID="9da0e798-4444-45c5-8cfe-76278d0624bf" containerName="payload-processing" containerID="cri-o://e547a9c72df08edffacc0fa1f434070e79a54bfcb6964987994972de9bb4f963" gracePeriod=30
Sep 18 22:20:47.203858 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:47.203826    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp"]
Sep 18 22:20:47.204030 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:47.204011    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp" podUID="fa24d601-26c7-4fa8-b71e-71fff9a6670b" containerName="payload-pre-processing" containerID="cri-o://16c6a3d6406a59dac96a829cbf153f5f009bad62c2eecc972a66d5c6489593c6" gracePeriod=30
Sep 18 22:20:47.348520 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:47.348456    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae66312c-88ba-4519-8c8e-ed63c962c1ee" path="/var/lib/kubelet/pods/ae66312c-88ba-4519-8c8e-ed63c962c1ee/volumes"
Sep 18 22:20:47.443996 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:47.443968    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt"
Sep 18 22:20:47.465717 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:47.465692    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp"
Sep 18 22:20:47.548748 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:47.548718    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q46zh\" (UniqueName: \"kubernetes.io/projected/fa24d601-26c7-4fa8-b71e-71fff9a6670b-kube-api-access-q46zh\") pod \"fa24d601-26c7-4fa8-b71e-71fff9a6670b\" (UID: \"fa24d601-26c7-4fa8-b71e-71fff9a6670b\") "
Sep 18 22:20:47.548905 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:47.548772    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9da0e798-4444-45c5-8cfe-76278d0624bf-plugins-config-volume\") pod \"9da0e798-4444-45c5-8cfe-76278d0624bf\" (UID: \"9da0e798-4444-45c5-8cfe-76278d0624bf\") "
Sep 18 22:20:47.548905 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:47.548803    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa24d601-26c7-4fa8-b71e-71fff9a6670b-plugins-config-volume\") pod \"fa24d601-26c7-4fa8-b71e-71fff9a6670b\" (UID: \"fa24d601-26c7-4fa8-b71e-71fff9a6670b\") "
Sep 18 22:20:47.548905 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:47.548876    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mfgx\" (UniqueName: \"kubernetes.io/projected/9da0e798-4444-45c5-8cfe-76278d0624bf-kube-api-access-7mfgx\") pod \"9da0e798-4444-45c5-8cfe-76278d0624bf\" (UID: \"9da0e798-4444-45c5-8cfe-76278d0624bf\") "
Sep 18 22:20:47.549230 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:47.549203    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9da0e798-4444-45c5-8cfe-76278d0624bf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9da0e798-4444-45c5-8cfe-76278d0624bf" (UID: "9da0e798-4444-45c5-8cfe-76278d0624bf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:20:47.549315 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:47.549248    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa24d601-26c7-4fa8-b71e-71fff9a6670b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fa24d601-26c7-4fa8-b71e-71fff9a6670b" (UID: "fa24d601-26c7-4fa8-b71e-71fff9a6670b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:20:47.551152 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:47.551128    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9da0e798-4444-45c5-8cfe-76278d0624bf-kube-api-access-7mfgx" (OuterVolumeSpecName: "kube-api-access-7mfgx") pod "9da0e798-4444-45c5-8cfe-76278d0624bf" (UID: "9da0e798-4444-45c5-8cfe-76278d0624bf"). InnerVolumeSpecName "kube-api-access-7mfgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:20:47.551246 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:47.551167    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa24d601-26c7-4fa8-b71e-71fff9a6670b-kube-api-access-q46zh" (OuterVolumeSpecName: "kube-api-access-q46zh") pod "fa24d601-26c7-4fa8-b71e-71fff9a6670b" (UID: "fa24d601-26c7-4fa8-b71e-71fff9a6670b"). InnerVolumeSpecName "kube-api-access-q46zh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:20:47.649792 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:47.649708    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9da0e798-4444-45c5-8cfe-76278d0624bf-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:20:47.649792 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:47.649738    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa24d601-26c7-4fa8-b71e-71fff9a6670b-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:20:47.649792 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:47.649750    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mfgx\" (UniqueName: \"kubernetes.io/projected/9da0e798-4444-45c5-8cfe-76278d0624bf-kube-api-access-7mfgx\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:20:47.649792 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:47.649763    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q46zh\" (UniqueName: \"kubernetes.io/projected/fa24d601-26c7-4fa8-b71e-71fff9a6670b-kube-api-access-q46zh\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:20:48.038717 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.038678    2574 generic.go:356] "Generic (PLEG): container finished" podID="fa24d601-26c7-4fa8-b71e-71fff9a6670b" containerID="16c6a3d6406a59dac96a829cbf153f5f009bad62c2eecc972a66d5c6489593c6" exitCode=0
Sep 18 22:20:48.038717 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.038720    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp"
Sep 18 22:20:48.039201 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.038752    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp" event={"ID":"fa24d601-26c7-4fa8-b71e-71fff9a6670b","Type":"ContainerDied","Data":"16c6a3d6406a59dac96a829cbf153f5f009bad62c2eecc972a66d5c6489593c6"}
Sep 18 22:20:48.039201 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.038801    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp" event={"ID":"fa24d601-26c7-4fa8-b71e-71fff9a6670b","Type":"ContainerDied","Data":"f91c54ec106fd80020a7d238ee04deed2fbc7f074740b6944c81c4c7347bdf9e"}
Sep 18 22:20:48.039201 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.038823    2574 scope.go:117] "RemoveContainer" containerID="16c6a3d6406a59dac96a829cbf153f5f009bad62c2eecc972a66d5c6489593c6"
Sep 18 22:20:48.040352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.040323    2574 generic.go:356] "Generic (PLEG): container finished" podID="9da0e798-4444-45c5-8cfe-76278d0624bf" containerID="e547a9c72df08edffacc0fa1f434070e79a54bfcb6964987994972de9bb4f963" exitCode=0
Sep 18 22:20:48.040555 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.040376    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt"
Sep 18 22:20:48.040555 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.040443    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt" event={"ID":"9da0e798-4444-45c5-8cfe-76278d0624bf","Type":"ContainerDied","Data":"e547a9c72df08edffacc0fa1f434070e79a54bfcb6964987994972de9bb4f963"}
Sep 18 22:20:48.040555 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.040485    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt" event={"ID":"9da0e798-4444-45c5-8cfe-76278d0624bf","Type":"ContainerDied","Data":"66c23b12008ca6287d72dc406031935498ce405ed3b37abfb1e89d6787a279d4"}
Sep 18 22:20:48.048732 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.048609    2574 scope.go:117] "RemoveContainer" containerID="16c6a3d6406a59dac96a829cbf153f5f009bad62c2eecc972a66d5c6489593c6"
Sep 18 22:20:48.048930 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:20:48.048905    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16c6a3d6406a59dac96a829cbf153f5f009bad62c2eecc972a66d5c6489593c6\": container with ID starting with 16c6a3d6406a59dac96a829cbf153f5f009bad62c2eecc972a66d5c6489593c6 not found: ID does not exist" containerID="16c6a3d6406a59dac96a829cbf153f5f009bad62c2eecc972a66d5c6489593c6"
Sep 18 22:20:48.049015 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.048941    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16c6a3d6406a59dac96a829cbf153f5f009bad62c2eecc972a66d5c6489593c6"} err="failed to get container status \"16c6a3d6406a59dac96a829cbf153f5f009bad62c2eecc972a66d5c6489593c6\": rpc error: code = NotFound desc = could not find container \"16c6a3d6406a59dac96a829cbf153f5f009bad62c2eecc972a66d5c6489593c6\": container with ID starting with 16c6a3d6406a59dac96a829cbf153f5f009bad62c2eecc972a66d5c6489593c6 not found: ID does not exist"
Sep 18 22:20:48.049015 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.048958    2574 scope.go:117] "RemoveContainer" containerID="e547a9c72df08edffacc0fa1f434070e79a54bfcb6964987994972de9bb4f963"
Sep 18 22:20:48.058751 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.058734    2574 scope.go:117] "RemoveContainer" containerID="e547a9c72df08edffacc0fa1f434070e79a54bfcb6964987994972de9bb4f963"
Sep 18 22:20:48.059030 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:20:48.059010    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e547a9c72df08edffacc0fa1f434070e79a54bfcb6964987994972de9bb4f963\": container with ID starting with e547a9c72df08edffacc0fa1f434070e79a54bfcb6964987994972de9bb4f963 not found: ID does not exist" containerID="e547a9c72df08edffacc0fa1f434070e79a54bfcb6964987994972de9bb4f963"
Sep 18 22:20:48.059118 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.059036    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e547a9c72df08edffacc0fa1f434070e79a54bfcb6964987994972de9bb4f963"} err="failed to get container status \"e547a9c72df08edffacc0fa1f434070e79a54bfcb6964987994972de9bb4f963\": rpc error: code = NotFound desc = could not find container \"e547a9c72df08edffacc0fa1f434070e79a54bfcb6964987994972de9bb4f963\": container with ID starting with e547a9c72df08edffacc0fa1f434070e79a54bfcb6964987994972de9bb4f963 not found: ID does not exist"
Sep 18 22:20:48.149493 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.149458    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp"]
Sep 18 22:20:48.185682 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.185656    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-3d28c1-9f97856d6-lq8xp"]
Sep 18 22:20:48.227501 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.227473    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt"]
Sep 18 22:20:48.243672 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.243638    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-3d28c1-58d5b6cd79-2gfkt"]
Sep 18 22:20:48.393943 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.393838    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8" podUID="9a91e485-4165-4bc9-8866-180ccd4368ee" containerName="main" containerID="cri-o://4f27765593302aa0d161c0192c354ef4bd3a95dad6eec501f5a37d842db5296e" gracePeriod=45
Sep 18 22:20:48.643247 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.643218    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"
Sep 18 22:20:48.759137 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.759110    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a91e485-4165-4bc9-8866-180ccd4368ee-model-cache\") pod \"9a91e485-4165-4bc9-8866-180ccd4368ee\" (UID: \"9a91e485-4165-4bc9-8866-180ccd4368ee\") "
Sep 18 22:20:48.759303 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.759165    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a91e485-4165-4bc9-8866-180ccd4368ee-tls-certs\") pod \"9a91e485-4165-4bc9-8866-180ccd4368ee\" (UID: \"9a91e485-4165-4bc9-8866-180ccd4368ee\") "
Sep 18 22:20:48.759303 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.759189    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkwgw\" (UniqueName: \"kubernetes.io/projected/9a91e485-4165-4bc9-8866-180ccd4368ee-kube-api-access-tkwgw\") pod \"9a91e485-4165-4bc9-8866-180ccd4368ee\" (UID: \"9a91e485-4165-4bc9-8866-180ccd4368ee\") "
Sep 18 22:20:48.759303 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.759214    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a91e485-4165-4bc9-8866-180ccd4368ee-dshm\") pod \"9a91e485-4165-4bc9-8866-180ccd4368ee\" (UID: \"9a91e485-4165-4bc9-8866-180ccd4368ee\") "
Sep 18 22:20:48.759486 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.759341    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a91e485-4165-4bc9-8866-180ccd4368ee-tmp-dir\") pod \"9a91e485-4165-4bc9-8866-180ccd4368ee\" (UID: \"9a91e485-4165-4bc9-8866-180ccd4368ee\") "
Sep 18 22:20:48.759486 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.759373    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a91e485-4165-4bc9-8866-180ccd4368ee-model-cache" (OuterVolumeSpecName: "model-cache") pod "9a91e485-4165-4bc9-8866-180ccd4368ee" (UID: "9a91e485-4165-4bc9-8866-180ccd4368ee"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:20:48.759486 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.759393    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a91e485-4165-4bc9-8866-180ccd4368ee-home\") pod \"9a91e485-4165-4bc9-8866-180ccd4368ee\" (UID: \"9a91e485-4165-4bc9-8866-180ccd4368ee\") "
Sep 18 22:20:48.759743 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.759614    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a91e485-4165-4bc9-8866-180ccd4368ee-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9a91e485-4165-4bc9-8866-180ccd4368ee" (UID: "9a91e485-4165-4bc9-8866-180ccd4368ee"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:20:48.759743 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.759687    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a91e485-4165-4bc9-8866-180ccd4368ee-home" (OuterVolumeSpecName: "home") pod "9a91e485-4165-4bc9-8866-180ccd4368ee" (UID: "9a91e485-4165-4bc9-8866-180ccd4368ee"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:20:48.759838 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.759771    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a91e485-4165-4bc9-8866-180ccd4368ee-tmp-dir\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:20:48.759838 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.759791    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a91e485-4165-4bc9-8866-180ccd4368ee-home\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:20:48.759838 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.759804    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a91e485-4165-4bc9-8866-180ccd4368ee-model-cache\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:20:48.761719 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.761697    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a91e485-4165-4bc9-8866-180ccd4368ee-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9a91e485-4165-4bc9-8866-180ccd4368ee" (UID: "9a91e485-4165-4bc9-8866-180ccd4368ee"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:20:48.761806 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.761743    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a91e485-4165-4bc9-8866-180ccd4368ee-kube-api-access-tkwgw" (OuterVolumeSpecName: "kube-api-access-tkwgw") pod "9a91e485-4165-4bc9-8866-180ccd4368ee" (UID: "9a91e485-4165-4bc9-8866-180ccd4368ee"). InnerVolumeSpecName "kube-api-access-tkwgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:20:48.761806 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.761765    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a91e485-4165-4bc9-8866-180ccd4368ee-dshm" (OuterVolumeSpecName: "dshm") pod "9a91e485-4165-4bc9-8866-180ccd4368ee" (UID: "9a91e485-4165-4bc9-8866-180ccd4368ee"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:20:48.860575 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.860537    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a91e485-4165-4bc9-8866-180ccd4368ee-tls-certs\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:20:48.860575 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.860569    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkwgw\" (UniqueName: \"kubernetes.io/projected/9a91e485-4165-4bc9-8866-180ccd4368ee-kube-api-access-tkwgw\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:20:48.860575 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:48.860581    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a91e485-4165-4bc9-8866-180ccd4368ee-dshm\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:20:49.048992 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:49.048903    2574 generic.go:356] "Generic (PLEG): container finished" podID="9a91e485-4165-4bc9-8866-180ccd4368ee" containerID="4f27765593302aa0d161c0192c354ef4bd3a95dad6eec501f5a37d842db5296e" exitCode=0
Sep 18 22:20:49.048992 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:49.048946    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"
Sep 18 22:20:49.048992 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:49.048970    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8" event={"ID":"9a91e485-4165-4bc9-8866-180ccd4368ee","Type":"ContainerDied","Data":"4f27765593302aa0d161c0192c354ef4bd3a95dad6eec501f5a37d842db5296e"}
Sep 18 22:20:49.049483 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:49.049000    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8" event={"ID":"9a91e485-4165-4bc9-8866-180ccd4368ee","Type":"ContainerDied","Data":"1033bf8b4666dfa2b759c288fa9cb55f17d6bfec4f161d97d4eb9dbb9f7b9525"}
Sep 18 22:20:49.049483 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:49.049017    2574 scope.go:117] "RemoveContainer" containerID="4f27765593302aa0d161c0192c354ef4bd3a95dad6eec501f5a37d842db5296e"
Sep 18 22:20:49.059308 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:49.059289    2574 scope.go:117] "RemoveContainer" containerID="4f27765593302aa0d161c0192c354ef4bd3a95dad6eec501f5a37d842db5296e"
Sep 18 22:20:49.059657 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:20:49.059629    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f27765593302aa0d161c0192c354ef4bd3a95dad6eec501f5a37d842db5296e\": container with ID starting with 4f27765593302aa0d161c0192c354ef4bd3a95dad6eec501f5a37d842db5296e not found: ID does not exist" containerID="4f27765593302aa0d161c0192c354ef4bd3a95dad6eec501f5a37d842db5296e"
Sep 18 22:20:49.059754 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:49.059664    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f27765593302aa0d161c0192c354ef4bd3a95dad6eec501f5a37d842db5296e"} err="failed to get container status \"4f27765593302aa0d161c0192c354ef4bd3a95dad6eec501f5a37d842db5296e\": rpc error: code = NotFound desc = could not find container \"4f27765593302aa0d161c0192c354ef4bd3a95dad6eec501f5a37d842db5296e\": container with ID starting with 4f27765593302aa0d161c0192c354ef4bd3a95dad6eec501f5a37d842db5296e not found: ID does not exist"
Sep 18 22:20:49.075973 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:49.075947    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"]
Sep 18 22:20:49.083295 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:49.083272    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-ab559b/test-model-ab559b-kserve-6c6cf7bdc7-5mnx8"]
Sep 18 22:20:49.345368 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:49.345289    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a91e485-4165-4bc9-8866-180ccd4368ee" path="/var/lib/kubelet/pods/9a91e485-4165-4bc9-8866-180ccd4368ee/volumes"
Sep 18 22:20:49.345674 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:49.345661    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9da0e798-4444-45c5-8cfe-76278d0624bf" path="/var/lib/kubelet/pods/9da0e798-4444-45c5-8cfe-76278d0624bf/volumes"
Sep 18 22:20:49.345977 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:49.345965    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa24d601-26c7-4fa8-b71e-71fff9a6670b" path="/var/lib/kubelet/pods/fa24d601-26c7-4fa8-b71e-71fff9a6670b/volumes"
Sep 18 22:20:52.566867 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:52.566830    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj" podUID="be2e3002-fd83-42c0-93fd-fa4e4a3c3a76" containerName="main" containerID="cri-o://297659c2dbe706238bb5e256b98e04a97cc4927c498502a55b41ab93462aee8a" gracePeriod=45
Sep 18 22:20:52.830104 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:52.830037    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"
Sep 18 22:20:52.891952 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:52.891922    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-tmp-dir\") pod \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\" (UID: \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\") "
Sep 18 22:20:52.892157 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:52.892007    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-dshm\") pod \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\" (UID: \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\") "
Sep 18 22:20:52.892157 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:52.892029    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-model-cache\") pod \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\" (UID: \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\") "
Sep 18 22:20:52.892157 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:52.892060    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slk5p\" (UniqueName: \"kubernetes.io/projected/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-kube-api-access-slk5p\") pod \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\" (UID: \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\") "
Sep 18 22:20:52.892157 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:52.892103    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-tls-certs\") pod \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\" (UID: \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\") "
Sep 18 22:20:52.892157 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:52.892127    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-home\") pod \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\" (UID: \"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76\") "
Sep 18 22:20:52.892446 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:52.892272    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "be2e3002-fd83-42c0-93fd-fa4e4a3c3a76" (UID: "be2e3002-fd83-42c0-93fd-fa4e4a3c3a76"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:20:52.892446 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:52.892340    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-model-cache" (OuterVolumeSpecName: "model-cache") pod "be2e3002-fd83-42c0-93fd-fa4e4a3c3a76" (UID: "be2e3002-fd83-42c0-93fd-fa4e4a3c3a76"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:20:52.892446 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:52.892398    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-tmp-dir\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:20:52.892637 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:52.892501    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-home" (OuterVolumeSpecName: "home") pod "be2e3002-fd83-42c0-93fd-fa4e4a3c3a76" (UID: "be2e3002-fd83-42c0-93fd-fa4e4a3c3a76"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:20:52.894752 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:52.894723    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "be2e3002-fd83-42c0-93fd-fa4e4a3c3a76" (UID: "be2e3002-fd83-42c0-93fd-fa4e4a3c3a76"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:20:52.894872 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:52.894790    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-kube-api-access-slk5p" (OuterVolumeSpecName: "kube-api-access-slk5p") pod "be2e3002-fd83-42c0-93fd-fa4e4a3c3a76" (UID: "be2e3002-fd83-42c0-93fd-fa4e4a3c3a76"). InnerVolumeSpecName "kube-api-access-slk5p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:20:52.894872 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:52.894803    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-dshm" (OuterVolumeSpecName: "dshm") pod "be2e3002-fd83-42c0-93fd-fa4e4a3c3a76" (UID: "be2e3002-fd83-42c0-93fd-fa4e4a3c3a76"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 22:20:52.993812 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:52.993763    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-dshm\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:20:52.993812 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:52.993796    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-model-cache\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:20:52.993812 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:52.993807    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slk5p\" (UniqueName: \"kubernetes.io/projected/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-kube-api-access-slk5p\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:20:52.993812 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:52.993815    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-tls-certs\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:20:52.993812 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:52.993823    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76-home\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:20:53.070904 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:53.070867    2574 generic.go:356] "Generic (PLEG): container finished" podID="be2e3002-fd83-42c0-93fd-fa4e4a3c3a76" containerID="297659c2dbe706238bb5e256b98e04a97cc4927c498502a55b41ab93462aee8a" exitCode=0
Sep 18 22:20:53.070904 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:53.070904    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"
Sep 18 22:20:53.071106 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:53.070952    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj" event={"ID":"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76","Type":"ContainerDied","Data":"297659c2dbe706238bb5e256b98e04a97cc4927c498502a55b41ab93462aee8a"}
Sep 18 22:20:53.071106 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:53.070995    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj" event={"ID":"be2e3002-fd83-42c0-93fd-fa4e4a3c3a76","Type":"ContainerDied","Data":"2fc96ae222d7c109de55d593763cb746481023b516463fd9e3207875564bae6a"}
Sep 18 22:20:53.071106 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:53.071014    2574 scope.go:117] "RemoveContainer" containerID="297659c2dbe706238bb5e256b98e04a97cc4927c498502a55b41ab93462aee8a"
Sep 18 22:20:53.080074 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:53.080056    2574 scope.go:117] "RemoveContainer" containerID="297659c2dbe706238bb5e256b98e04a97cc4927c498502a55b41ab93462aee8a"
Sep 18 22:20:53.080354 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:20:53.080304    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"297659c2dbe706238bb5e256b98e04a97cc4927c498502a55b41ab93462aee8a\": container with ID starting with 297659c2dbe706238bb5e256b98e04a97cc4927c498502a55b41ab93462aee8a not found: ID does not exist" containerID="297659c2dbe706238bb5e256b98e04a97cc4927c498502a55b41ab93462aee8a"
Sep 18 22:20:53.080354 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:53.080338    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"297659c2dbe706238bb5e256b98e04a97cc4927c498502a55b41ab93462aee8a"} err="failed to get container status \"297659c2dbe706238bb5e256b98e04a97cc4927c498502a55b41ab93462aee8a\": rpc error: code = NotFound desc = could not find container \"297659c2dbe706238bb5e256b98e04a97cc4927c498502a55b41ab93462aee8a\": container with ID starting with 297659c2dbe706238bb5e256b98e04a97cc4927c498502a55b41ab93462aee8a not found: ID does not exist"
Sep 18 22:20:53.107855 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:53.107821    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"]
Sep 18 22:20:53.122740 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:53.122712    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-59b357/e2e-conflict-a-97f2ccbd-kserve-7f9d4b8869-fcqcj"]
Sep 18 22:20:53.347210 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:53.347114    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be2e3002-fd83-42c0-93fd-fa4e4a3c3a76" path="/var/lib/kubelet/pods/be2e3002-fd83-42c0-93fd-fa4e4a3c3a76/volumes"
Sep 18 22:20:54.481232 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.481196    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj"]
Sep 18 22:20:54.481706 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.481582    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa24d601-26c7-4fa8-b71e-71fff9a6670b" containerName="payload-pre-processing"
Sep 18 22:20:54.481706 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.481594    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa24d601-26c7-4fa8-b71e-71fff9a6670b" containerName="payload-pre-processing"
Sep 18 22:20:54.481706 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.481610    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9da0e798-4444-45c5-8cfe-76278d0624bf" containerName="payload-processing"
Sep 18 22:20:54.481706 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.481615    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9da0e798-4444-45c5-8cfe-76278d0624bf" containerName="payload-processing"
Sep 18 22:20:54.481706 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.481624    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be2e3002-fd83-42c0-93fd-fa4e4a3c3a76" containerName="main"
Sep 18 22:20:54.481706 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.481629    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="be2e3002-fd83-42c0-93fd-fa4e4a3c3a76" containerName="main"
Sep 18 22:20:54.481706 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.481635    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a91e485-4165-4bc9-8866-180ccd4368ee" containerName="main"
Sep 18 22:20:54.481706 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.481640    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a91e485-4165-4bc9-8866-180ccd4368ee" containerName="main"
Sep 18 22:20:54.481706 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.481701    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa24d601-26c7-4fa8-b71e-71fff9a6670b" containerName="payload-pre-processing"
Sep 18 22:20:54.481706 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.481710    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="be2e3002-fd83-42c0-93fd-fa4e4a3c3a76" containerName="main"
Sep 18 22:20:54.482228 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.481716    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9da0e798-4444-45c5-8cfe-76278d0624bf" containerName="payload-processing"
Sep 18 22:20:54.482228 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.481724    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a91e485-4165-4bc9-8866-180ccd4368ee" containerName="main"
Sep 18 22:20:54.486337 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.486316    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj"
Sep 18 22:20:54.489110 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.489091    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-aa9dcd-serving-cert\""
Sep 18 22:20:54.587301 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.587264    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj"]
Sep 18 22:20:54.607875 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.607843    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdd59b11-07a8-4f74-93fa-0c91912020f2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj\" (UID: \"fdd59b11-07a8-4f74-93fa-0c91912020f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj"
Sep 18 22:20:54.608077 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.607904    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fdd59b11-07a8-4f74-93fa-0c91912020f2-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj\" (UID: \"fdd59b11-07a8-4f74-93fa-0c91912020f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj"
Sep 18 22:20:54.608077 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.607936    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fdd59b11-07a8-4f74-93fa-0c91912020f2-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj\" (UID: \"fdd59b11-07a8-4f74-93fa-0c91912020f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj"
Sep 18 22:20:54.608077 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.608020    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l2bx\" (UniqueName: \"kubernetes.io/projected/fdd59b11-07a8-4f74-93fa-0c91912020f2-kube-api-access-9l2bx\") pod \"maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj\" (UID: \"fdd59b11-07a8-4f74-93fa-0c91912020f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj"
Sep 18 22:20:54.709246 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.709205    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l2bx\" (UniqueName: \"kubernetes.io/projected/fdd59b11-07a8-4f74-93fa-0c91912020f2-kube-api-access-9l2bx\") pod \"maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj\" (UID: \"fdd59b11-07a8-4f74-93fa-0c91912020f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj"
Sep 18 22:20:54.709434 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.709277    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdd59b11-07a8-4f74-93fa-0c91912020f2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj\" (UID: \"fdd59b11-07a8-4f74-93fa-0c91912020f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj"
Sep 18 22:20:54.709434 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.709318    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fdd59b11-07a8-4f74-93fa-0c91912020f2-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj\" (UID: \"fdd59b11-07a8-4f74-93fa-0c91912020f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj"
Sep 18 22:20:54.709434 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.709336    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fdd59b11-07a8-4f74-93fa-0c91912020f2-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj\" (UID: \"fdd59b11-07a8-4f74-93fa-0c91912020f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj"
Sep 18 22:20:54.709583 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:20:54.709454    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-serving-cert: secret "maas-api-e2e-shared-b-w2-aa9dcd-serving-cert" not found
Sep 18 22:20:54.709583 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:20:54.709561    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdd59b11-07a8-4f74-93fa-0c91912020f2-maas-api-tls podName:fdd59b11-07a8-4f74-93fa-0c91912020f2 nodeName:}" failed. No retries permitted until 2026-09-18 22:20:55.209539057 +0000 UTC m=+1230.341320140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fdd59b11-07a8-4f74-93fa-0c91912020f2-maas-api-tls") pod "maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj" (UID: "fdd59b11-07a8-4f74-93fa-0c91912020f2") : secret "maas-api-e2e-shared-b-w2-aa9dcd-serving-cert" not found
Sep 18 22:20:54.709984 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.709961    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdd59b11-07a8-4f74-93fa-0c91912020f2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj\" (UID: \"fdd59b11-07a8-4f74-93fa-0c91912020f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj"
Sep 18 22:20:54.711998 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.711975    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fdd59b11-07a8-4f74-93fa-0c91912020f2-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj\" (UID: \"fdd59b11-07a8-4f74-93fa-0c91912020f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj"
Sep 18 22:20:54.725544 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:54.725490    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l2bx\" (UniqueName: \"kubernetes.io/projected/fdd59b11-07a8-4f74-93fa-0c91912020f2-kube-api-access-9l2bx\") pod \"maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj\" (UID: \"fdd59b11-07a8-4f74-93fa-0c91912020f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj"
Sep 18 22:20:55.214300 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:55.214265    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fdd59b11-07a8-4f74-93fa-0c91912020f2-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj\" (UID: \"fdd59b11-07a8-4f74-93fa-0c91912020f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj"
Sep 18 22:20:55.217109 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:55.217088    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fdd59b11-07a8-4f74-93fa-0c91912020f2-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj\" (UID: \"fdd59b11-07a8-4f74-93fa-0c91912020f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj"
Sep 18 22:20:55.397031 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:55.396990    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj"
Sep 18 22:20:55.722084 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:55.722026    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj"]
Sep 18 22:20:55.724763 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:20:55.724735    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdd59b11_07a8_4f74_93fa_0c91912020f2.slice/crio-140da880910860b6f58ae43e7a083cf8a1c499cf7126ef0d361e2bcccdcd4232 WatchSource:0}: Error finding container 140da880910860b6f58ae43e7a083cf8a1c499cf7126ef0d361e2bcccdcd4232: Status 404 returned error can't find the container with id 140da880910860b6f58ae43e7a083cf8a1c499cf7126ef0d361e2bcccdcd4232
Sep 18 22:20:55.981110 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:55.981028    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh"]
Sep 18 22:20:55.985662 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:55.985640    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh"
Sep 18 22:20:55.990105 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:55.990084    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-aa9dcd\""
Sep 18 22:20:56.016632 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:56.016594    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh"]
Sep 18 22:20:56.090170 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:56.090120    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj" event={"ID":"fdd59b11-07a8-4f74-93fa-0c91912020f2","Type":"ContainerStarted","Data":"140da880910860b6f58ae43e7a083cf8a1c499cf7126ef0d361e2bcccdcd4232"}
Sep 18 22:20:56.114461 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:56.114431    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw"]
Sep 18 22:20:56.119233 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:56.119213    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw"
Sep 18 22:20:56.122409 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:56.122380    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/235df737-207e-40a9-83a9-5daf2e3f89f3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh\" (UID: \"235df737-207e-40a9-83a9-5daf2e3f89f3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh"
Sep 18 22:20:56.122644 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:56.122581    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swvmh\" (UniqueName: \"kubernetes.io/projected/235df737-207e-40a9-83a9-5daf2e3f89f3-kube-api-access-swvmh\") pod \"payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh\" (UID: \"235df737-207e-40a9-83a9-5daf2e3f89f3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh"
Sep 18 22:20:56.128384 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:56.128366    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-aa9dcd-dockercfg-d7mcj\""
Sep 18 22:20:56.152017 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:56.151981    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw"]
Sep 18 22:20:56.223518 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:56.223480    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swvmh\" (UniqueName: \"kubernetes.io/projected/235df737-207e-40a9-83a9-5daf2e3f89f3-kube-api-access-swvmh\") pod \"payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh\" (UID: \"235df737-207e-40a9-83a9-5daf2e3f89f3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh"
Sep 18 22:20:56.223720 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:56.223567    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/235df737-207e-40a9-83a9-5daf2e3f89f3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh\" (UID: \"235df737-207e-40a9-83a9-5daf2e3f89f3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh"
Sep 18 22:20:56.223720 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:56.223591    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v7sc\" (UniqueName: \"kubernetes.io/projected/4394eb4a-d0b2-4bb0-9a5a-fc8b94019412-kube-api-access-2v7sc\") pod \"payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw\" (UID: \"4394eb4a-d0b2-4bb0-9a5a-fc8b94019412\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw"
Sep 18 22:20:56.223720 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:56.223637    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4394eb4a-d0b2-4bb0-9a5a-fc8b94019412-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw\" (UID: \"4394eb4a-d0b2-4bb0-9a5a-fc8b94019412\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw"
Sep 18 22:20:56.224358 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:56.224332    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/235df737-207e-40a9-83a9-5daf2e3f89f3-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh\" (UID: \"235df737-207e-40a9-83a9-5daf2e3f89f3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh"
Sep 18 22:20:56.235457 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:56.235399    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swvmh\" (UniqueName: \"kubernetes.io/projected/235df737-207e-40a9-83a9-5daf2e3f89f3-kube-api-access-swvmh\") pod \"payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh\" (UID: \"235df737-207e-40a9-83a9-5daf2e3f89f3\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh"
Sep 18 22:20:56.296646 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:56.296605    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh"
Sep 18 22:20:56.324489 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:56.324456    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v7sc\" (UniqueName: \"kubernetes.io/projected/4394eb4a-d0b2-4bb0-9a5a-fc8b94019412-kube-api-access-2v7sc\") pod \"payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw\" (UID: \"4394eb4a-d0b2-4bb0-9a5a-fc8b94019412\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw"
Sep 18 22:20:56.324669 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:56.324543    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4394eb4a-d0b2-4bb0-9a5a-fc8b94019412-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw\" (UID: \"4394eb4a-d0b2-4bb0-9a5a-fc8b94019412\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw"
Sep 18 22:20:56.325475 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:56.325451    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4394eb4a-d0b2-4bb0-9a5a-fc8b94019412-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw\" (UID: \"4394eb4a-d0b2-4bb0-9a5a-fc8b94019412\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw"
Sep 18 22:20:56.338864 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:56.338728    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v7sc\" (UniqueName: \"kubernetes.io/projected/4394eb4a-d0b2-4bb0-9a5a-fc8b94019412-kube-api-access-2v7sc\") pod \"payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw\" (UID: \"4394eb4a-d0b2-4bb0-9a5a-fc8b94019412\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw"
Sep 18 22:20:56.429094 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:56.429057    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw"
Sep 18 22:20:56.612770 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:56.612742    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh"]
Sep 18 22:20:56.614213 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:20:56.614183    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod235df737_207e_40a9_83a9_5daf2e3f89f3.slice/crio-c2b784318f9da08a52c69cf553d2106293aa8191bf31e9319161a797c9f6e9ec WatchSource:0}: Error finding container c2b784318f9da08a52c69cf553d2106293aa8191bf31e9319161a797c9f6e9ec: Status 404 returned error can't find the container with id c2b784318f9da08a52c69cf553d2106293aa8191bf31e9319161a797c9f6e9ec
Sep 18 22:20:56.717389 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:56.717356    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw"]
Sep 18 22:20:56.722183 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:20:56.722158    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4394eb4a_d0b2_4bb0_9a5a_fc8b94019412.slice/crio-993e8b5ea1c31c352e5a02e247feb6e3f72fc6792aec7c7b034286b4b426d880 WatchSource:0}: Error finding container 993e8b5ea1c31c352e5a02e247feb6e3f72fc6792aec7c7b034286b4b426d880: Status 404 returned error can't find the container with id 993e8b5ea1c31c352e5a02e247feb6e3f72fc6792aec7c7b034286b4b426d880
Sep 18 22:20:57.097516 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:57.097477    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw" event={"ID":"4394eb4a-d0b2-4bb0-9a5a-fc8b94019412","Type":"ContainerStarted","Data":"aa1b8c59b54d32041cda2d155c4af5c0e4a4fa6dccb4cd88950e684943b55031"}
Sep 18 22:20:57.097715 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:57.097564    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw" event={"ID":"4394eb4a-d0b2-4bb0-9a5a-fc8b94019412","Type":"ContainerStarted","Data":"993e8b5ea1c31c352e5a02e247feb6e3f72fc6792aec7c7b034286b4b426d880"}
Sep 18 22:20:57.097715 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:57.097597    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw"
Sep 18 22:20:57.099203 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:57.099179    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh" event={"ID":"235df737-207e-40a9-83a9-5daf2e3f89f3","Type":"ContainerStarted","Data":"1458d7f2af226d3801c83ab7112841c815c94a003f36803cc4069c44c01f0f44"}
Sep 18 22:20:57.099343 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:57.099223    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh"
Sep 18 22:20:57.099343 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:57.099260    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh" event={"ID":"235df737-207e-40a9-83a9-5daf2e3f89f3","Type":"ContainerStarted","Data":"c2b784318f9da08a52c69cf553d2106293aa8191bf31e9319161a797c9f6e9ec"}
Sep 18 22:20:57.100800 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:57.100769    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj" event={"ID":"fdd59b11-07a8-4f74-93fa-0c91912020f2","Type":"ContainerStarted","Data":"e3f395defb6d6563b7a6c6a71baa503cf1245fefe44fb8bd506cd990c95d5320"}
Sep 18 22:20:57.100916 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:57.100892    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj"
Sep 18 22:20:57.142585 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:57.142517    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw" podStartSLOduration=1.142485864 podStartE2EDuration="1.142485864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:20:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:20:57.13536685 +0000 UTC m=+1232.267147931" watchObservedRunningTime="2026-09-18 22:20:57.142485864 +0000 UTC m=+1232.274266943"
Sep 18 22:20:57.207922 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:57.207861    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj" podStartSLOduration=2.870896996 podStartE2EDuration="3.207845688s" totalImagesPullingTime="336.948692ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:20:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:20:57.200469403 +0000 UTC m=+1232.332250484" watchObservedRunningTime="2026-09-18 22:20:57.207845688 +0000 UTC m=+1232.339626798"
Sep 18 22:20:57.267194 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:20:57.267142    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh" podStartSLOduration=2.2671259519999998 podStartE2EDuration="2.267125952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:20:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:20:57.26541155 +0000 UTC m=+1232.397192633" watchObservedRunningTime="2026-09-18 22:20:57.267125952 +0000 UTC m=+1232.398907041"
Sep 18 22:21:03.113068 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:03.113038    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj"
Sep 18 22:21:08.109537 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:08.109464    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw"
Sep 18 22:21:08.109982 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:08.109722    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh"
Sep 18 22:21:25.400355 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:25.400323    2574 scope.go:117] "RemoveContainer" containerID="c9b86b3c5eef4723d81b2cef07f9e161a3e32c3991cce103dc8ae4c735362cb1"
Sep 18 22:21:25.408710 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:25.408686    2574 scope.go:117] "RemoveContainer" containerID="d287207639eafb4c857a5929c3cbdb1a04e0f2a3cc09d677a0e02c387edcd269"
Sep 18 22:21:25.417451 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:25.417430    2574 scope.go:117] "RemoveContainer" containerID="01b0c66067f3fbd1129c59b273f8c1b4023f849b321b424ec0f0180fdd0e4e4e"
Sep 18 22:21:29.293720 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:29.293687    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj"]
Sep 18 22:21:29.298928 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:29.298909    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj"
Sep 18 22:21:29.302397 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:29.302370    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-027c8100\""
Sep 18 22:21:29.302652 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:29.302370    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-027c8100-dockercfg-brm6x\""
Sep 18 22:21:29.316882 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:29.316852    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj"]
Sep 18 22:21:29.318555 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:29.318526    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl69z\" (UniqueName: \"kubernetes.io/projected/e15b0979-4ff5-4075-b74d-f1a8c0299099-kube-api-access-tl69z\") pod \"payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj\" (UID: \"e15b0979-4ff5-4075-b74d-f1a8c0299099\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj"
Sep 18 22:21:29.319685 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:29.318785    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e15b0979-4ff5-4075-b74d-f1a8c0299099-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj\" (UID: \"e15b0979-4ff5-4075-b74d-f1a8c0299099\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj"
Sep 18 22:21:29.421370 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:29.421331    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e15b0979-4ff5-4075-b74d-f1a8c0299099-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj\" (UID: \"e15b0979-4ff5-4075-b74d-f1a8c0299099\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj"
Sep 18 22:21:29.421556 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:29.421404    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl69z\" (UniqueName: \"kubernetes.io/projected/e15b0979-4ff5-4075-b74d-f1a8c0299099-kube-api-access-tl69z\") pod \"payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj\" (UID: \"e15b0979-4ff5-4075-b74d-f1a8c0299099\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj"
Sep 18 22:21:29.422130 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:29.422110    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e15b0979-4ff5-4075-b74d-f1a8c0299099-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj\" (UID: \"e15b0979-4ff5-4075-b74d-f1a8c0299099\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj"
Sep 18 22:21:29.447052 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:29.447026    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl69z\" (UniqueName: \"kubernetes.io/projected/e15b0979-4ff5-4075-b74d-f1a8c0299099-kube-api-access-tl69z\") pod \"payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj\" (UID: \"e15b0979-4ff5-4075-b74d-f1a8c0299099\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj"
Sep 18 22:21:29.618244 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:29.618152    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj"
Sep 18 22:21:29.914566 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:21:29.914533    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode15b0979_4ff5_4075_b74d_f1a8c0299099.slice/crio-f6d1601de5f643c2bdae811d35fbb2dca0065b5e824f9fe7f5fcc23e91f43349 WatchSource:0}: Error finding container f6d1601de5f643c2bdae811d35fbb2dca0065b5e824f9fe7f5fcc23e91f43349: Status 404 returned error can't find the container with id f6d1601de5f643c2bdae811d35fbb2dca0065b5e824f9fe7f5fcc23e91f43349
Sep 18 22:21:29.914943 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:29.914921    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj"]
Sep 18 22:21:30.278317 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:30.278275    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj" event={"ID":"e15b0979-4ff5-4075-b74d-f1a8c0299099","Type":"ContainerStarted","Data":"57442779ff41fcf6c19106e26ec5496d75a7a052ff7a3f23e6621e47c2e3b331"}
Sep 18 22:21:30.278545 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:30.278343    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj" event={"ID":"e15b0979-4ff5-4075-b74d-f1a8c0299099","Type":"ContainerStarted","Data":"f6d1601de5f643c2bdae811d35fbb2dca0065b5e824f9fe7f5fcc23e91f43349"}
Sep 18 22:21:30.278545 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:30.278383    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj"
Sep 18 22:21:36.963020 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:36.962964    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj" podStartSLOduration=7.962948674 podStartE2EDuration="7.962948674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:21:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:21:30.311647506 +0000 UTC m=+1265.443428588" watchObservedRunningTime="2026-09-18 22:21:36.962948674 +0000 UTC m=+1272.094729759"
Sep 18 22:21:36.965438 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:36.963682    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk"]
Sep 18 22:21:36.966985 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:36.966971    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk"
Sep 18 22:21:36.980575 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:36.980557    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-123a30\""
Sep 18 22:21:36.988060 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:36.988039    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6bb06bb0-2361-4bae-a7e4-9874bf395cdf-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk\" (UID: \"6bb06bb0-2361-4bae-a7e4-9874bf395cdf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk"
Sep 18 22:21:36.988170 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:36.988088    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw77k\" (UniqueName: \"kubernetes.io/projected/6bb06bb0-2361-4bae-a7e4-9874bf395cdf-kube-api-access-vw77k\") pod \"payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk\" (UID: \"6bb06bb0-2361-4bae-a7e4-9874bf395cdf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk"
Sep 18 22:21:37.028103 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:37.028072    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk"]
Sep 18 22:21:37.088524 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:37.088470    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6bb06bb0-2361-4bae-a7e4-9874bf395cdf-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk\" (UID: \"6bb06bb0-2361-4bae-a7e4-9874bf395cdf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk"
Sep 18 22:21:37.088674 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:37.088541    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw77k\" (UniqueName: \"kubernetes.io/projected/6bb06bb0-2361-4bae-a7e4-9874bf395cdf-kube-api-access-vw77k\") pod \"payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk\" (UID: \"6bb06bb0-2361-4bae-a7e4-9874bf395cdf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk"
Sep 18 22:21:37.089264 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:37.089246    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6bb06bb0-2361-4bae-a7e4-9874bf395cdf-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk\" (UID: \"6bb06bb0-2361-4bae-a7e4-9874bf395cdf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk"
Sep 18 22:21:37.107703 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:37.107675    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw77k\" (UniqueName: \"kubernetes.io/projected/6bb06bb0-2361-4bae-a7e4-9874bf395cdf-kube-api-access-vw77k\") pod \"payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk\" (UID: \"6bb06bb0-2361-4bae-a7e4-9874bf395cdf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk"
Sep 18 22:21:37.276554 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:37.276464    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk"
Sep 18 22:21:37.587444 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:37.587420    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk"]
Sep 18 22:21:37.593563 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:21:37.590836    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb06bb0_2361_4bae_a7e4_9874bf395cdf.slice/crio-05265ccc00d5e4e42584b89a383741fcaf90d534b97962fe485ce3d46ae72100 WatchSource:0}: Error finding container 05265ccc00d5e4e42584b89a383741fcaf90d534b97962fe485ce3d46ae72100: Status 404 returned error can't find the container with id 05265ccc00d5e4e42584b89a383741fcaf90d534b97962fe485ce3d46ae72100
Sep 18 22:21:38.319349 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:38.319311    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk" event={"ID":"6bb06bb0-2361-4bae-a7e4-9874bf395cdf","Type":"ContainerStarted","Data":"f58aad5ab5d2a74b1abd254b000c3121ab976d4a2d88d1b4e567b1f2d16e0685"}
Sep 18 22:21:38.319876 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:38.319371    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk" event={"ID":"6bb06bb0-2361-4bae-a7e4-9874bf395cdf","Type":"ContainerStarted","Data":"05265ccc00d5e4e42584b89a383741fcaf90d534b97962fe485ce3d46ae72100"}
Sep 18 22:21:38.319876 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:38.319437    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk"
Sep 18 22:21:38.350432 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:38.350379    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk" podStartSLOduration=2.350362947 podStartE2EDuration="2.350362947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:21:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:21:38.349821483 +0000 UTC m=+1273.481602566" watchObservedRunningTime="2026-09-18 22:21:38.350362947 +0000 UTC m=+1273.482144033"
Sep 18 22:21:41.286026 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:41.285998    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj"
Sep 18 22:21:49.327939 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:21:49.327911    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk"
Sep 18 22:22:01.933457 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:01.933418    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf"]
Sep 18 22:22:01.937233 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:01.937216    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf"
Sep 18 22:22:01.939773 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:01.939746    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-7f10d8\""
Sep 18 22:22:01.939906 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:01.939849    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-7f10d8-dockercfg-sfl9v\""
Sep 18 22:22:01.949215 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:01.949190    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf"]
Sep 18 22:22:02.014363 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:02.014332    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96968c3d-5d91-4d1a-a0b0-f923f47b006b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf\" (UID: \"96968c3d-5d91-4d1a-a0b0-f923f47b006b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf"
Sep 18 22:22:02.014665 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:02.014383    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t4tk\" (UniqueName: \"kubernetes.io/projected/96968c3d-5d91-4d1a-a0b0-f923f47b006b-kube-api-access-4t4tk\") pod \"payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf\" (UID: \"96968c3d-5d91-4d1a-a0b0-f923f47b006b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf"
Sep 18 22:22:02.027000 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:02.026970    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2"]
Sep 18 22:22:02.030564 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:02.030544    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2"
Sep 18 22:22:02.046540 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:02.046496    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2"]
Sep 18 22:22:02.115236 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:02.115206    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96968c3d-5d91-4d1a-a0b0-f923f47b006b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf\" (UID: \"96968c3d-5d91-4d1a-a0b0-f923f47b006b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf"
Sep 18 22:22:02.115393 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:02.115250    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t4tk\" (UniqueName: \"kubernetes.io/projected/96968c3d-5d91-4d1a-a0b0-f923f47b006b-kube-api-access-4t4tk\") pod \"payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf\" (UID: \"96968c3d-5d91-4d1a-a0b0-f923f47b006b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf"
Sep 18 22:22:02.115393 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:02.115287    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bbb6f4f-e8ec-4272-878d-32bc7bb220aa-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2\" (UID: \"3bbb6f4f-e8ec-4272-878d-32bc7bb220aa\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2"
Sep 18 22:22:02.115393 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:02.115315    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbdnx\" (UniqueName: \"kubernetes.io/projected/3bbb6f4f-e8ec-4272-878d-32bc7bb220aa-kube-api-access-mbdnx\") pod \"payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2\" (UID: \"3bbb6f4f-e8ec-4272-878d-32bc7bb220aa\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2"
Sep 18 22:22:02.116022 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:02.116004    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96968c3d-5d91-4d1a-a0b0-f923f47b006b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf\" (UID: \"96968c3d-5d91-4d1a-a0b0-f923f47b006b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf"
Sep 18 22:22:02.124376 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:02.124352    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t4tk\" (UniqueName: \"kubernetes.io/projected/96968c3d-5d91-4d1a-a0b0-f923f47b006b-kube-api-access-4t4tk\") pod \"payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf\" (UID: \"96968c3d-5d91-4d1a-a0b0-f923f47b006b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf"
Sep 18 22:22:02.216623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:02.216542    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bbb6f4f-e8ec-4272-878d-32bc7bb220aa-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2\" (UID: \"3bbb6f4f-e8ec-4272-878d-32bc7bb220aa\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2"
Sep 18 22:22:02.216623 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:02.216586    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbdnx\" (UniqueName: \"kubernetes.io/projected/3bbb6f4f-e8ec-4272-878d-32bc7bb220aa-kube-api-access-mbdnx\") pod \"payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2\" (UID: \"3bbb6f4f-e8ec-4272-878d-32bc7bb220aa\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2"
Sep 18 22:22:02.217255 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:02.217231    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bbb6f4f-e8ec-4272-878d-32bc7bb220aa-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2\" (UID: \"3bbb6f4f-e8ec-4272-878d-32bc7bb220aa\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2"
Sep 18 22:22:02.231228 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:02.231207    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbdnx\" (UniqueName: \"kubernetes.io/projected/3bbb6f4f-e8ec-4272-878d-32bc7bb220aa-kube-api-access-mbdnx\") pod \"payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2\" (UID: \"3bbb6f4f-e8ec-4272-878d-32bc7bb220aa\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2"
Sep 18 22:22:02.247069 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:02.247047    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf"
Sep 18 22:22:02.340637 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:02.340614    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2"
Sep 18 22:22:02.524144 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:02.524120    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf"]
Sep 18 22:22:02.528795 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:22:02.528717    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96968c3d_5d91_4d1a_a0b0_f923f47b006b.slice/crio-84e78b7a2f876b1f3d07f3e87ea3bd5793d1cfae3453bbb9612cd58695ec4854 WatchSource:0}: Error finding container 84e78b7a2f876b1f3d07f3e87ea3bd5793d1cfae3453bbb9612cd58695ec4854: Status 404 returned error can't find the container with id 84e78b7a2f876b1f3d07f3e87ea3bd5793d1cfae3453bbb9612cd58695ec4854
Sep 18 22:22:02.612793 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:02.612765    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2"]
Sep 18 22:22:02.613431 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:22:02.613403    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bbb6f4f_e8ec_4272_878d_32bc7bb220aa.slice/crio-442cff81adf02078633f24e0f5c6aefad0e384a73362ffee046395d99d8036ab WatchSource:0}: Error finding container 442cff81adf02078633f24e0f5c6aefad0e384a73362ffee046395d99d8036ab: Status 404 returned error can't find the container with id 442cff81adf02078633f24e0f5c6aefad0e384a73362ffee046395d99d8036ab
Sep 18 22:22:03.446347 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:03.446315    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf" event={"ID":"96968c3d-5d91-4d1a-a0b0-f923f47b006b","Type":"ContainerStarted","Data":"b4a322604a78e46b03a4f3ca42c181a816d596242d474b3226dc4a3f80e2dc50"}
Sep 18 22:22:03.446835 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:03.446494    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf"
Sep 18 22:22:03.446835 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:03.446559    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf" event={"ID":"96968c3d-5d91-4d1a-a0b0-f923f47b006b","Type":"ContainerStarted","Data":"84e78b7a2f876b1f3d07f3e87ea3bd5793d1cfae3453bbb9612cd58695ec4854"}
Sep 18 22:22:03.448177 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:03.448152    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2" event={"ID":"3bbb6f4f-e8ec-4272-878d-32bc7bb220aa","Type":"ContainerStarted","Data":"91a3bbfd08daa1a535214c123cd4b9cbfa73d814088e4cc95f4f16721aaaf801"}
Sep 18 22:22:03.448282 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:03.448197    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2" event={"ID":"3bbb6f4f-e8ec-4272-878d-32bc7bb220aa","Type":"ContainerStarted","Data":"442cff81adf02078633f24e0f5c6aefad0e384a73362ffee046395d99d8036ab"}
Sep 18 22:22:03.448282 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:03.448226    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2"
Sep 18 22:22:03.465249 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:03.465208    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf" podStartSLOduration=2.465195472 podStartE2EDuration="2.465195472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:22:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:22:03.463113534 +0000 UTC m=+1298.594894609" watchObservedRunningTime="2026-09-18 22:22:03.465195472 +0000 UTC m=+1298.596976553"
Sep 18 22:22:03.482875 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:03.482832    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2" podStartSLOduration=1.4828191689999999 podStartE2EDuration="1.482819169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:22:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:22:03.481684368 +0000 UTC m=+1298.613465451" watchObservedRunningTime="2026-09-18 22:22:03.482819169 +0000 UTC m=+1298.614600250"
Sep 18 22:22:14.456695 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:14.456660    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2"
Sep 18 22:22:14.457049 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:14.456867    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf"
Sep 18 22:22:25.459225 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:22:25.459193    2574 scope.go:117] "RemoveContainer" containerID="2b5a33351600825b795dc46c97fa09b9dd7c59395079f0c23f99ff9a2819785c"
Sep 18 22:24:00.377528 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:24:00.377482    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj"]
Sep 18 22:24:00.378078 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:24:00.377721    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj" podUID="e15b0979-4ff5-4075-b74d-f1a8c0299099" containerName="payload-pre-processing" containerID="cri-o://57442779ff41fcf6c19106e26ec5496d75a7a052ff7a3f23e6621e47c2e3b331" gracePeriod=30
Sep 18 22:24:00.629556 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:24:00.629466    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj"
Sep 18 22:24:00.669988 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:24:00.669959    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tl69z\" (UniqueName: \"kubernetes.io/projected/e15b0979-4ff5-4075-b74d-f1a8c0299099-kube-api-access-tl69z\") pod \"e15b0979-4ff5-4075-b74d-f1a8c0299099\" (UID: \"e15b0979-4ff5-4075-b74d-f1a8c0299099\") "
Sep 18 22:24:00.670171 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:24:00.670002    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e15b0979-4ff5-4075-b74d-f1a8c0299099-plugins-config-volume\") pod \"e15b0979-4ff5-4075-b74d-f1a8c0299099\" (UID: \"e15b0979-4ff5-4075-b74d-f1a8c0299099\") "
Sep 18 22:24:00.670382 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:24:00.670358    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e15b0979-4ff5-4075-b74d-f1a8c0299099-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e15b0979-4ff5-4075-b74d-f1a8c0299099" (UID: "e15b0979-4ff5-4075-b74d-f1a8c0299099"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:24:00.672202 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:24:00.672174    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e15b0979-4ff5-4075-b74d-f1a8c0299099-kube-api-access-tl69z" (OuterVolumeSpecName: "kube-api-access-tl69z") pod "e15b0979-4ff5-4075-b74d-f1a8c0299099" (UID: "e15b0979-4ff5-4075-b74d-f1a8c0299099"). InnerVolumeSpecName "kube-api-access-tl69z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:24:00.771298 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:24:00.771273    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tl69z\" (UniqueName: \"kubernetes.io/projected/e15b0979-4ff5-4075-b74d-f1a8c0299099-kube-api-access-tl69z\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:24:00.771298 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:24:00.771296    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e15b0979-4ff5-4075-b74d-f1a8c0299099-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:24:01.059119 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:24:01.059077    2574 generic.go:356] "Generic (PLEG): container finished" podID="e15b0979-4ff5-4075-b74d-f1a8c0299099" containerID="57442779ff41fcf6c19106e26ec5496d75a7a052ff7a3f23e6621e47c2e3b331" exitCode=0
Sep 18 22:24:01.059319 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:24:01.059126    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj"
Sep 18 22:24:01.059319 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:24:01.059167    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj" event={"ID":"e15b0979-4ff5-4075-b74d-f1a8c0299099","Type":"ContainerDied","Data":"57442779ff41fcf6c19106e26ec5496d75a7a052ff7a3f23e6621e47c2e3b331"}
Sep 18 22:24:01.059319 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:24:01.059231    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj" event={"ID":"e15b0979-4ff5-4075-b74d-f1a8c0299099","Type":"ContainerDied","Data":"f6d1601de5f643c2bdae811d35fbb2dca0065b5e824f9fe7f5fcc23e91f43349"}
Sep 18 22:24:01.059319 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:24:01.059265    2574 scope.go:117] "RemoveContainer" containerID="57442779ff41fcf6c19106e26ec5496d75a7a052ff7a3f23e6621e47c2e3b331"
Sep 18 22:24:01.068646 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:24:01.068623    2574 scope.go:117] "RemoveContainer" containerID="57442779ff41fcf6c19106e26ec5496d75a7a052ff7a3f23e6621e47c2e3b331"
Sep 18 22:24:01.068902 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:24:01.068885    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57442779ff41fcf6c19106e26ec5496d75a7a052ff7a3f23e6621e47c2e3b331\": container with ID starting with 57442779ff41fcf6c19106e26ec5496d75a7a052ff7a3f23e6621e47c2e3b331 not found: ID does not exist" containerID="57442779ff41fcf6c19106e26ec5496d75a7a052ff7a3f23e6621e47c2e3b331"
Sep 18 22:24:01.068947 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:24:01.068911    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57442779ff41fcf6c19106e26ec5496d75a7a052ff7a3f23e6621e47c2e3b331"} err="failed to get container status \"57442779ff41fcf6c19106e26ec5496d75a7a052ff7a3f23e6621e47c2e3b331\": rpc error: code = NotFound desc = could not find container \"57442779ff41fcf6c19106e26ec5496d75a7a052ff7a3f23e6621e47c2e3b331\": container with ID starting with 57442779ff41fcf6c19106e26ec5496d75a7a052ff7a3f23e6621e47c2e3b331 not found: ID does not exist"
Sep 18 22:24:01.085147 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:24:01.085126    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj"]
Sep 18 22:24:01.090801 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:24:01.090773    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-027c8100-848b646b9d-jwglj"]
Sep 18 22:24:01.346471 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:24:01.346389    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e15b0979-4ff5-4075-b74d-f1a8c0299099" path="/var/lib/kubelet/pods/e15b0979-4ff5-4075-b74d-f1a8c0299099/volumes"
Sep 18 22:24:25.486848 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:24:25.486817    2574 scope.go:117] "RemoveContainer" containerID="8bca19e31dcfe305d4f3d3c139422046764885630c92ed1f8dc52f9bea39efc3"
Sep 18 22:25:53.490281 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:53.490195    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn"]
Sep 18 22:25:53.490836 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:53.490435    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn" podUID="3871c08d-2953-4b12-96dd-f8e5cc491fde" containerName="payload-processing" containerID="cri-o://19339692e928646a4cd46c31f1f759da24cdac169fa0a160e2d6cb7b6d79a600" gracePeriod=30
Sep 18 22:25:53.545541 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:53.545497    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4"]
Sep 18 22:25:53.545721 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:53.545701    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4" podUID="62589d81-9fe3-4f3a-8715-3e453f397d4b" containerName="payload-pre-processing" containerID="cri-o://a8a32a754b924025265087d05111626c5773171f24763fb4d91bf9035c5dc8b9" gracePeriod=30
Sep 18 22:25:53.628386 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:53.628357    2574 generic.go:356] "Generic (PLEG): container finished" podID="3871c08d-2953-4b12-96dd-f8e5cc491fde" containerID="19339692e928646a4cd46c31f1f759da24cdac169fa0a160e2d6cb7b6d79a600" exitCode=0
Sep 18 22:25:53.628556 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:53.628429    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn" event={"ID":"3871c08d-2953-4b12-96dd-f8e5cc491fde","Type":"ContainerDied","Data":"19339692e928646a4cd46c31f1f759da24cdac169fa0a160e2d6cb7b6d79a600"}
Sep 18 22:25:53.801096 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:53.801071    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn"
Sep 18 22:25:53.829698 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:53.829676    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4"
Sep 18 22:25:53.859802 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:53.859781    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9c5d\" (UniqueName: \"kubernetes.io/projected/3871c08d-2953-4b12-96dd-f8e5cc491fde-kube-api-access-n9c5d\") pod \"3871c08d-2953-4b12-96dd-f8e5cc491fde\" (UID: \"3871c08d-2953-4b12-96dd-f8e5cc491fde\") "
Sep 18 22:25:53.859904 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:53.859868    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3871c08d-2953-4b12-96dd-f8e5cc491fde-plugins-config-volume\") pod \"3871c08d-2953-4b12-96dd-f8e5cc491fde\" (UID: \"3871c08d-2953-4b12-96dd-f8e5cc491fde\") "
Sep 18 22:25:53.860247 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:53.860218    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3871c08d-2953-4b12-96dd-f8e5cc491fde-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3871c08d-2953-4b12-96dd-f8e5cc491fde" (UID: "3871c08d-2953-4b12-96dd-f8e5cc491fde"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:25:53.862380 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:53.862354    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3871c08d-2953-4b12-96dd-f8e5cc491fde-kube-api-access-n9c5d" (OuterVolumeSpecName: "kube-api-access-n9c5d") pod "3871c08d-2953-4b12-96dd-f8e5cc491fde" (UID: "3871c08d-2953-4b12-96dd-f8e5cc491fde"). InnerVolumeSpecName "kube-api-access-n9c5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:25:53.960555 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:53.960497    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2s9d\" (UniqueName: \"kubernetes.io/projected/62589d81-9fe3-4f3a-8715-3e453f397d4b-kube-api-access-v2s9d\") pod \"62589d81-9fe3-4f3a-8715-3e453f397d4b\" (UID: \"62589d81-9fe3-4f3a-8715-3e453f397d4b\") "
Sep 18 22:25:53.960705 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:53.960566    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62589d81-9fe3-4f3a-8715-3e453f397d4b-plugins-config-volume\") pod \"62589d81-9fe3-4f3a-8715-3e453f397d4b\" (UID: \"62589d81-9fe3-4f3a-8715-3e453f397d4b\") "
Sep 18 22:25:53.960848 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:53.960823    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3871c08d-2953-4b12-96dd-f8e5cc491fde-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:25:53.960848 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:53.960843    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9c5d\" (UniqueName: \"kubernetes.io/projected/3871c08d-2953-4b12-96dd-f8e5cc491fde-kube-api-access-n9c5d\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:25:53.961003 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:53.960874    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62589d81-9fe3-4f3a-8715-3e453f397d4b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "62589d81-9fe3-4f3a-8715-3e453f397d4b" (UID: "62589d81-9fe3-4f3a-8715-3e453f397d4b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:25:53.962594 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:53.962573    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62589d81-9fe3-4f3a-8715-3e453f397d4b-kube-api-access-v2s9d" (OuterVolumeSpecName: "kube-api-access-v2s9d") pod "62589d81-9fe3-4f3a-8715-3e453f397d4b" (UID: "62589d81-9fe3-4f3a-8715-3e453f397d4b"). InnerVolumeSpecName "kube-api-access-v2s9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:25:54.061869 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:54.061794    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2s9d\" (UniqueName: \"kubernetes.io/projected/62589d81-9fe3-4f3a-8715-3e453f397d4b-kube-api-access-v2s9d\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:25:54.061869 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:54.061820    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62589d81-9fe3-4f3a-8715-3e453f397d4b-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:25:54.634480 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:54.634443    2574 generic.go:356] "Generic (PLEG): container finished" podID="62589d81-9fe3-4f3a-8715-3e453f397d4b" containerID="a8a32a754b924025265087d05111626c5773171f24763fb4d91bf9035c5dc8b9" exitCode=0
Sep 18 22:25:54.634897 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:54.634482    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4"
Sep 18 22:25:54.634897 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:54.634530    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4" event={"ID":"62589d81-9fe3-4f3a-8715-3e453f397d4b","Type":"ContainerDied","Data":"a8a32a754b924025265087d05111626c5773171f24763fb4d91bf9035c5dc8b9"}
Sep 18 22:25:54.634897 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:54.634585    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4" event={"ID":"62589d81-9fe3-4f3a-8715-3e453f397d4b","Type":"ContainerDied","Data":"cd8208737d0e7c0bd91202707cba2abee2a8af000645723d994440158b483712"}
Sep 18 22:25:54.634897 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:54.634615    2574 scope.go:117] "RemoveContainer" containerID="a8a32a754b924025265087d05111626c5773171f24763fb4d91bf9035c5dc8b9"
Sep 18 22:25:54.636186 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:54.636154    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn"
Sep 18 22:25:54.636299 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:54.636157    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn" event={"ID":"3871c08d-2953-4b12-96dd-f8e5cc491fde","Type":"ContainerDied","Data":"b90411b1af8722d0b07b470f37be090f5ed1d85211a0329616d826057c133be9"}
Sep 18 22:25:54.648045 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:54.648019    2574 scope.go:117] "RemoveContainer" containerID="a8a32a754b924025265087d05111626c5773171f24763fb4d91bf9035c5dc8b9"
Sep 18 22:25:54.648380 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:25:54.648345    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8a32a754b924025265087d05111626c5773171f24763fb4d91bf9035c5dc8b9\": container with ID starting with a8a32a754b924025265087d05111626c5773171f24763fb4d91bf9035c5dc8b9 not found: ID does not exist" containerID="a8a32a754b924025265087d05111626c5773171f24763fb4d91bf9035c5dc8b9"
Sep 18 22:25:54.648475 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:54.648382    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8a32a754b924025265087d05111626c5773171f24763fb4d91bf9035c5dc8b9"} err="failed to get container status \"a8a32a754b924025265087d05111626c5773171f24763fb4d91bf9035c5dc8b9\": rpc error: code = NotFound desc = could not find container \"a8a32a754b924025265087d05111626c5773171f24763fb4d91bf9035c5dc8b9\": container with ID starting with a8a32a754b924025265087d05111626c5773171f24763fb4d91bf9035c5dc8b9 not found: ID does not exist"
Sep 18 22:25:54.648475 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:54.648405    2574 scope.go:117] "RemoveContainer" containerID="19339692e928646a4cd46c31f1f759da24cdac169fa0a160e2d6cb7b6d79a600"
Sep 18 22:25:54.681795 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:54.681770    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4"]
Sep 18 22:25:54.692601 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:54.692580    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-59b357-5cd87464cd-s9sr4"]
Sep 18 22:25:54.714102 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:54.714079    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn"]
Sep 18 22:25:54.721217 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:54.721190    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-59b357-6978cbb9-hmttn"]
Sep 18 22:25:55.347989 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:55.347948    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3871c08d-2953-4b12-96dd-f8e5cc491fde" path="/var/lib/kubelet/pods/3871c08d-2953-4b12-96dd-f8e5cc491fde/volumes"
Sep 18 22:25:55.348312 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:25:55.348298    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62589d81-9fe3-4f3a-8715-3e453f397d4b" path="/var/lib/kubelet/pods/62589d81-9fe3-4f3a-8715-3e453f397d4b/volumes"
Sep 18 22:26:02.261072 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:02.261031    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v"]
Sep 18 22:26:02.261539 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:02.261474    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3871c08d-2953-4b12-96dd-f8e5cc491fde" containerName="payload-processing"
Sep 18 22:26:02.261539 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:02.261488    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3871c08d-2953-4b12-96dd-f8e5cc491fde" containerName="payload-processing"
Sep 18 22:26:02.261539 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:02.261500    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e15b0979-4ff5-4075-b74d-f1a8c0299099" containerName="payload-pre-processing"
Sep 18 22:26:02.261539 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:02.261523    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e15b0979-4ff5-4075-b74d-f1a8c0299099" containerName="payload-pre-processing"
Sep 18 22:26:02.261678 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:02.261547    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62589d81-9fe3-4f3a-8715-3e453f397d4b" containerName="payload-pre-processing"
Sep 18 22:26:02.261678 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:02.261552    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="62589d81-9fe3-4f3a-8715-3e453f397d4b" containerName="payload-pre-processing"
Sep 18 22:26:02.261678 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:02.261619    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e15b0979-4ff5-4075-b74d-f1a8c0299099" containerName="payload-pre-processing"
Sep 18 22:26:02.261678 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:02.261631    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="62589d81-9fe3-4f3a-8715-3e453f397d4b" containerName="payload-pre-processing"
Sep 18 22:26:02.261678 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:02.261636    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3871c08d-2953-4b12-96dd-f8e5cc491fde" containerName="payload-processing"
Sep 18 22:26:02.265633 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:02.265616    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v"
Sep 18 22:26:02.271279 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:02.271258    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-4583f0-dockercfg-mkk45\""
Sep 18 22:26:02.271387 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:02.271263    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-4583f0\""
Sep 18 22:26:02.282040 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:02.282017    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v"]
Sep 18 22:26:02.334229 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:02.334199    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj7qw\" (UniqueName: \"kubernetes.io/projected/53393f62-0b91-484b-a91a-ac4aaaa92f3d-kube-api-access-dj7qw\") pod \"payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v\" (UID: \"53393f62-0b91-484b-a91a-ac4aaaa92f3d\") " pod="openshift-ingress/payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v"
Sep 18 22:26:02.334404 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:02.334349    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53393f62-0b91-484b-a91a-ac4aaaa92f3d-plugins-config-volume\") pod \"payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v\" (UID: \"53393f62-0b91-484b-a91a-ac4aaaa92f3d\") " pod="openshift-ingress/payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v"
Sep 18 22:26:02.435290 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:02.435254    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj7qw\" (UniqueName: \"kubernetes.io/projected/53393f62-0b91-484b-a91a-ac4aaaa92f3d-kube-api-access-dj7qw\") pod \"payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v\" (UID: \"53393f62-0b91-484b-a91a-ac4aaaa92f3d\") " pod="openshift-ingress/payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v"
Sep 18 22:26:02.435472 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:02.435346    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53393f62-0b91-484b-a91a-ac4aaaa92f3d-plugins-config-volume\") pod \"payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v\" (UID: \"53393f62-0b91-484b-a91a-ac4aaaa92f3d\") " pod="openshift-ingress/payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v"
Sep 18 22:26:02.436003 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:02.435983    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53393f62-0b91-484b-a91a-ac4aaaa92f3d-plugins-config-volume\") pod \"payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v\" (UID: \"53393f62-0b91-484b-a91a-ac4aaaa92f3d\") " pod="openshift-ingress/payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v"
Sep 18 22:26:02.449501 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:02.449481    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj7qw\" (UniqueName: \"kubernetes.io/projected/53393f62-0b91-484b-a91a-ac4aaaa92f3d-kube-api-access-dj7qw\") pod \"payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v\" (UID: \"53393f62-0b91-484b-a91a-ac4aaaa92f3d\") " pod="openshift-ingress/payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v"
Sep 18 22:26:02.575394 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:02.575364    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v"
Sep 18 22:26:02.920464 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:02.920439    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v"]
Sep 18 22:26:02.922625 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:26:02.922599    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53393f62_0b91_484b_a91a_ac4aaaa92f3d.slice/crio-0c426400f6f8363c075ff32f29d207942c0736df59270d518ca120106b3b75c8 WatchSource:0}: Error finding container 0c426400f6f8363c075ff32f29d207942c0736df59270d518ca120106b3b75c8: Status 404 returned error can't find the container with id 0c426400f6f8363c075ff32f29d207942c0736df59270d518ca120106b3b75c8
Sep 18 22:26:03.686816 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:03.686785    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v" event={"ID":"53393f62-0b91-484b-a91a-ac4aaaa92f3d","Type":"ContainerStarted","Data":"142fba01de4febc330595f7e2c1285b1458931769cf844f623f286cf074778ce"}
Sep 18 22:26:03.687305 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:03.686831    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v" event={"ID":"53393f62-0b91-484b-a91a-ac4aaaa92f3d","Type":"ContainerStarted","Data":"0c426400f6f8363c075ff32f29d207942c0736df59270d518ca120106b3b75c8"}
Sep 18 22:26:03.687305 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:03.686922    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v"
Sep 18 22:26:03.721273 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:03.721220    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v" podStartSLOduration=1.721203911 podStartE2EDuration="1.721203911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:26:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:26:03.718043524 +0000 UTC m=+1538.849824646" watchObservedRunningTime="2026-09-18 22:26:03.721203911 +0000 UTC m=+1538.852984994"
Sep 18 22:26:14.694752 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:14.694716    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v"
Sep 18 22:26:25.516905 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:26:25.516875    2574 scope.go:117] "RemoveContainer" containerID="74392f5d1318dca26fb6eab6090646620f25b1e7a746b02f541efc9b6d193c38"
Sep 18 22:27:20.173732 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:27:20.173642    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v"]
Sep 18 22:27:20.174281 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:27:20.173902    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v" podUID="53393f62-0b91-484b-a91a-ac4aaaa92f3d" containerName="payload-processing" containerID="cri-o://142fba01de4febc330595f7e2c1285b1458931769cf844f623f286cf074778ce" gracePeriod=30
Sep 18 22:27:20.431631 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:27:20.431569    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v"
Sep 18 22:27:20.610790 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:27:20.610759    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53393f62-0b91-484b-a91a-ac4aaaa92f3d-plugins-config-volume\") pod \"53393f62-0b91-484b-a91a-ac4aaaa92f3d\" (UID: \"53393f62-0b91-484b-a91a-ac4aaaa92f3d\") "
Sep 18 22:27:20.610988 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:27:20.610852    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dj7qw\" (UniqueName: \"kubernetes.io/projected/53393f62-0b91-484b-a91a-ac4aaaa92f3d-kube-api-access-dj7qw\") pod \"53393f62-0b91-484b-a91a-ac4aaaa92f3d\" (UID: \"53393f62-0b91-484b-a91a-ac4aaaa92f3d\") "
Sep 18 22:27:20.611227 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:27:20.611198    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53393f62-0b91-484b-a91a-ac4aaaa92f3d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "53393f62-0b91-484b-a91a-ac4aaaa92f3d" (UID: "53393f62-0b91-484b-a91a-ac4aaaa92f3d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:27:20.613065 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:27:20.613044    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53393f62-0b91-484b-a91a-ac4aaaa92f3d-kube-api-access-dj7qw" (OuterVolumeSpecName: "kube-api-access-dj7qw") pod "53393f62-0b91-484b-a91a-ac4aaaa92f3d" (UID: "53393f62-0b91-484b-a91a-ac4aaaa92f3d"). InnerVolumeSpecName "kube-api-access-dj7qw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:27:20.711878 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:27:20.711773    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53393f62-0b91-484b-a91a-ac4aaaa92f3d-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:27:20.711878 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:27:20.711816    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dj7qw\" (UniqueName: \"kubernetes.io/projected/53393f62-0b91-484b-a91a-ac4aaaa92f3d-kube-api-access-dj7qw\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:27:21.070561 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:27:21.070462    2574 generic.go:356] "Generic (PLEG): container finished" podID="53393f62-0b91-484b-a91a-ac4aaaa92f3d" containerID="142fba01de4febc330595f7e2c1285b1458931769cf844f623f286cf074778ce" exitCode=0
Sep 18 22:27:21.070561 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:27:21.070524    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v"
Sep 18 22:27:21.070561 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:27:21.070548    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v" event={"ID":"53393f62-0b91-484b-a91a-ac4aaaa92f3d","Type":"ContainerDied","Data":"142fba01de4febc330595f7e2c1285b1458931769cf844f623f286cf074778ce"}
Sep 18 22:27:21.070785 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:27:21.070605    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v" event={"ID":"53393f62-0b91-484b-a91a-ac4aaaa92f3d","Type":"ContainerDied","Data":"0c426400f6f8363c075ff32f29d207942c0736df59270d518ca120106b3b75c8"}
Sep 18 22:27:21.070785 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:27:21.070635    2574 scope.go:117] "RemoveContainer" containerID="142fba01de4febc330595f7e2c1285b1458931769cf844f623f286cf074778ce"
Sep 18 22:27:21.082178 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:27:21.082152    2574 scope.go:117] "RemoveContainer" containerID="142fba01de4febc330595f7e2c1285b1458931769cf844f623f286cf074778ce"
Sep 18 22:27:21.082537 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:27:21.082489    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"142fba01de4febc330595f7e2c1285b1458931769cf844f623f286cf074778ce\": container with ID starting with 142fba01de4febc330595f7e2c1285b1458931769cf844f623f286cf074778ce not found: ID does not exist" containerID="142fba01de4febc330595f7e2c1285b1458931769cf844f623f286cf074778ce"
Sep 18 22:27:21.082622 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:27:21.082540    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"142fba01de4febc330595f7e2c1285b1458931769cf844f623f286cf074778ce"} err="failed to get container status \"142fba01de4febc330595f7e2c1285b1458931769cf844f623f286cf074778ce\": rpc error: code = NotFound desc = could not find container \"142fba01de4febc330595f7e2c1285b1458931769cf844f623f286cf074778ce\": container with ID starting with 142fba01de4febc330595f7e2c1285b1458931769cf844f623f286cf074778ce not found: ID does not exist"
Sep 18 22:27:21.095368 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:27:21.095343    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v"]
Sep 18 22:27:21.097755 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:27:21.097731    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-4583f0-656d576d6c-25m5v"]
Sep 18 22:27:21.345947 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:27:21.345867    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53393f62-0b91-484b-a91a-ac4aaaa92f3d" path="/var/lib/kubelet/pods/53393f62-0b91-484b-a91a-ac4aaaa92f3d/volumes"
Sep 18 22:28:03.562591 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:03.562556    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8"]
Sep 18 22:28:03.563083 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:03.562752    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8" podUID="bc95d937-ff26-443a-bd90-c50a39e542c9" containerName="maas-api" containerID="cri-o://3f2e45fcc4d74a93508f1367e9a618d53dc9bd0c7741d1ef84161f3ac78f3c43" gracePeriod=30
Sep 18 22:28:03.732063 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:03.732025    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8"]
Sep 18 22:28:03.732305 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:03.732261    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8" podUID="9e8d9811-15c2-4f2e-b681-2defe2119735" containerName="payload-pre-processing" containerID="cri-o://f4b6e252b0bd7d013c4adf55ceefe8d25efe743fd440f49f6180cccd2ef04c78" gracePeriod=30
Sep 18 22:28:03.867997 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:03.867971    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8"
Sep 18 22:28:03.976340 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:03.976311    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8"
Sep 18 22:28:03.985596 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:03.985569    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc95d937-ff26-443a-bd90-c50a39e542c9-maas-api-tls\") pod \"bc95d937-ff26-443a-bd90-c50a39e542c9\" (UID: \"bc95d937-ff26-443a-bd90-c50a39e542c9\") "
Sep 18 22:28:03.985714 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:03.985625    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rwjm\" (UniqueName: \"kubernetes.io/projected/bc95d937-ff26-443a-bd90-c50a39e542c9-kube-api-access-9rwjm\") pod \"bc95d937-ff26-443a-bd90-c50a39e542c9\" (UID: \"bc95d937-ff26-443a-bd90-c50a39e542c9\") "
Sep 18 22:28:03.985714 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:03.985688    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc95d937-ff26-443a-bd90-c50a39e542c9-openshift-service-ca\") pod \"bc95d937-ff26-443a-bd90-c50a39e542c9\" (UID: \"bc95d937-ff26-443a-bd90-c50a39e542c9\") "
Sep 18 22:28:03.985714 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:03.985706    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc95d937-ff26-443a-bd90-c50a39e542c9-metrics-certs\") pod \"bc95d937-ff26-443a-bd90-c50a39e542c9\" (UID: \"bc95d937-ff26-443a-bd90-c50a39e542c9\") "
Sep 18 22:28:03.986059 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:03.986035    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc95d937-ff26-443a-bd90-c50a39e542c9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bc95d937-ff26-443a-bd90-c50a39e542c9" (UID: "bc95d937-ff26-443a-bd90-c50a39e542c9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:28:03.987841 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:03.987819    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc95d937-ff26-443a-bd90-c50a39e542c9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bc95d937-ff26-443a-bd90-c50a39e542c9" (UID: "bc95d937-ff26-443a-bd90-c50a39e542c9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:28:03.987941 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:03.987926    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc95d937-ff26-443a-bd90-c50a39e542c9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bc95d937-ff26-443a-bd90-c50a39e542c9" (UID: "bc95d937-ff26-443a-bd90-c50a39e542c9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:28:03.988003 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:03.987941    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc95d937-ff26-443a-bd90-c50a39e542c9-kube-api-access-9rwjm" (OuterVolumeSpecName: "kube-api-access-9rwjm") pod "bc95d937-ff26-443a-bd90-c50a39e542c9" (UID: "bc95d937-ff26-443a-bd90-c50a39e542c9"). InnerVolumeSpecName "kube-api-access-9rwjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:28:04.087252 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.087168    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54rkr\" (UniqueName: \"kubernetes.io/projected/9e8d9811-15c2-4f2e-b681-2defe2119735-kube-api-access-54rkr\") pod \"9e8d9811-15c2-4f2e-b681-2defe2119735\" (UID: \"9e8d9811-15c2-4f2e-b681-2defe2119735\") "
Sep 18 22:28:04.087252 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.087224    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e8d9811-15c2-4f2e-b681-2defe2119735-plugins-config-volume\") pod \"9e8d9811-15c2-4f2e-b681-2defe2119735\" (UID: \"9e8d9811-15c2-4f2e-b681-2defe2119735\") "
Sep 18 22:28:04.087549 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.087525    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc95d937-ff26-443a-bd90-c50a39e542c9-maas-api-tls\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:28:04.087549 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.087551    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rwjm\" (UniqueName: \"kubernetes.io/projected/bc95d937-ff26-443a-bd90-c50a39e542c9-kube-api-access-9rwjm\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:28:04.087718 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.087566    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc95d937-ff26-443a-bd90-c50a39e542c9-openshift-service-ca\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:28:04.087718 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.087578    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bc95d937-ff26-443a-bd90-c50a39e542c9-metrics-certs\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:28:04.087718 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.087678    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e8d9811-15c2-4f2e-b681-2defe2119735-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9e8d9811-15c2-4f2e-b681-2defe2119735" (UID: "9e8d9811-15c2-4f2e-b681-2defe2119735"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:28:04.089435 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.089408    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e8d9811-15c2-4f2e-b681-2defe2119735-kube-api-access-54rkr" (OuterVolumeSpecName: "kube-api-access-54rkr") pod "9e8d9811-15c2-4f2e-b681-2defe2119735" (UID: "9e8d9811-15c2-4f2e-b681-2defe2119735"). InnerVolumeSpecName "kube-api-access-54rkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:28:04.188914 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.188885    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54rkr\" (UniqueName: \"kubernetes.io/projected/9e8d9811-15c2-4f2e-b681-2defe2119735-kube-api-access-54rkr\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:28:04.188914 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.188912    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e8d9811-15c2-4f2e-b681-2defe2119735-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:28:04.283456 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.283426    2574 generic.go:356] "Generic (PLEG): container finished" podID="9e8d9811-15c2-4f2e-b681-2defe2119735" containerID="f4b6e252b0bd7d013c4adf55ceefe8d25efe743fd440f49f6180cccd2ef04c78" exitCode=0
Sep 18 22:28:04.283658 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.283469    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8"
Sep 18 22:28:04.283658 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.283539    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8" event={"ID":"9e8d9811-15c2-4f2e-b681-2defe2119735","Type":"ContainerDied","Data":"f4b6e252b0bd7d013c4adf55ceefe8d25efe743fd440f49f6180cccd2ef04c78"}
Sep 18 22:28:04.283658 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.283600    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8" event={"ID":"9e8d9811-15c2-4f2e-b681-2defe2119735","Type":"ContainerDied","Data":"ab0bcfd7c10abf9e22816c8019f7f9769246f892ebb3854c8c39eaab4d9ad7b6"}
Sep 18 22:28:04.283658 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.283628    2574 scope.go:117] "RemoveContainer" containerID="f4b6e252b0bd7d013c4adf55ceefe8d25efe743fd440f49f6180cccd2ef04c78"
Sep 18 22:28:04.284982 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.284961    2574 generic.go:356] "Generic (PLEG): container finished" podID="bc95d937-ff26-443a-bd90-c50a39e542c9" containerID="3f2e45fcc4d74a93508f1367e9a618d53dc9bd0c7741d1ef84161f3ac78f3c43" exitCode=0
Sep 18 22:28:04.285094 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.284996    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8"
Sep 18 22:28:04.285094 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.285054    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8" event={"ID":"bc95d937-ff26-443a-bd90-c50a39e542c9","Type":"ContainerDied","Data":"3f2e45fcc4d74a93508f1367e9a618d53dc9bd0c7741d1ef84161f3ac78f3c43"}
Sep 18 22:28:04.285380 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.285097    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8" event={"ID":"bc95d937-ff26-443a-bd90-c50a39e542c9","Type":"ContainerDied","Data":"96dd572a4fbd1ddce3e73c9b222ed0c22d9dadf4bc0e9797de4f962ea25511c4"}
Sep 18 22:28:04.293262 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.293250    2574 scope.go:117] "RemoveContainer" containerID="f4b6e252b0bd7d013c4adf55ceefe8d25efe743fd440f49f6180cccd2ef04c78"
Sep 18 22:28:04.293562 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:28:04.293544    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4b6e252b0bd7d013c4adf55ceefe8d25efe743fd440f49f6180cccd2ef04c78\": container with ID starting with f4b6e252b0bd7d013c4adf55ceefe8d25efe743fd440f49f6180cccd2ef04c78 not found: ID does not exist" containerID="f4b6e252b0bd7d013c4adf55ceefe8d25efe743fd440f49f6180cccd2ef04c78"
Sep 18 22:28:04.293638 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.293569    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4b6e252b0bd7d013c4adf55ceefe8d25efe743fd440f49f6180cccd2ef04c78"} err="failed to get container status \"f4b6e252b0bd7d013c4adf55ceefe8d25efe743fd440f49f6180cccd2ef04c78\": rpc error: code = NotFound desc = could not find container \"f4b6e252b0bd7d013c4adf55ceefe8d25efe743fd440f49f6180cccd2ef04c78\": container with ID starting with f4b6e252b0bd7d013c4adf55ceefe8d25efe743fd440f49f6180cccd2ef04c78 not found: ID does not exist"
Sep 18 22:28:04.293638 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.293584    2574 scope.go:117] "RemoveContainer" containerID="3f2e45fcc4d74a93508f1367e9a618d53dc9bd0c7741d1ef84161f3ac78f3c43"
Sep 18 22:28:04.301772 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.301756    2574 scope.go:117] "RemoveContainer" containerID="3f2e45fcc4d74a93508f1367e9a618d53dc9bd0c7741d1ef84161f3ac78f3c43"
Sep 18 22:28:04.301978 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:28:04.301964    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f2e45fcc4d74a93508f1367e9a618d53dc9bd0c7741d1ef84161f3ac78f3c43\": container with ID starting with 3f2e45fcc4d74a93508f1367e9a618d53dc9bd0c7741d1ef84161f3ac78f3c43 not found: ID does not exist" containerID="3f2e45fcc4d74a93508f1367e9a618d53dc9bd0c7741d1ef84161f3ac78f3c43"
Sep 18 22:28:04.302025 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.301984    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f2e45fcc4d74a93508f1367e9a618d53dc9bd0c7741d1ef84161f3ac78f3c43"} err="failed to get container status \"3f2e45fcc4d74a93508f1367e9a618d53dc9bd0c7741d1ef84161f3ac78f3c43\": rpc error: code = NotFound desc = could not find container \"3f2e45fcc4d74a93508f1367e9a618d53dc9bd0c7741d1ef84161f3ac78f3c43\": container with ID starting with 3f2e45fcc4d74a93508f1367e9a618d53dc9bd0c7741d1ef84161f3ac78f3c43 not found: ID does not exist"
Sep 18 22:28:04.315228 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.315208    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8"]
Sep 18 22:28:04.323976 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.323952    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-62f806-5d4b6747bf-2d8q8"]
Sep 18 22:28:04.337641 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.337593    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8"]
Sep 18 22:28:04.340638 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:04.340612    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-62f806-85c544dfd-7ght8"]
Sep 18 22:28:05.350704 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:05.350673    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e8d9811-15c2-4f2e-b681-2defe2119735" path="/var/lib/kubelet/pods/9e8d9811-15c2-4f2e-b681-2defe2119735/volumes"
Sep 18 22:28:05.351075 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:05.351049    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc95d937-ff26-443a-bd90-c50a39e542c9" path="/var/lib/kubelet/pods/bc95d937-ff26-443a-bd90-c50a39e542c9/volumes"
Sep 18 22:28:22.704579 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:22.704544    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj"]
Sep 18 22:28:22.704991 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:22.704807    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj" podUID="fdd59b11-07a8-4f74-93fa-0c91912020f2" containerName="maas-api" containerID="cri-o://e3f395defb6d6563b7a6c6a71baa503cf1245fefe44fb8bd506cd990c95d5320" gracePeriod=30
Sep 18 22:28:22.800079 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:22.800048    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh"]
Sep 18 22:28:22.800294 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:22.800255    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh" podUID="235df737-207e-40a9-83a9-5daf2e3f89f3" containerName="payload-processing" containerID="cri-o://1458d7f2af226d3801c83ab7112841c815c94a003f36803cc4069c44c01f0f44" gracePeriod=30
Sep 18 22:28:22.807998 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:22.807665    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw"]
Sep 18 22:28:22.807998 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:22.807869    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw" podUID="4394eb4a-d0b2-4bb0-9a5a-fc8b94019412" containerName="payload-pre-processing" containerID="cri-o://aa1b8c59b54d32041cda2d155c4af5c0e4a4fa6dccb4cd88950e684943b55031" gracePeriod=30
Sep 18 22:28:22.977265 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:22.977200    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj"
Sep 18 22:28:23.055340 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.055311    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdd59b11-07a8-4f74-93fa-0c91912020f2-openshift-service-ca\") pod \"fdd59b11-07a8-4f74-93fa-0c91912020f2\" (UID: \"fdd59b11-07a8-4f74-93fa-0c91912020f2\") "
Sep 18 22:28:23.055340 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.055350    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9l2bx\" (UniqueName: \"kubernetes.io/projected/fdd59b11-07a8-4f74-93fa-0c91912020f2-kube-api-access-9l2bx\") pod \"fdd59b11-07a8-4f74-93fa-0c91912020f2\" (UID: \"fdd59b11-07a8-4f74-93fa-0c91912020f2\") "
Sep 18 22:28:23.055661 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.055387    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fdd59b11-07a8-4f74-93fa-0c91912020f2-metrics-certs\") pod \"fdd59b11-07a8-4f74-93fa-0c91912020f2\" (UID: \"fdd59b11-07a8-4f74-93fa-0c91912020f2\") "
Sep 18 22:28:23.055661 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.055475    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fdd59b11-07a8-4f74-93fa-0c91912020f2-maas-api-tls\") pod \"fdd59b11-07a8-4f74-93fa-0c91912020f2\" (UID: \"fdd59b11-07a8-4f74-93fa-0c91912020f2\") "
Sep 18 22:28:23.055783 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.055762    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdd59b11-07a8-4f74-93fa-0c91912020f2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fdd59b11-07a8-4f74-93fa-0c91912020f2" (UID: "fdd59b11-07a8-4f74-93fa-0c91912020f2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:28:23.058588 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.058558    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdd59b11-07a8-4f74-93fa-0c91912020f2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fdd59b11-07a8-4f74-93fa-0c91912020f2" (UID: "fdd59b11-07a8-4f74-93fa-0c91912020f2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:28:23.059946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.059917    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdd59b11-07a8-4f74-93fa-0c91912020f2-kube-api-access-9l2bx" (OuterVolumeSpecName: "kube-api-access-9l2bx") pod "fdd59b11-07a8-4f74-93fa-0c91912020f2" (UID: "fdd59b11-07a8-4f74-93fa-0c91912020f2"). InnerVolumeSpecName "kube-api-access-9l2bx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:28:23.059946 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.059934    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdd59b11-07a8-4f74-93fa-0c91912020f2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fdd59b11-07a8-4f74-93fa-0c91912020f2" (UID: "fdd59b11-07a8-4f74-93fa-0c91912020f2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:28:23.082343 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.082320    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh"
Sep 18 22:28:23.084223 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.084205    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw"
Sep 18 22:28:23.156099 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.156063    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swvmh\" (UniqueName: \"kubernetes.io/projected/235df737-207e-40a9-83a9-5daf2e3f89f3-kube-api-access-swvmh\") pod \"235df737-207e-40a9-83a9-5daf2e3f89f3\" (UID: \"235df737-207e-40a9-83a9-5daf2e3f89f3\") "
Sep 18 22:28:23.156271 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.156111    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4394eb4a-d0b2-4bb0-9a5a-fc8b94019412-plugins-config-volume\") pod \"4394eb4a-d0b2-4bb0-9a5a-fc8b94019412\" (UID: \"4394eb4a-d0b2-4bb0-9a5a-fc8b94019412\") "
Sep 18 22:28:23.156271 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.156137    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2v7sc\" (UniqueName: \"kubernetes.io/projected/4394eb4a-d0b2-4bb0-9a5a-fc8b94019412-kube-api-access-2v7sc\") pod \"4394eb4a-d0b2-4bb0-9a5a-fc8b94019412\" (UID: \"4394eb4a-d0b2-4bb0-9a5a-fc8b94019412\") "
Sep 18 22:28:23.156271 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.156176    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/235df737-207e-40a9-83a9-5daf2e3f89f3-plugins-config-volume\") pod \"235df737-207e-40a9-83a9-5daf2e3f89f3\" (UID: \"235df737-207e-40a9-83a9-5daf2e3f89f3\") "
Sep 18 22:28:23.156454 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.156324    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdd59b11-07a8-4f74-93fa-0c91912020f2-openshift-service-ca\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:28:23.156454 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.156340    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9l2bx\" (UniqueName: \"kubernetes.io/projected/fdd59b11-07a8-4f74-93fa-0c91912020f2-kube-api-access-9l2bx\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:28:23.156454 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.156355    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fdd59b11-07a8-4f74-93fa-0c91912020f2-metrics-certs\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:28:23.156454 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.156366    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fdd59b11-07a8-4f74-93fa-0c91912020f2-maas-api-tls\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:28:23.156652 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.156530    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4394eb4a-d0b2-4bb0-9a5a-fc8b94019412-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4394eb4a-d0b2-4bb0-9a5a-fc8b94019412" (UID: "4394eb4a-d0b2-4bb0-9a5a-fc8b94019412"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:28:23.156652 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.156555    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/235df737-207e-40a9-83a9-5daf2e3f89f3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "235df737-207e-40a9-83a9-5daf2e3f89f3" (UID: "235df737-207e-40a9-83a9-5daf2e3f89f3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:28:23.158255 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.158237    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/235df737-207e-40a9-83a9-5daf2e3f89f3-kube-api-access-swvmh" (OuterVolumeSpecName: "kube-api-access-swvmh") pod "235df737-207e-40a9-83a9-5daf2e3f89f3" (UID: "235df737-207e-40a9-83a9-5daf2e3f89f3"). InnerVolumeSpecName "kube-api-access-swvmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:28:23.158345 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.158311    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4394eb4a-d0b2-4bb0-9a5a-fc8b94019412-kube-api-access-2v7sc" (OuterVolumeSpecName: "kube-api-access-2v7sc") pod "4394eb4a-d0b2-4bb0-9a5a-fc8b94019412" (UID: "4394eb4a-d0b2-4bb0-9a5a-fc8b94019412"). InnerVolumeSpecName "kube-api-access-2v7sc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:28:23.257218 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.257131    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/235df737-207e-40a9-83a9-5daf2e3f89f3-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:28:23.257218 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.257160    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swvmh\" (UniqueName: \"kubernetes.io/projected/235df737-207e-40a9-83a9-5daf2e3f89f3-kube-api-access-swvmh\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:28:23.257218 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.257170    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4394eb4a-d0b2-4bb0-9a5a-fc8b94019412-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:28:23.257218 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.257180    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2v7sc\" (UniqueName: \"kubernetes.io/projected/4394eb4a-d0b2-4bb0-9a5a-fc8b94019412-kube-api-access-2v7sc\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:28:23.380127 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.380093    2574 generic.go:356] "Generic (PLEG): container finished" podID="235df737-207e-40a9-83a9-5daf2e3f89f3" containerID="1458d7f2af226d3801c83ab7112841c815c94a003f36803cc4069c44c01f0f44" exitCode=0
Sep 18 22:28:23.380273 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.380136    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh"
Sep 18 22:28:23.380273 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.380171    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh" event={"ID":"235df737-207e-40a9-83a9-5daf2e3f89f3","Type":"ContainerDied","Data":"1458d7f2af226d3801c83ab7112841c815c94a003f36803cc4069c44c01f0f44"}
Sep 18 22:28:23.380273 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.380223    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh" event={"ID":"235df737-207e-40a9-83a9-5daf2e3f89f3","Type":"ContainerDied","Data":"c2b784318f9da08a52c69cf553d2106293aa8191bf31e9319161a797c9f6e9ec"}
Sep 18 22:28:23.380273 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.380251    2574 scope.go:117] "RemoveContainer" containerID="1458d7f2af226d3801c83ab7112841c815c94a003f36803cc4069c44c01f0f44"
Sep 18 22:28:23.381492 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.381468    2574 generic.go:356] "Generic (PLEG): container finished" podID="fdd59b11-07a8-4f74-93fa-0c91912020f2" containerID="e3f395defb6d6563b7a6c6a71baa503cf1245fefe44fb8bd506cd990c95d5320" exitCode=0
Sep 18 22:28:23.381634 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.381500    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj" event={"ID":"fdd59b11-07a8-4f74-93fa-0c91912020f2","Type":"ContainerDied","Data":"e3f395defb6d6563b7a6c6a71baa503cf1245fefe44fb8bd506cd990c95d5320"}
Sep 18 22:28:23.381634 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.381541    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj"
Sep 18 22:28:23.381634 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.381568    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj" event={"ID":"fdd59b11-07a8-4f74-93fa-0c91912020f2","Type":"ContainerDied","Data":"140da880910860b6f58ae43e7a083cf8a1c499cf7126ef0d361e2bcccdcd4232"}
Sep 18 22:28:23.383398 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.383378    2574 generic.go:356] "Generic (PLEG): container finished" podID="4394eb4a-d0b2-4bb0-9a5a-fc8b94019412" containerID="aa1b8c59b54d32041cda2d155c4af5c0e4a4fa6dccb4cd88950e684943b55031" exitCode=0
Sep 18 22:28:23.383528 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.383421    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw"
Sep 18 22:28:23.383528 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.383424    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw" event={"ID":"4394eb4a-d0b2-4bb0-9a5a-fc8b94019412","Type":"ContainerDied","Data":"aa1b8c59b54d32041cda2d155c4af5c0e4a4fa6dccb4cd88950e684943b55031"}
Sep 18 22:28:23.383528 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.383457    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw" event={"ID":"4394eb4a-d0b2-4bb0-9a5a-fc8b94019412","Type":"ContainerDied","Data":"993e8b5ea1c31c352e5a02e247feb6e3f72fc6792aec7c7b034286b4b426d880"}
Sep 18 22:28:23.390987 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.390967    2574 scope.go:117] "RemoveContainer" containerID="1458d7f2af226d3801c83ab7112841c815c94a003f36803cc4069c44c01f0f44"
Sep 18 22:28:23.391287 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:28:23.391266    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1458d7f2af226d3801c83ab7112841c815c94a003f36803cc4069c44c01f0f44\": container with ID starting with 1458d7f2af226d3801c83ab7112841c815c94a003f36803cc4069c44c01f0f44 not found: ID does not exist" containerID="1458d7f2af226d3801c83ab7112841c815c94a003f36803cc4069c44c01f0f44"
Sep 18 22:28:23.391352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.391298    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1458d7f2af226d3801c83ab7112841c815c94a003f36803cc4069c44c01f0f44"} err="failed to get container status \"1458d7f2af226d3801c83ab7112841c815c94a003f36803cc4069c44c01f0f44\": rpc error: code = NotFound desc = could not find container \"1458d7f2af226d3801c83ab7112841c815c94a003f36803cc4069c44c01f0f44\": container with ID starting with 1458d7f2af226d3801c83ab7112841c815c94a003f36803cc4069c44c01f0f44 not found: ID does not exist"
Sep 18 22:28:23.391352 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.391316    2574 scope.go:117] "RemoveContainer" containerID="e3f395defb6d6563b7a6c6a71baa503cf1245fefe44fb8bd506cd990c95d5320"
Sep 18 22:28:23.399935 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.399915    2574 scope.go:117] "RemoveContainer" containerID="e3f395defb6d6563b7a6c6a71baa503cf1245fefe44fb8bd506cd990c95d5320"
Sep 18 22:28:23.400221 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:28:23.400201    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3f395defb6d6563b7a6c6a71baa503cf1245fefe44fb8bd506cd990c95d5320\": container with ID starting with e3f395defb6d6563b7a6c6a71baa503cf1245fefe44fb8bd506cd990c95d5320 not found: ID does not exist" containerID="e3f395defb6d6563b7a6c6a71baa503cf1245fefe44fb8bd506cd990c95d5320"
Sep 18 22:28:23.400297 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.400228    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3f395defb6d6563b7a6c6a71baa503cf1245fefe44fb8bd506cd990c95d5320"} err="failed to get container status \"e3f395defb6d6563b7a6c6a71baa503cf1245fefe44fb8bd506cd990c95d5320\": rpc error: code = NotFound desc = could not find container \"e3f395defb6d6563b7a6c6a71baa503cf1245fefe44fb8bd506cd990c95d5320\": container with ID starting with e3f395defb6d6563b7a6c6a71baa503cf1245fefe44fb8bd506cd990c95d5320 not found: ID does not exist"
Sep 18 22:28:23.400297 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.400244    2574 scope.go:117] "RemoveContainer" containerID="aa1b8c59b54d32041cda2d155c4af5c0e4a4fa6dccb4cd88950e684943b55031"
Sep 18 22:28:23.408021 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.408003    2574 scope.go:117] "RemoveContainer" containerID="aa1b8c59b54d32041cda2d155c4af5c0e4a4fa6dccb4cd88950e684943b55031"
Sep 18 22:28:23.408339 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:28:23.408321    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa1b8c59b54d32041cda2d155c4af5c0e4a4fa6dccb4cd88950e684943b55031\": container with ID starting with aa1b8c59b54d32041cda2d155c4af5c0e4a4fa6dccb4cd88950e684943b55031 not found: ID does not exist" containerID="aa1b8c59b54d32041cda2d155c4af5c0e4a4fa6dccb4cd88950e684943b55031"
Sep 18 22:28:23.408403 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.408347    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa1b8c59b54d32041cda2d155c4af5c0e4a4fa6dccb4cd88950e684943b55031"} err="failed to get container status \"aa1b8c59b54d32041cda2d155c4af5c0e4a4fa6dccb4cd88950e684943b55031\": rpc error: code = NotFound desc = could not find container \"aa1b8c59b54d32041cda2d155c4af5c0e4a4fa6dccb4cd88950e684943b55031\": container with ID starting with aa1b8c59b54d32041cda2d155c4af5c0e4a4fa6dccb4cd88950e684943b55031 not found: ID does not exist"
Sep 18 22:28:23.418584 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.418563    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh"]
Sep 18 22:28:23.428756 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.428735    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-aa9dcd-6c8b667b6c-hxrwh"]
Sep 18 22:28:23.461561 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.461535    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw"]
Sep 18 22:28:23.463117 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.463099    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-aa9dcd-59cd7b7dcd-np9nw"]
Sep 18 22:28:23.509481 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.509390    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj"]
Sep 18 22:28:23.518944 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:23.518909    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-aa9dcd-7b45f586cd-w2fsj"]
Sep 18 22:28:25.345799 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:25.345760    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="235df737-207e-40a9-83a9-5daf2e3f89f3" path="/var/lib/kubelet/pods/235df737-207e-40a9-83a9-5daf2e3f89f3/volumes"
Sep 18 22:28:25.346285 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:25.346266    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4394eb4a-d0b2-4bb0-9a5a-fc8b94019412" path="/var/lib/kubelet/pods/4394eb4a-d0b2-4bb0-9a5a-fc8b94019412/volumes"
Sep 18 22:28:25.346698 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:28:25.346681    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdd59b11-07a8-4f74-93fa-0c91912020f2" path="/var/lib/kubelet/pods/fdd59b11-07a8-4f74-93fa-0c91912020f2/volumes"
Sep 18 22:30:01.195452 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:30:01.195402    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-09-18T22:29:51Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-18T22:29:51Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-18T22:29:51Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-09-18T22:29:51Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-141-255.ec2.internal\": Patch \"https://a66ec91cf751f4c1382c481e2fb16083-c3d57fc087862a64.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-141-255.ec2.internal/status?timeout=10s\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 18 22:30:10.032186 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.032151    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7f10d8-29829510-h8qsp"]
Sep 18 22:30:10.032697 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.032500    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="235df737-207e-40a9-83a9-5daf2e3f89f3" containerName="payload-processing"
Sep 18 22:30:10.032697 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.032526    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="235df737-207e-40a9-83a9-5daf2e3f89f3" containerName="payload-processing"
Sep 18 22:30:10.032697 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.032535    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc95d937-ff26-443a-bd90-c50a39e542c9" containerName="maas-api"
Sep 18 22:30:10.032697 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.032540    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc95d937-ff26-443a-bd90-c50a39e542c9" containerName="maas-api"
Sep 18 22:30:10.032697 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.032549    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4394eb4a-d0b2-4bb0-9a5a-fc8b94019412" containerName="payload-pre-processing"
Sep 18 22:30:10.032697 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.032554    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4394eb4a-d0b2-4bb0-9a5a-fc8b94019412" containerName="payload-pre-processing"
Sep 18 22:30:10.032697 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.032563    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdd59b11-07a8-4f74-93fa-0c91912020f2" containerName="maas-api"
Sep 18 22:30:10.032697 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.032568    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdd59b11-07a8-4f74-93fa-0c91912020f2" containerName="maas-api"
Sep 18 22:30:10.032697 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.032580    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53393f62-0b91-484b-a91a-ac4aaaa92f3d" containerName="payload-processing"
Sep 18 22:30:10.032697 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.032585    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="53393f62-0b91-484b-a91a-ac4aaaa92f3d" containerName="payload-processing"
Sep 18 22:30:10.032697 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.032599    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e8d9811-15c2-4f2e-b681-2defe2119735" containerName="payload-pre-processing"
Sep 18 22:30:10.032697 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.032604    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e8d9811-15c2-4f2e-b681-2defe2119735" containerName="payload-pre-processing"
Sep 18 22:30:10.032697 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.032659    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="53393f62-0b91-484b-a91a-ac4aaaa92f3d" containerName="payload-processing"
Sep 18 22:30:10.032697 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.032665    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc95d937-ff26-443a-bd90-c50a39e542c9" containerName="maas-api"
Sep 18 22:30:10.032697 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.032673    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4394eb4a-d0b2-4bb0-9a5a-fc8b94019412" containerName="payload-pre-processing"
Sep 18 22:30:10.032697 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.032680    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdd59b11-07a8-4f74-93fa-0c91912020f2" containerName="maas-api"
Sep 18 22:30:10.032697 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.032686    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e8d9811-15c2-4f2e-b681-2defe2119735" containerName="payload-pre-processing"
Sep 18 22:30:10.032697 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.032692    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="235df737-207e-40a9-83a9-5daf2e3f89f3" containerName="payload-processing"
Sep 18 22:30:10.035676 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.035654    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7f10d8-29829510-h8qsp"
Sep 18 22:30:10.040206 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.040187    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9g7m4\""
Sep 18 22:30:10.044740 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.044720    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7f10d8-29829510-h8qsp"
Sep 18 22:30:10.147196 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.147163    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829510-ks4hj"]
Sep 18 22:30:10.150800 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.150784    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829510-ks4hj"
Sep 18 22:30:10.160572 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.160552    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829510-ks4hj"
Sep 18 22:30:10.750178 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.750148    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829510-ks4hj"]
Sep 18 22:30:10.788469 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:10.788438    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7f10d8-29829510-h8qsp"]
Sep 18 22:30:11.048455 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:11.048432    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829510-ks4hj"]
Sep 18 22:30:11.050852 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:30:11.050825    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5222730d_67d7_4c83_b990_768c89020e97.slice/crio-a8b7c0daf6517ced1b8b0970c69c37aa7cf7e285432e850b67d71c1676e4c886 WatchSource:0}: Error finding container a8b7c0daf6517ced1b8b0970c69c37aa7cf7e285432e850b67d71c1676e4c886: Status 404 returned error can't find the container with id a8b7c0daf6517ced1b8b0970c69c37aa7cf7e285432e850b67d71c1676e4c886
Sep 18 22:30:11.127779 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:11.127757    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7f10d8-29829510-h8qsp"]
Sep 18 22:30:11.129837 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:30:11.129816    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28e6478c_a10b_4d3c_9afe_da5a3dbe7650.slice/crio-82bb06e1399828ed4dbdfdf58ac82ccd8c77dfb8b4bd54aa39b027e7106ae1b1 WatchSource:0}: Error finding container 82bb06e1399828ed4dbdfdf58ac82ccd8c77dfb8b4bd54aa39b027e7106ae1b1: Status 404 returned error can't find the container with id 82bb06e1399828ed4dbdfdf58ac82ccd8c77dfb8b4bd54aa39b027e7106ae1b1
Sep 18 22:30:11.887640 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:11.887601    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7f10d8-29829510-h8qsp" event={"ID":"28e6478c-a10b-4d3c-9afe-da5a3dbe7650","Type":"ContainerStarted","Data":"0efd7ffde62ff850a51632687be3aad86393a49bff6b69a24d1be56ce28d10fe"}
Sep 18 22:30:11.887850 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:11.887669    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7f10d8-29829510-h8qsp" event={"ID":"28e6478c-a10b-4d3c-9afe-da5a3dbe7650","Type":"ContainerStarted","Data":"82bb06e1399828ed4dbdfdf58ac82ccd8c77dfb8b4bd54aa39b027e7106ae1b1"}
Sep 18 22:30:11.889083 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:11.889059    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829510-ks4hj" event={"ID":"5222730d-67d7-4c83-b990-768c89020e97","Type":"ContainerStarted","Data":"73383c7e37cdd9ddd5c86a1ccc50b45e822a46449be9935a09bd1b2ad2dc7047"}
Sep 18 22:30:11.889216 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:11.889099    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829510-ks4hj" event={"ID":"5222730d-67d7-4c83-b990-768c89020e97","Type":"ContainerStarted","Data":"a8b7c0daf6517ced1b8b0970c69c37aa7cf7e285432e850b67d71c1676e4c886"}
Sep 18 22:30:11.919667 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:11.919610    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7f10d8-29829510-h8qsp" podStartSLOduration=2.919595307 podStartE2EDuration="2.919595307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:30:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:30:11.91900023 +0000 UTC m=+1787.050781312" watchObservedRunningTime="2026-09-18 22:30:11.919595307 +0000 UTC m=+1787.051376388"
Sep 18 22:30:11.940820 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:11.940772    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829510-ks4hj" podStartSLOduration=1.940759446 podStartE2EDuration="1.940759446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:30:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:30:11.939368491 +0000 UTC m=+1787.071149585" watchObservedRunningTime="2026-09-18 22:30:11.940759446 +0000 UTC m=+1787.072540584"
Sep 18 22:30:12.896614 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:12.896581    2574 generic.go:356] "Generic (PLEG): container finished" podID="28e6478c-a10b-4d3c-9afe-da5a3dbe7650" containerID="0efd7ffde62ff850a51632687be3aad86393a49bff6b69a24d1be56ce28d10fe" exitCode=0
Sep 18 22:30:12.897053 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:12.896673    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7f10d8-29829510-h8qsp" event={"ID":"28e6478c-a10b-4d3c-9afe-da5a3dbe7650","Type":"ContainerDied","Data":"0efd7ffde62ff850a51632687be3aad86393a49bff6b69a24d1be56ce28d10fe"}
Sep 18 22:30:12.898083 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:12.898057    2574 generic.go:356] "Generic (PLEG): container finished" podID="5222730d-67d7-4c83-b990-768c89020e97" containerID="73383c7e37cdd9ddd5c86a1ccc50b45e822a46449be9935a09bd1b2ad2dc7047" exitCode=0
Sep 18 22:30:12.898203 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:12.898132    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829510-ks4hj" event={"ID":"5222730d-67d7-4c83-b990-768c89020e97","Type":"ContainerDied","Data":"73383c7e37cdd9ddd5c86a1ccc50b45e822a46449be9935a09bd1b2ad2dc7047"}
Sep 18 22:30:14.036156 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:14.036132    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829510-ks4hj"
Sep 18 22:30:14.063031 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:14.063009    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7f10d8-29829510-h8qsp"
Sep 18 22:30:14.909135 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:14.909103    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7f10d8-29829510-h8qsp"
Sep 18 22:30:14.909135 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:14.909116    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7f10d8-29829510-h8qsp" event={"ID":"28e6478c-a10b-4d3c-9afe-da5a3dbe7650","Type":"ContainerDied","Data":"82bb06e1399828ed4dbdfdf58ac82ccd8c77dfb8b4bd54aa39b027e7106ae1b1"}
Sep 18 22:30:14.909383 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:14.909165    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82bb06e1399828ed4dbdfdf58ac82ccd8c77dfb8b4bd54aa39b027e7106ae1b1"
Sep 18 22:30:14.910445 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:14.910417    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829510-ks4hj"
Sep 18 22:30:14.910445 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:14.910425    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829510-ks4hj" event={"ID":"5222730d-67d7-4c83-b990-768c89020e97","Type":"ContainerDied","Data":"a8b7c0daf6517ced1b8b0970c69c37aa7cf7e285432e850b67d71c1676e4c886"}
Sep 18 22:30:14.910630 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:14.910471    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8b7c0daf6517ced1b8b0970c69c37aa7cf7e285432e850b67d71c1676e4c886"
Sep 18 22:30:20.614525 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.614429    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf"]
Sep 18 22:30:20.614969 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.614870    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5222730d-67d7-4c83-b990-768c89020e97" containerName="cleanup"
Sep 18 22:30:20.614969 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.614885    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5222730d-67d7-4c83-b990-768c89020e97" containerName="cleanup"
Sep 18 22:30:20.614969 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.614905    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28e6478c-a10b-4d3c-9afe-da5a3dbe7650" containerName="cleanup"
Sep 18 22:30:20.614969 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.614910    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="28e6478c-a10b-4d3c-9afe-da5a3dbe7650" containerName="cleanup"
Sep 18 22:30:20.614969 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.614966    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="28e6478c-a10b-4d3c-9afe-da5a3dbe7650" containerName="cleanup"
Sep 18 22:30:20.615166 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.614974    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5222730d-67d7-4c83-b990-768c89020e97" containerName="cleanup"
Sep 18 22:30:20.618113 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.618097    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf"
Sep 18 22:30:20.628808 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.628790    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-adba81-serving-cert\""
Sep 18 22:30:20.629386 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.629356    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 18 22:30:20.629589 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.629576    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 22:30:20.629589 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.629581    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-c6l9h\""
Sep 18 22:30:20.632604 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.632589    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 18 22:30:20.633914 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.633897    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7866bfc2-792a-4606-a58e-c570a852c24b-maas-api-tls\") pod \"maas-api-e2e-ipp-a-adba81-6764978566-dj8rf\" (UID: \"7866bfc2-792a-4606-a58e-c570a852c24b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf"
Sep 18 22:30:20.633971 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.633955    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7866bfc2-792a-4606-a58e-c570a852c24b-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-adba81-6764978566-dj8rf\" (UID: \"7866bfc2-792a-4606-a58e-c570a852c24b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf"
Sep 18 22:30:20.634014 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.633997    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7866bfc2-792a-4606-a58e-c570a852c24b-metrics-certs\") pod \"maas-api-e2e-ipp-a-adba81-6764978566-dj8rf\" (UID: \"7866bfc2-792a-4606-a58e-c570a852c24b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf"
Sep 18 22:30:20.634049 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.634031    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx9bv\" (UniqueName: \"kubernetes.io/projected/7866bfc2-792a-4606-a58e-c570a852c24b-kube-api-access-mx9bv\") pod \"maas-api-e2e-ipp-a-adba81-6764978566-dj8rf\" (UID: \"7866bfc2-792a-4606-a58e-c570a852c24b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf"
Sep 18 22:30:20.639838 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.639816    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf"]
Sep 18 22:30:20.734799 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.734766    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7866bfc2-792a-4606-a58e-c570a852c24b-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-adba81-6764978566-dj8rf\" (UID: \"7866bfc2-792a-4606-a58e-c570a852c24b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf"
Sep 18 22:30:20.734799 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.734809    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7866bfc2-792a-4606-a58e-c570a852c24b-metrics-certs\") pod \"maas-api-e2e-ipp-a-adba81-6764978566-dj8rf\" (UID: \"7866bfc2-792a-4606-a58e-c570a852c24b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf"
Sep 18 22:30:20.735034 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.734832    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx9bv\" (UniqueName: \"kubernetes.io/projected/7866bfc2-792a-4606-a58e-c570a852c24b-kube-api-access-mx9bv\") pod \"maas-api-e2e-ipp-a-adba81-6764978566-dj8rf\" (UID: \"7866bfc2-792a-4606-a58e-c570a852c24b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf"
Sep 18 22:30:20.735034 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.734876    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7866bfc2-792a-4606-a58e-c570a852c24b-maas-api-tls\") pod \"maas-api-e2e-ipp-a-adba81-6764978566-dj8rf\" (UID: \"7866bfc2-792a-4606-a58e-c570a852c24b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf"
Sep 18 22:30:20.735676 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.735583    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7866bfc2-792a-4606-a58e-c570a852c24b-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-adba81-6764978566-dj8rf\" (UID: \"7866bfc2-792a-4606-a58e-c570a852c24b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf"
Sep 18 22:30:20.737694 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.737674    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7866bfc2-792a-4606-a58e-c570a852c24b-metrics-certs\") pod \"maas-api-e2e-ipp-a-adba81-6764978566-dj8rf\" (UID: \"7866bfc2-792a-4606-a58e-c570a852c24b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf"
Sep 18 22:30:20.737800 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.737723    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7866bfc2-792a-4606-a58e-c570a852c24b-maas-api-tls\") pod \"maas-api-e2e-ipp-a-adba81-6764978566-dj8rf\" (UID: \"7866bfc2-792a-4606-a58e-c570a852c24b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf"
Sep 18 22:30:20.746830 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.746798    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx9bv\" (UniqueName: \"kubernetes.io/projected/7866bfc2-792a-4606-a58e-c570a852c24b-kube-api-access-mx9bv\") pod \"maas-api-e2e-ipp-a-adba81-6764978566-dj8rf\" (UID: \"7866bfc2-792a-4606-a58e-c570a852c24b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf"
Sep 18 22:30:20.928826 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:20.928792    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf"
Sep 18 22:30:21.245294 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:30:21.245263    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7866bfc2_792a_4606_a58e_c570a852c24b.slice/crio-ad2eb85067419edc61fad008337af8523416c33aee1131f5be65152c02b0d79c WatchSource:0}: Error finding container ad2eb85067419edc61fad008337af8523416c33aee1131f5be65152c02b0d79c: Status 404 returned error can't find the container with id ad2eb85067419edc61fad008337af8523416c33aee1131f5be65152c02b0d79c
Sep 18 22:30:21.245972 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:21.245947    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf"]
Sep 18 22:30:21.246574 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:21.246559    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 22:30:21.946679 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:21.946643    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf" event={"ID":"7866bfc2-792a-4606-a58e-c570a852c24b","Type":"ContainerStarted","Data":"438a26c1e8d1f6f7360f50fbf16e1825da1d2087cb4925b6081b2b4da33aaa80"}
Sep 18 22:30:21.947143 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:21.946701    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf" event={"ID":"7866bfc2-792a-4606-a58e-c570a852c24b","Type":"ContainerStarted","Data":"ad2eb85067419edc61fad008337af8523416c33aee1131f5be65152c02b0d79c"}
Sep 18 22:30:21.947143 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:21.946729    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf"
Sep 18 22:30:21.983215 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:21.983166    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf" podStartSLOduration=1.591598941 podStartE2EDuration="1.983149855s" totalImagesPullingTime="391.550914ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:30:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:30:21.982454045 +0000 UTC m=+1797.114235127" watchObservedRunningTime="2026-09-18 22:30:21.983149855 +0000 UTC m=+1797.114930937"
Sep 18 22:30:22.403236 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:22.403163    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75"]
Sep 18 22:30:22.406651 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:22.406635    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75"
Sep 18 22:30:22.409826 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:22.409807    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-adba81-dockercfg-h7ssx\""
Sep 18 22:30:22.410425 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:22.410412    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-adba81\""
Sep 18 22:30:22.420616 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:22.420595    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75"]
Sep 18 22:30:22.451437 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:22.451413    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pbpz\" (UniqueName: \"kubernetes.io/projected/be737660-a2b3-4c5f-b20d-0ed8af1544c2-kube-api-access-2pbpz\") pod \"payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75\" (UID: \"be737660-a2b3-4c5f-b20d-0ed8af1544c2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75"
Sep 18 22:30:22.451582 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:22.451490    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be737660-a2b3-4c5f-b20d-0ed8af1544c2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75\" (UID: \"be737660-a2b3-4c5f-b20d-0ed8af1544c2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75"
Sep 18 22:30:22.551969 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:22.551941    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pbpz\" (UniqueName: \"kubernetes.io/projected/be737660-a2b3-4c5f-b20d-0ed8af1544c2-kube-api-access-2pbpz\") pod \"payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75\" (UID: \"be737660-a2b3-4c5f-b20d-0ed8af1544c2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75"
Sep 18 22:30:22.552102 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:22.552011    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be737660-a2b3-4c5f-b20d-0ed8af1544c2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75\" (UID: \"be737660-a2b3-4c5f-b20d-0ed8af1544c2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75"
Sep 18 22:30:22.552643 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:22.552625    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be737660-a2b3-4c5f-b20d-0ed8af1544c2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75\" (UID: \"be737660-a2b3-4c5f-b20d-0ed8af1544c2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75"
Sep 18 22:30:22.570886 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:22.570865    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pbpz\" (UniqueName: \"kubernetes.io/projected/be737660-a2b3-4c5f-b20d-0ed8af1544c2-kube-api-access-2pbpz\") pod \"payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75\" (UID: \"be737660-a2b3-4c5f-b20d-0ed8af1544c2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75"
Sep 18 22:30:22.717323 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:22.717298    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75"
Sep 18 22:30:23.020923 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:23.020900    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75"]
Sep 18 22:30:23.023349 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:30:23.023323    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe737660_a2b3_4c5f_b20d_0ed8af1544c2.slice/crio-6cfd788d254fcd09516452efaab58b2ea217dd921b5df70eab181b66bcdb96ef WatchSource:0}: Error finding container 6cfd788d254fcd09516452efaab58b2ea217dd921b5df70eab181b66bcdb96ef: Status 404 returned error can't find the container with id 6cfd788d254fcd09516452efaab58b2ea217dd921b5df70eab181b66bcdb96ef
Sep 18 22:30:23.961062 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:23.961029    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75" event={"ID":"be737660-a2b3-4c5f-b20d-0ed8af1544c2","Type":"ContainerStarted","Data":"d9d25dee437ff74db22a1ffdf96eaed5a1f0212a08bd833e1c6814ef4a5a220b"}
Sep 18 22:30:23.961246 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:23.961076    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75" event={"ID":"be737660-a2b3-4c5f-b20d-0ed8af1544c2","Type":"ContainerStarted","Data":"6cfd788d254fcd09516452efaab58b2ea217dd921b5df70eab181b66bcdb96ef"}
Sep 18 22:30:23.961246 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:23.961164    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75"
Sep 18 22:30:23.986071 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:23.986019    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75" podStartSLOduration=1.986003208 podStartE2EDuration="1.986003208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:30:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:30:23.984739849 +0000 UTC m=+1799.116520932" watchObservedRunningTime="2026-09-18 22:30:23.986003208 +0000 UTC m=+1799.117784341"
Sep 18 22:30:27.959208 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:27.959175    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf"
Sep 18 22:30:34.968294 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:34.968263    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75"
Sep 18 22:30:53.967950 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:53.967910    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2"]
Sep 18 22:30:53.972791 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:53.972766    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2"
Sep 18 22:30:53.975362 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:53.975343    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-58a8ca\""
Sep 18 22:30:53.975769 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:53.975752    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-58a8ca-dockercfg-ddbnm\""
Sep 18 22:30:53.984166 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:53.984142    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2"]
Sep 18 22:30:54.138998 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:54.138960    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77f320cb-b46b-494b-92be-d32e7b46009d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2\" (UID: \"77f320cb-b46b-494b-92be-d32e7b46009d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2"
Sep 18 22:30:54.139166 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:54.139088    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjn9m\" (UniqueName: \"kubernetes.io/projected/77f320cb-b46b-494b-92be-d32e7b46009d-kube-api-access-hjn9m\") pod \"payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2\" (UID: \"77f320cb-b46b-494b-92be-d32e7b46009d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2"
Sep 18 22:30:54.240170 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:54.240080    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77f320cb-b46b-494b-92be-d32e7b46009d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2\" (UID: \"77f320cb-b46b-494b-92be-d32e7b46009d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2"
Sep 18 22:30:54.240170 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:54.240170    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjn9m\" (UniqueName: \"kubernetes.io/projected/77f320cb-b46b-494b-92be-d32e7b46009d-kube-api-access-hjn9m\") pod \"payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2\" (UID: \"77f320cb-b46b-494b-92be-d32e7b46009d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2"
Sep 18 22:30:54.240849 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:54.240828    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77f320cb-b46b-494b-92be-d32e7b46009d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2\" (UID: \"77f320cb-b46b-494b-92be-d32e7b46009d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2"
Sep 18 22:30:54.258435 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:54.258408    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjn9m\" (UniqueName: \"kubernetes.io/projected/77f320cb-b46b-494b-92be-d32e7b46009d-kube-api-access-hjn9m\") pod \"payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2\" (UID: \"77f320cb-b46b-494b-92be-d32e7b46009d\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2"
Sep 18 22:30:54.283426 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:54.283393    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2"
Sep 18 22:30:54.562714 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:54.562687    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2"]
Sep 18 22:30:54.565047 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:30:54.565016    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77f320cb_b46b_494b_92be_d32e7b46009d.slice/crio-f75649f7ac3ec12173dbb29220f681bb484a7d4e07098f4aa8d20ac06fba420e WatchSource:0}: Error finding container f75649f7ac3ec12173dbb29220f681bb484a7d4e07098f4aa8d20ac06fba420e: Status 404 returned error can't find the container with id f75649f7ac3ec12173dbb29220f681bb484a7d4e07098f4aa8d20ac06fba420e
Sep 18 22:30:55.129068 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:55.129028    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2" event={"ID":"77f320cb-b46b-494b-92be-d32e7b46009d","Type":"ContainerStarted","Data":"f374bcd91a064d5161748aedac76589ae00e906c27555adbb57e8e9db62882fa"}
Sep 18 22:30:55.129574 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:55.129097    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2" event={"ID":"77f320cb-b46b-494b-92be-d32e7b46009d","Type":"ContainerStarted","Data":"f75649f7ac3ec12173dbb29220f681bb484a7d4e07098f4aa8d20ac06fba420e"}
Sep 18 22:30:55.129574 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:55.129125    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2"
Sep 18 22:30:55.163524 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:30:55.163450    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2" podStartSLOduration=2.163435013 podStartE2EDuration="2.163435013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:30:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:30:55.160893927 +0000 UTC m=+1830.292675010" watchObservedRunningTime="2026-09-18 22:30:55.163435013 +0000 UTC m=+1830.295216095"
Sep 18 22:31:06.136096 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:31:06.136061    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2"
Sep 18 22:31:25.088842 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:31:25.088813    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-z62nt_8d3bcc3f-e11d-43d7-b7a9-6204cbd617ac/payload-processing/0.log"
Sep 18 22:31:25.211379 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:31:25.211350    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2_77f320cb-b46b-494b-92be-d32e7b46009d/payload-processing/0.log"
Sep 18 22:32:06.527048 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:06.527013    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75_be737660-a2b3-4c5f-b20d-0ed8af1544c2/payload-processing/0.log"
Sep 18 22:32:06.655118 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:06.655091    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-z62nt_8d3bcc3f-e11d-43d7-b7a9-6204cbd617ac/payload-processing/0.log"
Sep 18 22:32:06.784771 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:06.784699    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2_77f320cb-b46b-494b-92be-d32e7b46009d/payload-processing/0.log"
Sep 18 22:32:06.912192 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:06.912167    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2_77f320cb-b46b-494b-92be-d32e7b46009d/payload-processing/0.log"
Sep 18 22:32:15.673294 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:15.673264    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr"]
Sep 18 22:32:15.676753 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:15.676733    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr"
Sep 18 22:32:15.678914 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:15.678892    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-3aa245-serving-cert\""
Sep 18 22:32:15.689314 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:15.689289    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr"]
Sep 18 22:32:15.772691 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:15.772651    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fac85902-5349-44fa-bbf4-6d655cab61d6-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr\" (UID: \"fac85902-5349-44fa-bbf4-6d655cab61d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr"
Sep 18 22:32:15.772691 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:15.772688    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dxxq\" (UniqueName: \"kubernetes.io/projected/fac85902-5349-44fa-bbf4-6d655cab61d6-kube-api-access-9dxxq\") pod \"maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr\" (UID: \"fac85902-5349-44fa-bbf4-6d655cab61d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr"
Sep 18 22:32:15.772902 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:15.772713    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac85902-5349-44fa-bbf4-6d655cab61d6-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr\" (UID: \"fac85902-5349-44fa-bbf4-6d655cab61d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr"
Sep 18 22:32:15.772902 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:15.772808    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fac85902-5349-44fa-bbf4-6d655cab61d6-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr\" (UID: \"fac85902-5349-44fa-bbf4-6d655cab61d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr"
Sep 18 22:32:15.874035 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:15.873996    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fac85902-5349-44fa-bbf4-6d655cab61d6-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr\" (UID: \"fac85902-5349-44fa-bbf4-6d655cab61d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr"
Sep 18 22:32:15.874035 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:15.874041    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dxxq\" (UniqueName: \"kubernetes.io/projected/fac85902-5349-44fa-bbf4-6d655cab61d6-kube-api-access-9dxxq\") pod \"maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr\" (UID: \"fac85902-5349-44fa-bbf4-6d655cab61d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr"
Sep 18 22:32:15.874259 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:15.874063    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac85902-5349-44fa-bbf4-6d655cab61d6-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr\" (UID: \"fac85902-5349-44fa-bbf4-6d655cab61d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr"
Sep 18 22:32:15.874259 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:15.874098    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fac85902-5349-44fa-bbf4-6d655cab61d6-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr\" (UID: \"fac85902-5349-44fa-bbf4-6d655cab61d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr"
Sep 18 22:32:15.874259 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:32:15.874149    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-serving-cert: secret "maas-api-e2e-ipp-cleanup-3aa245-serving-cert" not found
Sep 18 22:32:15.874259 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:32:15.874222    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fac85902-5349-44fa-bbf4-6d655cab61d6-maas-api-tls podName:fac85902-5349-44fa-bbf4-6d655cab61d6 nodeName:}" failed. No retries permitted until 2026-09-18 22:32:16.374205159 +0000 UTC m=+1911.505986221 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fac85902-5349-44fa-bbf4-6d655cab61d6-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr" (UID: "fac85902-5349-44fa-bbf4-6d655cab61d6") : secret "maas-api-e2e-ipp-cleanup-3aa245-serving-cert" not found
Sep 18 22:32:15.874764 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:15.874735    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fac85902-5349-44fa-bbf4-6d655cab61d6-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr\" (UID: \"fac85902-5349-44fa-bbf4-6d655cab61d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr"
Sep 18 22:32:15.876770 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:15.876752    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac85902-5349-44fa-bbf4-6d655cab61d6-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr\" (UID: \"fac85902-5349-44fa-bbf4-6d655cab61d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr"
Sep 18 22:32:15.885303 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:15.885276    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dxxq\" (UniqueName: \"kubernetes.io/projected/fac85902-5349-44fa-bbf4-6d655cab61d6-kube-api-access-9dxxq\") pod \"maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr\" (UID: \"fac85902-5349-44fa-bbf4-6d655cab61d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr"
Sep 18 22:32:16.380114 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:16.380075    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fac85902-5349-44fa-bbf4-6d655cab61d6-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr\" (UID: \"fac85902-5349-44fa-bbf4-6d655cab61d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr"
Sep 18 22:32:16.382605 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:16.382584    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fac85902-5349-44fa-bbf4-6d655cab61d6-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr\" (UID: \"fac85902-5349-44fa-bbf4-6d655cab61d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr"
Sep 18 22:32:16.590558 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:16.590523    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr"
Sep 18 22:32:16.867272 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:16.867244    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr"]
Sep 18 22:32:16.869784 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:32:16.869761    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfac85902_5349_44fa_bbf4_6d655cab61d6.slice/crio-54f3a90ddd7400faa12728efde525dcb6765862681272a040497c14abb1f6fe2 WatchSource:0}: Error finding container 54f3a90ddd7400faa12728efde525dcb6765862681272a040497c14abb1f6fe2: Status 404 returned error can't find the container with id 54f3a90ddd7400faa12728efde525dcb6765862681272a040497c14abb1f6fe2
Sep 18 22:32:17.538334 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:17.538109    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr" event={"ID":"fac85902-5349-44fa-bbf4-6d655cab61d6","Type":"ContainerStarted","Data":"ed1cc3acac19aed0985973e15718c1c3c470fed7f154c9f735d77fb9684728d2"}
Sep 18 22:32:17.538334 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:17.538178    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr" event={"ID":"fac85902-5349-44fa-bbf4-6d655cab61d6","Type":"ContainerStarted","Data":"54f3a90ddd7400faa12728efde525dcb6765862681272a040497c14abb1f6fe2"}
Sep 18 22:32:17.538635 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:17.538364    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr"
Sep 18 22:32:17.570843 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:17.570789    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr" podStartSLOduration=2.224052477 podStartE2EDuration="2.570773037s" totalImagesPullingTime="346.72056ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:32:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:32:17.568052281 +0000 UTC m=+1912.699833364" watchObservedRunningTime="2026-09-18 22:32:17.570773037 +0000 UTC m=+1912.702554118"
Sep 18 22:32:23.548982 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:23.548952    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr"
Sep 18 22:32:53.438233 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:53.438198    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr"]
Sep 18 22:32:53.438822 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:53.438443    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr" podUID="fac85902-5349-44fa-bbf4-6d655cab61d6" containerName="maas-api" containerID="cri-o://ed1cc3acac19aed0985973e15718c1c3c470fed7f154c9f735d77fb9684728d2" gracePeriod=30
Sep 18 22:32:53.544709 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:53.544667    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr" podUID="fac85902-5349-44fa-bbf4-6d655cab61d6" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.75:8443/health\": dial tcp 10.134.0.75:8443: connect: connection refused"
Sep 18 22:32:53.691346 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:53.691286    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr"
Sep 18 22:32:53.715847 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:53.715798    2574 generic.go:356] "Generic (PLEG): container finished" podID="fac85902-5349-44fa-bbf4-6d655cab61d6" containerID="ed1cc3acac19aed0985973e15718c1c3c470fed7f154c9f735d77fb9684728d2" exitCode=0
Sep 18 22:32:53.716002 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:53.715865    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr"
Sep 18 22:32:53.716002 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:53.715909    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr" event={"ID":"fac85902-5349-44fa-bbf4-6d655cab61d6","Type":"ContainerDied","Data":"ed1cc3acac19aed0985973e15718c1c3c470fed7f154c9f735d77fb9684728d2"}
Sep 18 22:32:53.716002 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:53.715978    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr" event={"ID":"fac85902-5349-44fa-bbf4-6d655cab61d6","Type":"ContainerDied","Data":"54f3a90ddd7400faa12728efde525dcb6765862681272a040497c14abb1f6fe2"}
Sep 18 22:32:53.716142 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:53.716007    2574 scope.go:117] "RemoveContainer" containerID="ed1cc3acac19aed0985973e15718c1c3c470fed7f154c9f735d77fb9684728d2"
Sep 18 22:32:53.726184 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:53.726161    2574 scope.go:117] "RemoveContainer" containerID="ed1cc3acac19aed0985973e15718c1c3c470fed7f154c9f735d77fb9684728d2"
Sep 18 22:32:53.726540 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:32:53.726495    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed1cc3acac19aed0985973e15718c1c3c470fed7f154c9f735d77fb9684728d2\": container with ID starting with ed1cc3acac19aed0985973e15718c1c3c470fed7f154c9f735d77fb9684728d2 not found: ID does not exist" containerID="ed1cc3acac19aed0985973e15718c1c3c470fed7f154c9f735d77fb9684728d2"
Sep 18 22:32:53.726601 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:53.726548    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed1cc3acac19aed0985973e15718c1c3c470fed7f154c9f735d77fb9684728d2"} err="failed to get container status \"ed1cc3acac19aed0985973e15718c1c3c470fed7f154c9f735d77fb9684728d2\": rpc error: code = NotFound desc = could not find container \"ed1cc3acac19aed0985973e15718c1c3c470fed7f154c9f735d77fb9684728d2\": container with ID starting with ed1cc3acac19aed0985973e15718c1c3c470fed7f154c9f735d77fb9684728d2 not found: ID does not exist"
Sep 18 22:32:53.806909 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:53.806879    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fac85902-5349-44fa-bbf4-6d655cab61d6-maas-api-tls\") pod \"fac85902-5349-44fa-bbf4-6d655cab61d6\" (UID: \"fac85902-5349-44fa-bbf4-6d655cab61d6\") "
Sep 18 22:32:53.807083 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:53.806967    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fac85902-5349-44fa-bbf4-6d655cab61d6-openshift-service-ca\") pod \"fac85902-5349-44fa-bbf4-6d655cab61d6\" (UID: \"fac85902-5349-44fa-bbf4-6d655cab61d6\") "
Sep 18 22:32:53.807083 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:53.807002    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac85902-5349-44fa-bbf4-6d655cab61d6-metrics-certs\") pod \"fac85902-5349-44fa-bbf4-6d655cab61d6\" (UID: \"fac85902-5349-44fa-bbf4-6d655cab61d6\") "
Sep 18 22:32:53.807083 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:53.807029    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dxxq\" (UniqueName: \"kubernetes.io/projected/fac85902-5349-44fa-bbf4-6d655cab61d6-kube-api-access-9dxxq\") pod \"fac85902-5349-44fa-bbf4-6d655cab61d6\" (UID: \"fac85902-5349-44fa-bbf4-6d655cab61d6\") "
Sep 18 22:32:53.807418 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:53.807381    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fac85902-5349-44fa-bbf4-6d655cab61d6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fac85902-5349-44fa-bbf4-6d655cab61d6" (UID: "fac85902-5349-44fa-bbf4-6d655cab61d6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:32:53.809413 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:53.809380    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fac85902-5349-44fa-bbf4-6d655cab61d6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fac85902-5349-44fa-bbf4-6d655cab61d6" (UID: "fac85902-5349-44fa-bbf4-6d655cab61d6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:32:53.809574 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:53.809421    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fac85902-5349-44fa-bbf4-6d655cab61d6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fac85902-5349-44fa-bbf4-6d655cab61d6" (UID: "fac85902-5349-44fa-bbf4-6d655cab61d6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:32:53.809638 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:53.809600    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fac85902-5349-44fa-bbf4-6d655cab61d6-kube-api-access-9dxxq" (OuterVolumeSpecName: "kube-api-access-9dxxq") pod "fac85902-5349-44fa-bbf4-6d655cab61d6" (UID: "fac85902-5349-44fa-bbf4-6d655cab61d6"). InnerVolumeSpecName "kube-api-access-9dxxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:32:53.907648 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:53.907622    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fac85902-5349-44fa-bbf4-6d655cab61d6-maas-api-tls\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:32:53.907648 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:53.907647    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fac85902-5349-44fa-bbf4-6d655cab61d6-openshift-service-ca\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:32:53.907648 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:53.907656    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fac85902-5349-44fa-bbf4-6d655cab61d6-metrics-certs\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:32:53.907896 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:53.907665    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dxxq\" (UniqueName: \"kubernetes.io/projected/fac85902-5349-44fa-bbf4-6d655cab61d6-kube-api-access-9dxxq\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:32:54.043186 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:54.043151    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr"]
Sep 18 22:32:54.048457 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:54.048430    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3aa245-5bb8cb58c6-vggmr"]
Sep 18 22:32:55.346648 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:32:55.346616    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fac85902-5349-44fa-bbf4-6d655cab61d6" path="/var/lib/kubelet/pods/fac85902-5349-44fa-bbf4-6d655cab61d6/volumes"
Sep 18 22:33:20.591374 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:20.591286    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf"]
Sep 18 22:33:20.591888 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:20.591561    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf" podUID="7866bfc2-792a-4606-a58e-c570a852c24b" containerName="maas-api" containerID="cri-o://438a26c1e8d1f6f7360f50fbf16e1825da1d2087cb4925b6081b2b4da33aaa80" gracePeriod=30
Sep 18 22:33:20.655215 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:20.655179    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75"]
Sep 18 22:33:20.655438 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:20.655394    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75" podUID="be737660-a2b3-4c5f-b20d-0ed8af1544c2" containerName="payload-processing" containerID="cri-o://d9d25dee437ff74db22a1ffdf96eaed5a1f0212a08bd833e1c6814ef4a5a220b" gracePeriod=30
Sep 18 22:33:20.853805 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:20.853727    2574 generic.go:356] "Generic (PLEG): container finished" podID="be737660-a2b3-4c5f-b20d-0ed8af1544c2" containerID="d9d25dee437ff74db22a1ffdf96eaed5a1f0212a08bd833e1c6814ef4a5a220b" exitCode=0
Sep 18 22:33:20.853961 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:20.853801    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75" event={"ID":"be737660-a2b3-4c5f-b20d-0ed8af1544c2","Type":"ContainerDied","Data":"d9d25dee437ff74db22a1ffdf96eaed5a1f0212a08bd833e1c6814ef4a5a220b"}
Sep 18 22:33:20.855904 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:20.855879    2574 generic.go:356] "Generic (PLEG): container finished" podID="7866bfc2-792a-4606-a58e-c570a852c24b" containerID="438a26c1e8d1f6f7360f50fbf16e1825da1d2087cb4925b6081b2b4da33aaa80" exitCode=0
Sep 18 22:33:20.856033 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:20.855964    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf" event={"ID":"7866bfc2-792a-4606-a58e-c570a852c24b","Type":"ContainerDied","Data":"438a26c1e8d1f6f7360f50fbf16e1825da1d2087cb4925b6081b2b4da33aaa80"}
Sep 18 22:33:20.912220 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:20.912195    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf"
Sep 18 22:33:20.936125 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:20.936102    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75"
Sep 18 22:33:20.962036 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:20.962001    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pbpz\" (UniqueName: \"kubernetes.io/projected/be737660-a2b3-4c5f-b20d-0ed8af1544c2-kube-api-access-2pbpz\") pod \"be737660-a2b3-4c5f-b20d-0ed8af1544c2\" (UID: \"be737660-a2b3-4c5f-b20d-0ed8af1544c2\") "
Sep 18 22:33:20.962206 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:20.962044    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7866bfc2-792a-4606-a58e-c570a852c24b-metrics-certs\") pod \"7866bfc2-792a-4606-a58e-c570a852c24b\" (UID: \"7866bfc2-792a-4606-a58e-c570a852c24b\") "
Sep 18 22:33:20.962206 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:20.962072    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mx9bv\" (UniqueName: \"kubernetes.io/projected/7866bfc2-792a-4606-a58e-c570a852c24b-kube-api-access-mx9bv\") pod \"7866bfc2-792a-4606-a58e-c570a852c24b\" (UID: \"7866bfc2-792a-4606-a58e-c570a852c24b\") "
Sep 18 22:33:20.962206 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:20.962095    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7866bfc2-792a-4606-a58e-c570a852c24b-maas-api-tls\") pod \"7866bfc2-792a-4606-a58e-c570a852c24b\" (UID: \"7866bfc2-792a-4606-a58e-c570a852c24b\") "
Sep 18 22:33:20.962206 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:20.962127    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7866bfc2-792a-4606-a58e-c570a852c24b-openshift-service-ca\") pod \"7866bfc2-792a-4606-a58e-c570a852c24b\" (UID: \"7866bfc2-792a-4606-a58e-c570a852c24b\") "
Sep 18 22:33:20.962206 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:20.962202    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be737660-a2b3-4c5f-b20d-0ed8af1544c2-plugins-config-volume\") pod \"be737660-a2b3-4c5f-b20d-0ed8af1544c2\" (UID: \"be737660-a2b3-4c5f-b20d-0ed8af1544c2\") "
Sep 18 22:33:20.962751 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:20.962717    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7866bfc2-792a-4606-a58e-c570a852c24b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7866bfc2-792a-4606-a58e-c570a852c24b" (UID: "7866bfc2-792a-4606-a58e-c570a852c24b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:33:20.963030 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:20.962801    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be737660-a2b3-4c5f-b20d-0ed8af1544c2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "be737660-a2b3-4c5f-b20d-0ed8af1544c2" (UID: "be737660-a2b3-4c5f-b20d-0ed8af1544c2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:33:20.964630 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:20.964575    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7866bfc2-792a-4606-a58e-c570a852c24b-kube-api-access-mx9bv" (OuterVolumeSpecName: "kube-api-access-mx9bv") pod "7866bfc2-792a-4606-a58e-c570a852c24b" (UID: "7866bfc2-792a-4606-a58e-c570a852c24b"). InnerVolumeSpecName "kube-api-access-mx9bv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:33:20.964630 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:20.964613    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7866bfc2-792a-4606-a58e-c570a852c24b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7866bfc2-792a-4606-a58e-c570a852c24b" (UID: "7866bfc2-792a-4606-a58e-c570a852c24b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:33:20.964880 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:20.964860    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7866bfc2-792a-4606-a58e-c570a852c24b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7866bfc2-792a-4606-a58e-c570a852c24b" (UID: "7866bfc2-792a-4606-a58e-c570a852c24b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:33:20.964880 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:20.964865    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be737660-a2b3-4c5f-b20d-0ed8af1544c2-kube-api-access-2pbpz" (OuterVolumeSpecName: "kube-api-access-2pbpz") pod "be737660-a2b3-4c5f-b20d-0ed8af1544c2" (UID: "be737660-a2b3-4c5f-b20d-0ed8af1544c2"). InnerVolumeSpecName "kube-api-access-2pbpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:33:21.063776 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:21.063737    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be737660-a2b3-4c5f-b20d-0ed8af1544c2-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:33:21.063776 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:21.063767    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pbpz\" (UniqueName: \"kubernetes.io/projected/be737660-a2b3-4c5f-b20d-0ed8af1544c2-kube-api-access-2pbpz\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:33:21.063776 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:21.063776    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7866bfc2-792a-4606-a58e-c570a852c24b-metrics-certs\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:33:21.063776 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:21.063785    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mx9bv\" (UniqueName: \"kubernetes.io/projected/7866bfc2-792a-4606-a58e-c570a852c24b-kube-api-access-mx9bv\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:33:21.064108 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:21.063795    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7866bfc2-792a-4606-a58e-c570a852c24b-maas-api-tls\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:33:21.064108 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:21.063804    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7866bfc2-792a-4606-a58e-c570a852c24b-openshift-service-ca\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:33:21.862519 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:21.862466    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75"
Sep 18 22:33:21.863012 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:21.862499    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75" event={"ID":"be737660-a2b3-4c5f-b20d-0ed8af1544c2","Type":"ContainerDied","Data":"6cfd788d254fcd09516452efaab58b2ea217dd921b5df70eab181b66bcdb96ef"}
Sep 18 22:33:21.863012 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:21.862593    2574 scope.go:117] "RemoveContainer" containerID="d9d25dee437ff74db22a1ffdf96eaed5a1f0212a08bd833e1c6814ef4a5a220b"
Sep 18 22:33:21.872082 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:21.872045    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf" event={"ID":"7866bfc2-792a-4606-a58e-c570a852c24b","Type":"ContainerDied","Data":"ad2eb85067419edc61fad008337af8523416c33aee1131f5be65152c02b0d79c"}
Sep 18 22:33:21.872202 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:21.872144    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf"
Sep 18 22:33:21.878178 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:21.878158    2574 scope.go:117] "RemoveContainer" containerID="438a26c1e8d1f6f7360f50fbf16e1825da1d2087cb4925b6081b2b4da33aaa80"
Sep 18 22:33:21.917108 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:21.917077    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75"]
Sep 18 22:33:21.923339 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:21.923303    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-adba81-795f4bc679-rlb75"]
Sep 18 22:33:21.944233 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:21.944195    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf"]
Sep 18 22:33:21.951193 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:21.951162    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-adba81-6764978566-dj8rf"]
Sep 18 22:33:23.346325 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:23.346291    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7866bfc2-792a-4606-a58e-c570a852c24b" path="/var/lib/kubelet/pods/7866bfc2-792a-4606-a58e-c570a852c24b/volumes"
Sep 18 22:33:23.346730 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:33:23.346659    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be737660-a2b3-4c5f-b20d-0ed8af1544c2" path="/var/lib/kubelet/pods/be737660-a2b3-4c5f-b20d-0ed8af1544c2/volumes"
Sep 18 22:34:11.188380 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:11.188345    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-58a8ca-87g4n"]
Sep 18 22:34:11.188878 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:11.188760    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fac85902-5349-44fa-bbf4-6d655cab61d6" containerName="maas-api"
Sep 18 22:34:11.188878 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:11.188775    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fac85902-5349-44fa-bbf4-6d655cab61d6" containerName="maas-api"
Sep 18 22:34:11.188878 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:11.188785    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be737660-a2b3-4c5f-b20d-0ed8af1544c2" containerName="payload-processing"
Sep 18 22:34:11.188878 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:11.188792    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="be737660-a2b3-4c5f-b20d-0ed8af1544c2" containerName="payload-processing"
Sep 18 22:34:11.188878 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:11.188802    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7866bfc2-792a-4606-a58e-c570a852c24b" containerName="maas-api"
Sep 18 22:34:11.188878 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:11.188807    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7866bfc2-792a-4606-a58e-c570a852c24b" containerName="maas-api"
Sep 18 22:34:11.189071 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:11.188883    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fac85902-5349-44fa-bbf4-6d655cab61d6" containerName="maas-api"
Sep 18 22:34:11.189071 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:11.188894    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="be737660-a2b3-4c5f-b20d-0ed8af1544c2" containerName="payload-processing"
Sep 18 22:34:11.189071 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:11.188902    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7866bfc2-792a-4606-a58e-c570a852c24b" containerName="maas-api"
Sep 18 22:34:11.192139 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:11.192122    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-58a8ca-87g4n"
Sep 18 22:34:11.196299 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:11.196265    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 22:34:11.196299 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:11.196265    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9g7m4\""
Sep 18 22:34:11.204145 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:11.204117    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff5d29e2-0fb4-469a-860f-108f6a1547b8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-58a8ca-87g4n\" (UID: \"ff5d29e2-0fb4-469a-860f-108f6a1547b8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-58a8ca-87g4n"
Sep 18 22:34:11.206282 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:11.206255    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-58a8ca-87g4n"]
Sep 18 22:34:11.304814 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:11.304777    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff5d29e2-0fb4-469a-860f-108f6a1547b8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-58a8ca-87g4n\" (UID: \"ff5d29e2-0fb4-469a-860f-108f6a1547b8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-58a8ca-87g4n"
Sep 18 22:34:11.305357 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:11.305338    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff5d29e2-0fb4-469a-860f-108f6a1547b8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-58a8ca-87g4n\" (UID: \"ff5d29e2-0fb4-469a-860f-108f6a1547b8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-58a8ca-87g4n"
Sep 18 22:34:11.502417 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:11.502331    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-58a8ca-87g4n"
Sep 18 22:34:11.833054 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:11.832977    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-58a8ca-87g4n"]
Sep 18 22:34:11.836448 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:34:11.836415    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff5d29e2_0fb4_469a_860f_108f6a1547b8.slice/crio-d381758b9420922f0d9ed2b8d355cea17cedbe198bb9efc8fbda9b94893aa1cc WatchSource:0}: Error finding container d381758b9420922f0d9ed2b8d355cea17cedbe198bb9efc8fbda9b94893aa1cc: Status 404 returned error can't find the container with id d381758b9420922f0d9ed2b8d355cea17cedbe198bb9efc8fbda9b94893aa1cc
Sep 18 22:34:12.116723 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:12.116631    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-58a8ca-87g4n" event={"ID":"ff5d29e2-0fb4-469a-860f-108f6a1547b8","Type":"ContainerStarted","Data":"9762c64ee702882e6b4dd2f039b0fafb569939d300dd5a86e0918889dbff63fb"}
Sep 18 22:34:12.116723 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:12.116687    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-58a8ca-87g4n" event={"ID":"ff5d29e2-0fb4-469a-860f-108f6a1547b8","Type":"ContainerStarted","Data":"d381758b9420922f0d9ed2b8d355cea17cedbe198bb9efc8fbda9b94893aa1cc"}
Sep 18 22:34:12.136363 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:12.136313    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-58a8ca-87g4n" podStartSLOduration=1.136298631 podStartE2EDuration="1.136298631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:34:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:34:12.135656716 +0000 UTC m=+2027.267437797" watchObservedRunningTime="2026-09-18 22:34:12.136298631 +0000 UTC m=+2027.268079712"
Sep 18 22:34:13.123199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:13.123164    2574 generic.go:356] "Generic (PLEG): container finished" podID="ff5d29e2-0fb4-469a-860f-108f6a1547b8" containerID="9762c64ee702882e6b4dd2f039b0fafb569939d300dd5a86e0918889dbff63fb" exitCode=0
Sep 18 22:34:13.123199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:13.123203    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-58a8ca-87g4n" event={"ID":"ff5d29e2-0fb4-469a-860f-108f6a1547b8","Type":"ContainerDied","Data":"9762c64ee702882e6b4dd2f039b0fafb569939d300dd5a86e0918889dbff63fb"}
Sep 18 22:34:14.260286 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:14.260256    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-58a8ca-87g4n"
Sep 18 22:34:14.329371 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:14.329330    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff5d29e2-0fb4-469a-860f-108f6a1547b8-maas-api-service-ca\") pod \"ff5d29e2-0fb4-469a-860f-108f6a1547b8\" (UID: \"ff5d29e2-0fb4-469a-860f-108f6a1547b8\") "
Sep 18 22:34:14.329730 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:14.329704    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff5d29e2-0fb4-469a-860f-108f6a1547b8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ff5d29e2-0fb4-469a-860f-108f6a1547b8" (UID: "ff5d29e2-0fb4-469a-860f-108f6a1547b8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:34:14.430091 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:14.430062    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff5d29e2-0fb4-469a-860f-108f6a1547b8-maas-api-service-ca\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:34:15.134787 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:15.134749    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-58a8ca-87g4n" event={"ID":"ff5d29e2-0fb4-469a-860f-108f6a1547b8","Type":"ContainerDied","Data":"d381758b9420922f0d9ed2b8d355cea17cedbe198bb9efc8fbda9b94893aa1cc"}
Sep 18 22:34:15.134961 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:15.134804    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d381758b9420922f0d9ed2b8d355cea17cedbe198bb9efc8fbda9b94893aa1cc"
Sep 18 22:34:15.134961 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:15.134757    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-58a8ca-87g4n"
Sep 18 22:34:21.912733 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:21.912697    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2"]
Sep 18 22:34:21.913260 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:21.912944    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2" podUID="77f320cb-b46b-494b-92be-d32e7b46009d" containerName="payload-processing" containerID="cri-o://f374bcd91a064d5161748aedac76589ae00e906c27555adbb57e8e9db62882fa" gracePeriod=30
Sep 18 22:34:22.168693 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:22.168620    2574 generic.go:356] "Generic (PLEG): container finished" podID="77f320cb-b46b-494b-92be-d32e7b46009d" containerID="f374bcd91a064d5161748aedac76589ae00e906c27555adbb57e8e9db62882fa" exitCode=0
Sep 18 22:34:22.168802 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:22.168680    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2" event={"ID":"77f320cb-b46b-494b-92be-d32e7b46009d","Type":"ContainerDied","Data":"f374bcd91a064d5161748aedac76589ae00e906c27555adbb57e8e9db62882fa"}
Sep 18 22:34:22.168802 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:22.168746    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2" event={"ID":"77f320cb-b46b-494b-92be-d32e7b46009d","Type":"ContainerDied","Data":"f75649f7ac3ec12173dbb29220f681bb484a7d4e07098f4aa8d20ac06fba420e"}
Sep 18 22:34:22.168802 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:22.168774    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f75649f7ac3ec12173dbb29220f681bb484a7d4e07098f4aa8d20ac06fba420e"
Sep 18 22:34:22.175154 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:22.175135    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2"
Sep 18 22:34:22.300331 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:22.300303    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77f320cb-b46b-494b-92be-d32e7b46009d-plugins-config-volume\") pod \"77f320cb-b46b-494b-92be-d32e7b46009d\" (UID: \"77f320cb-b46b-494b-92be-d32e7b46009d\") "
Sep 18 22:34:22.300535 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:22.300410    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjn9m\" (UniqueName: \"kubernetes.io/projected/77f320cb-b46b-494b-92be-d32e7b46009d-kube-api-access-hjn9m\") pod \"77f320cb-b46b-494b-92be-d32e7b46009d\" (UID: \"77f320cb-b46b-494b-92be-d32e7b46009d\") "
Sep 18 22:34:22.300765 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:22.300745    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77f320cb-b46b-494b-92be-d32e7b46009d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "77f320cb-b46b-494b-92be-d32e7b46009d" (UID: "77f320cb-b46b-494b-92be-d32e7b46009d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:34:22.302685 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:22.302665    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77f320cb-b46b-494b-92be-d32e7b46009d-kube-api-access-hjn9m" (OuterVolumeSpecName: "kube-api-access-hjn9m") pod "77f320cb-b46b-494b-92be-d32e7b46009d" (UID: "77f320cb-b46b-494b-92be-d32e7b46009d"). InnerVolumeSpecName "kube-api-access-hjn9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:34:22.325591 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:22.325560    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-58a8ca-87g4n"]
Sep 18 22:34:22.330227 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:22.330199    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-58a8ca-87g4n"]
Sep 18 22:34:22.401460 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:22.401433    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjn9m\" (UniqueName: \"kubernetes.io/projected/77f320cb-b46b-494b-92be-d32e7b46009d-kube-api-access-hjn9m\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:34:22.401460 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:22.401457    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77f320cb-b46b-494b-92be-d32e7b46009d-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:34:23.173736 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:23.173703    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2"
Sep 18 22:34:23.200830 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:23.200799    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2"]
Sep 18 22:34:23.217856 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:23.217832    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-58a8ca-5465987875-hbpl2"]
Sep 18 22:34:23.345906 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:23.345874    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77f320cb-b46b-494b-92be-d32e7b46009d" path="/var/lib/kubelet/pods/77f320cb-b46b-494b-92be-d32e7b46009d/volumes"
Sep 18 22:34:23.346201 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:23.346188    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff5d29e2-0fb4-469a-860f-108f6a1547b8" path="/var/lib/kubelet/pods/ff5d29e2-0fb4-469a-860f-108f6a1547b8/volumes"
Sep 18 22:34:29.792045 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:29.792005    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-123a30-hzb7r"]
Sep 18 22:34:29.792420 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:29.792358    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77f320cb-b46b-494b-92be-d32e7b46009d" containerName="payload-processing"
Sep 18 22:34:29.792420 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:29.792369    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="77f320cb-b46b-494b-92be-d32e7b46009d" containerName="payload-processing"
Sep 18 22:34:29.792420 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:29.792378    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff5d29e2-0fb4-469a-860f-108f6a1547b8" containerName="revoke-keys"
Sep 18 22:34:29.792420 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:29.792383    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff5d29e2-0fb4-469a-860f-108f6a1547b8" containerName="revoke-keys"
Sep 18 22:34:29.792574 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:29.792461    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="77f320cb-b46b-494b-92be-d32e7b46009d" containerName="payload-processing"
Sep 18 22:34:29.792574 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:29.792469    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff5d29e2-0fb4-469a-860f-108f6a1547b8" containerName="revoke-keys"
Sep 18 22:34:29.795407 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:29.795391    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-123a30-hzb7r"
Sep 18 22:34:29.803544 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:29.803524    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 22:34:29.803805 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:29.803791    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9g7m4\""
Sep 18 22:34:29.818618 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:29.818590    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-123a30-hzb7r"]
Sep 18 22:34:29.862851 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:29.862819    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ae95885-b23e-45d3-ac5e-55954b38fb6e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-123a30-hzb7r\" (UID: \"9ae95885-b23e-45d3-ac5e-55954b38fb6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-123a30-hzb7r"
Sep 18 22:34:29.964172 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:29.964131    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ae95885-b23e-45d3-ac5e-55954b38fb6e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-123a30-hzb7r\" (UID: \"9ae95885-b23e-45d3-ac5e-55954b38fb6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-123a30-hzb7r"
Sep 18 22:34:29.965263 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:29.965239    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ae95885-b23e-45d3-ac5e-55954b38fb6e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-123a30-hzb7r\" (UID: \"9ae95885-b23e-45d3-ac5e-55954b38fb6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-123a30-hzb7r"
Sep 18 22:34:30.105013 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:30.104933    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-123a30-hzb7r"
Sep 18 22:34:30.378198 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:30.378116    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-123a30-hzb7r"]
Sep 18 22:34:30.380854 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:34:30.380827    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ae95885_b23e_45d3_ac5e_55954b38fb6e.slice/crio-a571aec18388711bfd1f9a22b04611347cd3795a243e492a229d84c753e3f500 WatchSource:0}: Error finding container a571aec18388711bfd1f9a22b04611347cd3795a243e492a229d84c753e3f500: Status 404 returned error can't find the container with id a571aec18388711bfd1f9a22b04611347cd3795a243e492a229d84c753e3f500
Sep 18 22:34:31.221667 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:31.221586    2574 generic.go:356] "Generic (PLEG): container finished" podID="9ae95885-b23e-45d3-ac5e-55954b38fb6e" containerID="c28334c12c18610dcf3fd0e5b2f5c96b8b591bb8d7e921dc44dc0f897d4d4af8" exitCode=0
Sep 18 22:34:31.222011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:31.221684    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-123a30-hzb7r" event={"ID":"9ae95885-b23e-45d3-ac5e-55954b38fb6e","Type":"ContainerDied","Data":"c28334c12c18610dcf3fd0e5b2f5c96b8b591bb8d7e921dc44dc0f897d4d4af8"}
Sep 18 22:34:31.222011 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:31.221752    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-123a30-hzb7r" event={"ID":"9ae95885-b23e-45d3-ac5e-55954b38fb6e","Type":"ContainerStarted","Data":"a571aec18388711bfd1f9a22b04611347cd3795a243e492a229d84c753e3f500"}
Sep 18 22:34:32.362690 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:32.362651    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-123a30-hzb7r"
Sep 18 22:34:32.483812 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:32.483707    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ae95885-b23e-45d3-ac5e-55954b38fb6e-maas-api-service-ca\") pod \"9ae95885-b23e-45d3-ac5e-55954b38fb6e\" (UID: \"9ae95885-b23e-45d3-ac5e-55954b38fb6e\") "
Sep 18 22:34:32.484107 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:32.484080    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ae95885-b23e-45d3-ac5e-55954b38fb6e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9ae95885-b23e-45d3-ac5e-55954b38fb6e" (UID: "9ae95885-b23e-45d3-ac5e-55954b38fb6e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:34:32.585171 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:32.585124    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ae95885-b23e-45d3-ac5e-55954b38fb6e-maas-api-service-ca\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:34:33.233329 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:33.233287    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-123a30-hzb7r" event={"ID":"9ae95885-b23e-45d3-ac5e-55954b38fb6e","Type":"ContainerDied","Data":"a571aec18388711bfd1f9a22b04611347cd3795a243e492a229d84c753e3f500"}
Sep 18 22:34:33.233329 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:33.233336    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a571aec18388711bfd1f9a22b04611347cd3795a243e492a229d84c753e3f500"
Sep 18 22:34:33.233556 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:33.233302    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-123a30-hzb7r"
Sep 18 22:34:40.487877 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:40.487841    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk"]
Sep 18 22:34:40.488341 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:40.488238    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk" podUID="6bb06bb0-2361-4bae-a7e4-9874bf395cdf" containerName="payload-pre-processing" containerID="cri-o://f58aad5ab5d2a74b1abd254b000c3121ab976d4a2d88d1b4e567b1f2d16e0685" gracePeriod=30
Sep 18 22:34:40.750950 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:40.750885    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk"
Sep 18 22:34:40.860295 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:40.860270    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6bb06bb0-2361-4bae-a7e4-9874bf395cdf-plugins-config-volume\") pod \"6bb06bb0-2361-4bae-a7e4-9874bf395cdf\" (UID: \"6bb06bb0-2361-4bae-a7e4-9874bf395cdf\") "
Sep 18 22:34:40.860474 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:40.860384    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vw77k\" (UniqueName: \"kubernetes.io/projected/6bb06bb0-2361-4bae-a7e4-9874bf395cdf-kube-api-access-vw77k\") pod \"6bb06bb0-2361-4bae-a7e4-9874bf395cdf\" (UID: \"6bb06bb0-2361-4bae-a7e4-9874bf395cdf\") "
Sep 18 22:34:40.860728 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:40.860704    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bb06bb0-2361-4bae-a7e4-9874bf395cdf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6bb06bb0-2361-4bae-a7e4-9874bf395cdf" (UID: "6bb06bb0-2361-4bae-a7e4-9874bf395cdf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:34:40.862566 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:40.862541    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bb06bb0-2361-4bae-a7e4-9874bf395cdf-kube-api-access-vw77k" (OuterVolumeSpecName: "kube-api-access-vw77k") pod "6bb06bb0-2361-4bae-a7e4-9874bf395cdf" (UID: "6bb06bb0-2361-4bae-a7e4-9874bf395cdf"). InnerVolumeSpecName "kube-api-access-vw77k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:34:40.884700 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:40.884671    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-123a30-hzb7r"]
Sep 18 22:34:40.890307 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:40.890285    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-123a30-hzb7r"]
Sep 18 22:34:40.961191 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:40.961155    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vw77k\" (UniqueName: \"kubernetes.io/projected/6bb06bb0-2361-4bae-a7e4-9874bf395cdf-kube-api-access-vw77k\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:34:40.961191 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:40.961183    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6bb06bb0-2361-4bae-a7e4-9874bf395cdf-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:34:41.272320 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:41.272285    2574 generic.go:356] "Generic (PLEG): container finished" podID="6bb06bb0-2361-4bae-a7e4-9874bf395cdf" containerID="f58aad5ab5d2a74b1abd254b000c3121ab976d4a2d88d1b4e567b1f2d16e0685" exitCode=0
Sep 18 22:34:41.272496 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:41.272327    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk"
Sep 18 22:34:41.272496 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:41.272381    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk" event={"ID":"6bb06bb0-2361-4bae-a7e4-9874bf395cdf","Type":"ContainerDied","Data":"f58aad5ab5d2a74b1abd254b000c3121ab976d4a2d88d1b4e567b1f2d16e0685"}
Sep 18 22:34:41.272496 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:41.272437    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk" event={"ID":"6bb06bb0-2361-4bae-a7e4-9874bf395cdf","Type":"ContainerDied","Data":"05265ccc00d5e4e42584b89a383741fcaf90d534b97962fe485ce3d46ae72100"}
Sep 18 22:34:41.272496 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:41.272465    2574 scope.go:117] "RemoveContainer" containerID="f58aad5ab5d2a74b1abd254b000c3121ab976d4a2d88d1b4e567b1f2d16e0685"
Sep 18 22:34:41.281794 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:41.281776    2574 scope.go:117] "RemoveContainer" containerID="f58aad5ab5d2a74b1abd254b000c3121ab976d4a2d88d1b4e567b1f2d16e0685"
Sep 18 22:34:41.282082 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:34:41.282062    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f58aad5ab5d2a74b1abd254b000c3121ab976d4a2d88d1b4e567b1f2d16e0685\": container with ID starting with f58aad5ab5d2a74b1abd254b000c3121ab976d4a2d88d1b4e567b1f2d16e0685 not found: ID does not exist" containerID="f58aad5ab5d2a74b1abd254b000c3121ab976d4a2d88d1b4e567b1f2d16e0685"
Sep 18 22:34:41.282133 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:41.282090    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f58aad5ab5d2a74b1abd254b000c3121ab976d4a2d88d1b4e567b1f2d16e0685"} err="failed to get container status \"f58aad5ab5d2a74b1abd254b000c3121ab976d4a2d88d1b4e567b1f2d16e0685\": rpc error: code = NotFound desc = could not find container \"f58aad5ab5d2a74b1abd254b000c3121ab976d4a2d88d1b4e567b1f2d16e0685\": container with ID starting with f58aad5ab5d2a74b1abd254b000c3121ab976d4a2d88d1b4e567b1f2d16e0685 not found: ID does not exist"
Sep 18 22:34:41.310194 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:41.310171    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk"]
Sep 18 22:34:41.330497 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:41.330470    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-123a30-c75879546-l8ntk"]
Sep 18 22:34:41.346113 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:41.346091    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bb06bb0-2361-4bae-a7e4-9874bf395cdf" path="/var/lib/kubelet/pods/6bb06bb0-2361-4bae-a7e4-9874bf395cdf/volumes"
Sep 18 22:34:41.346478 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:34:41.346457    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ae95885-b23e-45d3-ac5e-55954b38fb6e" path="/var/lib/kubelet/pods/9ae95885-b23e-45d3-ac5e-55954b38fb6e/volumes"
Sep 18 22:35:00.399865 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:00.399787    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7f10d8-29829510-h8qsp"]
Sep 18 22:35:00.404211 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:00.404185    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7f10d8-29829510-h8qsp"]
Sep 18 22:35:00.462133 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:00.462101    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2"]
Sep 18 22:35:00.462368 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:00.462327    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2" podUID="3bbb6f4f-e8ec-4272-878d-32bc7bb220aa" containerName="payload-processing" containerID="cri-o://91a3bbfd08daa1a535214c123cd4b9cbfa73d814088e4cc95f4f16721aaaf801" gracePeriod=30
Sep 18 22:35:00.502696 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:00.502670    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf"]
Sep 18 22:35:00.502918 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:00.502877    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf" podUID="96968c3d-5d91-4d1a-a0b0-f923f47b006b" containerName="payload-pre-processing" containerID="cri-o://b4a322604a78e46b03a4f3ca42c181a816d596242d474b3226dc4a3f80e2dc50" gracePeriod=30
Sep 18 22:35:00.774735 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:00.774702    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2"
Sep 18 22:35:00.778176 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:00.778157    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf"
Sep 18 22:35:00.836677 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:00.836650    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbdnx\" (UniqueName: \"kubernetes.io/projected/3bbb6f4f-e8ec-4272-878d-32bc7bb220aa-kube-api-access-mbdnx\") pod \"3bbb6f4f-e8ec-4272-878d-32bc7bb220aa\" (UID: \"3bbb6f4f-e8ec-4272-878d-32bc7bb220aa\") "
Sep 18 22:35:00.836831 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:00.836692    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4t4tk\" (UniqueName: \"kubernetes.io/projected/96968c3d-5d91-4d1a-a0b0-f923f47b006b-kube-api-access-4t4tk\") pod \"96968c3d-5d91-4d1a-a0b0-f923f47b006b\" (UID: \"96968c3d-5d91-4d1a-a0b0-f923f47b006b\") "
Sep 18 22:35:00.836831 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:00.836728    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96968c3d-5d91-4d1a-a0b0-f923f47b006b-plugins-config-volume\") pod \"96968c3d-5d91-4d1a-a0b0-f923f47b006b\" (UID: \"96968c3d-5d91-4d1a-a0b0-f923f47b006b\") "
Sep 18 22:35:00.836831 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:00.836770    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bbb6f4f-e8ec-4272-878d-32bc7bb220aa-plugins-config-volume\") pod \"3bbb6f4f-e8ec-4272-878d-32bc7bb220aa\" (UID: \"3bbb6f4f-e8ec-4272-878d-32bc7bb220aa\") "
Sep 18 22:35:00.837130 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:00.837104    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96968c3d-5d91-4d1a-a0b0-f923f47b006b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "96968c3d-5d91-4d1a-a0b0-f923f47b006b" (UID: "96968c3d-5d91-4d1a-a0b0-f923f47b006b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:35:00.837193 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:00.837145    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bbb6f4f-e8ec-4272-878d-32bc7bb220aa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3bbb6f4f-e8ec-4272-878d-32bc7bb220aa" (UID: "3bbb6f4f-e8ec-4272-878d-32bc7bb220aa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:35:00.838911 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:00.838890    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96968c3d-5d91-4d1a-a0b0-f923f47b006b-kube-api-access-4t4tk" (OuterVolumeSpecName: "kube-api-access-4t4tk") pod "96968c3d-5d91-4d1a-a0b0-f923f47b006b" (UID: "96968c3d-5d91-4d1a-a0b0-f923f47b006b"). InnerVolumeSpecName "kube-api-access-4t4tk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:35:00.839016 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:00.838919    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bbb6f4f-e8ec-4272-878d-32bc7bb220aa-kube-api-access-mbdnx" (OuterVolumeSpecName: "kube-api-access-mbdnx") pod "3bbb6f4f-e8ec-4272-878d-32bc7bb220aa" (UID: "3bbb6f4f-e8ec-4272-878d-32bc7bb220aa"). InnerVolumeSpecName "kube-api-access-mbdnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:35:00.937417 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:00.937329    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbdnx\" (UniqueName: \"kubernetes.io/projected/3bbb6f4f-e8ec-4272-878d-32bc7bb220aa-kube-api-access-mbdnx\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:35:00.937417 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:00.937357    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4t4tk\" (UniqueName: \"kubernetes.io/projected/96968c3d-5d91-4d1a-a0b0-f923f47b006b-kube-api-access-4t4tk\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:35:00.937417 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:00.937371    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96968c3d-5d91-4d1a-a0b0-f923f47b006b-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:35:00.937417 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:00.937382    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bbb6f4f-e8ec-4272-878d-32bc7bb220aa-plugins-config-volume\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:35:01.346788 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:01.346715    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28e6478c-a10b-4d3c-9afe-da5a3dbe7650" path="/var/lib/kubelet/pods/28e6478c-a10b-4d3c-9afe-da5a3dbe7650/volumes"
Sep 18 22:35:01.372455 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:01.372430    2574 generic.go:356] "Generic (PLEG): container finished" podID="96968c3d-5d91-4d1a-a0b0-f923f47b006b" containerID="b4a322604a78e46b03a4f3ca42c181a816d596242d474b3226dc4a3f80e2dc50" exitCode=0
Sep 18 22:35:01.372589 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:01.372472    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf"
Sep 18 22:35:01.372589 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:01.372476    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf" event={"ID":"96968c3d-5d91-4d1a-a0b0-f923f47b006b","Type":"ContainerDied","Data":"b4a322604a78e46b03a4f3ca42c181a816d596242d474b3226dc4a3f80e2dc50"}
Sep 18 22:35:01.372589 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:01.372544    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf" event={"ID":"96968c3d-5d91-4d1a-a0b0-f923f47b006b","Type":"ContainerDied","Data":"84e78b7a2f876b1f3d07f3e87ea3bd5793d1cfae3453bbb9612cd58695ec4854"}
Sep 18 22:35:01.372589 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:01.372571    2574 scope.go:117] "RemoveContainer" containerID="b4a322604a78e46b03a4f3ca42c181a816d596242d474b3226dc4a3f80e2dc50"
Sep 18 22:35:01.374018 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:01.373996    2574 generic.go:356] "Generic (PLEG): container finished" podID="3bbb6f4f-e8ec-4272-878d-32bc7bb220aa" containerID="91a3bbfd08daa1a535214c123cd4b9cbfa73d814088e4cc95f4f16721aaaf801" exitCode=0
Sep 18 22:35:01.374139 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:01.374046    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2"
Sep 18 22:35:01.374139 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:01.374067    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2" event={"ID":"3bbb6f4f-e8ec-4272-878d-32bc7bb220aa","Type":"ContainerDied","Data":"91a3bbfd08daa1a535214c123cd4b9cbfa73d814088e4cc95f4f16721aaaf801"}
Sep 18 22:35:01.374139 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:01.374104    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2" event={"ID":"3bbb6f4f-e8ec-4272-878d-32bc7bb220aa","Type":"ContainerDied","Data":"442cff81adf02078633f24e0f5c6aefad0e384a73362ffee046395d99d8036ab"}
Sep 18 22:35:01.381699 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:01.381673    2574 scope.go:117] "RemoveContainer" containerID="b4a322604a78e46b03a4f3ca42c181a816d596242d474b3226dc4a3f80e2dc50"
Sep 18 22:35:01.381968 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:35:01.381949    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4a322604a78e46b03a4f3ca42c181a816d596242d474b3226dc4a3f80e2dc50\": container with ID starting with b4a322604a78e46b03a4f3ca42c181a816d596242d474b3226dc4a3f80e2dc50 not found: ID does not exist" containerID="b4a322604a78e46b03a4f3ca42c181a816d596242d474b3226dc4a3f80e2dc50"
Sep 18 22:35:01.382052 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:01.381980    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4a322604a78e46b03a4f3ca42c181a816d596242d474b3226dc4a3f80e2dc50"} err="failed to get container status \"b4a322604a78e46b03a4f3ca42c181a816d596242d474b3226dc4a3f80e2dc50\": rpc error: code = NotFound desc = could not find container \"b4a322604a78e46b03a4f3ca42c181a816d596242d474b3226dc4a3f80e2dc50\": container with ID starting with b4a322604a78e46b03a4f3ca42c181a816d596242d474b3226dc4a3f80e2dc50 not found: ID does not exist"
Sep 18 22:35:01.382052 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:01.382001    2574 scope.go:117] "RemoveContainer" containerID="91a3bbfd08daa1a535214c123cd4b9cbfa73d814088e4cc95f4f16721aaaf801"
Sep 18 22:35:01.389516 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:01.389485    2574 scope.go:117] "RemoveContainer" containerID="91a3bbfd08daa1a535214c123cd4b9cbfa73d814088e4cc95f4f16721aaaf801"
Sep 18 22:35:01.389767 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:35:01.389748    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91a3bbfd08daa1a535214c123cd4b9cbfa73d814088e4cc95f4f16721aaaf801\": container with ID starting with 91a3bbfd08daa1a535214c123cd4b9cbfa73d814088e4cc95f4f16721aaaf801 not found: ID does not exist" containerID="91a3bbfd08daa1a535214c123cd4b9cbfa73d814088e4cc95f4f16721aaaf801"
Sep 18 22:35:01.389813 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:01.389773    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91a3bbfd08daa1a535214c123cd4b9cbfa73d814088e4cc95f4f16721aaaf801"} err="failed to get container status \"91a3bbfd08daa1a535214c123cd4b9cbfa73d814088e4cc95f4f16721aaaf801\": rpc error: code = NotFound desc = could not find container \"91a3bbfd08daa1a535214c123cd4b9cbfa73d814088e4cc95f4f16721aaaf801\": container with ID starting with 91a3bbfd08daa1a535214c123cd4b9cbfa73d814088e4cc95f4f16721aaaf801 not found: ID does not exist"
Sep 18 22:35:01.396083 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:01.396061    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf"]
Sep 18 22:35:01.400422 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:01.400403    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7f10d8-54cc6fb958-wm5cf"]
Sep 18 22:35:01.414829 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:01.414809    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2"]
Sep 18 22:35:01.418469 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:01.418450    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-7f10d8-868497d6c7-85nt2"]
Sep 18 22:35:03.345756 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:03.345722    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bbb6f4f-e8ec-4272-878d-32bc7bb220aa" path="/var/lib/kubelet/pods/3bbb6f4f-e8ec-4272-878d-32bc7bb220aa/volumes"
Sep 18 22:35:03.346255 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:35:03.346230    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96968c3d-5d91-4d1a-a0b0-f923f47b006b" path="/var/lib/kubelet/pods/96968c3d-5d91-4d1a-a0b0-f923f47b006b/volumes"
Sep 18 22:36:14.328638 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.328604    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7b57d79649-9h89m"]
Sep 18 22:36:14.329050 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.328930    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96968c3d-5d91-4d1a-a0b0-f923f47b006b" containerName="payload-pre-processing"
Sep 18 22:36:14.329050 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.328942    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="96968c3d-5d91-4d1a-a0b0-f923f47b006b" containerName="payload-pre-processing"
Sep 18 22:36:14.329050 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.328954    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bb06bb0-2361-4bae-a7e4-9874bf395cdf" containerName="payload-pre-processing"
Sep 18 22:36:14.329050 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.328961    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bb06bb0-2361-4bae-a7e4-9874bf395cdf" containerName="payload-pre-processing"
Sep 18 22:36:14.329050 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.328971    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ae95885-b23e-45d3-ac5e-55954b38fb6e" containerName="revoke-keys"
Sep 18 22:36:14.329050 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.328977    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ae95885-b23e-45d3-ac5e-55954b38fb6e" containerName="revoke-keys"
Sep 18 22:36:14.329050 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.328984    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bbb6f4f-e8ec-4272-878d-32bc7bb220aa" containerName="payload-processing"
Sep 18 22:36:14.329050 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.328989    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bbb6f4f-e8ec-4272-878d-32bc7bb220aa" containerName="payload-processing"
Sep 18 22:36:14.329050 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.329036    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bbb6f4f-e8ec-4272-878d-32bc7bb220aa" containerName="payload-processing"
Sep 18 22:36:14.329050 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.329046    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ae95885-b23e-45d3-ac5e-55954b38fb6e" containerName="revoke-keys"
Sep 18 22:36:14.329050 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.329052    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bb06bb0-2361-4bae-a7e4-9874bf395cdf" containerName="payload-pre-processing"
Sep 18 22:36:14.329391 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.329060    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="96968c3d-5d91-4d1a-a0b0-f923f47b006b" containerName="payload-pre-processing"
Sep 18 22:36:14.331959 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.331939    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b57d79649-9h89m"
Sep 18 22:36:14.335157 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.335101    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 18 22:36:14.335157 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.335101    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ww7bb\""
Sep 18 22:36:14.335157 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.335102    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 18 22:36:14.335408 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.335238    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 18 22:36:14.346843 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.346821    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b57d79649-9h89m"]
Sep 18 22:36:14.444285 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.444249    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zld5\" (UniqueName: \"kubernetes.io/projected/89487c43-0e3c-48ea-ae86-322b957ed8bc-kube-api-access-7zld5\") pod \"maas-controller-7b57d79649-9h89m\" (UID: \"89487c43-0e3c-48ea-ae86-322b957ed8bc\") " pod="opendatahub/maas-controller-7b57d79649-9h89m"
Sep 18 22:36:14.444285 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.444290    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89487c43-0e3c-48ea-ae86-322b957ed8bc-metrics-certs\") pod \"maas-controller-7b57d79649-9h89m\" (UID: \"89487c43-0e3c-48ea-ae86-322b957ed8bc\") " pod="opendatahub/maas-controller-7b57d79649-9h89m"
Sep 18 22:36:14.444497 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.444325    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/89487c43-0e3c-48ea-ae86-322b957ed8bc-webhook-cert\") pod \"maas-controller-7b57d79649-9h89m\" (UID: \"89487c43-0e3c-48ea-ae86-322b957ed8bc\") " pod="opendatahub/maas-controller-7b57d79649-9h89m"
Sep 18 22:36:14.545347 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.545313    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zld5\" (UniqueName: \"kubernetes.io/projected/89487c43-0e3c-48ea-ae86-322b957ed8bc-kube-api-access-7zld5\") pod \"maas-controller-7b57d79649-9h89m\" (UID: \"89487c43-0e3c-48ea-ae86-322b957ed8bc\") " pod="opendatahub/maas-controller-7b57d79649-9h89m"
Sep 18 22:36:14.545347 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.545348    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89487c43-0e3c-48ea-ae86-322b957ed8bc-metrics-certs\") pod \"maas-controller-7b57d79649-9h89m\" (UID: \"89487c43-0e3c-48ea-ae86-322b957ed8bc\") " pod="opendatahub/maas-controller-7b57d79649-9h89m"
Sep 18 22:36:14.545562 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.545378    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/89487c43-0e3c-48ea-ae86-322b957ed8bc-webhook-cert\") pod \"maas-controller-7b57d79649-9h89m\" (UID: \"89487c43-0e3c-48ea-ae86-322b957ed8bc\") " pod="opendatahub/maas-controller-7b57d79649-9h89m"
Sep 18 22:36:14.547936 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.547915    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/89487c43-0e3c-48ea-ae86-322b957ed8bc-webhook-cert\") pod \"maas-controller-7b57d79649-9h89m\" (UID: \"89487c43-0e3c-48ea-ae86-322b957ed8bc\") " pod="opendatahub/maas-controller-7b57d79649-9h89m"
Sep 18 22:36:14.548051 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.547948    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89487c43-0e3c-48ea-ae86-322b957ed8bc-metrics-certs\") pod \"maas-controller-7b57d79649-9h89m\" (UID: \"89487c43-0e3c-48ea-ae86-322b957ed8bc\") " pod="opendatahub/maas-controller-7b57d79649-9h89m"
Sep 18 22:36:14.554377 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.554352    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zld5\" (UniqueName: \"kubernetes.io/projected/89487c43-0e3c-48ea-ae86-322b957ed8bc-kube-api-access-7zld5\") pod \"maas-controller-7b57d79649-9h89m\" (UID: \"89487c43-0e3c-48ea-ae86-322b957ed8bc\") " pod="opendatahub/maas-controller-7b57d79649-9h89m"
Sep 18 22:36:14.641997 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.641918    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b57d79649-9h89m"
Sep 18 22:36:14.935668 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.935531    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b57d79649-9h89m"]
Sep 18 22:36:14.938600 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:36:14.938562    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89487c43_0e3c_48ea_ae86_322b957ed8bc.slice/crio-25c1766f5ad92029b277f34eb50833a39e9bd83c7a5a386775e86124c98b2992 WatchSource:0}: Error finding container 25c1766f5ad92029b277f34eb50833a39e9bd83c7a5a386775e86124c98b2992: Status 404 returned error can't find the container with id 25c1766f5ad92029b277f34eb50833a39e9bd83c7a5a386775e86124c98b2992
Sep 18 22:36:14.940218 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:14.940199    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 22:36:15.727955 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:15.727916    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b57d79649-9h89m" event={"ID":"89487c43-0e3c-48ea-ae86-322b957ed8bc","Type":"ContainerStarted","Data":"290a8bf51b04a0c6ab358b8ea782d485533336e7b106e08516d1f6ddf2ff85db"}
Sep 18 22:36:15.728420 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:15.727966    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b57d79649-9h89m" event={"ID":"89487c43-0e3c-48ea-ae86-322b957ed8bc","Type":"ContainerStarted","Data":"25c1766f5ad92029b277f34eb50833a39e9bd83c7a5a386775e86124c98b2992"}
Sep 18 22:36:15.728420 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:15.728017    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7b57d79649-9h89m"
Sep 18 22:36:15.765222 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:15.765177    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7b57d79649-9h89m" podStartSLOduration=1.400642445 podStartE2EDuration="1.765164583s" totalImagesPullingTime="364.522138ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:36:15.762723441 +0000 UTC m=+2150.894504523" watchObservedRunningTime="2026-09-18 22:36:15.765164583 +0000 UTC m=+2150.896945666"
Sep 18 22:36:25.656627 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:25.656596    2574 scope.go:117] "RemoveContainer" containerID="0efd7ffde62ff850a51632687be3aad86393a49bff6b69a24d1be56ce28d10fe"
Sep 18 22:36:26.735150 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:26.735124    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7b57d79649-9h89m"
Sep 18 22:36:36.077981 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:36.077941    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b57d79649-9h89m"]
Sep 18 22:36:36.078566 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:36.078185    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7b57d79649-9h89m" podUID="89487c43-0e3c-48ea-ae86-322b957ed8bc" containerName="manager" containerID="cri-o://290a8bf51b04a0c6ab358b8ea782d485533336e7b106e08516d1f6ddf2ff85db" gracePeriod=30
Sep 18 22:36:36.327208 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:36.327186    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b57d79649-9h89m"
Sep 18 22:36:36.334902 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:36.334851    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89487c43-0e3c-48ea-ae86-322b957ed8bc-metrics-certs\") pod \"89487c43-0e3c-48ea-ae86-322b957ed8bc\" (UID: \"89487c43-0e3c-48ea-ae86-322b957ed8bc\") "
Sep 18 22:36:36.335003 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:36.334936    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/89487c43-0e3c-48ea-ae86-322b957ed8bc-webhook-cert\") pod \"89487c43-0e3c-48ea-ae86-322b957ed8bc\" (UID: \"89487c43-0e3c-48ea-ae86-322b957ed8bc\") "
Sep 18 22:36:36.335003 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:36.334974    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zld5\" (UniqueName: \"kubernetes.io/projected/89487c43-0e3c-48ea-ae86-322b957ed8bc-kube-api-access-7zld5\") pod \"89487c43-0e3c-48ea-ae86-322b957ed8bc\" (UID: \"89487c43-0e3c-48ea-ae86-322b957ed8bc\") "
Sep 18 22:36:36.337078 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:36.337050    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89487c43-0e3c-48ea-ae86-322b957ed8bc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "89487c43-0e3c-48ea-ae86-322b957ed8bc" (UID: "89487c43-0e3c-48ea-ae86-322b957ed8bc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:36:36.337184 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:36.337079    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89487c43-0e3c-48ea-ae86-322b957ed8bc-kube-api-access-7zld5" (OuterVolumeSpecName: "kube-api-access-7zld5") pod "89487c43-0e3c-48ea-ae86-322b957ed8bc" (UID: "89487c43-0e3c-48ea-ae86-322b957ed8bc"). InnerVolumeSpecName "kube-api-access-7zld5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:36:36.337184 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:36.337101    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89487c43-0e3c-48ea-ae86-322b957ed8bc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "89487c43-0e3c-48ea-ae86-322b957ed8bc" (UID: "89487c43-0e3c-48ea-ae86-322b957ed8bc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:36:36.436223 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:36.436194    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/89487c43-0e3c-48ea-ae86-322b957ed8bc-webhook-cert\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:36:36.436223 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:36.436220    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zld5\" (UniqueName: \"kubernetes.io/projected/89487c43-0e3c-48ea-ae86-322b957ed8bc-kube-api-access-7zld5\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:36:36.436223 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:36.436229    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89487c43-0e3c-48ea-ae86-322b957ed8bc-metrics-certs\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:36:36.831859 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:36.831822    2574 generic.go:356] "Generic (PLEG): container finished" podID="89487c43-0e3c-48ea-ae86-322b957ed8bc" containerID="290a8bf51b04a0c6ab358b8ea782d485533336e7b106e08516d1f6ddf2ff85db" exitCode=0
Sep 18 22:36:36.832032 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:36.831866    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b57d79649-9h89m"
Sep 18 22:36:36.832032 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:36.831885    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b57d79649-9h89m" event={"ID":"89487c43-0e3c-48ea-ae86-322b957ed8bc","Type":"ContainerDied","Data":"290a8bf51b04a0c6ab358b8ea782d485533336e7b106e08516d1f6ddf2ff85db"}
Sep 18 22:36:36.832032 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:36.831926    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b57d79649-9h89m" event={"ID":"89487c43-0e3c-48ea-ae86-322b957ed8bc","Type":"ContainerDied","Data":"25c1766f5ad92029b277f34eb50833a39e9bd83c7a5a386775e86124c98b2992"}
Sep 18 22:36:36.832032 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:36.831949    2574 scope.go:117] "RemoveContainer" containerID="290a8bf51b04a0c6ab358b8ea782d485533336e7b106e08516d1f6ddf2ff85db"
Sep 18 22:36:36.842025 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:36.842008    2574 scope.go:117] "RemoveContainer" containerID="290a8bf51b04a0c6ab358b8ea782d485533336e7b106e08516d1f6ddf2ff85db"
Sep 18 22:36:36.842294 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:36:36.842271    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"290a8bf51b04a0c6ab358b8ea782d485533336e7b106e08516d1f6ddf2ff85db\": container with ID starting with 290a8bf51b04a0c6ab358b8ea782d485533336e7b106e08516d1f6ddf2ff85db not found: ID does not exist" containerID="290a8bf51b04a0c6ab358b8ea782d485533336e7b106e08516d1f6ddf2ff85db"
Sep 18 22:36:36.842394 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:36.842299    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"290a8bf51b04a0c6ab358b8ea782d485533336e7b106e08516d1f6ddf2ff85db"} err="failed to get container status \"290a8bf51b04a0c6ab358b8ea782d485533336e7b106e08516d1f6ddf2ff85db\": rpc error: code = NotFound desc = could not find container \"290a8bf51b04a0c6ab358b8ea782d485533336e7b106e08516d1f6ddf2ff85db\": container with ID starting with 290a8bf51b04a0c6ab358b8ea782d485533336e7b106e08516d1f6ddf2ff85db not found: ID does not exist"
Sep 18 22:36:36.854576 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:36.854550    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b57d79649-9h89m"]
Sep 18 22:36:36.859274 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:36.859249    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7b57d79649-9h89m"]
Sep 18 22:36:37.345750 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:37.345719    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89487c43-0e3c-48ea-ae86-322b957ed8bc" path="/var/lib/kubelet/pods/89487c43-0e3c-48ea-ae86-322b957ed8bc/volumes"
Sep 18 22:36:37.671481 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:37.671444    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7b57d79649-hm6jn"]
Sep 18 22:36:37.671862 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:37.671847    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89487c43-0e3c-48ea-ae86-322b957ed8bc" containerName="manager"
Sep 18 22:36:37.671906 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:37.671864    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="89487c43-0e3c-48ea-ae86-322b957ed8bc" containerName="manager"
Sep 18 22:36:37.671957 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:37.671946    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="89487c43-0e3c-48ea-ae86-322b957ed8bc" containerName="manager"
Sep 18 22:36:37.676499 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:37.676483    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b57d79649-hm6jn"
Sep 18 22:36:37.680740 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:37.680721    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 18 22:36:37.681457 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:37.681437    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ww7bb\""
Sep 18 22:36:37.681457 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:37.681448    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 18 22:36:37.681785 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:37.681750    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 18 22:36:37.702224 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:37.702192    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b57d79649-hm6jn"]
Sep 18 22:36:37.747992 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:37.747958    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97651fe5-4ab0-4414-8e42-986556e040fd-webhook-cert\") pod \"maas-controller-7b57d79649-hm6jn\" (UID: \"97651fe5-4ab0-4414-8e42-986556e040fd\") " pod="opendatahub/maas-controller-7b57d79649-hm6jn"
Sep 18 22:36:37.747992 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:37.747994    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97651fe5-4ab0-4414-8e42-986556e040fd-metrics-certs\") pod \"maas-controller-7b57d79649-hm6jn\" (UID: \"97651fe5-4ab0-4414-8e42-986556e040fd\") " pod="opendatahub/maas-controller-7b57d79649-hm6jn"
Sep 18 22:36:37.748152 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:37.748069    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gv6s\" (UniqueName: \"kubernetes.io/projected/97651fe5-4ab0-4414-8e42-986556e040fd-kube-api-access-8gv6s\") pod \"maas-controller-7b57d79649-hm6jn\" (UID: \"97651fe5-4ab0-4414-8e42-986556e040fd\") " pod="opendatahub/maas-controller-7b57d79649-hm6jn"
Sep 18 22:36:37.849389 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:37.849359    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gv6s\" (UniqueName: \"kubernetes.io/projected/97651fe5-4ab0-4414-8e42-986556e040fd-kube-api-access-8gv6s\") pod \"maas-controller-7b57d79649-hm6jn\" (UID: \"97651fe5-4ab0-4414-8e42-986556e040fd\") " pod="opendatahub/maas-controller-7b57d79649-hm6jn"
Sep 18 22:36:37.849564 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:37.849424    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97651fe5-4ab0-4414-8e42-986556e040fd-webhook-cert\") pod \"maas-controller-7b57d79649-hm6jn\" (UID: \"97651fe5-4ab0-4414-8e42-986556e040fd\") " pod="opendatahub/maas-controller-7b57d79649-hm6jn"
Sep 18 22:36:37.849564 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:37.849448    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97651fe5-4ab0-4414-8e42-986556e040fd-metrics-certs\") pod \"maas-controller-7b57d79649-hm6jn\" (UID: \"97651fe5-4ab0-4414-8e42-986556e040fd\") " pod="opendatahub/maas-controller-7b57d79649-hm6jn"
Sep 18 22:36:37.852205 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:37.852183    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97651fe5-4ab0-4414-8e42-986556e040fd-metrics-certs\") pod \"maas-controller-7b57d79649-hm6jn\" (UID: \"97651fe5-4ab0-4414-8e42-986556e040fd\") " pod="opendatahub/maas-controller-7b57d79649-hm6jn"
Sep 18 22:36:37.852307 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:37.852211    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97651fe5-4ab0-4414-8e42-986556e040fd-webhook-cert\") pod \"maas-controller-7b57d79649-hm6jn\" (UID: \"97651fe5-4ab0-4414-8e42-986556e040fd\") " pod="opendatahub/maas-controller-7b57d79649-hm6jn"
Sep 18 22:36:37.860353 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:37.860332    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gv6s\" (UniqueName: \"kubernetes.io/projected/97651fe5-4ab0-4414-8e42-986556e040fd-kube-api-access-8gv6s\") pod \"maas-controller-7b57d79649-hm6jn\" (UID: \"97651fe5-4ab0-4414-8e42-986556e040fd\") " pod="opendatahub/maas-controller-7b57d79649-hm6jn"
Sep 18 22:36:37.986420 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:37.986332    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b57d79649-hm6jn"
Sep 18 22:36:38.267922 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:38.267885    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b57d79649-hm6jn"]
Sep 18 22:36:38.270522 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:36:38.270476    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97651fe5_4ab0_4414_8e42_986556e040fd.slice/crio-c281e75d54328ce73eec79a5e2c64dc577cb4e7cb40b72f12f72f5717af04bef WatchSource:0}: Error finding container c281e75d54328ce73eec79a5e2c64dc577cb4e7cb40b72f12f72f5717af04bef: Status 404 returned error can't find the container with id c281e75d54328ce73eec79a5e2c64dc577cb4e7cb40b72f12f72f5717af04bef
Sep 18 22:36:38.844199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:38.844098    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b57d79649-hm6jn" event={"ID":"97651fe5-4ab0-4414-8e42-986556e040fd","Type":"ContainerStarted","Data":"af9e372aa83773b9eea93d209011f3322bab156d11f6ef33978c9d520dea3b08"}
Sep 18 22:36:38.844199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:38.844162    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b57d79649-hm6jn" event={"ID":"97651fe5-4ab0-4414-8e42-986556e040fd","Type":"ContainerStarted","Data":"c281e75d54328ce73eec79a5e2c64dc577cb4e7cb40b72f12f72f5717af04bef"}
Sep 18 22:36:38.844199 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:38.844188    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7b57d79649-hm6jn"
Sep 18 22:36:38.868240 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:38.868188    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7b57d79649-hm6jn" podStartSLOduration=1.5604319229999999 podStartE2EDuration="1.868172681s" totalImagesPullingTime="307.740758ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:36:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:36:38.865669921 +0000 UTC m=+2173.997451002" watchObservedRunningTime="2026-09-18 22:36:38.868172681 +0000 UTC m=+2173.999953763"
Sep 18 22:36:49.852099 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:36:49.852070    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7b57d79649-hm6jn"
Sep 18 22:37:25.676477 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:37:25.676445    2574 scope.go:117] "RemoveContainer" containerID="f374bcd91a064d5161748aedac76589ae00e906c27555adbb57e8e9db62882fa"
Sep 18 22:40:25.713055 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:25.713019    2574 scope.go:117] "RemoveContainer" containerID="9762c64ee702882e6b4dd2f039b0fafb569939d300dd5a86e0918889dbff63fb"
Sep 18 22:40:37.937173 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:37.937137    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl"]
Sep 18 22:40:37.940604 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:37.940584    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl"
Sep 18 22:40:37.944343 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:37.944320    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 22:40:37.944450 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:37.944320    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 18 22:40:37.945041 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:37.945020    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 18 22:40:37.945163 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:37.945044    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-c6l9h\""
Sep 18 22:40:37.945163 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:37.945032    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 18 22:40:37.953497 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:37.953470    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl"]
Sep 18 22:40:38.075447 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:38.075405    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c76708f7-9160-4dc3-a00a-a59c24370765-openshift-service-ca\") pod \"maas-api-b89d7f5c7-wk4rl\" (UID: \"c76708f7-9160-4dc3-a00a-a59c24370765\") " pod="odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl"
Sep 18 22:40:38.075667 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:38.075474    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlltt\" (UniqueName: \"kubernetes.io/projected/c76708f7-9160-4dc3-a00a-a59c24370765-kube-api-access-jlltt\") pod \"maas-api-b89d7f5c7-wk4rl\" (UID: \"c76708f7-9160-4dc3-a00a-a59c24370765\") " pod="odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl"
Sep 18 22:40:38.075667 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:38.075500    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c76708f7-9160-4dc3-a00a-a59c24370765-metrics-certs\") pod \"maas-api-b89d7f5c7-wk4rl\" (UID: \"c76708f7-9160-4dc3-a00a-a59c24370765\") " pod="odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl"
Sep 18 22:40:38.075667 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:38.075539    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c76708f7-9160-4dc3-a00a-a59c24370765-maas-api-tls\") pod \"maas-api-b89d7f5c7-wk4rl\" (UID: \"c76708f7-9160-4dc3-a00a-a59c24370765\") " pod="odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl"
Sep 18 22:40:38.176951 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:38.176912    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c76708f7-9160-4dc3-a00a-a59c24370765-openshift-service-ca\") pod \"maas-api-b89d7f5c7-wk4rl\" (UID: \"c76708f7-9160-4dc3-a00a-a59c24370765\") " pod="odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl"
Sep 18 22:40:38.177144 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:38.177005    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlltt\" (UniqueName: \"kubernetes.io/projected/c76708f7-9160-4dc3-a00a-a59c24370765-kube-api-access-jlltt\") pod \"maas-api-b89d7f5c7-wk4rl\" (UID: \"c76708f7-9160-4dc3-a00a-a59c24370765\") " pod="odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl"
Sep 18 22:40:38.177144 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:38.177039    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c76708f7-9160-4dc3-a00a-a59c24370765-metrics-certs\") pod \"maas-api-b89d7f5c7-wk4rl\" (UID: \"c76708f7-9160-4dc3-a00a-a59c24370765\") " pod="odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl"
Sep 18 22:40:38.177144 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:38.177068    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c76708f7-9160-4dc3-a00a-a59c24370765-maas-api-tls\") pod \"maas-api-b89d7f5c7-wk4rl\" (UID: \"c76708f7-9160-4dc3-a00a-a59c24370765\") " pod="odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl"
Sep 18 22:40:38.177675 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:38.177652    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c76708f7-9160-4dc3-a00a-a59c24370765-openshift-service-ca\") pod \"maas-api-b89d7f5c7-wk4rl\" (UID: \"c76708f7-9160-4dc3-a00a-a59c24370765\") " pod="odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl"
Sep 18 22:40:38.179871 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:38.179848    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c76708f7-9160-4dc3-a00a-a59c24370765-metrics-certs\") pod \"maas-api-b89d7f5c7-wk4rl\" (UID: \"c76708f7-9160-4dc3-a00a-a59c24370765\") " pod="odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl"
Sep 18 22:40:38.180002 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:38.179974    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c76708f7-9160-4dc3-a00a-a59c24370765-maas-api-tls\") pod \"maas-api-b89d7f5c7-wk4rl\" (UID: \"c76708f7-9160-4dc3-a00a-a59c24370765\") " pod="odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl"
Sep 18 22:40:38.184778 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:38.184758    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlltt\" (UniqueName: \"kubernetes.io/projected/c76708f7-9160-4dc3-a00a-a59c24370765-kube-api-access-jlltt\") pod \"maas-api-b89d7f5c7-wk4rl\" (UID: \"c76708f7-9160-4dc3-a00a-a59c24370765\") " pod="odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl"
Sep 18 22:40:38.251880 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:38.251795    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl"
Sep 18 22:40:38.539559 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:38.539523    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl"]
Sep 18 22:40:38.541023 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:40:38.540994    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc76708f7_9160_4dc3_a00a_a59c24370765.slice/crio-7f8795266637afd6e71cd2dd12072d6a59c2a77367bfa3b90eb4edca0a4dff29 WatchSource:0}: Error finding container 7f8795266637afd6e71cd2dd12072d6a59c2a77367bfa3b90eb4edca0a4dff29: Status 404 returned error can't find the container with id 7f8795266637afd6e71cd2dd12072d6a59c2a77367bfa3b90eb4edca0a4dff29
Sep 18 22:40:38.967063 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:38.967038    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl" event={"ID":"c76708f7-9160-4dc3-a00a-a59c24370765","Type":"ContainerStarted","Data":"7f8795266637afd6e71cd2dd12072d6a59c2a77367bfa3b90eb4edca0a4dff29"}
Sep 18 22:40:39.973952 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:39.973912    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl" event={"ID":"c76708f7-9160-4dc3-a00a-a59c24370765","Type":"ContainerStarted","Data":"0c74c669e3ebec3dcd9911b14655b7e8eeb641cfc37ece8fea5c750b9633c619"}
Sep 18 22:40:39.974336 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:39.974000    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl"
Sep 18 22:40:45.108645 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.108577    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl" podStartSLOduration=7.734769764 podStartE2EDuration="8.108554442s" totalImagesPullingTime="373.784678ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:40:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:40:39.99516809 +0000 UTC m=+2415.126949170" watchObservedRunningTime="2026-09-18 22:40:45.108554442 +0000 UTC m=+2420.240335525"
Sep 18 22:40:45.110567 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.110544    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl"]
Sep 18 22:40:45.110790 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.110760    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl" podUID="c76708f7-9160-4dc3-a00a-a59c24370765" containerName="maas-api" containerID="cri-o://0c74c669e3ebec3dcd9911b14655b7e8eeb641cfc37ece8fea5c750b9633c619" gracePeriod=30
Sep 18 22:40:45.116621 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.116600    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl"
Sep 18 22:40:45.152928 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.152892    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6b86cc866f-kkd69"]
Sep 18 22:40:45.156904 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.156888    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b86cc866f-kkd69"
Sep 18 22:40:45.171900 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.171871    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b86cc866f-kkd69"]
Sep 18 22:40:45.232788 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.232763    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d52772e5-526f-453a-8bb4-11dd998c5969-openshift-service-ca\") pod \"maas-api-6b86cc866f-kkd69\" (UID: \"d52772e5-526f-453a-8bb4-11dd998c5969\") " pod="odh-ai-gateway-infra/maas-api-6b86cc866f-kkd69"
Sep 18 22:40:45.232934 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.232805    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x68k\" (UniqueName: \"kubernetes.io/projected/d52772e5-526f-453a-8bb4-11dd998c5969-kube-api-access-8x68k\") pod \"maas-api-6b86cc866f-kkd69\" (UID: \"d52772e5-526f-453a-8bb4-11dd998c5969\") " pod="odh-ai-gateway-infra/maas-api-6b86cc866f-kkd69"
Sep 18 22:40:45.232934 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.232828    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d52772e5-526f-453a-8bb4-11dd998c5969-metrics-certs\") pod \"maas-api-6b86cc866f-kkd69\" (UID: \"d52772e5-526f-453a-8bb4-11dd998c5969\") " pod="odh-ai-gateway-infra/maas-api-6b86cc866f-kkd69"
Sep 18 22:40:45.233028 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.232955    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d52772e5-526f-453a-8bb4-11dd998c5969-maas-api-tls\") pod \"maas-api-6b86cc866f-kkd69\" (UID: \"d52772e5-526f-453a-8bb4-11dd998c5969\") " pod="odh-ai-gateway-infra/maas-api-6b86cc866f-kkd69"
Sep 18 22:40:45.334039 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.334008    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d52772e5-526f-453a-8bb4-11dd998c5969-maas-api-tls\") pod \"maas-api-6b86cc866f-kkd69\" (UID: \"d52772e5-526f-453a-8bb4-11dd998c5969\") " pod="odh-ai-gateway-infra/maas-api-6b86cc866f-kkd69"
Sep 18 22:40:45.334216 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.334068    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d52772e5-526f-453a-8bb4-11dd998c5969-openshift-service-ca\") pod \"maas-api-6b86cc866f-kkd69\" (UID: \"d52772e5-526f-453a-8bb4-11dd998c5969\") " pod="odh-ai-gateway-infra/maas-api-6b86cc866f-kkd69"
Sep 18 22:40:45.334216 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.334095    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x68k\" (UniqueName: \"kubernetes.io/projected/d52772e5-526f-453a-8bb4-11dd998c5969-kube-api-access-8x68k\") pod \"maas-api-6b86cc866f-kkd69\" (UID: \"d52772e5-526f-453a-8bb4-11dd998c5969\") " pod="odh-ai-gateway-infra/maas-api-6b86cc866f-kkd69"
Sep 18 22:40:45.334216 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.334120    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d52772e5-526f-453a-8bb4-11dd998c5969-metrics-certs\") pod \"maas-api-6b86cc866f-kkd69\" (UID: \"d52772e5-526f-453a-8bb4-11dd998c5969\") " pod="odh-ai-gateway-infra/maas-api-6b86cc866f-kkd69"
Sep 18 22:40:45.335007 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.334932    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d52772e5-526f-453a-8bb4-11dd998c5969-openshift-service-ca\") pod \"maas-api-6b86cc866f-kkd69\" (UID: \"d52772e5-526f-453a-8bb4-11dd998c5969\") " pod="odh-ai-gateway-infra/maas-api-6b86cc866f-kkd69"
Sep 18 22:40:45.336672 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.336643    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d52772e5-526f-453a-8bb4-11dd998c5969-maas-api-tls\") pod \"maas-api-6b86cc866f-kkd69\" (UID: \"d52772e5-526f-453a-8bb4-11dd998c5969\") " pod="odh-ai-gateway-infra/maas-api-6b86cc866f-kkd69"
Sep 18 22:40:45.336826 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.336806    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d52772e5-526f-453a-8bb4-11dd998c5969-metrics-certs\") pod \"maas-api-6b86cc866f-kkd69\" (UID: \"d52772e5-526f-453a-8bb4-11dd998c5969\") " pod="odh-ai-gateway-infra/maas-api-6b86cc866f-kkd69"
Sep 18 22:40:45.343447 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.343425    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x68k\" (UniqueName: \"kubernetes.io/projected/d52772e5-526f-453a-8bb4-11dd998c5969-kube-api-access-8x68k\") pod \"maas-api-6b86cc866f-kkd69\" (UID: \"d52772e5-526f-453a-8bb4-11dd998c5969\") " pod="odh-ai-gateway-infra/maas-api-6b86cc866f-kkd69"
Sep 18 22:40:45.361928 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.361880    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl"
Sep 18 22:40:45.490756 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.490717    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b86cc866f-kkd69"
Sep 18 22:40:45.536694 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.535936    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c76708f7-9160-4dc3-a00a-a59c24370765-openshift-service-ca\") pod \"c76708f7-9160-4dc3-a00a-a59c24370765\" (UID: \"c76708f7-9160-4dc3-a00a-a59c24370765\") "
Sep 18 22:40:45.536694 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.535986    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c76708f7-9160-4dc3-a00a-a59c24370765-maas-api-tls\") pod \"c76708f7-9160-4dc3-a00a-a59c24370765\" (UID: \"c76708f7-9160-4dc3-a00a-a59c24370765\") "
Sep 18 22:40:45.536694 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.536022    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c76708f7-9160-4dc3-a00a-a59c24370765-metrics-certs\") pod \"c76708f7-9160-4dc3-a00a-a59c24370765\" (UID: \"c76708f7-9160-4dc3-a00a-a59c24370765\") "
Sep 18 22:40:45.536694 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.536102    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlltt\" (UniqueName: \"kubernetes.io/projected/c76708f7-9160-4dc3-a00a-a59c24370765-kube-api-access-jlltt\") pod \"c76708f7-9160-4dc3-a00a-a59c24370765\" (UID: \"c76708f7-9160-4dc3-a00a-a59c24370765\") "
Sep 18 22:40:45.536694 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.536608    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c76708f7-9160-4dc3-a00a-a59c24370765-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c76708f7-9160-4dc3-a00a-a59c24370765" (UID: "c76708f7-9160-4dc3-a00a-a59c24370765"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 22:40:45.540839 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.539146    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c76708f7-9160-4dc3-a00a-a59c24370765-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c76708f7-9160-4dc3-a00a-a59c24370765" (UID: "c76708f7-9160-4dc3-a00a-a59c24370765"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:40:45.540839 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.540027    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c76708f7-9160-4dc3-a00a-a59c24370765-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c76708f7-9160-4dc3-a00a-a59c24370765" (UID: "c76708f7-9160-4dc3-a00a-a59c24370765"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 22:40:45.540839 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.540355    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c76708f7-9160-4dc3-a00a-a59c24370765-kube-api-access-jlltt" (OuterVolumeSpecName: "kube-api-access-jlltt") pod "c76708f7-9160-4dc3-a00a-a59c24370765" (UID: "c76708f7-9160-4dc3-a00a-a59c24370765"). InnerVolumeSpecName "kube-api-access-jlltt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 22:40:45.637148 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.637067    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c76708f7-9160-4dc3-a00a-a59c24370765-openshift-service-ca\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:40:45.637148 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.637096    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c76708f7-9160-4dc3-a00a-a59c24370765-maas-api-tls\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:40:45.637148 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.637106    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c76708f7-9160-4dc3-a00a-a59c24370765-metrics-certs\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:40:45.637148 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.637115    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlltt\" (UniqueName: \"kubernetes.io/projected/c76708f7-9160-4dc3-a00a-a59c24370765-kube-api-access-jlltt\") on node \"ip-10-0-141-255.ec2.internal\" DevicePath \"\""
Sep 18 22:40:45.769423 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:45.769354    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b86cc866f-kkd69"]
Sep 18 22:40:45.771728 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:40:45.771682    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd52772e5_526f_453a_8bb4_11dd998c5969.slice/crio-d19992be72391ecf80be347923adcfad02330c00d67132663ecf1a1a7ee2c22a WatchSource:0}: Error finding container d19992be72391ecf80be347923adcfad02330c00d67132663ecf1a1a7ee2c22a: Status 404 returned error can't find the container with id d19992be72391ecf80be347923adcfad02330c00d67132663ecf1a1a7ee2c22a
Sep 18 22:40:46.004313 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:46.004279    2574 generic.go:356] "Generic (PLEG): container finished" podID="c76708f7-9160-4dc3-a00a-a59c24370765" containerID="0c74c669e3ebec3dcd9911b14655b7e8eeb641cfc37ece8fea5c750b9633c619" exitCode=0
Sep 18 22:40:46.004501 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:46.004316    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl" event={"ID":"c76708f7-9160-4dc3-a00a-a59c24370765","Type":"ContainerDied","Data":"0c74c669e3ebec3dcd9911b14655b7e8eeb641cfc37ece8fea5c750b9633c619"}
Sep 18 22:40:46.004501 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:46.004364    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl"
Sep 18 22:40:46.004501 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:46.004374    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl" event={"ID":"c76708f7-9160-4dc3-a00a-a59c24370765","Type":"ContainerDied","Data":"7f8795266637afd6e71cd2dd12072d6a59c2a77367bfa3b90eb4edca0a4dff29"}
Sep 18 22:40:46.004501 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:46.004407    2574 scope.go:117] "RemoveContainer" containerID="0c74c669e3ebec3dcd9911b14655b7e8eeb641cfc37ece8fea5c750b9633c619"
Sep 18 22:40:46.005726 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:46.005699    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b86cc866f-kkd69" event={"ID":"d52772e5-526f-453a-8bb4-11dd998c5969","Type":"ContainerStarted","Data":"d19992be72391ecf80be347923adcfad02330c00d67132663ecf1a1a7ee2c22a"}
Sep 18 22:40:46.013247 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:46.013232    2574 scope.go:117] "RemoveContainer" containerID="0c74c669e3ebec3dcd9911b14655b7e8eeb641cfc37ece8fea5c750b9633c619"
Sep 18 22:40:46.013537 ip-10-0-141-255 kubenswrapper[2574]: E0918 22:40:46.013500    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c74c669e3ebec3dcd9911b14655b7e8eeb641cfc37ece8fea5c750b9633c619\": container with ID starting with 0c74c669e3ebec3dcd9911b14655b7e8eeb641cfc37ece8fea5c750b9633c619 not found: ID does not exist" containerID="0c74c669e3ebec3dcd9911b14655b7e8eeb641cfc37ece8fea5c750b9633c619"
Sep 18 22:40:46.013625 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:46.013543    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c74c669e3ebec3dcd9911b14655b7e8eeb641cfc37ece8fea5c750b9633c619"} err="failed to get container status \"0c74c669e3ebec3dcd9911b14655b7e8eeb641cfc37ece8fea5c750b9633c619\": rpc error: code = NotFound desc = could not find container \"0c74c669e3ebec3dcd9911b14655b7e8eeb641cfc37ece8fea5c750b9633c619\": container with ID starting with 0c74c669e3ebec3dcd9911b14655b7e8eeb641cfc37ece8fea5c750b9633c619 not found: ID does not exist"
Sep 18 22:40:46.030451 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:46.030430    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl"]
Sep 18 22:40:46.034760 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:46.034738    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-b89d7f5c7-wk4rl"]
Sep 18 22:40:47.013313 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:47.013234    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b86cc866f-kkd69" event={"ID":"d52772e5-526f-453a-8bb4-11dd998c5969","Type":"ContainerStarted","Data":"680d8961ff974117f5af028b68a3af0085a07f96e18c575c2d5c79d252b29890"}
Sep 18 22:40:47.013729 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:47.013368    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6b86cc866f-kkd69"
Sep 18 22:40:47.346309 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:47.346232    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c76708f7-9160-4dc3-a00a-a59c24370765" path="/var/lib/kubelet/pods/c76708f7-9160-4dc3-a00a-a59c24370765/volumes"
Sep 18 22:40:53.024701 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:53.024671    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6b86cc866f-kkd69"
Sep 18 22:40:53.044628 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:40:53.044569    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6b86cc866f-kkd69" podStartSLOduration=7.699512953 podStartE2EDuration="8.044549225s" totalImagesPullingTime="345.036272ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 22:40:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:40:47.044347936 +0000 UTC m=+2422.176129018" watchObservedRunningTime="2026-09-18 22:40:53.044549225 +0000 UTC m=+2428.176330300"
Sep 18 22:41:13.221984 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:13.221953    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7b57d79649-hm6jn_97651fe5-4ab0-4414-8e42-986556e040fd/manager/0.log"
Sep 18 22:41:13.331392 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:13.331365    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vp2mz_f20298f0-c5ca-4216-baec-f68350aeac3f/server/0.log"
Sep 18 22:41:13.683166 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:13.683139    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8_3a46f632-7b18-48f7-b24f-8fc3e34974f1/copy-manifests/0.log"
Sep 18 22:41:13.689260 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:13.689231    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8_3a46f632-7b18-48f7-b24f-8fc3e34974f1/manager/0.log"
Sep 18 22:41:14.164350 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:14.164331    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6b86cc866f-kkd69_d52772e5-526f-453a-8bb4-11dd998c5969/maas-api/0.log"
Sep 18 22:41:14.382289 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:14.382252    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29829495-xw78h_e141295d-62de-4c82-b421-149360c89dfc/cleanup/0.log"
Sep 18 22:41:14.491183 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:14.491097    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29829510-ks4hj_5222730d-67d7-4c83-b990-768c89020e97/cleanup/0.log"
Sep 18 22:41:16.533438 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:16.533405    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-c59ml_cc447b07-c187-4bf9-8093-727cbd725dad/discovery/0.log"
Sep 18 22:41:17.073432 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:17.073401    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-z62nt_8d3bcc3f-e11d-43d7-b7a9-6204cbd617ac/payload-processing/0.log"
Sep 18 22:41:17.179987 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:17.179959    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6454c8d7fd-6mjst_77a9d433-df3d-4200-b498-83d36e01cf77/router/0.log"
Sep 18 22:41:17.620550 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:17.620523    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-ztxpg_1fd0cc7d-54d0-4cf6-82f6-a1b5610713c7/main/0.log"
Sep 18 22:41:17.847282 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:17.847251    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-mbdqg_67ecb6fa-6a71-4686-baf8-c7847be6eef9/main/0.log"
Sep 18 22:41:18.066423 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:18.066386    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-zz57r_9f20d405-508c-4682-b9a4-9569b43224e9/main/0.log"
Sep 18 22:41:25.731847 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:25.731815    2574 scope.go:117] "RemoveContainer" containerID="c28334c12c18610dcf3fd0e5b2f5c96b8b591bb8d7e921dc44dc0f897d4d4af8"
Sep 18 22:41:27.021677 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:27.021629    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-t7m2k_0fa9a758-4e4b-477c-b6de-b36dc677e1cd/global-pull-secret-syncer/0.log"
Sep 18 22:41:27.133953 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:27.133908    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p5qkr_e92e768d-c8b5-4b47-a146-ca7ebecb1bab/konnectivity-agent/0.log"
Sep 18 22:41:27.189260 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:27.189225    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-255.ec2.internal_79f70c2b414f57ea7072d15b46bebdf1/haproxy/0.log"
Sep 18 22:41:33.527528 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:33.527475    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb79f4ad-4280-4592-bd9e-ec15548dee34/alertmanager/0.log"
Sep 18 22:41:33.547823 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:33.547798    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb79f4ad-4280-4592-bd9e-ec15548dee34/config-reloader/0.log"
Sep 18 22:41:33.568138 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:33.568114    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb79f4ad-4280-4592-bd9e-ec15548dee34/kube-rbac-proxy-web/0.log"
Sep 18 22:41:33.590243 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:33.590220    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb79f4ad-4280-4592-bd9e-ec15548dee34/kube-rbac-proxy/0.log"
Sep 18 22:41:33.611000 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:33.610977    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb79f4ad-4280-4592-bd9e-ec15548dee34/kube-rbac-proxy-metric/0.log"
Sep 18 22:41:33.631853 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:33.631833    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb79f4ad-4280-4592-bd9e-ec15548dee34/prom-label-proxy/0.log"
Sep 18 22:41:33.653911 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:33.653892    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb79f4ad-4280-4592-bd9e-ec15548dee34/init-config-reloader/0.log"
Sep 18 22:41:33.835069 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:33.835005    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-g2wwm_84ef876b-2231-447e-956c-74b7ed846422/monitoring-plugin/0.log"
Sep 18 22:41:33.990311 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:33.990288    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mmdtn_b8000511-78a2-4532-b5f6-9747952ad979/node-exporter/0.log"
Sep 18 22:41:34.023441 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:34.023414    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mmdtn_b8000511-78a2-4532-b5f6-9747952ad979/kube-rbac-proxy/0.log"
Sep 18 22:41:34.061733 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:34.061709    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mmdtn_b8000511-78a2-4532-b5f6-9747952ad979/init-textfile/0.log"
Sep 18 22:41:34.178409 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:34.178388    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-fnhql_f88c7ac8-1bf4-4cbc-8fca-0676e39fe460/kube-rbac-proxy-main/0.log"
Sep 18 22:41:34.201026 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:34.201000    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-fnhql_f88c7ac8-1bf4-4cbc-8fca-0676e39fe460/kube-rbac-proxy-self/0.log"
Sep 18 22:41:34.222836 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:34.222809    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-fnhql_f88c7ac8-1bf4-4cbc-8fca-0676e39fe460/openshift-state-metrics/0.log"
Sep 18 22:41:37.094775 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:37.094740    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s5gh8/perf-node-gather-daemonset-pr5v8"]
Sep 18 22:41:37.095138 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:37.095110    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c76708f7-9160-4dc3-a00a-a59c24370765" containerName="maas-api"
Sep 18 22:41:37.095138 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:37.095124    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c76708f7-9160-4dc3-a00a-a59c24370765" containerName="maas-api"
Sep 18 22:41:37.095210 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:37.095178    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c76708f7-9160-4dc3-a00a-a59c24370765" containerName="maas-api"
Sep 18 22:41:37.098263 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:37.098243    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-pr5v8"
Sep 18 22:41:37.100534 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:37.100495    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s5gh8\"/\"kube-root-ca.crt\""
Sep 18 22:41:37.100667 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:37.100542    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s5gh8\"/\"openshift-service-ca.crt\""
Sep 18 22:41:37.100667 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:37.100599    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s5gh8\"/\"default-dockercfg-mb95d\""
Sep 18 22:41:37.106555 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:37.106533    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s5gh8/perf-node-gather-daemonset-pr5v8"]
Sep 18 22:41:37.275380 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:37.275347    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a8e44ded-9629-4d91-8b2c-8ce5387081cc-lib-modules\") pod \"perf-node-gather-daemonset-pr5v8\" (UID: \"a8e44ded-9629-4d91-8b2c-8ce5387081cc\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-pr5v8"
Sep 18 22:41:37.275575 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:37.275390    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a8e44ded-9629-4d91-8b2c-8ce5387081cc-proc\") pod \"perf-node-gather-daemonset-pr5v8\" (UID: \"a8e44ded-9629-4d91-8b2c-8ce5387081cc\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-pr5v8"
Sep 18 22:41:37.275575 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:37.275462    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9btf\" (UniqueName: \"kubernetes.io/projected/a8e44ded-9629-4d91-8b2c-8ce5387081cc-kube-api-access-z9btf\") pod \"perf-node-gather-daemonset-pr5v8\" (UID: \"a8e44ded-9629-4d91-8b2c-8ce5387081cc\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-pr5v8"
Sep 18 22:41:37.275575 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:37.275529    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a8e44ded-9629-4d91-8b2c-8ce5387081cc-podres\") pod \"perf-node-gather-daemonset-pr5v8\" (UID: \"a8e44ded-9629-4d91-8b2c-8ce5387081cc\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-pr5v8"
Sep 18 22:41:37.275575 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:37.275554    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8e44ded-9629-4d91-8b2c-8ce5387081cc-sys\") pod \"perf-node-gather-daemonset-pr5v8\" (UID: \"a8e44ded-9629-4d91-8b2c-8ce5387081cc\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-pr5v8"
Sep 18 22:41:37.376598 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:37.376524    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9btf\" (UniqueName: \"kubernetes.io/projected/a8e44ded-9629-4d91-8b2c-8ce5387081cc-kube-api-access-z9btf\") pod \"perf-node-gather-daemonset-pr5v8\" (UID: \"a8e44ded-9629-4d91-8b2c-8ce5387081cc\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-pr5v8"
Sep 18 22:41:37.376598 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:37.376568    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a8e44ded-9629-4d91-8b2c-8ce5387081cc-podres\") pod \"perf-node-gather-daemonset-pr5v8\" (UID: \"a8e44ded-9629-4d91-8b2c-8ce5387081cc\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-pr5v8"
Sep 18 22:41:37.376598 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:37.376587    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8e44ded-9629-4d91-8b2c-8ce5387081cc-sys\") pod \"perf-node-gather-daemonset-pr5v8\" (UID: \"a8e44ded-9629-4d91-8b2c-8ce5387081cc\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-pr5v8"
Sep 18 22:41:37.376841 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:37.376644    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a8e44ded-9629-4d91-8b2c-8ce5387081cc-lib-modules\") pod \"perf-node-gather-daemonset-pr5v8\" (UID: \"a8e44ded-9629-4d91-8b2c-8ce5387081cc\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-pr5v8"
Sep 18 22:41:37.376841 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:37.376668    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a8e44ded-9629-4d91-8b2c-8ce5387081cc-proc\") pod \"perf-node-gather-daemonset-pr5v8\" (UID: \"a8e44ded-9629-4d91-8b2c-8ce5387081cc\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-pr5v8"
Sep 18 22:41:37.376841 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:37.376697    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a8e44ded-9629-4d91-8b2c-8ce5387081cc-podres\") pod \"perf-node-gather-daemonset-pr5v8\" (UID: \"a8e44ded-9629-4d91-8b2c-8ce5387081cc\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-pr5v8"
Sep 18 22:41:37.376841 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:37.376731    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8e44ded-9629-4d91-8b2c-8ce5387081cc-sys\") pod \"perf-node-gather-daemonset-pr5v8\" (UID: \"a8e44ded-9629-4d91-8b2c-8ce5387081cc\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-pr5v8"
Sep 18 22:41:37.376841 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:37.376743    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a8e44ded-9629-4d91-8b2c-8ce5387081cc-proc\") pod \"perf-node-gather-daemonset-pr5v8\" (UID: \"a8e44ded-9629-4d91-8b2c-8ce5387081cc\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-pr5v8"
Sep 18 22:41:37.376841 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:37.376766    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a8e44ded-9629-4d91-8b2c-8ce5387081cc-lib-modules\") pod \"perf-node-gather-daemonset-pr5v8\" (UID: \"a8e44ded-9629-4d91-8b2c-8ce5387081cc\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-pr5v8"
Sep 18 22:41:37.386014 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:37.385991    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9btf\" (UniqueName: \"kubernetes.io/projected/a8e44ded-9629-4d91-8b2c-8ce5387081cc-kube-api-access-z9btf\") pod \"perf-node-gather-daemonset-pr5v8\" (UID: \"a8e44ded-9629-4d91-8b2c-8ce5387081cc\") " pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-pr5v8"
Sep 18 22:41:37.408484 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:37.408459    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-pr5v8"
Sep 18 22:41:37.679222 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:37.679186    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s5gh8/perf-node-gather-daemonset-pr5v8"]
Sep 18 22:41:37.682551 ip-10-0-141-255 kubenswrapper[2574]: W0918 22:41:37.682524    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda8e44ded_9629_4d91_8b2c_8ce5387081cc.slice/crio-24981773ada171d05bbcfd152d925dfdc01f94dc577eafcdad3c431e4515283b WatchSource:0}: Error finding container 24981773ada171d05bbcfd152d925dfdc01f94dc577eafcdad3c431e4515283b: Status 404 returned error can't find the container with id 24981773ada171d05bbcfd152d925dfdc01f94dc577eafcdad3c431e4515283b
Sep 18 22:41:38.259076 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:38.259034    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-pr5v8" event={"ID":"a8e44ded-9629-4d91-8b2c-8ce5387081cc","Type":"ContainerStarted","Data":"6df761da870d07273cdcfdf59861158cc67df646ece573fec742797a3bef06dd"}
Sep 18 22:41:38.259452 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:38.259126    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-pr5v8"
Sep 18 22:41:38.259452 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:38.259147    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-pr5v8" event={"ID":"a8e44ded-9629-4d91-8b2c-8ce5387081cc","Type":"ContainerStarted","Data":"24981773ada171d05bbcfd152d925dfdc01f94dc577eafcdad3c431e4515283b"}
Sep 18 22:41:38.275106 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:38.275058    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-pr5v8" podStartSLOduration=1.275043263 podStartE2EDuration="1.275043263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 22:41:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 22:41:38.274551499 +0000 UTC m=+2473.406332583" watchObservedRunningTime="2026-09-18 22:41:38.275043263 +0000 UTC m=+2473.406824345"
Sep 18 22:41:38.317157 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:38.317131    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-lfdc6_84360888-bdae-4bde-b642-448c68479846/volume-data-source-validator/0.log"
Sep 18 22:41:39.300680 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:39.300649    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bcxc9_4148d3f5-0a43-4d62-b1cc-6015b20f7228/dns/0.log"
Sep 18 22:41:39.321647 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:39.321623    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bcxc9_4148d3f5-0a43-4d62-b1cc-6015b20f7228/kube-rbac-proxy/0.log"
Sep 18 22:41:39.487639 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:39.487609    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tb58x_3935be4c-a503-4315-8667-dba4a76ab439/dns-node-resolver/0.log"
Sep 18 22:41:40.120563 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:40.120531    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5868589844-72z5r_89432bb2-0b3f-48e4-b1c3-f22bdc5e7399/registry/0.log"
Sep 18 22:41:40.165764 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:40.165735    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rtsx9_cdf3488e-8f04-4dfe-b930-3a01d87da247/node-ca/0.log"
Sep 18 22:41:41.484876 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:41.484841    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-c59ml_cc447b07-c187-4bf9-8093-727cbd725dad/discovery/0.log"
Sep 18 22:41:41.723288 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:41.723261    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-z62nt_8d3bcc3f-e11d-43d7-b7a9-6204cbd617ac/payload-processing/0.log"
Sep 18 22:41:41.760542 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:41.760449    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6454c8d7fd-6mjst_77a9d433-df3d-4200-b498-83d36e01cf77/router/0.log"
Sep 18 22:41:42.713222 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:42.713193    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hmx2x_75534380-ec8e-48f6-bf26-a57584c2e185/serve-healthcheck-canary/0.log"
Sep 18 22:41:43.261473 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:43.261447    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fvlvf_e81147d8-4915-42ce-9328-e5b8db7cc44c/kube-rbac-proxy/0.log"
Sep 18 22:41:43.281276 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:43.281244    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fvlvf_e81147d8-4915-42ce-9328-e5b8db7cc44c/exporter/0.log"
Sep 18 22:41:43.301437 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:43.301418    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fvlvf_e81147d8-4915-42ce-9328-e5b8db7cc44c/extractor/0.log"
Sep 18 22:41:44.274648 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:44.274623    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s5gh8/perf-node-gather-daemonset-pr5v8"
Sep 18 22:41:45.869450 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:45.869422    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7b57d79649-hm6jn_97651fe5-4ab0-4414-8e42-986556e040fd/manager/0.log"
Sep 18 22:41:45.892042 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:45.892022    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vp2mz_f20298f0-c5ca-4216-baec-f68350aeac3f/server/0.log"
Sep 18 22:41:46.094068 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:46.093993    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8_3a46f632-7b18-48f7-b24f-8fc3e34974f1/manager/0.log"
Sep 18 22:41:46.118672 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:46.118644    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79cf4c6fc4-jm6j8_3a46f632-7b18-48f7-b24f-8fc3e34974f1/copy-manifests/0.log"
Sep 18 22:41:47.634355 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:47.634265    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5fd7755fbb-z6l22_ace6c0d5-9d12-4514-858b-8783de080784/manager/0.log"
Sep 18 22:41:47.660148 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:47.660116    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-rz8xx_64901fa0-3b26-4c21-bbd7-2796696f94cc/openshift-lws-operator/0.log"
Sep 18 22:41:48.200131 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:48.200051    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-c59ml_cc447b07-c187-4bf9-8093-727cbd725dad/discovery/0.log"
Sep 18 22:41:48.310066 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:48.310032    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-z62nt_8d3bcc3f-e11d-43d7-b7a9-6204cbd617ac/payload-processing/0.log"
Sep 18 22:41:48.323103 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:48.323078    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6454c8d7fd-6mjst_77a9d433-df3d-4200-b498-83d36e01cf77/router/0.log"
Sep 18 22:41:50.152674 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:50.152645    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-c59ml_cc447b07-c187-4bf9-8093-727cbd725dad/discovery/0.log"
Sep 18 22:41:50.267076 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:50.267052    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-z62nt_8d3bcc3f-e11d-43d7-b7a9-6204cbd617ac/payload-processing/0.log"
Sep 18 22:41:50.283591 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:50.283565    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6454c8d7fd-6mjst_77a9d433-df3d-4200-b498-83d36e01cf77/router/0.log"
Sep 18 22:41:52.724649 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:52.724606    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-kgk9h_b76a0482-5bca-4ad0-a5a2-3d133290eec7/migrator/0.log"
Sep 18 22:41:52.751054 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:52.751025    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-kgk9h_b76a0482-5bca-4ad0-a5a2-3d133290eec7/graceful-termination/0.log"
Sep 18 22:41:54.124333 ip-10-0-141-255 kubenswrapper[2574]: I0918 22:41:54.124303    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4s62x_09e0c1dc-cf28-4957-9607-f530d6f0e1e1/kube-multus/0.log"